Summary of Dagster Day 2022

This is an AI generated summary. There may be inaccuracies.
Summarize another video · Purchase summarize.tech Premium

00:00:00 - 01:00:00

Dagster is a cloud-based data orchestration platform that makes it easy to spin up and down compute resources based on which branches are open. In this video, we learn about the features of Dagster and how to use the platform to build a sample data pipeline.

00:00:00 Dagster is a new generation orchestration platform for the development, production, and observation of data assets. Today, they are announcing the release of Dagster 1.0 and the launch of Daxter Cloud to general availability. This will allow anyone to sign up and deploy workloads to production.
00:05:00 The Dagster Cloud is a new orchestrator and control plane designed for modern data teams. It provides a frictionless development workflow that embraces devops processes, a unified control plane that provides a single pane of glass for data teams and their stakeholders, and software-defined assets that simplify and consolidate your stack of tools into an operationally robust coherent platform.
00:10:00 In this video, we learn how to use the Dagster programming model to build a sample data platform. We see how to create assets in Python and how to load them from external tools such as dbt. We also learn how to use different I/O managers to control how and where our assets are stored.
00:15:00 Dagster Day is a holiday celebrated by the Dagster community. It is a day to celebrate the software-defined assets that Dagster provides. This year, Dagster Day is being held on February 28th.
00:20:00 Dagster is a tool for orchestrating data pipelines and provides a variety of features to make this process easier, including a graphical user interface and integration with GitHub.
00:25:00 The video showcases how easy it is to get started with Dagster on Dagster Cloud, and how the platform can help data engineering teams be more productive and collaboration. A demo is given of how to make a change to code and have it automatically deployed to production.
00:30:00 The video describes the process of creating and deploying a data workflow on the Dexter Cloud platform. It explains how the platform is designed to enable developers to write, test, and deploy their code with confidence. The video also introduces the pricing model for the platform, which is based on the duration of computations that are run.
00:35:00 The video discusses the features of Dagster, a cloud-based data management platform. It highlights the advantages of using Dagster, including the ability to customize the data plane, the usage-based pricing, and the robust security features. The video also offers a free trial for those interested in trying out the platform.
00:40:00 Dagster is a data orchestration platform that allows users to easily spin up and down compute resources based on which branches are open. This makes it easy to migrate to Dagster Cloud from a self-managed instance in Kubernetes.
00:45:00 In response to a question about when it is worth using Dagster, Sandy says that it is designed to be lightweight and easy to use, even for simple data pipelines.
00:50:00 Dagster is a data engineering platform that is expanding and hiring outside of the US. They are also planning to add certifications for Dagster in the future.
00:55:00 The video discusses how Dagster can be used with branch deployments to eliminate the need for staging environments for production deployments. It also talks about how Dagster can be integrated with other technologies like Apache Arrow and dbt.

01:00:00 - 01:00:00

The Dagster team is excited about their new cloud product and the possibilities for innovation in the coming year. They are focusing on improving developer productivity, making serverless more accessible and usable, expanding enterprise capabilities, and making Dexter a more powerful tool for managing data.