.png){kind=logo}
Dataform saves your queries as you develop, ensuring users never lose work. Get feedback on errors and inferred dependencies as you type.
Dataform validates compiled queries against the data warehouse in real time, helping users identify issues before running queries.
Work in an isolated development environment, run queries, tests and inspect results before committing, without overriding production data.
Inspect changes before committing, add messages and revert files without touching a command line.
When your changes are tested and ready to go, create a pull request so your team can review it.
Dataform makes it easy to review all changes made before pushing to master or to a Git branch.
.png)
Configure schedules across multiple environments such as staging and production. Running your scripts on a repeating schedule ensures output data is always kept up to date.
Assertions enable you to check that the datasets you create are correct. Quickly add data quality checks for uniqueness or null values, or write a custom assertion in SQL to check any property of your data.
Quickly react if your pipeline or data quality tests fail through email and slack notifications.
Give business users and other analysts visibility into your data model, enabling them to answer data questions quickly by making it easy to search across tables, columns and other table metadata.
Dataform updates the entire dependency tree of your project with every save so you can get a quick visual overview of how your tables, views, and other actions depend on each other while developing.
Document your datasets in the same file where you define you transformations and push that metadata back to your warehouse where it can be consumed by other tools.
.png)
Dataform enables analysts to manage all data processes in your warehouse, turning raw data into the clean datasets you need for analytics.
If your business is scaling fast and you want to ensure data quality, make your life easier, leverage engineering best practices and remain BI tool agnostic then don’t hesitate to use Dataform for a second!
Having modeled data using other tools in the past, this is much simpler and an easier environment to code in. The code compiles in real time and lets you know if there are errors in the syntax. It also helps generate a dependency graph for the data pipeline which is insanely useful.
After using Dataform for a while I really discovered the power of integrating an IDE with an ETL tool. The web based IDE completely eliminates the hassle of maintaining local dev environments.
Connect to your warehouse and publish your first data model in 5 minutes.
