data-pipelines

Issue from the Dagster Slack

[dagster_shell] defer environ copy to solid run time

This issue was generated from the slack conversation at: https://dagster.slack.com/archives/C01U954MEER/p1623181007055200?thread_ts=1623181007.055200&cid=

🚨🚨 Feature Request

• Related to an existing Issue
• A new implementation (Improvement, Extension)

If your feature will improve HUB

Need a way to check if a dataset already exists.

hub.empty throws an error if a dataset exists and hub.load throws an error if the dataset does not exist.

Need a way to check if a dataset already exists without throwing a

Describe the solution you'd like
Add types to Python codebase

What does your solution aim to solve?
Make it more explicit what arguments functions take and therefore make it easier to extend consume or refactor code.

Sending a rest call to delete a job specification throws 404 where as grpc call works fine. Steps to reproduce

curl -X DELETE "http://localhost:9100/v1/project/my-project/namespace/kush/helloworld" -H  "accept: application/json"

Motivation

As odd-platform supports redshift and so on, it would be awesome to support BigQuery integration.

What is the feature request? What problem does it solve?
ConfigurationBuilder enables plugins and vdk-core to provide any kind of configuration. Then users can see it documented using vdk config-help, other plugins to access it in type safe manner using Configuration class.
Confi