The Wayback Machine - https://web.archive.org/web/20200918173045/https://github.com/topics/data-engineering
Skip to content
#

data-engineering

Here are 539 public repositories matching this topic...

incubator-superset
danielnuriyev
danielnuriyev commented Sep 15, 2020

Description

I just run MySQLFetch task:

mysql = MySQLFetch(
        host="...",
        port=3306,
        db_name="...",
        user="...",
        password="...",
        query="SELECT * FROM ... LIMIT 1"
    )
mysql.run()

And I get this:

Traceback (most recent call last):
  File "/Users/danielnuriyev/simplisafe/scripts/lib/python3.8/site-packages/IPython/core/int
spbail
spbail commented Aug 28, 2020

Describe the bug
This is basically one of the issues I called out in #1855:
When I run datasource new and exit the process at any point (e.g. ctrl+c), I still get a block for the credentials in config_variables.yml. However great_expectations.yml doesn't have the datasource entry. I would expect any kind of failure in the datasource creation process to not leave any artifacts.

**To Re

davidradl
davidradl commented Jun 26, 2020

In SubjectAreaRESTServicesInstance, it hard codes the default page size as 0, this is not correct

public static final String PAGE_SIZE_DEFAULT_VALUE = "0";
it should be changed to
public static final String PAGE_SIZE_DEFAULT_VALUE = "1000";

So it is consistent with OMAGServerConfig default
private static final int defaultMaxPageSize = 1000;

AlvaroMarquesAndrade
AlvaroMarquesAndrade commented Sep 17, 2020

Pivot missing categories breaks FeatureSet/AggregatedFeatureSet

Summary

When defining a feature set, it's expected that pivot will have all categories and, as a consequence, the resulting Source dataframe will be suitable to be transformed. When a different behavior happens, FeatureSet and AggregatedFeatureSet breaks.

Feature related:

Age: legacy

Improve this page

Add a description, image, and links to the data-engineering topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the data-engineering topic, visit your repo's landing page and select "manage topics."

Learn more

You can’t perform that action at this time.