data-engineering
Here are 607 public repositories matching this topic...
Opened from the Prefect Public Slack Community
powp905: Hello,
We are currently looking at shelltask and dbtshelltask and we are wondering why helper_script is only in the constructor and why it cannot set when we call run. Th
-
Updated
Nov 23, 2020
Describe the bug
Using a data source with umlauts in the column names leads to the Jupyter Notebook with which the suite can be edited throw an error on startup. The Notebook then doesn't load.
This might be a Jupyter Notebook bug, not sure?!
To Reproduce
Steps to reproduce the behavior:
- Initialize a suite with this xlsx file as a data source (nothing fancy: Just two columns, the
-
Updated
Nov 28, 2020 - Go
-
Updated
Sep 11, 2020
-
Updated
Nov 23, 2020 - JavaScript
-
Updated
Nov 26, 2020 - Python
-
Updated
Nov 28, 2020 - Jupyter Notebook
-
Updated
Oct 14, 2020 - Jupyter Notebook
-
Updated
Mar 9, 2020 - Python
Problem description
When I use the function of concatenating multiple columns, I find that it does not handle null values as expected.
This is the current output
df.concatenate_columns(["cat_1","cat_2","cat_3"],"cat",sep=",")| cat_1 | cat_2 |
|---|
if they are not class methods then the method would be invoked for every test and a session would be created for each of those tests.
`class PySparkTest(unittest.TestCase):
@classmethod
def suppress_py4j_logging(cls):
logger = logging.getLogger('py4j')
logger.setLevel(logging.WARN)
@classmethod
def create_testing_pyspark_session(cls):
return Sp
-
Updated
Nov 29, 2020 - R
-
Updated
Mar 5, 2020 - Python
-
Updated
Nov 28, 2020 - CSS
-
Updated
Nov 29, 2018 - Java
-
Updated
Sep 15, 2020
-
Updated
Nov 27, 2020 - Java
-
Updated
Nov 27, 2020 - TypeScript
-
Updated
Apr 20, 2020 - Python
-
Updated
Nov 28, 2020
-
Updated
Nov 16, 2020 - Python
-
Updated
Nov 20, 2020 - Python
-
Updated
Mar 25, 2019
-
Updated
Nov 11, 2020 - Python
-
Updated
Nov 23, 2020 - Clojure
-
Updated
Aug 7, 2019 - Jupyter Notebook
-
Updated
Nov 27, 2020 - Python
Improve this page
Add a description, image, and links to the data-engineering topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the data-engineering topic, visit your repo's landing page and select "manage topics."


Screenshot
N/A
Description
Right now whenever users search for queries they are case sensitive. We should remove this to allow users to put in term with any cases
Design input
[describe any input/collaboration you'd like from designers, and
tag accordingly. For design review, add the
label
design:review. If this includes a design proposal,include the label `design:suggest