data-engineering
Here are 662 public repositories matching this topic...
Current behavior
All ShellTask logs are logged at DEBUG level, preventing showing the command output in the UI logs unless the agent's logging threshold is set to DEBUG. But this is undesired for production workloads, as this applies to all log messages
streaming logging for the ShellTask was introduced in #3584
Proposed behavior
change existing stream_logs parameter to `U
-
Updated
Jan 17, 2021
-
Updated
Jan 15, 2021
Describe the bug
data docs columns shrink to 1 character width with long query
To Reproduce
Steps to reproduce the behavior:
- make a batch from a long query string
- run validation
- render result to data docs
- See screenshot
<img width="1525" alt="Data_documentation_compiled_by_Great_Expectations" src="https://user-images.githubusercontent.com/928247/103230647-30eca500-4
-
Updated
Jan 18, 2021 - Go
-
Updated
Jan 13, 2021
-
Updated
Jan 18, 2021 - JavaScript
-
Updated
Jan 18, 2021 - Python
-
Updated
Jan 19, 2021 - Jupyter Notebook
-
Updated
Oct 14, 2020 - Jupyter Notebook
-
Updated
Mar 9, 2020 - Python
Current UI is confusing with the order of compare/merge between branches.
Problem description
When I use the function of concatenating multiple columns, I find that it does not handle null values as expected.
This is the current output
df.concatenate_columns(["cat_1","cat_2","cat_3"],"cat",sep=",")| cat_1 | cat_2 |
|---|
if they are not class methods then the method would be invoked for every test and a session would be created for each of those tests.
`class PySparkTest(unittest.TestCase):
@classmethod
def suppress_py4j_logging(cls):
logger = logging.getLogger('py4j')
logger.setLevel(logging.WARN)
@classmethod
def create_testing_pyspark_session(cls):
return Sp
-
Updated
Jan 19, 2021 - R
-
Updated
Mar 5, 2020 - Python
-
Updated
Jan 15, 2021 - Ruby
-
Updated
Dec 30, 2020 - CSS
-
Updated
Jan 15, 2021
-
Updated
Nov 29, 2018 - Java
-
Updated
Jan 18, 2021 - TypeScript
-
Updated
Jan 18, 2021 - Java
-
Updated
Apr 20, 2020 - Python
-
Updated
Jan 15, 2021
-
Updated
Jan 4, 2021 - Python
-
Updated
Dec 4, 2020 - Python
-
Updated
Jan 14, 2021 - Python
-
Updated
Aug 7, 2019 - Jupyter Notebook
-
Updated
Mar 25, 2019
Improve this page
Add a description, image, and links to the data-engineering topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the data-engineering topic, visit your repo's landing page and select "manage topics."


Screenshot
attached
Description
<img width="1402" alt="Screen Shot 2021-01-15 at 2 35 11 AM" src="https://user-images.githubusercontent.com/4502866/104715562-930f1d80-56db-11eb-8cb1-b2