Change Request

In TEP 17 @coryrc documented a way to prevent script injection when substituting variables in, for example, script fields of Steps.

The approach is to do something like this:

   steps:
    - env:
        - name: SCRIPT_CONTENTS
          value: $(params.script)
      script: |
        printf '%s' "${SCRIPT

Found that if all pods end up on the same node (just happened to me) nothing works well at least on our cluster due to hairpin issues. Any chance the yaml could have anti-affinity set for the pods so they don't end up on the same node by accident?

We are using font-awesome V4 and should migrate to font-awesome V5 which comes with its own vue.js module: https://github.com/FortAwesome/vue-fontawesome

Migration includes removing old font-awesome V4 module and changing all existing icons to new vue.js tag.

This is blocked until #114 is merged which comes with first initial integration.

Summary

jx create addon istio doesn't work
since v 1.5 istio moved to operator so no folder install/kubernetes/helm/istio

Steps to reproduce the behavior

jx create addon istio

Output

Istio package already downloaded: /Users/msirs/.jx/cache/istio-1.6.0-osx.tar.gz
error: Could not find folder install/kubernetes/helm/istio inside istio clone at /Users/msirs/.jx/cache/istio

Introduction

We need a section in the docs to describe how to migrate from the old-style dataset, e.g. ParquetS3DataSet to the new style e.g. kedro.extras.datasets.pandas.ParquetDataSet.

Suggestion

To migrate from ParquetS3DataSet to pandas.ParquetDataSet, the steps are the following:

In the catalog.yaml:

• Change the type from ParquetS3DataSet to pandas.ParquetDataSet

We are trying to use GE with GCP DataProc clusters. While cluster creation we are installing great-expectations==0.12.4. This installs ruamel.yaml==0.15.35 as dependency. After cluster creation if we try to import great_expectations we get error:

Traceback (most recent call last):
File "", line 1, in
File "/opt/conda/default/lib/python3.6/site-packages/great_expectations/_

async def sub(a, b):
  return a - b

See fridgerator/PyNode#25 for details.

While testing another PR, I found that mu pipeline logs command displays information from the pipelines, but also shows this error:

$ mu pipeline logs
[... normal, expected output ...]
func1 ▶ ERROR  ResourceNotFoundException: The specified log group does not exist.
	status code: 400, request id: f7260741-7f69-4772-b4cc-7c6a9c22d264

This error does not occur with the `-f

The PR JuliaData/CategoricalArrays.jl#310 means that an array with elements of type Symbol can no longer be wrapped as a CategoricalArray.

This means all MLJ documentation and test code that uses symbols in categorical data must be refactored to use strings instead.

These repos, at least, need checking/refactoring, in order of priority:

• MLJ

• [ ]

"We could also try and update the job naming for CWL jobs to include fewer UUIDs, because I'm not sure they really help anyone for debugging." DataBiosphere/toil#3226 (comment)

┆Issue is synchronized with this Jira Task
┆Issue Number: TOIL-666