0

I am trying to use sed to remove a piece of code from a yaml file. what I have so far is the below code, but it does not work.

sed -i 's/- node-service\/velocity_log_deployment((.|\n)*)//' config.yml

the code that I want to remove is:

       - terraform/init_and_plan:
          name: terraform_plan
          context:
            - phdv-docker-hub-creds
            - phdv-aws
          terraform_version: <<pipeline.parameters.terraform_version>>
          working_directory: ~/project/infra
          persist_to_workspace_filepath_prefix: infra/
          requires:
            - package
# remove start
      - node-service/velocity_log_deployment:
          name: velocity_log_deployment
          repository_url: https://github.com/pizzahutuk/lambda-contentful-menu-sync
          requires:
            - terraform_apply
          context:
            - phdv-docker-hub-creds
            - phdv-aws
# remove end
      - terraform/init_and_apply:
          name: terraform_apply
          context:
            - phdv-docker-hub-creds
            - phdv-aws
          terraform_version: <<pipeline.parameters.terraform_version>>
          working_directory: ~/project/infra
          requires:
            - terraform_plan
          filters:
            branches:
              only: main

result after sed replace:

       - terraform/init_and_plan:
          name: terraform_plan
          context:
            - phdv-docker-hub-creds
            - phdv-aws
          terraform_version: <<pipeline.parameters.terraform_version>>
          working_directory: ~/project/infra
          persist_to_workspace_filepath_prefix: infra/
          requires:
            - package
      - terraform/init_and_apply:
          name: terraform_apply
          context:
            - phdv-docker-hub-creds
            - phdv-aws
          terraform_version: <<pipeline.parameters.terraform_version>>
          working_directory: ~/project/infra
          requires:
            - terraform_plan
          filters:
            branches:
              only: main
Improve this question
1
  • Your YAML seems to be partial. What are the sections that you have deleted? This array should probably be part of a structure, right? Commented Mar 21, 2023 at 11:40

1 Answer 1

Reset to default
2

Honestly; this is terraform. That's a gigantic piece of software meant to help you deploy infrastructure through code; it uses a well-defined file format, YAML, for that job. So, keeping these files syntactically intact is pretty important.

Still you chose to use an inadequate tool for that language, sed, using regular expressions to parse a non-regular language, instead of a tool that actually "speaks the language".
The most correct approach here is to ignore what has been done using sed and just use, for example, if you're using Kislyuk's yq, it lets just delete elements.

yq -y 'del(.[] | select(."node-service/velocity_log_deployment"))' config.yml

should do what you want. Add the -i switch to change the file in-place. Omit the -y if you're using the Go yq.

Improve this answer
9
  • My version of yq (4.32.2, updated from github just a couple of minutes ago) doesn't have -y. What does it do? Commented Mar 21, 2023 at 9:10
  • ah, sorry, there's actually two yq, @roaima. For mine it re-converts to yaml (it uses jq underneath). Y Commented Mar 21, 2023 at 9:10
  • Ah ok! For now I'm going to leave my first comment in place (I've added a link to the version I had) but I'll delete this one. Just acknowledging your comment, really! Thanks. Commented Mar 21, 2023 at 9:12
  • I'll try with yours as well Commented Mar 21, 2023 at 9:12
  • 1
    Gotcha. My version doesn't need to the -y flag at all Commented Mar 21, 2023 at 9:14

You must log in to answer this question.

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.