Can AWS Step Function depend on concurrent Lambdas completing?

Question

I am attempting to find a way to have a Parent Lambda function invoke multiple concurrent parameterized Child Lambda functions, and have another Final Lambda function execute once all of the Child Lambda functions have completed.

The goal is for the Child functions to write data to S3, and for the Final function to import the data from S3 to a database.

Is this possible using Step Functions? If so, how? Is there a better way to approach this?

Does this answer your question? Parallel States Merge the output in Step Function — JD D
– JD D, Commented Sep 29, 2020 at 3:35
That's close, except I need to be able to dynamically invoke multiple concurrent Child functions using the output of the Parent task, rather than explicitly defining each Child function. — MJ.
– MJ., Commented Sep 29, 2020 at 12:49

JD D · Accepted Answer · 2020-09-29 13:00:57Z

2

Yes, it is possible with Step functions. You will need to use a Map state in your state machine.

Here is an AWS Blog post about the Map state that gives examples of it's usage when it was first announced.

edited Sep 29, 2020 at 13:00

JD D

8,2162 gold badges42 silver badges56 bronze badges

answered Sep 29, 2020 at 5:29

Pubudu Jayawardana

2,3651 gold badge13 silver badges18 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

MJ. Over a year ago

This looks like it's probably what I need, going to look into it further, thanks!

Collectives™ on Stack Overflow

Can AWS Step Function depend on concurrent Lambdas completing?

1 Answer 1

1 Comment

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Linked

Related