Skip to main content

You are not logged in. Your edit will be placed in a queue until it is peer reviewed.

We welcome edits that make the post easier to understand and more valuable for readers. Because community members review edits, please try to make the post substantially better than how you found it, for example, by fixing grammar or adding additional resources and hyperlinks.

1
  • 1
    This is a very interesting question, but much too broad. You seem to consider using S3 as a kind of processing pipeline. So I'd recommend to you take a look at Streaming data, an excellent book about real-time data pipelines that need to scale. Given your domain, it would be a real investment, as it covers all the aspects you'll need to ba aware of. Commented Oct 19, 2019 at 8:52