Scaling Event Handlers

Event-driven data pipelines naturally scale much better, but there are many choices. AWS offers SQS as a message queuing system and both Kinesis and Kafka as message streaming systems. What are the differences? Read these articles

* https://jayendrapatil.com/aws-kinesis-data-streams-vs-sqs/

* https://sookocheff.com/post/aws/comparing-kinesis-and-sqs/

* https://medium.com/@kumargaurav1247/sqs-vs-sns-vs-kinesis-difference-63b1aca143f4

Conclusion: SNS -> SQS is much simpler and works for most use cases.