Search
  • Tim Burns
    • Oct 17, 2020
    • 1 min read

Scaling Event Handlers

Event-driven data pipelines naturally scale much better, but there are many choices. AWS offers SQS as a message queuing system and both Kinesis and Kafka as message streaming systems. What are the differences? Read these articles


* https://jayendrapatil.com/aws-kinesis-data-streams-vs-sqs/

* https://sookocheff.com/post/aws/comparing-kinesis-and-sqs/

* https://medium.com/@kumargaurav1247/sqs-vs-sns-vs-kinesis-difference-63b1aca143f4


Conclusion: SNS -> SQS is much simpler and works for most use cases.

5 views0 comments

Recent Posts

See All

Downloading CMS Data is a bit tricky. The base site is here: https://data.cms.gov/provider-data/docs After beating my head against the wall, I discovered that the data key is embedded on the web page.