Real time Streaming Solution advice

• Apache Pulsar

  30 13,727 9.8 Java

  Apache Pulsar - distributed pub-sub messaging system

  

Good luck with your project! Sounds challenging but very interesting, both product and engineering wise. AWS/GCP services would definitely give you a fast start, and future support for scale and processing which is great for mvp or a pilot, and I would probably start with the mentioned services as well, but from my experience and based on your performance needs, definitely around financial use case and especially stocks you will need close to a millisecond latency across your ecosystem which I think is hard to get over aws and gcp offerings. Have you tried Kafka, Pulsar, or Memphis? Learning curve would be harder, but in long term I think they will be better for the performance requirements

• memphis

  52 3,145 9.9 Go

  Memphis.dev is a highly scalable and effortless data streaming platform

  

Good luck with your project! Sounds challenging but very interesting, both product and engineering wise. AWS/GCP services would definitely give you a fast start, and future support for scale and processing which is great for mvp or a pilot, and I would probably start with the mentioned services as well, but from my experience and based on your performance needs, definitely around financial use case and especially stocks you will need close to a millisecond latency across your ecosystem which I think is hard to get over aws and gcp offerings. Have you tried Kafka, Pulsar, or Memphis? Learning curve would be harder, but in long term I think they will be better for the performance requirements

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• ApacheKafka

  104 28 0.0

  A curated re-sources list for awesome Apache Kafka

Good luck with your project! Sounds challenging but very interesting, both product and engineering wise. AWS/GCP services would definitely give you a fast start, and future support for scale and processing which is great for mvp or a pilot, and I would probably start with the mentioned services as well, but from my experience and based on your performance needs, definitely around financial use case and especially stocks you will need close to a millisecond latency across your ecosystem which I think is hard to get over aws and gcp offerings. Have you tried Kafka, Pulsar, or Memphis? Learning curve would be harder, but in long term I think they will be better for the performance requirements

• FinnhubKafkaConnector

  1 1 10.0 Java

  Kafka Connect connector for OHLCV candles from Finnhub

https://github.com/jan-cin/FinnhubKafkaConnector Someone posted this on Reddit in a diff sub. Can be a start, play around with your analysis and see if the preliminary results actually make it worth going all the way.

Suggest a related project