anyone have experience writing data to parquet files? Is there a better alternative for storing large amounts of financial tick data?

• parquet-go

  4 333 0.0 Go

  Discontinued Go library to read/write Parquet files (by segmentio)

  

segmentio/parquet-go

• parquet-go

  3 1,165 4.2 Go

  pure golang library for reading/writing parquet file

xitongsys/parquet-go

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• marketstore

  31 1,817 0.0 Go

  DataFrame Server for Financial Timeseries Data

  

I'm also open to the idea of a better tick-storage solution, but after trying many out like Alpaca Marketstore, TimescaleDB, etc. it seems like parquet files would fit my needs better and give me more flexibility for replaying data into my algorithms.

• ClickHouse

  208 34,054 10.0 C++

  ClickHouse® is a free analytics DBMS for big data

  

clickhouse

• frostdb

  5 1,206 9.5 Go

  ❄️ Coolest database around 🧊 Embeddable column database written in Go.

  

We use clickhouse, but i would take a look at https://github.com/polarsignals/frostdb

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

Suggest a related project