tenzir
Baserow
tenzir | Baserow | |
---|---|---|
15 | 45 | |
615 | - | |
1.5% | - | |
10.0 | - | |
5 days ago | - | |
C++ | Python,JavaScript | |
BSD 3-clause "New" or "Revised" License | MIT |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
tenzir
-
Vector: A high-performance observability data pipeline
We're building something similar at Tenzir, but more for operational security workloads. https://docs.tenzir.com
Differences to Vector:
- An agent has optional indexed storage, so you can store your data there and pick it up later. The storage is based on Apache Feather, Parquet's little brother.
- Pipelines operators both work with data frames (Arrow record batches) or chunks of bytes.
- Structured pipelines are multi-schema, i.e., a single pipeline can process streams of record batches with different schemas.
-
Ask HN: Who is hiring? (March 2024)
Tenzir | Remote (EU) or Hamburg, Germany | open-core | Full-time | https://tenzir.com
Tenzir is hiring several key engineering roles to meet the needs in expanding the team. Our product: security data pipelines. From the data side, think of it as an Arrow-native, multi-schema ETL tool that offers optional storage in Parquet/Feather. From the security perspective, think of it as a solution for collecting, parsing, transforming, aggregating, and routing data. We typically sit between the data sources (endpoint, network, cloud) and sinks (SIEM, data lake).
Our open-source execution engine is C++20 (https://github.com/tenzir/tenzir), our platform is SvelteKit and TypeScript. Experience with data-first frontend apps is a great plus. Open positions at https://tenzir.jobs.personio.de:
- Fullstack Engineer
-
Pql, a pipelined query language that compiles to SQL (written in Go)
We're in the middle of getting TQL v2 [] out of the door with support for expressions and more advanced control flow, e.g., match-case statements. There's a blog post [#] about the core design of the engine as well.
While it's a general-purpose ETL tool, we're targeting primary operational security use case where people today use Splunk, Sentinel/ADX, Elastic, etc. So some operators are very security'ish, like Sigma, YARA, or Velociraptor.
[] https://github.com/tenzir/tenzir/blob/64ef997d736e9416e859bf...
[#] https://docs.tenzir.com/blog/five-design-principles-for-buil...
-
Cisco Acquires Splunk
Hey, founder of Tenzir [1] here — We are building an open-core pipeline-first security data engine that can massively reduce your Splunk costs. Even though we go to market "mid stream" we have a few users that use us as light-weight SIEM (or more accurately, just plain log management).
We are still in early access to browse through our docs or swing by our Discord.
[1] https://tenzir.com | https://docs.tenzir.com
-
VAST 3.1 open-source security data pipelines released
Download VAST v3.1 here: https://github.com/tenzir/vast/releases/tag/v3.1.0
-
C++ Jobs - Q2 2022
Tenzir is a funded seed-stage startup that builds a next generation data-plane for plug-and-play security operations. Our mission is to empower defenders with an open data engineering platform to perform data-driven investigations through combination best-of-breed solutions. Our stack consists of the high-performance C++20 telemetry engine VAST, a Rust API, and a ReasonML-based frontend.
-
Parallel Grouped Aggregation in DuckDB
I had chat with Hannes, the DuckDB co-founder, a few weeks ago. They are building awesome stuff to become the "SQLite of OLAP". The team comes with a strong academic background and is tuned into the data engineering world.
At Tenzir, we looked at DuckDB as embeddable backend engine to do the heavy lifting of query execution of our engine [1]. Our idea is throwing over a set of Parquet files, along with a query; initially SQL but perhaps soon Substrait [2] if it picks up.
We also experiment with a cloud deployment [3] where a different set of I/O path may warrant a different backend engine. Right now, we're working on a serverless approach leveraging Datafusion (and depending on maturity, Ballista at some point).
My hunch is that we will see more pluggability in this space moving forward. It's not only meaningful from an open-core business model perspective, but also pays dividends to the UX. The company that's solving a domain problem (for us: security operations center infrastructre) can leverage a high-bandwidth drop-in engine and only needs to wire it properly. This requires much less data engineers than building a poorman's version of the same inhouse.
We also have the R use case, e.g., to write reports in Rmarkdown that crunch some customer security telemetry, highlighting outliers or other noteworthy events. We're not there yet, but with the right query backend, I would expect to get this almost for free. We're close to being ready to use Arrow Flight for interop, but it's not zero-copy. DuckDB has demonstrated the zero-copy approach recently [4], going through the C API. (The story is also relevant when doing s/R/Python/, FWIW.)
[1] https://github.com/tenzir/vast
-
C++ Jobs - Q4 2021
To this end, we build the high-performance telemetry engine VAST, which at its core, ingests hundreds of thousands of events per second from high-volume data sources (such as network telemetry as NetFlow, Zeek, Suricata, and endpoint telemetry from various agents). To the user, VAST offers low-latency access through various APIs, and in particular Apache Arrow for high-bandwidth data sharing with downstream tooling. A flexible plugin API enables additional security-specific use cases on top, such as realtime matching of threat intelligence or mining of asset data for passive inventorization.
-
Ask HN: Who is hiring? (October 2021)
Tenzir | C++, ReasonML, Rust, Python | Remote | Open-source | Full-time | https://tenzir.com
Tenzir is a funded seed-stage startup that builds a next generation data-plane for plug-and-play security operations. Our mission is to empower defenders with an open platform to perform automated data-driven investigations through combination best-of-breed solutions. Our stack consists of the high-performance C++ database VAST (https://github.com/tenzir/vast), a Rust API, and a ReasonML-based frontend.
Our open engineering positions include:
- Database: https://tenzir.com/career/backend-engineer/
- DevOps: https://tenzir.com/career/devops-platform-engineer/
- Frontend: https://tenzir.com/career/frontend-engineer/
We are based out of Hamburg, Germany, but cultivate an agile remote-first mindset. If you live in the region and look for a System Administrator, we’d love to hear from you!
For any questions, feel free to reach out to us at [email protected].
-
Hiring: ReasonML Frontend Engineer - Remote EU
We at Tenzir (https://tenzir.com/) are an early-stage startup that build a next generation data-plane for modern Security Operations Centers. We are looking for a frontend engineer to help us enhance the web interface to VAST (our open-core telemetry engine, https://github.com/tenzir/vast). In our stack, we use C++ for VAST , Rust and ReasonML (compiled to JS) in our API-Layer, and ReasonML on the frontend. Our website is written in ReasonML with the help of Gatsby. Our team cultivates a mindset of strong typing and functional programming, practiced end-to-end across the entire stack. We're a remote-first company, scattered across Europe. Ideally looking for someone within (+ / -) 4hrs timezone.
Baserow
- Retool Database
-
10 open-source alternatives to run your businesses
4. Baserow - 1.5k ⭐️
-
Just released Baserow 1.15 with timezone support, today() & now() formula functions, personal views and more - open-source Airtable alternative.
GitLab repository: https://gitlab.com/bramw/baserow.
-
Baserow for Developers: January Developer Digest
💬 Follow us at @baserow on Twitter for staying in the known of all company updates and news. ⌨️ Join the Baserow community forum to chat with other developers and the Baserow team. ⭐️ Star Baserow on GitLab to show your appreciation of our work.
-
🎉 Just released Baserow 1.14 with the audit log, Baserow role based permissions & more…!
Check out the full roundup: https://baserow.io/blog/1-14-release-of-baserow. Test out Baserow 1.14: https://baserow.io. GitLab repository: Bram Wiepjes / baserow · GitLab.
-
Open Source Django Projects for Study
Baserow
-
Use cookies and sessions (not JWTs) for authentication
I'd also written an article on token authentication for django: https://www.spapas.net/2021/08/25/django-token-rest-auth/ using the REST Framework's TokenAuthentication.
This is simplest thing for most cases.
The session authentication that is proposed in the article is also great but has two problems:
* It will be hacky to implement for mobile apps (it should be possible but would not be something I'd like to do, I had tried in the past and remember that I needed to jump to a lot of hoops to "pick" that session cookie)
* The cookies can't be shared between different domains (cookies be shared the same domain or between a parent and child domain, i.e api.example.com can set/get cookies from .example.com).
So you can use the SessionAuthnentication if your frontend and backend share their domain and you know that your API won't ever be used for mobiles apps. On all other cases use TokenAuthentication.
I don't have experience with JWT Authentication, however I know it can be done and is used be various apps f.e baserow: https://gitlab.com/bramw/baserow/-/blob/develop/backend/src/...
-
Can you (developers who've worked professionally with Djano) share a Django project Dockerfile and docker-compose files with what you consider best practices?
Feel free to dig into https://gitlab.com/bramw/baserow repository, e.g. https://gitlab.com/bramw/baserow/-/blob/develop/backend/Dockerfile... There are docker compose files too.
-
Check out Baserow 1.13 with role-based access control and SSO + support us on Product Hunt 🚀 - Open Source Airtable alternative
Great idea! I've created an issue for it on the backlog https://gitlab.com/bramw/baserow/-/issues/1399.
-
🔥 We’ve just released 1.13.1 with direct support for enterprise, hiding form view fields via query parameters, and many other things.
Here is the full scoop on all new things: https://gitlab.com/bramw/baserow/-/releases/1.13.1.
What are some alternatives?
webviz - web-based visualization libraries
nocodb - 🔥 🔥 🔥 Open Source Airtable Alternative
exo - A process manager & log viewer for dev
Directus - The Modern Data Stack 🐰 — Directus is an instant REST+GraphQL API and intuitive no-code data collaboration app for any SQL database.
dfir-orc - Forensics artefact collection tool for systems running Microsoft Windows
seatable - SeaTable: easy like a spreadsheet, powerful like a database. Unlimited rows in a single base.
FFMpeg-Online - This repository catalogs a list of FFMpeg commands for different situations. By https://hotpot.ai.
Metabase - The simplest, fastest way to get business intelligence and analytics to everyone in your company :yum:
label-studio - Label Studio is a multi-type data labeling and annotation tool with standardized output format
logseq - A local-first, non-linear, outliner notebook for organizing and sharing your personal knowledge base. Use it to organize your todo list, to write your journals, or to record your unique life.
FlatBuffers - FlatBuffers: Memory Efficient Serialization Library
superset - Apache Superset is a Data Visualization and Data Exploration Platform