dbt-sessionization
soda-sql
Our great sponsors
dbt-sessionization | soda-sql | |
---|---|---|
6 | 25 | |
18 | 50 | |
- | - | |
0.0 | 8.2 | |
over 1 year ago | over 1 year ago | |
Python | ||
MIT License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
dbt-sessionization
-
Data modeling for clickstream/event data
Googling around I found this repo from rudderstack which shows several examples of DBT models about how one could handle this situation, but I haven't found much else - maybe I'm asking google the wrong question.
-
How To Event Stream Data From Your Hugo Site To Google Analytics Using RudderStack
RudderStack is an open-source customer data platform that empowers you to track your customer events from your web, mobile, and server-side sources in real-time. We have also open-sourced our primary repository - rudder-server - on GitHub. This article will walk you through the process of integrating your Hugo site with RudderStack using our JavaScript SDK. It will also help you track the real-time user events and send them to the destinations of your choice.
-
Send Form Data From Marketo to Multiple Destinations Using RudderStack
By using RudderStack to understand how users are finding and interacting with your site and then combining that with the data collected by your Marketo forms, you'll get deeper insights about your potential customers and provide higher quality leads to your sales team.
-
Data Warehouse Integration: Refining Your Customer Data Stack
RudderStack lets you send the rich analysis from your warehouse to your entire customer data stack. Read more about how RudderStack's Warehouse Actions feature unlocks the data in your warehouse.
-
How To Event Stream Data From Your Nuxt.Js App Using RudderStack
RudderStack is an open-source Customer Data Pipeline that enables you to track events from your web, mobile, and server-side sources and send them to your whole customer data stack in real-time. We have also open-sourced our primary GitHub repository - rudder-server.
-
Clickstream Data Mining Techniques: An Introduction
We highly recommend checking out our Sessionization repository on GitHub to see how to use the sessions in a practical scenario.
soda-sql
-
Data Quality - Great Expectations for Data Engineers
I might be a bit biased, but that was my opinion before even I started contributing to Soda SQL.
- dbt vs R/Python for transformation
-
SodaCL - preview of a new "data reliability as code" language
I'm one of the developers of the Open Source soda-sql data quality monitoring library, and over the past year we got some incredible feedback from our users, and based on that we started working on a new DSL for data reliability as code we are calling Soda CL.
-
How do you test your pipelines?
You can also use soda-sql to do checks on your warehouses separately. Both Soda SQL and Soda Spark are OSS/Apache licensed.
-
Being constantly shut down by more senior team members when I mention adding some QA in our work
As many have said, there might be business side of things to deliver. Somebody above promised delivery with tight deadlines. Trust me, I am not a fan, but this how the world works and it sucks. I would say in your free time, explore tools like greatexpectations.io https://greatexpectations.io/ or https://github.com/sodadata/soda-sql which are modern ways of testing in your learning curve
- Soda
- How heavily do you use Great Expectations?
-
What are some exciting new tools/libraries in 2021?
soda-sql really cool library to automate data quality checks on SQL tables
-
How do I incorporate testing after the fact?
Look at SodaSQL. It's more enterprise focused than Great Expectations and you can pipe results to a database for downstream actions and analysis.
-
Data Testing Tools, Pytest vs Great Expectations vs Soda vs Deequ
Certainly! Itβs not requested that much π but please add an issue on GitHub . I would love to add at least experimental support.
What are some alternatives?
rudderstack-docs - Documentation repository for RudderStack - the Customer Data Platform for Developers.
deequ - Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.
rudder-analytics-nuxt - Sample Nuxt.js app which integrated with RudderStack's JavaScript SDK.
pandera - A light-weight, flexible, and expressive statistical data testing library
dbt-customer-journey-analysis - Using DBT for Customer Journey Analysis on RudderStack - an open-source, warehouse-first customer data pipeline and Segment alternative.
sqlfluff - A modular SQL linter and auto-formatter with support for multiple dialects and templated code.
ClickstreamAnalysis - Analyzing Clickstream Data using Markov Chains and data mining SPACE algorithm
re_data - re_data - fix data issues before your users & CEO would discover them π
trino_data_mesh - Proof of concept on how to gain insights with Trino across different databases from a distributed data mesh
rudder-sdk-js - JavaScript SDK for RudderStack - the Customer Data Platform for Developers.
spark-fast-tests - Apache Spark testing helpers (dependency free & works with Scalatest, uTest, and MUnit)