lamed
alephbet
| lamed | alephbet | |
|---|---|---|
| 2 | 2 | |
| 42 | 281 | |
| - | 0.4% | |
| 0.0 | 2.8 | |
| almost 3 years ago | 2 months ago | |
| Python | JavaScript | |
| MIT License | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
lamed
-
Show HN: Open-source A/B Testing framework
> Open source A/B testing is a graveyard of abandoned projects
Quite true, sadly. FWIW, we keep maintaining Alephbet, even though honestly I have no clue who's actively using it besides us :) the codebase is simple enough that it doesn't require a lot of work luckily.
Re stats: I did implement a Bayesian dashboard of sorts with Alephbet, but I'm not sure it prevents the peeking problem on its own. It requires some discipline when planning the tests to decide ahead when to look at results. Disclaimer: my stats chops are virtually non-existent, but that's what I learned over the years. Georgi's platform really helps structure this process of planning and when to stop the experiment (either when successful or when it's failed).
Another small (but in my experience important) thing that sets Alephbet apart from other A/B testing platforms: ad blockers. Mixpanel, GA, Amplitude etc frequently and trivially get blocked by ad blockers on the client. For client-side A/B tests this can reduce the data quality (even though typically A/B tests are not privacy invasive). Alephbet's Lamed[0] backend allows you to create a custom AWS url that's far less likely to get blocked. The "data quality" with Alephbet is higher in my experience than the data we see, e.g. in Amplitude.
[0] https://github.com/Alephbet/lamed
alephbet
-
A/B testing a Vue app with AlephBet
As mentioned before, we will use AlephBet for managing the A/B tests.
-
Show HN: Open-source A/B Testing framework
Wow this looks very polished. (Out of frustration with Optimizely) I created and maintain a couple of A/B test open source projects[0][1] but the statistical analysis was always the hardest part so I’m keen to see what you are doing. We’re currently relying on a commercial tool called Analytics Toolkit[2] for this part alone and have been quite happy with it though. The owner is very knowledgable and responsive (no affiliation just happy customers). I wonder if you can adopt similar ideas/algorithms into the open source tool. That can be useful I imagine.
[0] https://github.com/Alephbet/alephbet
[1] https://github.com/Alephbet/lamed
[2] https://www.analytics-toolkit.com/
What are some alternatives?
sixpack - Sixpack is a language-agnostic a/b-testing framework