Research

Open-source projects categorized as Research
Edit details
Language: + Python + C++ + Jupyter Notebook + Swift + Go + TypeScript + Rust + TeX
Topics: Machine Learning Deep Learning Python Artificial intelligence AI
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
Sponsored

Top 23 Research Open-Source Projects

  • google-research

    Google Research

    • Project mention: Show HN: Next-token prediction in JavaScript – build fast LLMs from scratch | news.ycombinator.com | 2024-04-10

    People on here will be happy to say that I do a similar thing, however my sequence length is dynamic because I also use a 2nd data structure - I'll use pretentious academic speak: I use a simple bigram LM (2-gram) for single next-word likeliness and separately a trie that models all words and phrases (so, n-gram). Not sure how many total nodes because sentence lengths vary in training data, but there are about 200,000 entry points (keys) so probably about 2-10 million total nodes in the default setup.

    "Constructing 7-gram LM": They likely started with bigrams (what I use) which only tells you the next word based on 1 word given, and thought to increase accuracy by modeling out more words in a sequence, and eventually let the user (developer) pass in any amount they want to model (https://github.com/google-research/google-research/blob/5c87...). I thought of this too at first, but I actually got more accuracy (and speed) out of just keeping them as bigrams and making a totally separate structure that models out an n-gram of all phrases (e.g. could be a 24-token long sequence or 100+ tokens etc. I model it all) and if that phrase is found, then I just get the bigram assumption of the last token of the phrase. This works better when the training data is more diverse (for a very generic model), but theirs would probably outperform mine on accuracy when the training data has a lot of nearly identical sentences that only change wildly toward the end - I don't find this pattern in typical data though, maybe for certain coding and other tasks there are those patterns though. But because it's not dynamic and they make you provide that number, even a low number (any phrase longer than 2 words) - theirs will always have to do more lookup work than with simple bigrams and they're also limited by that fixed number as far as accuracy. I wonder how scalable that is - if I need to train on occasional ~100-word long sentences but also (and mostly) just ~3-word long sentences, I guess I set this to 100 and have a mostly "undefined" trie.

    I also thought of the name "LMJS", theirs is "jslm" :) but I went with simply "next-token-prediction" because that's what it ultimately does as a library. I don't know what theirs is really designed for other than proving a concept. Most of their code files are actually comments and hypothetical scenarios.

    I recently added a browser example showing simple autocomplete using my library: https://github.com/bennyschmidt/next-token-prediction/tree/m... (video)

    And next I'm implementing 8-dimensional embeddings that are converted to normalized vectors between 0-1 to see if doing math on them does anything useful beyond similarity, right now they look like this:

      [nextFrequency, prevalence, specificity, length, firstLetter, lastLetter, firstVowel, lastVowel]

  • AirSim

    Open source simulator for autonomous vehicles built on Unreal Engine / Unity, from Microsoft AI & Research

    • Project mention: Modding API for old game: Strategies to ensure it runs on older systems while not losing productivity? | /r/REGames | 2023-05-04

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • qlib

    Qlib is an AI-oriented quantitative investment platform that aims to realize the potential, empower research, and create value using AI technologies in quantitative investment, from exploring ideas to implementing productions. Qlib supports diverse machine learning modeling paradigms. including supervised learning, market dynamics modeling, and RL.

    • Project mention: Open-source AI-oriented quantitative investment platform | news.ycombinator.com | 2023-11-03

  • carla

    Open-source simulator for autonomous driving research.

    • Project mention: Tesla braces for its first trial involving Autopilot fatality | news.ycombinator.com | 2023-08-28

  • ipatool

    Command-line tool that allows searching and downloading app packages (known as ipa files) from the iOS App Store

    • Project mention: Old versions of the iOS app? | /r/jellyfin | 2023-06-01

    If you need an older app to install on your older device I suggest IPAtool. It let's you "purchase" apps which then download latest compatible version from the app store

  • Memex

    Browser extension to curate, annotate, and discuss the most valuable content and ideas on the web. As individuals, teams and communities.

    • Project mention: Mozilla "MemoryCache" Local AI | news.ycombinator.com | 2023-12-12

    I think WorldBrain (https://github.com/WorldBrain/Memex) promises this. While I'm also excited by the idea, I think there was some reason why I ended up not using it.

  • software-papers

    📚 A curated list of papers for Software Engineers

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo

  • StarWars.iOS

    This component implements transition animation to crumble view-controller into tiny pieces.

  • mlfinlab

    MlFinLab helps portfolio managers and traders who want to leverage the power of machine learning by providing reproducible, interpretable, and easy to use tools.

    • Project mention: mlfinlab: open source library maintained by hudson and thames though much of the content has moved to a subscription model. Idea is to implement academic research in python code and aggregate it as a package. Sources from [Journal of financial data s | /r/algoprojects | 2023-11-21

  • acme

    A library of reinforcement learning components and agents

  • catalyst

    Accelerated deep learning R&D (by catalyst-team)

    • Project mention: Instance segmentation of small objects in grainy drone imagery | /r/computervision | 2023-12-09

  • scenic

    Scenic: A Jax Library for Computer Vision Research and Beyond (by google-research)

  • best_AI_papers_2021

    A curated list of the latest breakthroughs in AI (in 2021) by release date with a clear video explanation, link to a more in-depth article, and code.

  • lingvo

    Lingvo

  • Theseus

    Theseus is a modern OS written from scratch in Rust that explores 𝐢𝐧𝐭𝐫𝐚𝐥𝐢𝐧𝐠𝐮𝐚𝐥 𝐝𝐞𝐬𝐢𝐠𝐧: closing the semantic gap between compiler and hardware by maximally leveraging the power of language safety and affine types. Theseus aims to shift OS responsibilities like resource management into the compiler.

    • Project mention: Theseus OS | news.ycombinator.com | 2023-10-23

  • awesome-deep-learning-music

    List of articles related to deep learning applied to music

  • OpenBot

    OpenBot leverages smartphones as brains for low-cost robots. We have designed a small electric vehicle that costs about $50 and serves as a robot body. Our software stack for Android smartphones supports advanced robotics workloads such as person following and real-time autonomous navigation.

  • datasets

    🎁 5,400,000+ Unsplash images made available for research and machine learning (by unsplash)

    • Project mention: AI-Powered Image Search with CLIP, pgvector, and Fast API | dev.to | 2024-02-12

    Here's a live demo with a simple React frontend. It's searching against an S3 bucket containing Unsplash's open source dataset of 25,000 images, plus a few of my own.

  • mindforger

    Thinking notebook and Markdown editor with LLM wingman.

    • Project mention: Show HN: MindForger – Attention, LLM is all your note-taking app needs | news.ycombinator.com | 2024-02-18

  • morphogenesis-resources

    Resources on the topic of digital morphogenesis (creating form with code). Includes links to major articles, code repos, creative projects, books, software, and more.

  • awesome-research

    :seedling: a curated list of tools to help you with your research/life; I built a front end around this repo, please use the link below [This repo is Not Maintained Anymore]

  • OSINT_Collection

    Maintained collection of OSINT related resources. (All Free & Actionable)

  • ultimate-defi-research-base

    Here we collect and discuss the best DeFI & Blockchain researches and tools. Feel free to DM me on Twitter or open pool request.

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Research related posts

Index

What are some of the best open-source Research projects? This list will help you:

Project Stars
1 google-research 32,804
2 AirSim 15,867
3 qlib 14,136
4 carla 10,491
5 ipatool 5,046
6 Memex 4,329
7 software-papers 3,827
8 StarWars.iOS 3,774
9 mlfinlab 3,771
10 acme 3,370
11 catalyst 3,223
12 scenic 2,995
13 best_AI_papers_2021 2,902
14 lingvo 2,780
15 Theseus 2,735
16 awesome-deep-learning-music 2,734
17 OpenBot 2,696
18 datasets 2,299
19 mindforger 2,180
20 morphogenesis-resources 1,959
21 awesome-research 1,913
22 OSINT_Collection 1,822
23 ultimate-defi-research-base 1,811

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com