Moving from Typescript and Langchain to Rust and Loops

1. app

   1 33 444 9.9 TypeScript

   Discontinued 🍕 Insights into your entire open source ecosystem. (by open-sauced)

   

   The /embed endpoint is the engine that fuels the process of downloading and generating embeddings for GitHub repositories. A simpler and straightforward approach was embraced for fetching a repository; instead of pursuing individual requests, Repo-Query taps into the GitHub API's /archive service. This streamlined the process by condensing repository downloads into a single, efficient request per repository. Without the need for iterating through individual file retrieval requests, reminiscent of Langchain's GitHub document loader. The download time for the (https://github.com/open-sauced/app) repository was now down to 5 seconds(50 Mbps) for me.

2. InfluxDB

   www.influxdata.com featured

   InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.

   

3. repo-query

   2 2 82 7.5 Rust

   Ask questions, get insights from repos

   

   Repo-Query, a REST service that indexes public repositories and provides insightful answers to user queries, all within your browser through the OpenSaucedAI browser extension.

4. gh-answering-proto

   3 1 6 4.5 TypeScript

   

   In perhaps a day or two, the prototype of Repo-Query was hacked together. Leaning on the abstractions provided by modern web development, the initial version of the service was woven together using Typescript and Langchain. The sandbox for this initial experiment was the repository gh-answering-proto, and the outputs of the semantic-search were close to what a human would find when asked to find a code chunk relevant to a query. This accuracy produced some impressive results.

5. ai

   4 6 78 7.0 TypeScript

   Discover open-source projects on GitHub relevant to your skills (with ai). (by open-sauced)

   

   Repo-Query, a REST service that indexes public repositories and provides insightful answers to user queries, all within your browser through the OpenSaucedAI browser extension.

6. langchainjs

   5 17 14,751 9.9 TypeScript

   🦜🔗 Build context-aware reasoning applications 🦜🔗

   

   At the time of the prototype's development, the Langchain GitHub loader sent one request per file to fetch the repository sequentially, leading to prolonged download times. In our case about 2 minutes for the insights.opensauced.pizza repository. This issue was later resolved in hwchase17/langchainjs#2224, enabling parallel requests for faster retrieval.

7. rayon

   6 68 11,830 6.9 Rust

   Rayon: A data parallelism library for Rust

   

   In the quest for more efficient solutions, the ONNX runtime emerged as a beacon of performance. The decision to transition from Typescript to Rust was an unconventional yet pivotal one. Driven by Rust's robust parallel processing capabilities using Rayon and seamless integration with ONNX through the ort crate, Repo-Query unlocked a realm of unparalleled efficiency. The result? A transformation from sluggish processing to, I have to say it, blazing-fast performance.

8. Puts Debuggerer

   7 3,525 205 4.2 Ruby

   Ruby library for improved puts debugging, automatically displaying bonus useful information such as source line number and source code.

   

   pub async fn fetch_repo_files(repository: &Repository) -> Result> { let Repository { owner, name, branch, } = repository; let url = format!("https://github.com/{owner}/{name}/archive/{branch}.zip"); let response = reqwest::get(url).await?.bytes().await?; ... }

9. SaaSHub

   www.saashub.com featured

   SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

   

10. ort

    8 7 1,351 9.6 Rust

    Fast ML inference & training for ONNX models in Rust (by pykeio)

    

    In the quest for more efficient solutions, the ONNX runtime emerged as a beacon of performance. The decision to transition from Typescript to Rust was an unconventional yet pivotal one. Driven by Rust's robust parallel processing capabilities using Rayon and seamless integration with ONNX through the ort crate, Repo-Query unlocked a realm of unparalleled efficiency. The result? A transformation from sluggish processing to, I have to say it, blazing-fast performance.

Suggest a related project