[P] I built a tool that auto-generates scrapers for any website with GPT

• llm_data_parser

  1 22 1.9 Python

  This is a proof-of-concept of using an LLM to find and extract meaningful data without parsing the html too much.

I actually tried doing this with langchain and gpt-3 and upload it to github a week ago, you can find it here, https://github.com/repollo/llm_data_parser Is really crappy right now because I only wanted to show to rpilocator.com’s owner it was possible, since he’s having to go through each spider/scraper and update it every time a website gets modified. But really cool to see a whole platform for this very purpose! Would be cool to see support for multiple libraries, and programming languages!

• Consent-O-Matic

  70 2,395 9.4 JavaScript

  Browser extension that automatically fills out cookie popups based on your preferences

  

You'll want to check out https://github.com/cavi-au/Consent-O-Matic

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• text-generation-webui

  876 36,293 9.9 Python

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

Suggest a related project