PentestGPT VS turbopilot

👨‍💻 Source: https://github.com/GreyDGL/PentestGPT

A GPT-empowered penetration testing tool (https://github.com/GreyDGL/PentestGPT)

How you use it is up to you. There are hundreds of question answer clones with different data source adapters. Some projects that I found more interesting: https://github.com/GreyDGL/PentestGPT https://github.com/jina-ai/dev-gpt https://github.com/corca-ai/EVAL You can probably build something similar to smol developer with langchain too.

Look up langchain. Some example projects. https://github.com/corca-ai/EVAL https://github.com/jina-ai/dev-gpt https://github.com/GreyDGL/PentestGPT https://blog.langchain.dev/origin-web-browser/

fyi https://github.com/ravenscroftj/turbopilot

TurboPilot: self-hosted copilot clone which uses the library behind llama.cpp to run the 6 Billion Parameter Salesforce Codegen model in 4GiB of RAM. (https://github.com/ravenscroftj/turbopilot)

This repo has a potential

Right now https://github.com/ggerganov/llama.cpp is the dominant back-end for querying models, but forks and alternatives like https://github.com/ravenscroftj/turbopilot keep popping up. Increasingly, models submitted to huggingface explicitly note in their READMEs that the model is not compatible with llama.cpp, and that a different back-end must be used.

There's turbopilot. I haven't tried it yet, but it looks promising.

Turbopilot | open source LLM code completion engine and Copilot alternative

This 6B parameters tool (based on README) could be runned with 4 Gb of RAM. https://github.com/ravenscroftj/turbopilot

there is an interesting link https://github.com/ravenscroftj/turbopilot/wiki/Converting-and-Quantizing-The-Models , just wondering if anyone have done this with 16b and put the weights somewhere