ezkl
aperture
Our great sponsors
ezkl | aperture | |
---|---|---|
7 | 25 | |
829 | 227 | |
7.0% | 3.5% | |
9.6 | 8.0 | |
3 days ago | 5 days ago | |
Rust | Go | |
Apache License 2.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
ezkl
- Show HN: Turn ML/AI models into zero-knowledge proofs
-
Decentralized Artificial Intelligence
One can cryptographically prove the correct inference of a small AI model now with https://github.com/zkonduit/ezkl (our open-source package).
-
PoisonGPT: We hid a lobotomized LLM on Hugging Face to spread fake news
Our project proves AI model execution with cryptography, but without any trusted hardware (using zero-knowledge proofs): https://github.com/zkonduit/ezkl
-
Reverse Engineering TikTok's VM Obfuscation (Part 1)
What about sth like this https://github.com/zkonduit/ezkl ?
-
We’re Brian Retford, Jason Morton, and Ryan Cao, various researchers and developers in the ZKML (zero knowledge machine learning) space and we’ve been asked by r/privacy mods to help explain and answer questions about ZKML and why it’s important for the future of data privacy! AMA
u/zkonduit - Jason Morton CEO @ Zkonduit is building zkml developer tools such as ezkl that make it easy to turn computational graphs such as neural nets into zero-knowledge proofs. He has held a tenured professorship of Mathematics and Statistics, founded and sold a regulated Ethereum-based financial intermediary, and started turning deep learning models into systems of polynomial equations in 2008.
- GitHub - zkonduit/ezkl
-
What's the Deal with Zkapps?
Examples include the various zkEVM projects, risc0, and slightly more limited stuff like our effort to compile PyTorch/ONNX to a zk circuit (https://github.com/zkonduit/ezkl).
Speed and memory usage is improving quickly.
aperture
-
Decentralized Artificial Intelligence
It's valuable to examine the challenges in machine learning without assuming decentralization as a solution:
> High Cost and Resource Requirements
For training and local inferencing use, quantization may help. Problem becomes local via quantization vs. remote full tensor use. Solution may involve distributed inferencing. Techniques like model distillation can help create smaller, more efficient models for inferencing.
> Data Privacy
For training, some private datasets may be needed. For local inferencing use, determining what needs to be inferenced locally vs. what needs to be run remotely may be useful. Problem becomes privacy scope mapped onto a marketplace to mitigate high cost and resource requirements. Techniques like model explainability (versioning) and robustness testing can help build trust in AI systems.
Complying with data privacy regulations and ensuring that AI systems adhere to legal and ethical standards can be a challenge, especially in international contexts.
> Incentives
Instead of assuming the solution when considering the problem, we assume there is an incentive to either simply train a model or use one. Problem becomes financial rewards, data access agreements, or even altruistic motivations.
> Stale Data and Reproducibility
Both the code and datasets for training the model need to be updated. Inferencing needs RAG, so the augmented reference data needs to be updated as well. Anything updated might need some type of revision control, especially if that data (or code) results in poor output. Labeling data and knowledge transfer are another problems that needs revision control.
> Interoperability
We can assume a marketplace for a ML train/inference platform is needed. We have HuggingFace, for example. The problem here is likely based on the tendency for datasets to be private, such as in the case of Llama 2. Models contain the "essence" of the dataset, but we still need RAG to ground the responses.
There does exist one technology that may assist in solving most of these issues without assuming full decentralization, and that is the Lightning Network combined with the yet to be implemented 402 response code: https://github.com/lightninglabs/aperture
-
Bitcoin is “logical currency choice for AI”
You are right, it's not a strawman argument. It's an ad hominem argument. I get them confused.
While this guy may be shady as they come, and I'm not a big fan personally, the idea of combining Lightning and 402 responses is very interesting, and one I've been thinking about since Joseph and Tadge wrote the Lightning paper.
There is a means to do this today: https://github.com/lightninglabs/aperture
Consider that these entities may become self-managing at some point in the near future. If they need to pay for calls to other models, crypto-payments can be useful because they include identity and payment in one function.
As far as the vendors go, I would agree that some of them don't care about the ethical considerations and they remain focused on grabbing marketshare. That said, it's likely there we be a multitude of models running and trying to get them all talking to each other and paying for the compute required for inferencing is going to be a pain.
While it is true that there have been scams and fraudulent activities in the cryptocurrency space, it is unfair to label all blockchains as scams. Many blockchain projects have legitimate use cases and are backed by reputable organizations.
The Lightning Network is not a cryptocurrency itself but rather a layer-two scaling solution built on top of existing blockchain networks, most notably Bitcoin. It is designed to facilitate faster and cheaper transactions by creating off-chain payment channels between participants, which has risk limited to the initial payment and subsequent updates to the contract. These payment channels allow for quicker and more cost-effective transactions, while the final settlement is recorded on the underlying blockchain.
In the case of the Lightning Network, Bitcoin is the underlying cryptocurrency used for value transfer and security, while the Lightning Network enables faster and more scalable transactions by leveraging the trustless nature of the blockchain.
-
National Geographic lays off its last remaining staff writers
https://github.com/lightninglabs/aperture
I’m not sure if lsat.tech is having issues, looks like the protocol was recently renamed L402:
- 402: Aperture's Payment Required Revolutionizing Machine Learning Payments
-
Digital collectibles / NFTs on Instagram are winding down
Crypto is useful. A very long time ago there was a conversation about killer use cases. People on the ethereum side of the room thought programmable chains were it. People on the Bitcoin side said it was micropayments and script based post dating.
I said that it was likely paying for compute resources that would be a killer use case. Implementing 402s would be that manifest: https://github.com/lightninglabs/aperture
Now we’re moving deep into the AI markets, this will be a thing, combining both.
That said, con artists will still try to hustle others.
- Stop Bitching About Ads and Push Browsers to Implement Aperture
-
Cloudflare mitigates record-breaking 71M request-per-second DDoS attack
> what's stopping anyone from bridging a non-CN/RU Intranet to CN/RU-Intranet.
If someone were considering this, here's a means to do it with 402s: https://github.com/lightninglabs/aperture
-
Private Keys for decentralized secure ID?
Check out LNURL-auth or perhaps LSATs
-
Fees on Lightning Network Payments
https://lsat.tech/ with this authentication specification you can gate your content with lightning payments
- Aperture is a HTTP 402 reverse proxy
What are some alternatives?
plaidml - PlaidML is a framework for making deep learning work everywhere.
beaker - An experimental peer-to-peer Web browser
fingerprintjs - Browser fingerprinting library. Accuracy of this version is 40-60%, accuracy of the commercial Fingerprint Identification is 99.5%. V4 of this library is BSL licensed.
lntip - tip discord users with Bitcoin through the Lightning Network