promptbench
kubernetes-client
promptbench | kubernetes-client | |
---|---|---|
4 | 11 | |
2,225 | 3,335 | |
7.4% | 0.8% | |
9.1 | 9.7 | |
16 days ago | 9 days ago | |
Python | Java | |
MIT License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
promptbench
-
Show HN: Times faster LLM evaluation with Bayesian optimization
Fair question.
Evaluate refers to the phase after training to check if the training is good.
Usually the flow goes training -> evaluation -> deployment (what you called inference). This project is aimed for evaluation. Evaluation can be slow (might even be slower than training if you're finetuning on a small domain specific subset)!
So there are [quite](https://github.com/microsoft/promptbench) [a](https://github.com/confident-ai/deepeval) [few](https://github.com/openai/evals) [frameworks](https://github.com/EleutherAI/lm-evaluation-harness) working on evaluation, however, all of them are quite slow, because LLM are slow if you don't have infinite money. [This](https://github.com/open-compass/opencompass) one tries to speed up by parallelizing on multiple computers, but none of them takes advantage of the fact that many evaluation queries might be similar and all try to evaluate on all given queries. And that's where this project might come in handy.
- FLaNK Weekly 31 December 2023
- FLaNK 25 December 2023
- Promptbench: A Unified Library for Evaluating and Understanding LLMs
kubernetes-client
- FLaNK 25 December 2023
-
I would like to make calls to the K8s API server from within a Java app that is running in a pod. How would I authenticate it to do so?
While that is true I‘d like to suggest taking a look at this client: https://github.com/fabric8io/kubernetes-client
-
Does Fabric8io K8s java client support patch() or rollingupdate() using YAML snippets?
I am trying to program the patching/rolling upgrade of k8s apps by taking deployment snippets as input. I use patch() method to apply the snippet onto an existing deployment as part of rollingupdate using fabric8io's k8s client APIS.. Fabric8.io kubernetes-client version 4.10.1I'm also using some loadYaml helper methods from kubernetes-api 3.0.12.
-
Pod labeling not possible from within pod using Kubernetes on Docker-EE
This approach works fine on our DIND-Kubernetes environment. However, when tried to port the deployment onto a Docker-EE Kubernetes environment we ran into trouble because the command kubectl label pod generates a run time error which is completely misleading (also see https://github.com/fabric8io/kubernetes-client/issues/853).
-
Using Java annotation processor in Scala
To be specific, I am trying to use https://github.com/fabric8io/kubernetes-client/tree/master/crd-generator in scala code. If it is only duplicating one class or so, that seems manageable. But if I need to rewrite everything I am less confident
- Is 6 LPA worth it to work at a startup from 9 AM to 8 PM?
-
Creating scalable microservices for practice?
In terms of spinning up and managing everything, like, the stuff that's not Java apps. But some of the old fabric8 work - the predecessor to jKube - provides Java APIs and utilities to doing things like writing kubernetes operators in Java. Check out the kubernetes-client project. A lot of people never even learn about kubernetes operators, and just think "I have a service, la la la" plug their ears and then assume there will be some magic operational team that will deploy some service mesh app to solve all their problems.
-
How can I deploy a containerized application from code?
Fabric8 is a very good Solution. I played also with k8s provided solution but especially custom resource definitions are a hell. I can recommend fabric8 it’s also used in operators like strimzi https://github.com/fabric8io/kubernetes-client
-
Canceling a Tekton TaskRun with Fabric8 Kubernetes Java Client
As the name says, this article is all about how to Cancel TaskRuns in Tekton using the Fabric8 Tekton client. You can see the latest example code here
-
Difference between service-account token and client certificates for programmatic access
Can the service account token, be used programmtically e.g., using https://github.com/fabric8io/kubernetes-client ?
What are some alternatives?
awesome-gpt-prompt-engineering - A curated list of awesome resources, tools, and other shiny things for GPT prompt engineering.
jkube - Build and Deploy java applications on Kubernetes
osgameclones - Open Source Clones of Popular Games
dsl - Structurizr DSL
opencompass - OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.
MockServer - MockServer enables easy mocking of any system you integrate with via HTTP or HTTPS with clients written in Java, JavaScript and Ruby. MockServer also includes a proxy that introspects all proxied traffic including encrypted SSL traffic and supports Port Forwarding, Web Proxying (i.e. HTTP proxy), HTTPS Tunneling Proxying (using HTTP CONNECT) and SOCKS Proxying (i.e. dynamic port forwarding).
JavaOnRaspberryPi - Sources and scripts for the book "Getting started with Java on the Raspberry Pi"
container-jfr - Secure JDK Flight Recorder management for containerized JVMs
Zolver - Automatic jigsaw puzzle solver
consul-api - Java client for Consul HTTP API
FLiPStackWeekly - FLaNK AI Weekly covering Apache NiFi, Apache Flink, Apache Kafka, Apache Spark, Apache Iceberg, Apache Ozone, Apache Pulsar, and more...
Quarkus - Quarkus: Supersonic Subatomic Java.