wit VS Codename One

wit.ai — NLP for developers.

Hello everyone, new to LLMs. I am working on my thesis project. The whole idea is to create a mixed reality voice assistant that can control some devices in a room and you can have with it a more intelligent conversation compared to other voice assistants(Alexa,Google, etc.). I thought initially to use wit.ai for the extraction of commands and if it's not a recognized command to send a request to a chatgpt API. Then I realized that wit.ai wasn't pretty accurate when I added multiple intents, for example distinguishing creating list from adding item to list or removing item from removing reminder etc, even though I added enough training data. Sometimes it identifies the entities correctly, but the intent is wrong even though there are no intents with these entities in the existing data. If user does not specify correctly a command I will have to handle a lot of scenarios like not specifying time or date or both and asking user to give them again and managing to extract the values correctly after. I thought that chatgpt could actually do both if I give some instructions with the formats of prompts and responses I want. I tried it in the web version and seemed to do what I want. Then I realized how expensive it is to use their API just to have context on a conversation. So my next thought was to use a local llm. So could someone recommend me a small model that can be used for such case or what adjustments should I do in order to work? In my university I can use a machine with 32GΒ Ram and Nvidia Α4000 GPU. Thank you :)

I can't find anything wrong with the code you posted. It is possible that wit.ai is expecting some default header that Unity is not sending (and that you are not setting)

Even though this was made for VR hopefully the scripts for wit.ai and GPT will be helpful to anyone who wants to explore this topic and doesn't know where to start.

Hey HN,

We're Alex, Martin and Laurent. We previously founded [Wit.ai](http://wit.ai/) (W14), which we sold to Facebook in 2015. Since 2019, we've been working on Nabla (https://www.nabla.com), an intelligent assistant for health practitioners.

When GPT-3 was released in 2020, we investigated it's usage in a medical context[0], to mixed results.

Since then we’ve kept exploring opportunities at the intersection of healthcare and AI, and noticed that doctors spend am awful lot of time on medical documentation (writing clinical notes, updating their EHR, etc.).

Today, we're releasing Nabla Copilot, a Chrome extension generating clinical notes from video consultations, to address this problem.

You can try it out, without installation nor sign up, on our demo page: [https://www.nabla.com/copilot-demo/](https://www.nabla.com/copilot-demo/)

Here’s how it works under the hood:

- When a doctor starts a video consultation, our Chrome extension auto-starts itself and listens to the active tab as well as the doctor’s microphone.

Thank you, that's helpful except that currently we're not running our own server. I'm currently using wit.ai for NLP which is a web API service provided by Meta. I'm trying to budget for what it would cost to roll out our own on a private cloud.

I have an NLP agent that uses wit.ai to "understand" input prompts. Now, wit.ai is just an API server that calculates the most probable intent of the prompt (out of the intents trained with) and also extracts the entities present in the prompt.

Wit AI : Natural Language for Developers

wit.ai — NLP for developers.

codenameone.com — Open source, cross-platform, mobile app development toolchain for Java/Kotlin developers. Free for commercial use with an unlimited number of projects

This was resolved in this issue: https://github.com/codenameone/CodenameOne/issues/3706

Naturally depends on the use case, yet they work good enough to be in business for 20 years.

https://www.ptc.com/en/products/developer-tools/perc

https://www.aicas.com/wp/products-services/jamaicavm-tools/

https://www.codenameone.com/

Android 5 & 6 (only changed back into JIT/AOT due to long compile times), https://www.infoq.com/news/2014/07/art-runtime/

Unfortunely the best well known, Excelsior JET, is no longer in business, most likely due to GraalVM and OpenJ9 being available as free beer, while PTC, Aicas Codename One are safe in their domains.

There is also RoboVM (https://github.com/MobiVM/robovm) as free beer, however it actually started as a commercial product, and the acquisition from Xamarin kind of stagnated it (naturally).

At Codename One, we were using App Engine when our daily billing suddenly skyrocketed from a few dollars to hundreds. The potential cost was so high it threatened to bankrupt us within a month. Despite our best efforts, including educated guesses and fixing everything we could, we were never able to pinpoint the specific bug. Instead, we had to solve the problem through brute force.

We don't use GraalVM since our project was developed prior to its existence and we aimed for deeper native integration than it can offer: https://github.com/codenameone/CodenameOne

XMLVM, Codename One and iSpectrum (cross compile Java code from an Android app or creating one from scratch

I suggest filing an RFE in the issue tracker.

Thanks. It's always good to get another reminder. Yes, it was reported. u/shannah78 is working on this but we have time until November.

please check this issue https://github.com/codenameone/CodenameOne/issues/3686

We use ParparVM which we wrote. It compiles a subset of Java 8 (sort of) to native by translating the bytecode to C and passing that through XCode. The reason we took this path and not the path of "direct to native", is that it allows for future compatibility.