react-native-vision-camera VS mlkit

React Native Vision Camera

Camera and Image Captioning: For taking pictures we will use react-native-vision-camera and for generating captions from the images, react-native-quick-tflite.

> One of the big "aha" moments I had was a couple years ago when I was trying out Stripe's Identity product, which lets you take a selfie and a picture of your ID for identity verification purposes. It's pretty amazing how Stripe was able to do the full image analysis (i.e. edge detection when you take a picture of your ID) solely with browser APIs.

Do you have any details on that Stripe app? I've found the browser camera handling lacking on mobile if you want to overlay it with a "position the subject here" rectangle, or display instructions alongside, or detect QR codes as well as other subjects. I'd like this to be an out-of-date view. I've been considering React Native for the next version, using https://github.com/mrousavy/react-native-vision-camera as it seems much more feature complete.

You can use react-native-vision-camera and a frame processor that uses some kind of OCR to get the number plates.

This is a demonstration of what VisionCamera V3 is capable of - I built a small plugin to load any TensorFlow Model (.tflite) from resources and run it on every Camera Frame. This is going to be a game-changer, since the developer no longer needs to write native code for such complex tasks - it only takes a few lines of JavaScript to spin up a Camera, do real-time processing with a TensorFlow model, and draw anything to the Frame. Magic!

it's https://github.com/mrousavy/react-native-vision-camera

I finally got react-native-vision-camera and vision-camera-face-detector working yesterday by using Windows Subsystem for Linux (WSL). On windows itself it just doesn't work for me (https://github.com/mrousavy/react-native-vision-camera/issues/1474)

I'm the author of react-native-vision-camera, a library that exposes platform native Camera features to React Native.

Here’s an example from react-native-vision https://github.com/mrousavy/react-native-vision-camera/blob/main/example/src/views/StatusBarBlurBackground.tsx

So I dug deeper and ended up finding a sample project from Google using ML Kit, but the same reading issue occurred. That's when I started to question whether the problem was actually with the reader.

I used ML Kit pos estimation API. I followed New features in ML Kit video and building use cases playlist. I tried to understand googlesamples/mlkit and tensorflow/examples but I barely understand, where the define the processor, and I loos it when it comes to the cameraSource file. eventually I created a runnable application.

To understand the implementation of getBitmap(), please refer to BitmapUtils.java.

Next, we draw an overlay above the camera preview. There is an excellent GraphicOverlay class provided by Android ML Kit demo project. We don't need to reinvent the wheel:

Download the sample code of ML Kit vision.

MLKit is distributed by CocoaPods, no Carthage or SMP support, but at least we ask Google to add such options...