Jina AI examples VS pdfminer.six

- Modern PDFs - if you wanna extract text and images, then the PDFSegmenter used in my example will work. If tables too, might need some additional jiggery-pokery, but definitely doable. I know other ppl using the same framework (Jina) who've accomplished it.

- Exact word search - pretty simple. I've focused on more advanced stuff because color vs colour is same same but different. Also just because it's pretty easy since I'm just using pre-defined building blocks, not manually integrating stuff

- Cross platform frontend - I've seen a lyrics search frontend [0] and I've built stuff in Streamlit before. Jina offers RESTful/gRPC/WebSockets gateways so it can't be too tough

- Lightweight? I mean how lightweight do you want it? C? Bash? Assembly? I've found Python good for text parsing

- Long-term: The notebook I wrote has a few (each of which have their own), but compared to others they're relatively lightweight.

- Gluing code: I've been using pre-existing building blocks, and writing new Executors (i.e. building blocks) is relatively straightforward, and then scaling them up with shards, replicas, etc is just a parameter away.

I'm more into the search side then the PDF stuff. The PDF side I've had experience with through bitter suffering and torment. Not a fun format to work with (unless you're into sado-masochism)

[0] https://github.com/jina-ai/examples/tree/master/multires-lyr...

Semantic Wikipedia Search

I was looking for some projects based on search engines, and building a tool which could search across various types of data, and that's when I came across this GitHub project: https://github.com/jina-ai/jina/blob/master/.github/pages/hello-world.md#-multimodal-document-search. Encouraged by thorough, step by step instructions on how to build a search service that can use diverse modal features to provide accurate results; I ventured through the documents till I came to the latest updated version, here: https://github.com/jina-ai/examples/tree/master/cross-modal-search.

There are already some examples on music search, pdf search and video search that shows some POC of it's capabilities around those use cases. You can discuss your specific use case in detail with Jina community on slack

Thank you so much for the appreciation and sharing your use cases. Checkout examples for chatbot and financial analysis - https://github.com/jina-ai/examples

git clone --depth 1 --filter=blob:none --sparse https://github.com/jina-ai/examples git sparse-checkout set multimodal-search-pdf

I love to use PDFMiner and PDFQuery for this https://github.com/pdfminer/pdfminer.six https://towardsdatascience.com/scrape-data-from-pdf-files-using-python-and-pdfquery-d033721c3b28

Entering things in Excel is very easy. Extracting things from PDF is a pain. This (https://github.com/pdfminer/pdfminer.six) gets pretty close to what you need, but it may be easier to use this to just convert the entire PDF to text and parse the text to extract the info you need.

Convert pdf to string https://github.com/pdfminer/pdfminer.six

Now I see that the project is abandoned but there's an active fork called pdfminer.six . Hope that helps.

Technically this information is on my transcript, so I will be trying to use pdfminer to extract that data if there is a way to use a class you recommend when using that code https://github.com/pdfminer/pdfminer.six