advanced-java
fscrawler
Our great sponsors
| advanced-java | fscrawler | |
|---|---|---|
| 1 | 3 | |
| 74,291 | 1,295 | |
| 1.1% | - | |
| 6.3 | 9.4 | |
| 28 days ago | 13 days ago | |
| Java | Java | |
| Creative Commons Attribution Share Alike 4.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
advanced-java
-
Top 10 Developer Trends, Mon Oct 12 2020
doocs / advanced-java
fscrawler
-
Tools for converting assorted text files to JSON?
Or use the ingest Attachment plugin, or https://github.com/dadoonet/fscrawler and remove any doubt
-
How to index PDF files with AppSeach
Did you sir give FSCrawler a shot? it's also a file system crawler that automatically ingests files into an ElasticSearch index and it is built over Tika so it performs typically the same (multiple file formats, multiple languages, ...). It can also perform OCR while indexing (uses Tesseract) by just toggling it on its config (I didn't try the OCR that much for a lack of need and for the ridiculous amount of times it added to the indexation process on my small environment).
What are some alternatives?
dslabs - Distributed Systems Labs and Framework
Elasticsearch - Free and Open, Distributed, RESTful Search Engine
TWINT - An advanced Twitter scraping & OSINT tool written in Python that doesn't use Twitter's API, allowing you to scrape a user's followers, following, Tweets and more while evading most API limitations.
mutad - Realtime Data Processing and Search Engine Implementation.
webp-imageio - Java ImageIO WebP support
webmagic - A scalable web crawler framework for Java.
steve - SteVe - OCPP server implementation in Java
nifi-extracttext-processor - Apache NiFi Custom Processor Extracting Text From Files with Apache Tika
PrettyZoo - 😉 Pretty nice Zookeeper GUI, Support Win / Mac / Linux Platform
analysis-ik - 🚌 The IK Analysis plugin integrates Lucene IK analyzer into Elasticsearch and OpenSearch, support customized dictionary.
CCPS209Labs - Graded lab problems for the author's Java course CCPS 209 Computer Science II.
url-collector - An application that crawls the Common Crawl corpus for URLs with the specified file extensions.