skrape.it
unfurl
skrape.it | unfurl | |
---|---|---|
4 | 4 | |
753 | 262 | |
- | - | |
6.1 | 7.3 | |
9 days ago | 3 months ago | |
Kotlin | HTML | |
MIT License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
skrape.it
-
Ksoup - Koltin Multiplatform HTML Parser ⚡
What is wrong with skrape.it?
-
Why most of us won't be inventing little languages
This includes many things that Kotlin makes use of, like String.invoke(block: () -> Unit) which is both an extension on String instances and makes uses of Kotlin's "ability" to move lambdas out of parentheses if they are the last argument (so something like log(lazyString: () -> String), can be used as log({ "message" }), or log { "message" }, @DslMarker (to allow a String.invoke(() -> Unit) block in the form of "it should behave well", only inside the context of a StringSpec.), infix funs (+ is infix operator fun plus(), with some slightly specific language handling because it's extremely common, infix fun shouldBe). This is using Kotest (https://kotest.io/docs/framework/writing-tests.html), but other tools like Ktor, Skrape.it (https://github.com/skrapeit/skrape.it), and more: https://kotlinlang.org/docs/type-safe-builders.html
- Skrape{It}
-
Best webscraping tool for kotlin 2021?
I use skrape{it} (https://github.com/skrapeit/skrape.it) in my projects for 5 months now. Pretty good library IMO.Q
unfurl
-
Ksoup - Koltin Multiplatform HTML Parser ⚡
Very interesting! I've been wanting to migrate my library, unfurl to kotlin multiplatform. Maybe this is my sign.
-
Unfurl, a library for generating link previews
unfurl is not very different from your gist. It is slightly more comprehensive by supporting both Open Graph Protocol and Twitter Cards, plus falls back to back to reading HTML head tags. It is also extensible for websites that use javascript and can't be scraped such as twitter.
What are some alternatives?
ktor - Framework for quickly creating connected applications in Kotlin with minimal effort
Dawn - Here lies the fork of greatest open-source Reddit app
kottpd - REST framework written in pure Kotlin
previewjs - Preview UI components in your IDE instantly
krawler - A web crawling framework written in Kotlin
crux - Crux offers a flexible plugin-based API & implementation to extract interesting information from Web pages.
hexagon - Hexagon is a microservices toolkit written in Kotlin. Its purpose is to ease the building of services (Web applications or APIs) that run inside a cloud platform.
Tusky - An Android client for the microblogging server Mastodon
GraphQL Kotlin - Libraries for running GraphQL in Kotlin
markdown-preview.nvim - markdown preview plugin for (neo)vim
KotlinPrimavera - Spring support libraries for Kotlin
SwiftLinkPreview - It makes a preview from an URL, grabbing all the information such as title, relevant texts and images.