kotlin-spark-api
awesome-spark
kotlin-spark-api | awesome-spark | |
---|---|---|
3 | 1 | |
440 | 1,617 | |
0.7% | 0.9% | |
4.4 | 1.0 | |
28 days ago | 30 days ago | |
Kotlin | Shell | |
Apache License 2.0 | Creative Commons Zero v1.0 Universal |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
kotlin-spark-api
-
What are your favorite Apache Spark open source libraries?
https://github.com/Kotlin/kotlin-spark-api this definitely needs to be in the language bindings section 😅
-
Migration from Scala to Kotlin
Kotlin should mostly have no problems being called in Scala. Give kotlin-spark-api a look to figure out how would that work the other way around.
-
From First Principles: Why Scala?
Scala is nice for doing things with Spark compared to say, Java, but I really think that Kotlin can do just as well. The only advantage Scala has with Spark is the syntactic sugar. Once there is an API for Kotlin (beyond the preview version), I will be dropping Scala like a bad habit. Kotlin is also concise, has better IntelliJ support, and better Java interop.
https://github.com/JetBrains/kotlin-spark-api
awesome-spark
-
What are your favorite Apache Spark open source libraries?
The awesome-spark repo has a list of Spark OSS libraries, but a lot of them are quite old.
What are some alternatives?
Slick - Slick (Scala Language Integrated Connection Kit) is a modern database query and access library for Scala
data_origination_workshop - Hands-on workshop with Iceberg, Redpanda, Debezium and Kafka-Connect
ScalikeJDBC - A tidy SQL-based DB access library for Scala developers. This library naturally wraps JDBC APIs and provides you easy-to-use APIs.
papers-we-love - Papers from the computer science community to read and discuss.
Quill - Compile-time Language Integrated Queries for Scala
docker-spark - Apache Spark docker image
treelog - Allows logging in a tree structure so that comprehensive logging does not become incomprehensible
PyCall.jl - Package to call Python functions from the Julia language
dotty - The Scala 3 compiler, also known as Dotty.
cf020031308