Top 23 Scala Open-Source Projects
-
Apache Spark is one of the most actively developed open-source projects in big data. The following code examples require that you have Spark set up and can execute Python code using the PySpark library. The examples also require that you have your data in Amazon S3 (Simple Storage Service). All this is set up on AWS EMR (Elastic MapReduce).
-
-
SonarQube
Static code analysis for 29 languages.. Your projects are multi-language. So is SonarQube analysis. Find Bugs, Vulnerabilities, Security Hotspots, and Code Smells so you can release quality code every time. Get started analyzing your projects today for free.
-
Project mention: Avro SpecificRecord File Sink using apache flink is not compiling due to error incompatible types: FileSink<?> cannot be converted to SinkFunction<?> | reddit.com/r/apacheflink | 2021-09-14
[1]: https://mvnrepository.com/artifact/org.apache.avro/avro-maven-plugin/1.8.2 [2]: https://github.com/apache/flink/blob/master/flink-connectors/flink-connector-files/src/main/java/org/apache/flink/connector/file/sink/FileSink.java [3]: https://ci.apache.org/projects/flink/flink-docs-master/docs/connectors/datastream/file_sink/ [4]: https://github.com/apache/flink/blob/c81b831d5fe08d328251d91f4f255b1508a9feb4/flink-end-to-end-tests/flink-file-sink-test/src/main/java/FileSinkProgram.java [5]: https://github.com/rajcspsg/streaming-file-sink-demo
-
Scala - Popular in the data-science world, particularly when working with distributed data processing (e.g. Spark). Lots of large companies have dedicated data teams that process the huge amount of analytics and other data the games produce.
-
Deeplearning4j
Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top of the core c++ library. Also includes samediff: a pytorch/tensorflow like library for running deep learning using automatic differentiation.
DL4J
-
-
Safari cannot render the "cardinal" piece set on lichess.org correctly. Parts of the design are blurred.
-
Scout APM
Less time debugging, more time building. Scout APM allows you to find and fix performance issues with no hassle. Now with error monitoring and external services monitoring, Scout is a developer's best friend when it comes to application development.
-
Project mention: Any advice on setting up or working with Kafka? | reddit.com/r/ExperiencedDevs | 2022-02-18
Some random tips: * Use SSDs, not magnetic disks. Our Kafka brokers used to use magnetic disks for more throughput, but this caused wayyyy more problems, like very slow broker restarts. * You'll want to install something like Burrow so you can get better lag metrics. * You might want to install CMAK. It's a web interface for common ops tasks.
-
milewski-ctfp-pdf
Bartosz Milewski's 'Category Theory for Programmers' unofficial PDF and LaTeX source
Project mention: What are the "meta principles" for all programming languages? | reddit.com/r/computerscience | 2022-05-08Category is able to encapsulate a lot of these things as well: https://bartoszmilewski.com/2014/10/28/category-theory-for-programmers-the-preface/
-
Gitbucket
A Git platform powered by Scala with easy installation, high extensibility & GitHub API compatibility
Another self-hosted project in the space that i've seen was GitBucket, although it runs on the JVM (not necessarily a bad thing, just different from Go): https://gitbucket.github.io/
-
> Quasiquoting means creating a list where some elements are evaluated at runtime
Take a look at the awesome 'Make A Lisp' (MAL), in particular the section on quoting:
https://github.com/kanaka/mal/blob/master/process/guide.md#s...
This has a fairly good description of what happens during quasi-quoting.
-
-
-
Project mention: Purge the board of directors of Twacker. | reddit.com/r/conspiracy_commons | 2022-05-05
I’m a software engineer. Twitter’s original code was REALLY good - they open sourced some of it back in the day). They still need tech talent to keep it site running smoothly.
-
Zeppelin
Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.
Have you tried Apache Zepellin I remember that you can pretty print spark dataframes directly on it with z.show(df)
-
There are many tools out there like Gatling, Locust, and K6, but here I'll explain just a bit of JMeter. It is totally visual and pretty easy to follow and understand 🤗; it also includes a module that generates dashboards that gives us an APDEX result, which is what we want. By default, I have it on my system; you can use the same idea or simply download it from the official website and run it afterward.
-
https://github.com/lampepfl/dotty/issues/14262 points to https://github.com/invesdwin/invesdwin-context/blob/master/invesdwin-context-parent/invesdwin-context-scala/src/main/java/de/invesdwin/context/scala/pool/WrappedScalaScriptEngine.java which seems to be doing some caching via https://docs.oracle.com/javase/8/docs/api/javax/script/Compilable.html, but I have zero experience with this stuff.
-
papermill - similar to nbconvert with parametrization, and intergration for cloud storages
-
-
Project mention: How do i stop git bash from showing the time taken for each command | reddit.com/r/git | 2022-05-10
BTW, if you're curious, it appears OP is using this: https://github.com/sbt/sbt/releases/tag/v1.6.2 Pretty sure one of the executables is doing ANSI colours.
-
How does all that affects the average Scala developer? Well, there's a broad spectrum of users ranging from the ones "enjoying a simple and comfy typed-python" to the "fleet of PhDs and postdocs at EPFL" making you feel ridiculous about your theoretical baggage, and a damn vibrant community of enthusiasts in-between, trying to catch-up with the flow and becoming better every day by doing so. Scala is perhaps one of the best languages out there if what you are doing is a work of art/love or if you work in a problem space where the unique capabilities and abstractions of the language makes it a no-brainer. It also has some impressive cross-compilation abilities (to javascript or to native) making it extremely versatile.
-
Then you think wrong: https://github.com/polynote/polynote / https://polynote.org/about/
-
Until recently, there was only 64-bit support. 32-bit support is coming, though, see this pr. This means that you will be able to target 32-bit microcontrollers soon. Anything lower than 32-bit might not be realistic.
Scala related posts
- Lichess.org "cardinal" piece set.
- What is the best strat in Othello? I have been trying different strats, but some people seem to always be able to win against me anyways.
- What is this?
- What game did you buy but never played it?
- Best way to port a scala + swing app to flutter?
- what popular companies uses Scala?
- What's the best chess book on the sub?
Index
What are some of the best open-source Scala projects? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | Apache Spark | 32,823 |
| 2 | Apache Kafka | 21,885 |
| 3 | Apache Flink | 18,864 |
| 4 | scala | 13,748 |
| 5 | Deeplearning4j | 12,463 |
| 6 | Play | 12,124 |
| 7 | lila | 11,494 |
| 8 | kafka-manager | 10,782 |
| 9 | milewski-ctfp-pdf | 9,398 |
| 10 | Gitbucket | 8,641 |
| 11 | mal | 8,604 |
| 12 | awesome-scala | 8,380 |
| 13 | awesomo | 8,368 |
| 14 | Finagle | 8,247 |
| 15 | Zeppelin | 5,661 |
| 16 | Gatling | 5,517 |
| 17 | dotty | 4,953 |
| 18 | papermill | 4,689 |
| 19 | Scalaz | 4,535 |
| 20 | sbt | 4,509 |
| 21 | Scala.js | 4,305 |
| 22 | polynote | 4,301 |
| 23 | Scala Native | 4,126 |
There are 13 new remote jobs listed recently.
Are you hiring? Post a new remote job listing for free.
