spark-sbt.g8
sqldb-logger
spark-sbt.g8 | sqldb-logger | |
---|---|---|
2 | 3 | |
73 | 339 | |
- | - | |
1.8 | 0.0 | |
about 3 years ago | 4 months ago | |
Scala | Go | |
- | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
spark-sbt.g8
-
Open source PySpark project idea
I built this for Spark Scala projects with SBT and it has been used extensively: https://github.com/MrPowers/spark-sbt.g8
-
Ask HN: What are some tools / libraries you built yourself?
I built daria (https://github.com/MrPowers/spark-daria) to make it easier to write Spark and spark-fast-tests (https://github.com/MrPowers/spark-fast-tests) to provide a good testing workflow.
quinn (https://github.com/MrPowers/quinn) and chispa (https://github.com/MrPowers/chispa) are the PySpark equivalents.
Built bebe (https://github.com/MrPowers/bebe) to expose the Spark Catalyst expressions that aren't exposed to the Scala / Python APIs.
Also build spark-sbt.g8 to create a Spark project with a single command: https://github.com/MrPowers/spark-sbt.g8
sqldb-logger
- A logger for Go SQL database driver without modifying existing stdlib usage
-
DB Question: Can I get the final sql query from db.Exec?
You can use this to get instant query logging for sql.DB. https://github.com/simukti/sqldb-logger
-
Ask HN: What are some tools / libraries you built yourself?
sqldb-logger: https://github.com/simukti/sqldb-logger
It's a thin layer that wrap Go (Golang) SQL database driver, it does not change sql.DB usage in any existing Go app.
It is because I prefer to use vanilla Go sql.DB in my web service and I could not find any SQL logger for Go SQL database standard library that can use structured JSON logging.
What are some alternatives?
Pion WebRTC - Pure Go implementation of the WebRTC API
logxi - A 12-factor app logger built for performance and happy development
Nullboard - Nullboard is a minimalist kanban board, focused on compactness and readability.
logutils - Utilities for slightly better logging in Go (Golang).
tera - A template engine for Rust based on Jinja2/Django
go-logger - Simple logger for Go programs. Allows custom formats for messages.
emr-job-templates - A sample repository of production-ready Spark code for use with Amazon EMR.
lumberjack - lumberjack is a log rolling package for Go
GoJS, a JavaScript Library for HTML Diagrams - JavaScript diagramming library for interactive flowcharts, org charts, design tools, planning tools, visual languages.
phuslu/log - Fastest structured logging
yadm - Yet Another Dotfiles Manager
glog - Leveled execution logs for Go