Kiba
Guard
Kiba | Guard | |
---|---|---|
7 | 11 | |
1,722 | 6,230 | |
- | 0.0% | |
0.0 | 0.0 | |
over 1 year ago | 8 months ago | |
Ruby | Ruby | |
GNU Lesser General Public License v3.0 only | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Kiba
-
Ask HN: What side projects landed you a job?
I started https://github.com/thbar/kiba#kiba-etl to scratch my own itch & be able to write properly structured ETL jobs in Ruby. It was a blank-slate rewrite of something larger (activewarehouse-etl) which I could not maintain anymore.
This landed me not strictly a job, but long term consulting gigs with a number of companies in EU, UK & US.
The job was directly related to the project: companies wanted the expertise of data engineering & ETL, often with Kiba directly, but also in general.
This "side project" was totally worth it :-)
-
Ruby's Hash Is a Swiss-Army Knife
Definitely! As a matter of fact, this is the default data structure I use when writing Ruby ETL code (e.g. https://github.com/thbar/kiba/wiki).
Methods like "except" (https://docs.ruby-lang.org/en/3.2/Hash.html#method-i-except) or "fetch" (raising an error on missing key) are very convenient to write defensive data processing code!
Similarly, in Elixir, I use Maps a lot for the same type of jobs (https://hexdocs.pm/elixir/1.15.4/Map.html), with similar properties.
-
Thinking in learn Ruby
Ruby has a very cool ETL library named Kiba that fits wonderfully with Ruby's strengths.
- What ETL tool do you use?
-
Massive SQL import from csv file, nulls, best practices.
Though it might be overkill for your problem, but have you had a look at [kiba-etl](https://github.com/thbar/kiba/blob/master/README.md)?
-
My favorite Ruby gems
Kiba
-
Ruby ETL Strategies: Organizing block-based Kiba Pipelines
If you don’t use Kiba, but work with data, check it out.
Guard
-
The Fastest Way to Run Mastodon Tests
Guard is a Ruby gem that can be used to run test cases automatically when source files change. For example, with guard-minitestand a simple Guardfile, you can run tests as the files are modified.
-
Thinking in learn Ruby
Text and file processing. Everything from parsing log files and generating reports, to watching folders with the Guard library and doing things with the files.
-
Ask HN: What developer tools would you like to see?
Perhaps using guard you can automate that https://github.com/guard/guard
-
Unit tests run - Should it be included as a pre-push githook?
It seems like where you are, devs are pushing code that fails in the CI/CD pipeline, which means, if your test suite isn't flakey, they aren't running tests locally. I had this problem too. I work on a rails monorepo, so I use the guard gem to automatically run certain tests when certain files are changed. There should be an analagous tool in whatever language/framework env(s) you're working in.
-
Poor man's file watcher
You should definitely use something more polished like Guard but you could also experiment with a "simpler" approach.
-
What tools are people using for auto testing?
Check out https://github.com/guard/guard and https://github.com/guard/guard-rspec (if you're using rspec)
-
Watchdog/Guarddog for sending build notifications on ruby development?
Probably https://github.com/guard/guard
-
How to Setup Tailwind JIT in Rails 6 with Live Reload [2021]
Installation guide for guard
-
Test Commit Revert in Rails using Guard
Now, consider this a mea culpa, as I know there are many ways this could go wrong. The guard documentation was also kind enough to warn me as such. This is, for better or for worse, my first attempt at building out a way to TCR in Rails. I’m excited to be able to follow up as I spend more time with my monstrous guardfile and this workflow so I can let you know how it goes.
What are some alternatives?
Nokogiri - Nokogiri (鋸) makes it easy and painless to work with XML and HTML from Ruby.
Gollum - A simple, Git-powered wiki with a local frontend and support for many kinds of markup and content.
Roo - Roo provides an interface to spreadsheets of several sorts.
gon - Your Rails variables in your JS
data-science-with-ruby - Practical Data Science with Ruby based tools.
Ruby Operators - Webpage to show interesting names of different Ruby operators.
chronicle-etl - 📜 A CLI toolkit for extracting and working with your digital history
FasterPath - Faster Pathname handling for Ruby written in Rust
slay
Diffy - Easy Diffing in Ruby
ferrum - Headless Chrome Ruby API
DeepPluck - Allow you to pluck attributes from nested associations without loading a bunch of records.