smart_open
minitest
smart_open | minitest | |
---|---|---|
6 | 10 | |
3,093 | 3,243 | |
0.7% | 0.2% | |
8.3 | 8.0 | |
12 days ago | 20 days ago | |
Python | Ruby | |
MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
smart_open
- smart_open: Utils for streaming large files (S3, HDFS, gzip, bz2...)
-
Use AWS to unzip all of Wikipedia in 10 minutes
We’re using smart_open, which is an amazing library that lets you open objects in S3 (and other cloud object stores) as if they’re files on your filesystem. It’s obviously critical that we’re able to seek to an arbitrary position in an S3 file without first downloading the whole thing. We’ll assume you’re using Poetry, but you should be able to follow along with any other package manager:
-
Using AWS and Hyperscan to match regular expressions on 100GB of text
If you didn’t follow along with the first article in this series, you should be able to follow this article with your own dataset as long as you install smart_open and Meadowrun. smart_open is an amazing library that lets you open objects in S3 (and other cloud object stores) as if they’re files on your filesystem, and Meadowrun makes it easy to run your Python code on the cloud.
-
Ask HN: Codebases with great, easy to read code?
I see that you're primarily looking into Python work, so I'd recommend `smart_open` as a nice, compact way to get started.
https://github.com/RaRe-Technologies/smart_open
-
How to open an s3 binary file in lambda using python open() function?
You want smart_open. It gives you a (more complete) file-like interface to many different storage systems, including s3. You can read and seek as needed.
-
Fsspec: Filesystem Interfaces for Python
See also smart_open: https://github.com/RaRe-Technologies/smart_open which might be more user-friendly? Never used it myself but it was on HN before. Discussion on their bugtracker: https://github.com/RaRe-Technologies/smart_open/issues/579
minitest
-
Test Driving a Rails API - Part Two
In this part, we’ll set up our testing environment so that we can test our Rails API using minitest with minitest/spec. We’ll look at the differences between traditional style unit tests and spec-style tests, or specs. I’ll demonstrate why you should use minitest-rails. We’ll look at using rack-test for testing our API. We’ll even create our own generator to generate API specs.
-
Where can I learn to deliver a proper solution?
I forgot to mention that reading code is also a good way to learn how to write code, it's like inspiration. Check repos of some gems you like. For example sidekiq https://github.com/sidekiq/sidekiq/tree/main/lib/sidekiq Or minitest https://github.com/minitest/minitest/tree/master/lib/minitest
-
I_suck_and_my_tests_are_order_dependent
All through GitHub.
1. From https://github.com/rails/rails/blob/6ffb29d24e05abbd9ffe3ea9..., click "Blame" on the header bar over the file contents.
2. Scroll down to the line and click on the commit in the left column.
3. Scroll down to the file that removed the line from its previous file, activesupport/lib/active_support/test_case.rb.
4. Click the three-dots menu in that file's header bar and select "View file".
5. Click "History" in the header bar of the contributors, above the file contents.
6. I guessed here at commit 281f488 on its message: "Use the method provided by minitest to make tests order dependent". There's a comment here that identified the problem which led to, and provided context for, the change in 6ffb29d.
The OP is from minitest's documentation, so to find the introduction in minitest, it's basically the same process.
1. Go to https://github.com/minitest/minitest.
2. Search the repo for the method name. Even just "i_suck" will match the commit.
3. Select the oldest commit in the results. That's a4553e2.
-
Minitest, we've been doing it wrong?
The new test convention is now "test/**/test_*.rb" instead of "test/**/*_test.rb". For example, Puma and Minitest are popular repositories using this naming pattern.
-
Ask HN: Codebases with great, easy to read code?
https://github.com/seattlerb/minitest really removed the FUD for me when i started learning Ruby and Rails. Its full of metaprogramming and fancy tricks but is also quite small, practical and informal in its style.
e.g. "assert_equal" is really just "expected == actual" at it's core but it uses both both a block param (a kind of closure) for composing a default message and calls "diff" which is a dumb wrapper around the system "diff" utility (horrors!). There is even some evolved nastiness in there for an API change that uses the existing assert/refute logic to raise an informative message. this is handled with a simple if and not some sort of complex hard-to-follow factory pattern or dependency injection misuse.
https://github.com/seattlerb/minitest/blob/master/lib/minite...
-
49 Days of Ruby: Day 46 -- Testing Frameworks: Minitest
Those are just a few examples of what you can do with Minitest! Check out their README on GitHub and keep on exploring.
-
Ruby through the lens of Go
One of the things I love the most about Ruby is that it tends to coalesce around one or two really popular libraries. Rails is the big one obviously, but over time you see libraries designed for a particular purpose "winning" over other things. This includes things like linting/code analysis (Rubocop), authentication (Devise), testing (RSpec and Minitest) and more. The emphasis is on making something good great rather than making a lot of different good things.
-
Best way to learn testing in RSpec?
Then try minitest (unit and spec verisons) https://github.com/seattlerb/minitest
What are some alternatives?
s3fs - Amazon S3 filesystem for PyFilesystem2
Test::Unit - test-unit
Streamz - Real-time stream processing for python
RSpec - RSpec meta-gem that depends on the other components
s3path - s3path is a pathlib extension for AWS S3 Service
Cucumber - A home for issues that are common to multiple cucumber repositories
PyFilesystem2 - Python's Filesystem abstraction layer
Pundit Matchers - A set of RSpec matchers for testing Pundit authorisation policies.
rxsci - ReactiveX for data science
shoulda-matchers - Simple one-liner tests for common Rails functionality
fluvio-client-python - The Fluvio Python Client!
Aruba - Test command-line applications with Cucumber-Ruby, RSpec or Minitest.