fast_page
PgHero
fast_page | PgHero | |
---|---|---|
2 | 11 | |
295 | 7,707 | |
1.0% | - | |
2.9 | 7.2 | |
10 months ago | 2 months ago | |
Ruby | Ruby | |
Apache License 2.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
fast_page
-
We switched to cursor-based pagination
There are ways to mitigate the (although not eliminate) the slowing down of offset/limit pagination in later pages. The technique is called a "deferred join" and it is most effective in MySQL. The basic idea is to paginate as little data as necessary, and then do a self-join to get the rest of the data for a single page.
You can read more about it here: https://aaronfrancis.com/2022/efficient-pagination-using-def... or here https://planetscale.com/blog/fastpage-faster-offset-paginati....
There are libraries for Laravel (https://github.com/hammerstonedev/fast-paginate) and Rails (https://github.com/planetscale/fast_page) as well!
Cursor based pagination is wonderful, but sometimes you're stuck with offset/limit for whatever reason. Might as well make it fast.
-
Faster offset pagination for Rails apps
In both Django and Rails, passing a QuerySet or ActiveRecord::Relation as an argument to a filter/where creates a subquery - in this case, https://github.com/planetscale/fast_page/blob/main/lib/fast_... creates SELECT ... WHERE id IN (SELECT id FROM ...).
So it's not exactly an inner join, but in theory it will be optimized to the same query plan as an inner join. That said, https://stackoverflow.com/questions/2577174/join-vs-sub-quer... has lots of commentary on why this shouldn't be depended on.
PgHero
-
Show HN: PostgreSQL Index Advisor
I am using https://github.com/ankane/pghero/ and this is one of its features with GUI
-
What are your favourite approaches to keeping on top of Postgres health?
I use either PgHero or Rails PG Extras on every project
-
Slow query. Should add indexes?
There are tools available which can look at your Postgres logs and tell you if you need to add indexes, I've used https://github.com/ankane/pghero before and it seems decent.
-
Is there something like sentry.io, for checking how long rails queries and functions take to execute?
https://github.com/ankane/pghero (open source equivalent to pganalyze)
-
railstart-niceadmin support more features
- [pghero](https://github.com/ankane/pghero)
-
railstart-niceadmin release now!Backend management system based on Bootstrap 5 and NiceAdmin and Rails 7
pghero
- How and why Relational Model works for databases
-
Check why Django app is slow in production
If you are using PostgreSQL you can enable logging of slow queries and connect to the server with pghero (https://github.com/ankane/pghero) and check top queries by the number of requests and total usage time. Also, you can just enable logging of queries in Django, and on each request, you will have a list of queries on development, sometimes it's just a missing select_related of prefetch_related to increase performance, or you need to create a complex index.
-
Tips for a Healthier Postgres Database
If you are using rails, pghero is a great gem to get better visibility on your Postgres performance
https://github.com/ankane/pghero
-
PostgreSQL for Java Developer
I know others can answer this better but we use a combination of PgHero and logging of slow queries trough jOOQ.
What are some alternatives?
fast-paginate - A fast implementation of offset/limit pagination for Laravel.
Blazer - Business intelligence made simple
Scenic - Versioned database views for Rails
Database Cleaner - Strategies for cleaning databases in Ruby. Can be used to ensure a clean state for testing.
Seed dump - Rails 4/5 task to dump your data to db/seeds.rb
Lol DBA - lol_dba is a small package of rake tasks that scan your application models and displays a list of columns that probably should be indexed. Also, it can generate .sql migration scripts.
Large Hadron Migrator - Online MySQL schema migrations
DatabaseValidations - Database validations for ActiveRecord
SecondBase - Seamless second database integration for Rails.
SchemaPlus - SchemaPlus provides a collection of enhancements and extensions to ActiveRecord