doc
pgloader
Our great sponsors
doc | pgloader | |
---|---|---|
8 | 31 | |
15 | 5,066 | |
- | - | |
7.0 | 3.0 | |
21 days ago | 29 days ago | |
Common Lisp | Common Lisp | |
GNU General Public License v3.0 or later | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
doc
-
How do you think about version number management?
- it is possible to subscribe on the changes using RSS (this is a feature of the 40ANTS-DOC documentation builder).
-
From Common Lisp to Julia
So, the article is harsh on CL: YMMV. Also, your goal may vary: I want to build and ship (web) applications, and so far Julia doesn't look attractive to me (at all). Super fast incremental development, build a standalone binary and deploy on my VPS or ship an Electron window? done. Problem(s) solved, let's focus on my app please.
The author doesn't mention a few helpful things:
- editor support: https://lispcookbook.github.io/cl-cookbook/editor-support.ht... Emacs is first class, Portacle is an Emacs easy to install (3 clicks), Vim, Atom support is (was?) very good, Sublime Text seems good (it has an interactive debugger with stack frame inspection), VSCode sees good work underway, the Alive extension is new, usable but hard to install yet, LispWorks is proprietary and is more like Smalltalk, with many graphical windows to inspect your running application, Geany has simple and experimental support, Eclipse has basic support, Lem is a general purpose editor written in CL, it is Emacs-like and poorely documented :( we have Jupyter notebooks and simpler terminal-based interactive REPLs: cl-repl is like ipython.
So, one could complain five years ago easily about the lack of editor support, know your complaint should be more evolved than a Emacs/Vim dichotomy.
- package managers: Quicklisp is great, very slick and the ecosystem is very stable. When/if you encounter its limitations, you can use: Ultralisp, a Quicklisp distribution that ships every 5 minutes (but it doesn't check that all packages load correctly together), Qlot is used for project-local dependencies, where you pin each one precisely, CLPM is a new package manager that fixes some (all?) Quicklisp limitations
> [unicode, threading, GC…] All of these features are left to be implemented by third-party libraries
this leads to think that no implementation implements unicode or threading support O_o
> most of the language proper is not generic
mention generic-cl? https://github.com/alex-gutev/generic-cl/ (tried quickly, not intensively)
Documentation: fair points, but improving etc. Example of a new doc generator: https://40ants.com/doc/
Also I'd welcome a discussion about Coalton (Haskell-like type system on top of CL).
-
Kons-9 update – 3D Common Lisp system now on MacOS and Linux
Great news! Feedback: I guess it's time to start working on documentation ;) The readme doesn't say what the system does. I guess you could maintain a high overview "manually", and in parallel set up a documentation system (40ants doc is kinda cool). Best,
-
Favorite Lisp project? Shameless plugs welcome & encouraged!
- and 40ANTS-DOC builder.
-
Why Turtl Switched from Common Lisp to JavaScript
That is why I've put about half of this year into the Common Lisp documentation generator for all of my libraries.
If you are interested, please read it's docs and join the effort of making good documentation for CL projects: https://40ants.com/doc/
-
CL-TAR Project
And the doc is built with the new https://40ants.com/doc 🎉 Really cool.
- Does everyone here manually specify the entire project's dependency tree in .asd files?
pgloader
-
Why Is Common Lisp Not the Most Popular Programming Language?
No, it's difficult to read, and understand. It's a parenthesis circus, example -
https://github.com/dimitri/pgloader/blob/master/src/sources/...
-
We need to talk about parentheses
Examples (for Common Lisp, so not citing Emacs): reddit v1, Google's ITA Software that powers airfare search engines (Kayak, Orbitz…), Postgres' pgloader (http://pgloader.io/), which was re-written from Python to Common Lisp, Opus Modus for music composition, the Maxima CAS, PTC 3D designer CAD software (used by big brands worldwide), Grammarly, Mirai, the 3D editor that designed Gollum's face, the ScoreCloud app that lets you whistle or play an instrument and get the music score,
but also the ACL2 theorem prover, used in the industry since the 90s, NASA's PVS provers and SPIKE scheduler used for Hubble and JWT, many companies in Quantum Computing, companies like SISCOG, who plans the transportation systems of european metropolis' underground since the 80s, Ravenpack who's into big-data analysis for financial services (they might be hiring), Keepit (https://www.keepit.com/), Pocket Change (Japan, https://www.pocket-change.jp/en/), the new Feetr in trading (https://feetr.io/, you can search HN), Airbus, Alstom, Planisware (https://planisware.com),
or also the open-source screenshotbot (https://screenshotbot.io), the Kandria game (https://kandria.com/),
and the companies in https://github.com/azzamsa/awesome-lisp-companies and on LispWorks and Allegro's Success Stories.
https://github.com/tamurashingo/reddit1.0/
http://opusmodus.com/
https://www.ptc.com/en/products/cad/3d-design
http://www.izware.com/mirai
https://apps.apple.com/us/app/scorecloud-express/id566535238
-
We migrated our PostgreSQL database with 11 seconds downtime
I worked on migrating our MySQL system to PostgreSQL using pgloader ( https://pgloader.io/ ).
There were some hiccups, things that needed clarification in documentation, and some additional processes that needed to be done outside of the system to get everything we need in place, it was a amazing help. Not sure the project would've been possible without it.
Data mapping from PostgreSQL to PostgreSQL as in the article isn't nearly as bad as going between systems. We took a full extended outage and didn't preload any data. There were many dry runs before hand and validation before hand, but the system wasn't so mission critical that we couldn't afford to shutoff the system for a couple of hours.
-
Time For Me To Fly… To Render
Initially, I started down the pgloader path, which seemed to be a common approach for the database conversion. However, using my M1-chip MacBook Pro led to some unexpected issues. Instead, I opted to use NMIG to convert MySQL to PostgreSQL. For more information, please check out the “Highlights From the Database Conversion” section below.
-
PostgresSQL DB restore sature whole SAN IO
I just checked pgloader (which is mostly for heterogeneous database migrations) and it doesn't seem to have any explicit throttling features, either. However, you can set concurrency, number of workers, and batch size.
-
What language should i learn?
But do what makes you happy. The best PostgreSQL data loader in the world is written in Common Lisp. Now, CL is a fast and ANSI standardized language with multiple implementations, and was used to create Reddit, but it's hard to call it fashionable.
-
Why Lisp?
- [ScoreCloud](https://scorecloud.com/) - A web and mobile application to automatically create music notation from music performance or recordings. Built with LispWorks.
## DB tools
- [Pgloader](https://github.com/dimitri/pgloader/) - Migrate to PostgreSQL in a single command!. [PostgreSQL License]
-
What ETL tool you use with Postgres ?
I would warmly recommend https://pgloader.io but, unfortunately, the Oracle support is still in need of a sponsor :-)
-
Installing pgLoader on RHEL9 - No matching package to install: 'sbcl' - is there a workaround?
I followed instruction here: https://github.com/dimitri/pgloader/blob/master/INSTALL.md, but can't get pass sbcl requirement.
-
Introducing pgsqlite, a pure python module for import sqlite into postgres
https://pgloader.io/ There's been a great tool available for this for many years.
What are some alternatives?
wookie - Asynchronous HTTP server in common lisp
lisp-xl - Common Lisp Microsoft XLSX (Microsoft Excel) loader for arbitrarily-sized / big-size files
woo - A fast non-blocking HTTP server on top of libev
docker-postgres-upgrade - a PoC for using "pg_upgrade" inside Docker -- learn from it, adapt it for your needs; don't expect it to work as-is!
cl-lsp - An implementation of the Language Server Protocol for Common Lisp
HomeBrew - 🍺 The missing package manager for macOS (or Linux)
weblocks - This fork was created to experiment with some refactorings. They are collected in branch "reblocks".
cl-wget - The Non-Interactive Network Downloader: cl-wget is a free software for retrieving files using HTTPS; cl-wget makes mirroring websites easy.
cl-permutation - Permutations and permutation groups in Common Lisp.
kandria - A post-apocalyptic actionRPG. Now on Steam!
LispSyntax.jl - lisp-like syntax in julia
TimescaleDB - An open-source time-series SQL database optimized for fast ingest and complex queries. Packaged as a PostgreSQL extension.