|12 days ago||3 days ago|
|MIT License||GNU Affero General Public License v3.0|
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
A simple solution to rotate proxies or how to spin up your own rotation proxy server with Puppeteer and only a few lines of JS code
1 project | reddit.com/r/webscraping | 5 Mar 2021
I'm currently implementing concurrency conditions at project/proxy/domain/session level in https://github.com/get-set-fetch/scraper . On each level you can define the maximum number of requests and the delay between two consecutive requests.
Web scraping content into postgresql? Scheduling web scrapers into a pipeline with airflow?
1 project | reddit.com/r/webscraping | 15 Feb 2021
If you're familiar with nodejs give https://github.com/get-set-fetch/scraper a try. Scraped content can be stored in sqlite, mysql or postgresql. It also supports puppeteer, playwright, cheerio or jsdom for the actual content extraction. No scheduler though.
Web Scraping 101 with Python
5 projects | news.ycombinator.com | 10 Feb 2021
I'm using this exact strategy to scrape content directly from DOM using APIs like document.querySelectorAll. You can use the same code in both headless browser clients like Puppeteer or Playwright and DOM clients like cheerio or jsdom (assuming you have a wrapper over document API). Depending on the way a web page was fetched (opened in a browser tab or fetched via nodejs http/https requests), ExtractHtmlContentPlugin, ExtractUrlsPlugin use different DOM wrappers (native, cheerio, jsdom) to scrape the content.
What is your “I don't care if this succeeds” project?
42 projects | news.ycombinator.com | 1 Feb 2021
https://github.com/get-set-fetch/scraper - I've been working (intermittently :) ) on a nodejs or browser extension scraper for the last 3 years, see the other projects under the get-set-fetch umbrella. Putting a lot more effort lately as I really want to do those Alexa top 1 million analysis like top js libraries, certificate authorities and so on. A few weeks back I've posted on Show:HN as you can do basic/intermediate? scraping with it.
Not capable of handling 1 mil+ pages as it still limited to puppeteer or playwright. Working on adding cheerio/jsdom support right now.
Show HN: Plugin Based, Batteries Included, Web Scraper
1 project | news.ycombinator.com | 19 Jan 2021
Blindfold Chess Trainer
1 project | reddit.com/r/chess | 1 Dec 2021
Love the general idea of having blindfolded tactics and games. A similar site I regularly use: https://listudy.org/ I'm lazy! Instead of me typing the moves - maybe give me an empty chessboard to click on? I like the concept of listudy here. You have the option to show the position every x moves - maybe show this board all the time and give me the option to enter moves on that "outdated" board.
How would I go about learning chess opening for both sides?
2 projects | reddit.com/r/chessbeginners | 26 Oct 2021
Are there tools to study your own opening variations at random?
1 project | reddit.com/r/chess | 19 Aug 2021
Right now, I'm using Lichess Studies to make an "Interactive Lesson" chapter in which I create the main line, together with a lot of variations. Then, I import that chapter into listudy.org and am able to practice the variations of the opening. However, the order of the variations is always exactly the same. I'm already very happy with this method, but by getting the same order of variations, I get the feeling that I'm giving myself an unfair advantage in making the right moves. Is there any tool out there which can randomize the variations you get while practicing?
Intelligence and Practice in Chess Development
4 projects | news.ycombinator.com | 6 Jul 2021
I created a super simple Opening Trainer/Repertoire Builder tool!
3 projects | reddit.com/r/chess | 3 Jul 2021
there's https://listudy.org/ for that, but yes I do agree that lichess should probably implement this feature (and I guess someone will do it eventually)
What are alternatives for chessbase (osx)
1 project | reddit.com/r/chess | 13 May 2021
I read a couple of different books and then play the variations out with notes to Lichess' Studies. After that, I put that study on listudy.org (a website that randomly chooses the options from the opposite colour in your study and tells you if your answer is correct or wrong). It has worked great so far, I have made a lot of adjustments and made variations similar to make them easier to remember, got rid of some drawish variations I don't like, got rid of the moves that seem way too weird for me to understand. I highly recommend this method. Don't forget to make your studies private though, don't want people to see your entire repertoire!
I need help for prep for a very important game.
1 project | reddit.com/r/chess | 18 Apr 2021
Hey man I think you mean https://listudy.org/
I started Lichess, Ask Me Anything
22 projects | reddit.com/r/chess | 12 Apr 2021
Would you consider merging https://listudy.org into the official website if they allow it? I love the idea of studies, but I'm not that good at memorizing if it's just a noninteractive pgn file, and I like the idea of spaced repetition but listudy doesn't have that many good public studies right now because it's a small website. Anyways, thanks so much for lichess!
LiChess should implement this FANTASTIC idea of visual puzzles!
1 project | reddit.com/r/lichess | 10 Apr 2021
If you think these are cool, on https://listudy.org there's a puzzle feature that essentially goes back as many moves back in the game as you want then just gives the algebraic moves up to the puzzle position. It's worth checking out I think it's really cool
Idea to improve studies: test yourself feature
1 project | reddit.com/r/lichess | 29 Mar 2021
You could try LiStudy. They implement exactly this feature.
What are some alternatives?
playwright-python - Python version of the Playwright testing and automation library.
pyppeteer - Headless chrome/chromium automation library (unofficial port of puppeteer)
lichobile - lichess.org mobile application
vopono - Run applications through VPN tunnels with temporary network namespaces
Lila - ♞ lichess.org: the forever free, adless and open source chess server ♞
exomind - A personal knowledge management tool hosted on your own personal cloud
Projects - :page_with_curl: A list of practical projects that anyone can solve in any programming language.
Arthur - How to build your own AI art installation from scratch [Moved to: https://github.com/maxvfischer/DIY-ai-art]
commutative-algebra - An introduction to the basic ideas of commutative algebra
api - Lichess API documentation and examples
Scrapy - Scrapy, a fast high-level web crawling & scraping framework for Python.
Yue - A library for creating native cross-platform GUI apps