spotify-playlist-archive VS nyt-2020-election-scraper

There's a Spotify Playlist Archive on GitHub, but sadly, the earliest version it has archived, is from 2021-12-21.

Cool project!

I maintain an archive of Spotify playlists, scraped daily via GitHub Actions: https://github.com/mackorone/spotify-playlist-archive.

If you're willing to share, I'd love to hear about your experience with the Spotify API. What endpoints do you use? How often do you call them? How do you handle rate limiting? Has Spotify reached out regarding storing playlist data (being in violation of their terms of service)? Any other lessons or advice?

Additionally, I wonder if there's any opportunity for collaboration here. Perhaps you can use the archive to fill out your dataset? Maybe it can act as a cache for your system's scraping needs? Perhaps our Web UIs could link to each other or be combined somehow (https://spotifyplaylistarchive.com/)?

> Currently we keep track of 18378 Spotify playlists

How did you find all of these playlists? Querying Spotify for "Spotify"-owned playlists gives me less than 5000 results. I'd love to add more playlists to my archive but I don't have good discovery mechanisms, especially for non-Spotify-owned playlists.

I looked for it here: https://github.com/mackorone/spotify-playlist-archive/blob/main/playlists/pretty/05dTMGk8MjnpQg3bKuoXcc.md but either it's not there or it has a different name.

Here ya go: https://github.com/mackorone/spotify-playlist-archive/blob/main/playlists/pretty/37i9dQZF1DWTtTyjgd08yp.md

Certainly give u/mackorone project a look (https://github.com/mackorone/spotify-playlist-archive), as he has been doing it longer than i have and has cumulative playlist for every list being archived, which i don't. im only doing what im doing as im not a programmer, and feel alot of people who want this aren't, so having CSV spreadsheets (which include the URI link for each song) that can easily be converted back to a playlist on Spotify, it makes it easier for anyone to jump in and get use out of it!

RapCavier

Hi folks! A few years ago, I built system for archiving public Spotify playlists: https://github.com/mackorone/spotify-playlist-archive. For the technically inclined: it's a GitHub repository of Markdown playlist files, updated once a day by a Travis CI bot.

this site has all the songs from the pollen playlist in the past in one page so might be worth a shot looking here https://github.com/mackorone/spotify-playlist-archive/blob/master/playlists/cumulative/POLLEN.md

I haven't been able to find a similar resource for this year's election, but you're referencing this: https://alex.github.io/nyt-2020-election-scraper/battleground-state-changes.html

Fourth, Take a look at this website, it tracked all of the votes coming in for all the states. https://alex.github.io/nyt-2020-election-scraper/battleground-state-changes.html Alaska even took until two weeks after the election to finish their votes.

Georgia was called for Biden on Friday: Biden first captured the lead Friday early morning. It was later called for him several hours later. By practically every single news network, including Fox.

This is a really powerful use-case! If you saw Alex Gaynor's election tracker[1] during the US 2020 elections, it's exactly how it worked. Actions scraped the NYT election results.json, and a static site on GH pages rendered the data, XHRing the scraped JSON out of the repo periodically.

There's no GraphQL backend yet! We've only done HTTP and SQL backends so far. If your GQL query is simple enough, you might be able to squeak by with an HTTP flat action whose target is https://your.site/graphql?query=whatever ?

[1] https://alex.github.io/nyt-2020-election-scraper/battlegroun...

Nice start. Another project recently opened my eyes around the election and results. Where it has “output files” directly in GitHub. Would be cool to have something run daily that populates some output files with info for others to view directly in GitHub, but also show the power or the API. Here is the Election Results example: https://github.com/alex/nyt-2020-election-scraper

I can’t find any scrapers for this election. The general https://github.com/alex/nyt-2020-election-scraper/blob/master/battleground-state-changes.txt was a constant refresh for me.