pygooglenews VS SheetJS js-xlsx

I have ~4k start in 2 Python libraries. Both help fetch live news articles. Links below.

These were my first libraries.

I took the approach of promoting them as any other product. You have to "sell" your code. Even if it's 100% free.

In my opinion, the most important thing is DEMO. Just make a GIF where you showcase what your software does:

* 80% of engineers won't even bother to read the description

No one will spend their precious time trying to get through your code.

[0] https://github.com/kotartemiy/newscatcher Programmatically collect normalized news from (almost) any website.

[1] https://github.com/kotartemiy/pygooglenews If Google News had a Python library

I wrote a pygooglenews package for news mining out of google news.

I'm curious where the data get fetched from. The Author mentions that Mozilla Readability and SimplePie are used.

Readability to parse the content. SimplePie to fetch the data (I assume). Dat from RSS feeds?

In case you want to make something similar, I recently wrote a blog on where you could get news data for free [1]

(self-promo) I'd recommend to take a look at my Python package to mine news data from Google News [2]. Also, in 3 days we're releasing an absolutely free News API [3] that will support ~50-100k top stories per day.

[1] https://blog.newscatcherapi.com/an-ultimate-list-of-open-sou...

[2] https://github.com/kotartemiy/pygooglenews

[3] https://newscatcherapi.com/free-news-api

I wrote a python package to scrape google news headlines at scale: https://github.com/kotartemiy/pygooglenews

Write libraries AND services, where it makes sense.

I wrote a Python library to scrape google news [0]

We also have it as a service [1]

Want to know why? Because devs who can't pay won't pay. Businesses who can pay will rather pay for a service (API in our case), and not care about maintaining it.

[0] https://github.com/kotartemiy/pygooglenews

[1] https://newscatcherapi.com/google-news-api

You can use this Python project to scrape Google News (https://github.com/kotartemiy/pygooglenews) If you look at the code you can get a feel of how to call Google News directly.

https://github.com/kotartemiy/pygooglenews https://pypi.org/project/google-play-scraper/

ExcelJS and XLSX (SheetJS) are great libraries to work with XLSX files. The former I've found a bit easier to work with but less efficient in general.

Sure. I manipulate excel files programatically in the browser all the time. I don't really understand your exact workflow, but I use Javascript with xlsx and React.

Looking at the xlsx documentation, to parse files in the browser, rather than readFile, you use read, which is designed to parse binary data directly, rather than read from disk. There are a bunch of different formats if you go to the XLSX NPM page and scroll down to "Acquiring and Extracting Data". Importantly, it seems the data must already be serialized, so a Blob won't work, but we can work with that.

Last year, Bing and Edge erroneously flagged our website https://sheetjs.com/ as "dangerous": https://i.imgur.com/BvA3zrk.png

At the time, there was no "Safety Report" to indicate why Bing thought it was dangerous. The report page linked to https://www.bing.com/toolbox/bing-site-safety?url=https%3a%2... and it said "That web page doesn't exist"

To fix it, we had to register with "Bing Webmaster Tools" (https://www.bing.com/webmasters/about) and raise a support ticket.

Within a few days, the issue "resolved itself". It's possible that raising a ticket forced some automatic refresh of the indexed data for the domain.

xlsx.

SheetJS | https://sheetjs.com/ | Software Developer | Full time, Remote (US) | $165K - $240K

We're a bootstrapped company building open source solutions for spreadsheets and structured data. With over 1.5M unique monthly visitors, companies across the business world turn to us for challenging data processing problems. Over the last 10 years, we have pushed the boundaries of JavaScript and the web.

In this role, you will master new and established technologies while working on high-impact projects used by millions of people across the world. Balancing research and engineering, you will design and implement creative solutions that draw from your academic and professional experience.

https://sheetjs.com/careers/ more details

For more, you can visit xlsx documentation Link.

There are libraries like https://github.com/SheetJS/sheetjs to parse excel and https://www.chartjs.org/ for all kinds of charts/graphs. Not really much HTML involved here.. the markup gets generated by the chart library.