google-search-results-php
headless-chromium-php
Our great sponsors
google-search-results-php | headless-chromium-php | |
---|---|---|
32 | 10 | |
52 | 2,123 | |
- | 1.5% | |
2.2 | 7.2 | |
8 months ago | 9 days ago | |
PHP | PHP | |
MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
google-search-results-php
-
Automatic Images Classifier Generator
automatic-images-classifier-generator is a machine learning tool written in Python using SerpApi, Pytorch, FastAPI, and Couchbase to provide automated large dataset creation, automated training and testing of deep learning models with the ability to tweak algorithms, storing the structure and results of neural networks all in one place.
-
Ask HN: What are the best tools for web scraping in 2022?
We've built https://serpapi.com
We've invented the industry what you referring as "data type specific APIs"; APIs that abstract away all proxies issues, captcha solvings, various layouts support, even scrapping-related legal issues, and much more to a clean JSON response every single call. It was a lot of work but our success rate and response times are now rivaling non-scraping commercial APIs: https://serpapi.com/status
I think the next battle will be still legal despite all the wins in favor of scrapping public pages and common sense understanding this is the way to go. The EFF has been doing an amazing work in this world and we are proud to be a significant yearly contributor to the EFF.
-
How to Train a Scalable Classifier with FastAPI and SerpApi ?
This week, we will explore the combined capabilities of SerpApi’s powerful Google Images Results Scraper API on top of FastAPI’s fast to build web framework. We will start by creating a simple image database creator with sync method, and build up from there.
-
Ask HN: Who is hiring? (April 2022)
SerpApi | https://serpapi.com | Senior Web Engineer | Based in Austin, TX but everyone is remote | Full-time | ONSITE or FULLY REMOTE (We're a remote first company) | $150k 1099 for US or local avg + 20% for outside the US
SerpApi is the leading API to scrape and parse search engine results. We deeply support Google, Google Maps, Google Images, Bing, Baidu, and a lot more.
Our current stack is Ruby, Rails, MongoDB, and React.JS. We are looking for a senior web designer, a senior Front End Engineer, and a Senior Backend Engineer. For the senior web designer position, we're looking for someone to give us a strong visual direction and experience in CSS, JS, or React are definitely plusses but not required.
We have an awesome work environment: We are a remote first company. We do continuous integration, continuous deployments, code reviews, code pairings, profit sharing, and most of communication is async via GitHub. We value super strongly transparency, do open books, have a public roadmap, and contribute to the EFF.
Apply at: https://serpapi.com/team
-
The State of Web Scraping 2022: The Good, the Bad, the Ugly
You can do it as a service, but that is highly competitive and basically trading time for money. Best ways are to productize it:
- build a on-demand data api for a specific type of data and charge a premium for it. Good example is https://serpapi.com/ who do Google data, charge ~10X markup on proxy costs
- proxy solutions make good money. To scrape at scale you need proxies, and lots of users pay $1-5k per month. Lots of proxy solutions doing +$100k per month.
- build a tool that uses web scraped data, analyses/filters it and displays it to users. Lots of the biggest web scrapers are doing this, ex. doing product monitoring products for e-commerce companies, etc. Lots of competition there, but you can do it in new markets, like NFTs, etc.
- hedge funds will pay huge money for web data, if you have 5 years of continuous data so they can backtest it.
-
Ask HN: Who is hiring? (October 2021)
SerpApi | https://serpapi.com | Senior Web Engineer | Austin, TX | Full-time | ONSITE or FULLY REMOTE (We're a remote first company) | $150k 1099
SerpApi is the API to scrape and parse search engine results. We deeply support Google, Google Maps, Google Images, Bing, Baidu, and a lot more.
Our current stack is Ruby, Rails, MongoDB, and React.JS. We are looking for a senior web designer, a senior Front End Engineer, and a Senior Backend Engineer. For the senior web designer position, we're looking for someone to give us a strong visual direction and experience in CSS, JS, or React are definitely plusses but not required.
We have an awesome work environment: We are a remote first company. We do continuous integration, continuous deployments, code reviews, code pairings, profit sharing, and most of communication is async via GitHub. We value super strongly transparency, do open books, have a public roadmap, and contribute to the EFF.
Apply at: https://serpapi.com/team
-
How to Crawl the Web with Scrapy
I've had excellent luck with SerpAPI. It's $50 a month for 5,000 searches which has been plenty for my needs at a small SEO/marketing agency.
-
GitHub Issues-only project management
It's what we do at SerpApi (https://serpapi.com)!
Having everything as GitHub issues has several benefits: Everyone knows how to use them, great markdown support including images, ability to react and thumb up issues and comments, deep integration in the actual code - well it's github, and it feels rock solid!
-
Ask HN: Who is hiring? (August 2021)
SerpApi | https://serpapi.com | Senior Web Designer | Austin, TX | Full-time | ONSITE or FULLY REMOTE (We're a emote first company) | $150k 1099
SerpApi is the API to scrape and parse search engine results. We deeply support Google, Google Maps, Google Images, Bing, Baidu, and a lot more.
Our current stack is Ruby, Rails, MongoDB, and React.JS. We are looking for a senior web designer, a senior Front End Engineer, and a Senior Backend Engineer. For the senior web designer position, we're looking for someone to give us a strong visual direction and experience in CSS, JS, or React are definitely plusses but not required.
We have an awesome work environment: We are a remote first company. We do continuous integration, continuous deployments, code reviews, code pairings, profit sharing, and most of communication is async via GitHub. We value super strongly transparency, do open books, have a public roadmap, and contribute to the EFF.
Contact Julien @ julien _AT_ serpapi.com mentioning HN.
-
New search engine made with Python that's anonymous and has no ads or tracking. It tries to fight spam, and gives you control of how you view search results. You can search and read content anonymously with a proxied reader view. The alpha is live and free for anyone to use at lazyweb.ai
I work at https://serpapi.com/. I can hook you up with free credits if you want! (my email is julien _AT_ serpapi.com or ping me here on Reddit.)
headless-chromium-php
-
HTML to PDF package that supports RTL language?
I'm currently using Browsershot in a project and I choose it because, at the time, there wasn't any alternatives. Maybe you can find something in pure PHP now... Maybe this one?
-
Modern PDF library (no html)
I currently use https://github.com/chrome-php/chrome
-
Best way to create a pdfs (Recommend a library)
Headless Chrome with https://github.com/chrome-php/chrome works best for me. All native packages have it's quirks sadly.
-
TCPDF
We also use headless Chrome to generate the PDFs, using https://github.com/chrome-php/chrome and https://github.com/dreadnip/chrome-pdf-bundle
- Best PHP library options for scraping sites with JavaScript - Symfony Panther, Chrome-PHP, Mink, etc.?
-
Snappdf - Super simple & fast way to generate PDFs using Chromium/Chrome
did you consider using https://github.com/chrome-php/headless-chromium-php instead?
What are some alternatives?
Symfony Panther - A browser testing and web crawling library for PHP and Symfony
browsershot - Convert HTML to an image, PDF or string
cloudflare-scrape - A Python module to bypass Cloudflare's anti-bot page.
DiDOM - Simple and fast HTML and XML parser
got-scraping - HTTP client made for scraping based on got.
Invoice Ninja - Invoices, Expenses and Tasks built with Laravel, Flutter and React
snappdf - Convert webpages or HTML into the PDF file using Chromium-powered browsers.
rtila-releases
Bingo Functional - A simple functional programming library for PHP
crawler - Library for Rapid (Web) Crawler and Scraper Development