header-generator

NodeJs package for generating browser-like headers. (by apify)

Header-generator Alternatives

Similar projects and alternatives to header-generator

  • got-scraping

    HTTP client made for scraping based on got.

  • SurveyJS

    Open-Source JSON Form Builder to Create Dynamic Forms Right in Your App. With SurveyJS form UI libraries, you can build and style forms in a fully-integrated drag & drop form builder, render them in your JS app, and store form submission data in any backend, inc. PHP, ASP.NET Core, and Node.js.

    SurveyJS logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better header-generator alternative or higher similarity.

header-generator reviews and mentions

Posts with mentions or reviews of header-generator. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2021-08-06.
  • Show HN: Web scraping focused HTTP client for Node.js
    2 projects | news.ycombinator.com | 6 Aug 2021
    Hey everyone,

    we built a special-purpose web scraping client for Node.js. When scraping with pure HTTP clients, you want to blend in with the regular traffic as much as you can. This means your request signature needs to look like a browser's.

    With got-scraping, we developed a special purpose header generator(https://github.com/apify/header-generator) that uses a bayesian network and real browser headers to make your headers undistinguishable.

    We also override Node.js ciphers with the browser ones and simplify the use of proxies. HTTP protocol versions are auto-detected for both the target website and the proxy, so you can have a perfect HTTP2 connection even through a HTTP(S) proxy.

    It's always a work in progress, so we would be grateful for any comments or tips how to make the requests even more stealthy!

    Thanks!

Stats

Basic header-generator repo stats
1
58
0.0
over 1 year ago

apify/header-generator is an open source project licensed under Apache License 2.0 which is an OSI approved license.

The primary programming language of header-generator is TypeScript.


Sponsored
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com