curlconverter
playwright_stealth
Our great sponsors
curlconverter | playwright_stealth | |
---|---|---|
6 | 2 | |
7,128 | 381 | |
1.7% | - | |
7.7 | 3.7 | |
21 days ago | 5 days ago | |
TypeScript | Python | |
MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
curlconverter
-
Convert Curl Commands to Code
Simple way would be to add a “curl” options, looks like you’d just need to write up a method that matches this Request interface [0] to some curl command substrings you mash together.
Problem is of course: the headers and options are all going to be included. You could make it so it organizes them better though, maybe indenting and grouping like-options together so it’s easier to remove stuff.
[0] https://github.com/curlconverter/curlconverter/blob/e4b6fb74...
-
Show HN: OpenAPI DevTools – Chrome ext. that generates an API spec as you browse
I made a fork of the Chrome DevTools that adds exactly this. You can tell Chrome to use a different version of the DevTools if you start it from the command line
https://github.com/curlconverter/curlconverter/issues/64#iss...
- Program that converts a curl call into python code?
-
Ask HN: What companies are embracing “HTML over the wire”?
Someone added a ColdFusion Markup Language generator to https://curlconverter.com/cfml/ last year and after a few months I decided to remove it since I've never heard of it so nobody could possibly be using it, and the next day the guy who added support for it and 3 other people complained about it, so it seems like they're out there.
https://github.com/curlconverter/curlconverter.github.io/pul...
-
I absolutely love web scraping.
Relevant tools: - Browser dev tools and front-end tooling to debug JS and reconstruct requests in your code - grep.app and SourceGraph to check open-source parsers for some URLs (often, there are such repositories) - curlconverter to quickly draft a script from the cURL command - Regex and regex playgrounds to extract data from inline JavaScript - GraphQL introspection tools - Optionally, Fiddler or Wireshark to intercept and debug network requests (I don't use but my teammate does)
-
Convert curl commands to code in several languages
Original author here. Many smart people have contributed code over the years, but one warrants special mention.
About a year ago, verhovsky showed up out of nowhere. He rewrote the core of the application and increased the professionalism across the board. (dedicated domain, github page hosting, UI refresh, privacy improvements, and much more)
The tree-sitter PR is a monster achievement: https://github.com/curlconverter/curlconverter/pull/278
Search for parseAnsiCString in there. I don't think that had ever been implemented in JavaScript before.
For you, verhovsky, 10x engineer might be an understatement. Thank you!
playwright_stealth
-
How to rip PDF's from a protected website?
use a full browser like playwright (or puppeteer), load the "view PDF" page, extract the PDF from there. but its a challenge to hide playwright, see https://github.com/AtuboDad/playwright_stealth etc
-
I absolutely love web scraping.
There is another plugin, https://github.com/AtuboDad/playwright_stealth but I never tried it.
What are some alternatives?
curl-to-php - Convert curl commands to PHP code in your browser
NSwag - The Swagger/OpenAPI toolchain for .NET, ASP.NET Core and TypeScript.
curl-to-go - Convert curl commands to Go code in your browser
insomnia - The open-source, cross-platform API client for GraphQL, REST, WebSockets, SSE and gRPC. With Cloud, Local and Git storage.
rosso - Data parsers and formatters
blog
Commander.js - node.js command-line interfaces made easy
tree-sitter-bash - Bash grammar for tree-sitter
popcat - *pop* *pop* *pop*
openfirmware - Open Firmware (IEE1275-1994) implementation by its inventor.
mvp - 📲 simplest version of the @dwyl app