web-codecs
webrtc-for-the-curious
Our great sponsors
web-codecs | webrtc-for-the-curious | |
---|---|---|
14 | 13 | |
904 | 1,879 | |
2.2% | 1.0% | |
8.3 | 5.2 | |
8 days ago | 6 months ago | |
HTML | Python | |
GNU General Public License v3.0 or later | Creative Commons Zero v1.0 Universal |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
web-codecs
-
Replacing WebRTC: real-time latency with WebTransport and WebCodecs
Encoding alpha, please! https://github.com/w3c/webcodecs/issues/672
-
Real-Time Video Processing with WebCodecs and Streams
From developer.mozilla.org [0]
> WebCodecs API
> The WebCodecs API gives web developers low-level access to the individual frames of a video stream and chunks of audio. It is useful for web applications that require full control over the way media is processed. For example, video or audio editors, and video conferencing.
And from w3c [1]:
> The WebCodecs API allows web applications to encode and decode audio and video
All this looks really promising, I wouldn't have thought that we could use browsers directly to render videos. Maybe Puppeteer could then stream the content of the page it is rendering, for example a three.js animation.
[0] https://developer.mozilla.org/en-US/docs/Web/API/WebCodecs_A...
[1] https://github.com/w3c/webcodecs
-
Microsoft Clipchamp
As I understand it, Web Codecs is quite a ways away from being a web standard - it is currently just a draft[1] for a recommendation for a possible future standard.
Just beware of any major API changes or any indication that it might be dropped in its entirety!
[1]:https://w3c.github.io/webcodecs/
-
Chrome 94 Beta: WebCodecs, WebGPU, Scheduling, and More
WebCodecs has Mozilla and Microsoft coauthors: https://w3c.github.io/webcodecs/
WebGPU was chartered in 2017, with more Apple people in the initial membership than Mozilla or Google people: https://gpuweb.github.io/admin/cg-charter.html
Google specifically has approached Apple for input about scheduler.postTask(), and they say they've presented the proposal before at a working group that Apple is part of: https://lists.webkit.org/pipermail/webkit-dev/2021-June/0319...
I won't disagree that there's a ton that can be improved about the process, but it seems pretty unsubstantiated to claim that Google is "rushing forwards as fast as possible" given that they've been spending years working on these APIs in public. You can see from the rest of the post that they're running some experiments which they're specifically choosing not to enable by default, though they could.
-
Show HN: I made a meme creator that makes around $4k a month
I work for PaperlessPost.com, and for our Flyer product we export mp4s from ffmpeg compiled to WASM, which is similar to ffmpeg.js but optimized for our use case which sounds similar. We have this WebAssembly method working well but iOS 15 (and the other major browsers) now support MediaExporter which might be a better way to go if you have something else to convert these files. This becomes and issue because you can't control the format MediaRecorder is recording to but the management of memory, the image quality, the compression, the performance hit will be more ideal than these other methods. OMGgif is very slow and will produce large files or very bad looking ones. Keep in mind that GIFs limit the colors so something that looks nice on the screen might not look the same after it is saved. The other thing to look out for is the WebCodecs APIs which should be the ultimate way to handle all of this in the future but it is only working in Chrome I think https://github.com/w3c/webcodecs
-
Loading Audio in Node JS
While in theory it might be possible to run ffmpeg through emscripten and run it in a web worker (I certainly assume someone has done this), it's not necessarily practical to try and use the same technique from node to transcode audio on the web. The good news is that the w3c has chartered a working group to focus on web codecs. While this is at the time of writing still in early stages, the working group is powering ahead on designing and proposing an API to enable media transcoding on the web, and hopefully that will become available to us in the near future.
- WebCodecs
- What's the deal with the WebCodecs and InsertableStreams APIs?
- WebCodecs is a flexible web API for encoding and decoding audio and video
webrtc-for-the-curious
-
Dive into Web RTC or write SFU on your own
Here I will briefly go over the basics of how Web RTC works; for those who are interested in going a little deeper, I’ll leave the link here. In order for two peers to be able to provide themselves with RTCPeerConnection, the SDP (Session Description Protocol) protocol is used. The protocol has a key-value structure and is essentially a description of a single peer (the name speaks for itself).
- WebRTC for the Curious
- Show HN: Bring phone calls into the browser (sip-to-WebRTC)
-
Ask HN: What side projects landed you a job?
I have worked four jobs related to https://github.com/pion/webrtc and one for https://webrtcforthecurious.com
Two companies used Pion. The other two were just using the protocol (WebRTC)
-
Replacing WebRTC: real-time latency with WebTransport and WebCodecs
For the WebRTC jargon check out https://webrtcforthecurious.com/
If that still doesn’t cover enough I would love to hear! Always trying to make it better.
-
OBS Merges WebRTC Support
It is pretty easy to get a one way trip time for packets that is sub-second! You see it with conferencing and other real-time communication things.
If you are curious on the 'how' of WebRTC I wrote a Free/Open Source book that goes into the details https://webrtcforthecurious.com/. Happy to answer any particular questions you have.
-
Help: I'm facing an issue developing a webrtc app
Read this thoroughly: https://webrtcforthecurious.com
What are some alternatives?
web-bugs - A place to report bugs on websites.
broadcast-box - A broadcast, in a box.
moq-js - Typescript library for Media over QUIC
ws-tcp-proxy - Simple websocket tcp proxy.
webrtc-rtptransport - Repository for the RTPTransport specification of the WebRTC Working Group
offline-browser-communication - Demonstration of a browser connecting to Pion WebRTC without a signaling server.
meyda - Audio feature extraction for JavaScript.
standards-positions
direct-sockets - Direct Sockets API for the web platform
WebKit - Home of the WebKit project, the browser engine used by Safari, Mail, App Store and many other applications on macOS, iOS and Linux.
ebook-diffuser - An end to end, customizable, ebook automation tool