flatbush
protoc-gen-validate
Our great sponsors
flatbush | protoc-gen-validate | |
---|---|---|
5 | 6 | |
1,374 | 3,642 | |
- | 1.4% | |
0.0 | 8.0 | |
3 months ago | 8 days ago | |
JavaScript | Go | |
ISC License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
flatbush
-
Databases are the endgame for data-oriented design
> (There are ECS frameworks in JavaScript, which gives you absolutely no control over memory layout and thus completely defeats one of the primary purposes of the pattern.)
While JS does not provide great support for bit packing complex structs, typed arrays give you quite a bit of control over memory layout for simple numeric types, which is what you usually want for optimal data-oriented code anyway. This is a common technique used in fast JS libs for data visualization, ie:
https://github.com/mourner/flatbush
There are also basic operators required for bitarrays, which are useful for ECS and memory-efficient code generally.
-
React Virtualisation from scratch
using flatbush library instead of rbush which optimise the statically placed element, from the benchmark in the repository it could boost up to 5x the performance of rbush.
-
Load GeoHash data in RAM for querying for Proximity Searches
But for 500 k points, it's not many. I'd put it in the database tech I was using and hit an API for it. Or like you say, load it into memory and use Mourner's flatbush for a super simple and super fast solution..
- Flatbush: A fast static spatial index for 2D points and rectangles in JavaScript
-
Protobuf-ES: The Protocol Buffers TypeScript/JavaScript runtime we all deserve
> At pbf speeds, decoding is usually no longer a bottleneck, but bandwidth might be when comparing with gzipped JSON.
we were streaming a few hundred datapoints in a dozen flat arrays over websocket at 20-40hz and needed to decode the payload eagerly. plain JSON was a multi-factor speedup over pbf for this case. but it's fully possible i was holding it wrong, too!
even if your "bottleneck" is rendering/rasterization (10ms), but your data pipe takes 5ms instead of 1ms, it's a real effect on framerate, battery, thermals, etc.
i'm a big fan of your work! while i have you here, would you mind reviewing this sometime soon? ;)
https://github.com/mourner/flatbush/pull/44
protoc-gen-validate
- Protobuf Schema Validation
-
Protobuf-ES: The Protocol Buffers TypeScript/JavaScript runtime we all deserve
My understanding is that the powers that be within Google have decided that validating messages is outside the scope of schemas and serialization. protoc-gen-validate provides a portable way to perform validation: https://github.com/bufbuild/protoc-gen-validate
The problem with required fields is it kicks the can down the road when you want to deprecate a field. Keeping everything optional is much, much better for everyone in the long run.
-
Why isn't gRPC used more for browser to api transport over REST / graphql?
I built a (go) very rough draft to support 3.1 + a json pointer pkg to support a refactor that was in progress before I bailed on the idea. The amount of effort to get a conventional API was dwarfing that of grpc, especially with protoc-gen-validate.
- Protoc-Gen-Validate (PGV)
-
is there any package to generate validation code for struct instead of using reflect (tags)?
Yes, I am currently using this. I prefer something like this https://github.com/envoyproxy/protoc-gen-validate
-
sneak peak: code generation extensions to prost (protobuf code generator)
We've been using Rust with protobuf, but had to write lots of conversions from protobuf struct to actual DTO, since prost generates Options for nested types, and does not really support custom types. So I extended prost with the options that we needed. I might aim to also support protoc-gen-validate.
What are some alternatives?
virtualised-whiteboard
buf - The best way of working with Protocol Buffers.
liwords - A site that allows people to play a crossword board game against each other
prototool - Your Swiss Army Knife for Protocol Buffers
react-virtualized - React components for efficiently rendering large lists and tabular data
prost - PROST! a Protocol Buffers implementation for the Rust Language
ts-proto - An idiomatic protobuf generator for TypeScript
ozzo-validation - An idiomatic Go (golang) validation package. Supports configurable and extensible validation rules (validators) using normal language constructs instead of error-prone struct tags.
rbush - RBush — a high-performance JavaScript R-tree-based 2D spatial index for points and rectangles
grpc-web - gRPC Web implementation for Golang and TypeScript
pbf - A low-level, lightweight protocol buffers implementation in JavaScript.
protolock - Protocol Buffer companion tool. Track your .proto files and prevent changes to messages and services which impact API compatibility.