hashtable-benchmarks VS awayto

Since the blog post mentioned a PR to replace linear probing with Robin Hood, I just wanted to mention that I found bidirectional linear probing to outperform Robin Hood across the board in my Java integer set benchmarks:

https://github.com/senderista/hashtable-benchmarks/blob/mast...

https://github.com/senderista/hashtable-benchmarks/wiki/64-b...

https://homes.cs.washington.edu/~magda/papers/wang-cidr17.pd...

I'm most interested in developing high-performance database engines in low-level languages, but open to any challenging systems programming project. I've been working in C++ for the last 3 years, but have written nontrivial projects in Rust and Java as well (e.g., https://github.com/senderista/rotated-array-set, https://github.com/senderista/hashtable-benchmarks). I would enjoy using Rust or Zig on a new project, but I consider the project itself to be much more important than the language it's written in. I am not interested in cryptocurrency, adtech, or fintech projects.

Thanks for the details on your benchmarks. I would like sometime to extend BLP to a more generic setting; as I said I think any trick used with RH would also work with BLP. I just used an integer set because that's all I needed for my use case and it was easy to implement several different approaches for benchmarking. As you note, it favors use cases where the hash function is cheap (or invertible) and elements are cheap to move around.

About your question on load factors: no, the benchmarks are measuring exactly what they claim to be. The hash table constructor divides max data size by load factor to get the table size (https://github.com/senderista/hashtable-benchmarks/blob/mast...), and the benchmark code instantiates each hash table for exactly the measured data set size and load factor (https://github.com/senderista/hashtable-benchmarks/blob/mast...).

I can't explain the peaks around 1M in many of the plots; I didn't investigate them at the time and I don't have time now. It could be a JVM artifact, but I did try to use JMH "best practices", and there's no dynamic memory allocation or GC happening during the benchmark at all. It would be interesting to port these tables to Rust and repeat the measurements with Criterion. For more informative graphs I might try a log-linear approach: divide the intervals between the logarithmically spaced data sizes into a fixed number of subintervals (say 4).

I think "bidirectional linear probing" is an underrated approach (and much simpler): https://github.com/senderista/hashtable-benchmarks/blob/master/src/main/java/set/int64/BLPLongHashSet.java

I will probably never get around to porting my bidirectional linear probing integer hash set from Java to C++, but I hope someone can try adapting BLP to general C++ hashmaps and hashsets, because it significantly outperforms Robin Hood in my benchmarks.

https://homes.cs.washington.edu/~magda/papers/wang-cidr17.pd...

I'm most interested in developing high-performance database engines in low-level languages, but open to any challenging systems programming project. I've been working in C++ for the last 2 years, but have written nontrivial projects in Rust and Java as well (e.g., https://github.com/senderista/rotated-array-set, https://github.com/senderista/hashtable-benchmarks). I would enjoy using Rust or Zig on a new project, but I consider the project itself to be much more important than the language it's written in. I am not interested in cryptocurrency, adtech, or fintech projects.

Hey folks, just putting this up as a demo link for people to try out. It's a project I've been working on since January and in light of recent framework posts lately I figured I'd start talking about my own.

The link is a demo site of Awayto v2 [1] (ignore the front page info that's all from version 1). Awayto [0] started out as a quick deploy app which grew to exist via AWS. I felt the need to make something that wasn't so closely tied to cloud infra, and Awayto v2 is that. Currently deployed on hetzner vms, using Tailscale for networking, there is a great deal of things going on. There is a local installation path planned, as long as you provide your own servers, etc, as it all just works on Tailscale anyway. I'm still working on docs, but the goal is to spit out _everything_ a dev might want to control in their stack. My current version of deploying to hetzner sets up 7 servers (2 ns, exit, build, app, db, svc). Git profile [2] for more info, tech stack info.

This is just a short demo and will only be up a limited time. There's no email validation or anything, gibberish is welcome. You are not being tracked. I know I need how-to docs, video assists, and all that. Slow and steady. It's being hosted from a single warehouse in the Pacific Northwest, be kind. Caching is in play and not perfectly tuned so maybe wait a few minutes if something doesn't automatically show up. Any feedback is awesome. Cheers!

[0] https://github.com/keybittech/awayto

This is really cool to see in this format. Over the last few years I have spent my free time crafting a framework under similar ideologies. I think a lot of web devs end up making similar tools throughout their career, but perhaps never get to the point of sharing what they make. I finally formalized my framework last year and am well into battle testing it with clients and different projects. https://awayto.dev

In a similar light to what this FWA group is presenting, I also have put forth some points about why this style of web dev architecture is important and effective. https://awayto.blog/posts/webapps/

Actually, I started out reading Million Dollar Consulting last year and one of the first chapters essentially talks about the importance of having a portfolio of work, and being able to capitalize off that body of knowledge within to grow more as a consultant. Well, I took that as a sign to formalize a framework that would allow me to do my development work in a much more effective manner, as well as provide more out of the box functionality for my clients.

Overall, the experience has been really positive. Obviously I don't get to use my own framework with every client, and that's a good thing. But, when working with clients who need basic business problems solved, having an FWA style framework is going to allow you to iterate so much faster than traditional MVC platforms. At least this has been my experience. Specifically to that point, with templated and loosely coupled parts, you don't have to spend too long building your web app to get it to do something exceptional.

Location: Pacific Northwest

Remote: Yes

Willing to relocate: For Contract or Consulting Only

Technologies: Java, C#, Javascript, Typescript, HTML, CSS, React, Redux, Material UI, NodeJS, Webpack, Postgres, Cognito, Lambda, CloudFormation, CloudFront, S3, API Gateway, HITRUST, FERPA

Résumé/CV: https://www.linkedin.com/in/joe-mccormick-76224429/

Email: [email protected]

My name is Joe. If you are looking for a consulting- or contract-based resource, I am interested and open to take on projects of many varieties. Over the last 10 years, my professional experience has touched on Education, Professional Consulting, IT Management, E-Commerce, and I hold my MA in English teaching. I have helmed numerous, extremely successful software development teams within the companies I have worked at, on projects of large complexity, some with millions of users and in revenue.

Check out https://awayto.dev which is a free open source web application platform. It uses React, Redux, Material UI, NodeJS, Typescript, Webpack, Postgres, Cognito, Lambda, CloudFormation, CloudFront, S3, API Gateway, as well as my own custom scripts. Awayto makes it fast to deploy low-cost web applications and then have a skilled developer come in and build up your application.

Thank you for your time.

SEEKING WORK - Pacific Northwest - Contract/Consulting Remote/Onsite

If you are looking for a consulting- or contract-based resource, I am interested and open to take on projects of many varieties. Over the last 10 years, my professional experience has touched on Education, Professional Consulting, IT Management, E-Commerce, and I hold my MA in English teaching. I have led multiple successful development teams within the companies I have worked at, on projects of large complexity, some with millions of users and in revenue.

For my most recent completed work, I created https://awayto.dev, a free open source web application generation platform. It uses React, Redux, Material UI, NodeJS, Typescript, Webpack, Postgres, AWS Cognito, Lambda, CloudFormation, CloudFront, S3, API Gateway, as well as my own custom scripts. Awayto makes it fast to deploy low-cost web applications and then have a skilled developer come in and build up your application. https://github.com/keybittech/awayto

Thank you for your time.

Javascript, Typescript, Java, C#, HTML, CSS, HITRUST, FERPA

Inquiries: [email protected] Website: https://awayto.dev LinkedIn: https://www.linkedin.com/in/joe-mccormick-76224429/

Willing to relocate: For Contract or Consulting Only

Technologies: Java, C#, Javascript, Typescript, HTML, CSS, React, Redux, Material UI, NodeJS, Webpack, Postgres, Cognito, Lambda, CloudFormation, CloudFront, S3, API Gateway, HITRUST, FERPA

Résumé/CV: https://www.linkedin.com/in/joe-mccormick-76224429/

Email: [email protected]

If you are looking for a consulting- or contract-based resource, I am interested and open to take on projects of many varieties. Over the last 10 years, my professional experience has touched on Education, Professional Consulting, IT Management, E-Commerce, and I hold my MA in English teaching. I have led multiple successful development teams within the companies I have worked at, on projects of large complexity, some with millions of users and in revenue.

For my most recent completed work, I created https://awayto.dev, a free open source web application generation platform. It uses React, Redux, Material UI, NodeJS, Typescript, Webpack, Postgres, AWS Cognito, Lambda, CloudFormation, CloudFront, S3, API Gateway, as well as my own custom scripts. Awayto makes it fast to deploy low-cost web applications and then have a skilled developer come in and build up your application. https://github.com/keybittech/awayto

Thank you for your time.

I made a web application generation tool built on top of AWS. It deploys all the basics you need for a web application in the modern era (db, ui, api, users, groups, roles).

https://awayto.dev -- Check out the video

https://github.com/keybittech/awayto

If you like making tools for developers, contractors, and the business world. Come check us out and join the discord!

Hey there, I work on a project called Awayto. It generates and deploys web applications to AWS with all the base line bells and whistles (db, api, ui, user mgmt, react, typescript). I enjoy working on tools for developers and this is a project that's supposed to help developer consultants. It's a full stack framework, and there are of course many ways you could help or be involved, so if it sounds interesting please check it out!

https://github.com/keybittech/awayto

https://awayto.dev

A lot of the comments here are about difficulty cloud tech navigation/adoption. I create a framework built on top of AWS to try to alleviate a great deal of the infra management aspects of running web applications. It sets you up with all the basics out of the box in about 10 minutes (db, api, ui, users, groups, roles).

https://awayto.dev

https://github.com/keybittech/awayto

Along the same vein as other posts in this thread, startups and contractors need instantaneous test bed environments that support a lot out of the gate, and which can be the basis to scale from. I've been a contractor off and on for a few years and have seen this need first hand. So my tool is meant to fill in the foundations of great ideas, so those ideas can grow faster. I think that's an essential trait of cloud services that you will be hard-pressed to find elsewhere.

SEEKING WORK - Pacific Northwest - Contract/Consulting Remote/Onsite

If you are looking for a consulting- or contract-based resource, I am interested and open to take on projects of many varieties. Over the last 10 years, my professional experience has touched on Education, Professional Consulting, IT Management, E-Commerce, and I hold my MA in English teaching. I have led multiple successful development teams within the companies I have worked at, on projects of large complexity, some with millions of users and in revenue.

As a side project, I created https://awayto.dev, a free open source web application generation platform. It uses React, Redux, Material UI, NodeJS, Typescript, Webpack, Postgres, AWS Cognito, Lambda, CloudFormation, CloudFront, S3, API Gateway, as well as my own custom scripts. Awayto makes it fast to deploy low-cost web applications and then have a skilled developer come in and build up your application.

Thank you for your time.

Java, C#, Javascript, Typescript, HTML, CSS, PHP, Ruby, Python, HITRUST, FERPA

Inquiries: [email protected]

Remote: Yes

Willing to relocate: For Contract or Consulting Only

Technologies: Java, C#, Javascript, Typescript, HTML, CSS, React, Redux, Material UI, NodeJS, Webpack, Postgres, Cognito, Lambda, CloudFormation, CloudFront, S3, API Gateway, HITRUST, FERPA

Résumé/CV: https://www.linkedin.com/in/joe-mccormick-76224429/

Email: [email protected]

If you are looking for a consulting- or contract-based resource, I am interested and open to take on projects of many varieties. Over the last 10 years, my professional experience has touched on Education, Professional Consulting, IT Management, E-Commerce, and I hold my MA in English teaching. I have led multiple successful development teams within the companies I have worked at, on projects of large complexity, some with millions of users and in revenue.

As a side project, I created https://awayto.dev, a free open source web application generation platform. It uses React, Redux, Material UI, NodeJS, Typescript, Webpack, Postgres, AWS Cognito, Lambda, CloudFormation, CloudFront, S3, API Gateway, as well as my own custom scripts. Awayto makes it fast to deploy low-cost web applications and then have a skilled developer come in and build up your application.

Thank you for your time.