wrk VS Arraymancer

> My initial requirement was to send requests with unique parameters. To the best of my knowledge, no tool could do this.

wrk does this with lua. https://github.com/wg/wrk/blob/master/src/wrk.lua

Also even things like the venerable jmeter supported pulling parameters from a csv file.

We used wrk2, a fantastic tool to generate stable load on the server. Wrk2 improves on wrk and adds the ability to generate sustained load at a specific rate (-R parameter).

I am using a tool called wrk to make a bunch of requests to my website, and changing the concurrency of the requests drastically changes the result, with concurrency set to 1, I get 894 requests made in 10 seconds, and when I set concurrency to 10, I get 8549 requests. This linear scaling stops when increasing the concurrency more drastically (18805 requests for 100 and 19814 for 500 concurrency).

Im creating multithreaded async http server for learning purposes and i'm facing problem when benchmarking with wrk. I get socket read errors on every connection:

We use locust at work but I HIGHLY recommend wrk for a very robust yet simple load testing tool.

https://github.com/wg/wrk

And of course, this talk by Gil Tene is fantastic if you're interested in load testing stats https://www.youtube.com/watch?v=lJ8ydIuPFeU

Good morning what tool do you use to test your infra in terms of http load ? A tool that works, I tested : - https://github.com/tsenart/vegeta but it returns 0 errors or a http_net error from Golang - LOIC (Low Orbit Ion Canon) https://github.com/NewEraCracker/LOIC but the requests do not appear in my nginx logs and I feel no slowdown - Apache Jmeter https://jmeter.apache.org/ but I can't drop my infra and I have Java socket closed errors - K6 https://k6.io/ but I can't bring down my infra with - wrk https://github.com/wg/wrk no matter what parameter I put it doesn't make enough requests per second, I put the same parameters as on a tutorial and I don't get the same result...

You could try to just blast it with wrk or bombardier. Can easily get around 50k requests on consumer machine.

Sure, first I did the load testing on the same machine. The same machine ran web servers, php-fpm and ab / wrk programs.

There are http benchmarking tools like wrk [0]. You don't need a ddos service for that.

[0] https://github.com/wg/wrk

It is a small DSL written using macros at https://github.com/mratsim/Arraymancer/blob/master/src/array....

Nim has pretty great meta-programming capabilities and arraymancer employs some cool features like emitting cuda-kernels on the fly using standard templates depending on backend !

Nim has also a powerful deep learning library called Arraymancer. It's selling point is that you don't have to rewrite your code from research to production. It's used in various machine learning projects, but one recent one that caught my eye was https://github.com/amkrajewski/nimCSO "Composition Space Optimization"

https://github.com/mratsim/Arraymancer

- https://github.com/mratsim/Arraymancer/blob/master/src/array...

It's worth noting that nim async/await transformation is fully implemented as a library in macros.

https://github.com/mratsim/Arraymancer 11. « Premature optimisation is the root of all evil », Donald Knuth, The art of computer Programming It would be quite useful that someone writes one with examples for all these recommendations and more ...

In particular for deep learning as bobsyourunkl already mentioned there is arraymancer on the one hand and also flambeau on the other. The latter is a Nim wrapper around libtorch (i.e. the PyTorch C++ backend). It is missing things (to be wrapped by adding a few lines) and has some rough edges, but if one needs to get stuff done, it's possible.

how are u compiling (optimization, custom compilation flags etc.?) In my case https://github.com/mratsim/Arraymancer big project compile under your 4.2s so or you have like 10k+ lines of codes with macros or you just pass some debug flags to compiler :D

We have both raw wrappers for BLAS:

https://github.com/andreaferretti/nimblas

as well as LAPACK:

https://github.com/andreaferretti/nimlapack

For an example, consider calling the least squares routine `dgelsd` in arraymancer:

https://github.com/mratsim/Arraymancer/blob/master/src/array...

wrapped up in a nicer user facing API.

Feel free to hop onto matrix, if you have more questions!