ThreadPool VS CTPL

And in C++ can also use this dead-simple header file for a nice high-level, modern threadpool using function objects (lambdas) for very easy parallelization of arbitrary tasks: https://github.com/progschj/ThreadPool

Depending on how sophisticated you are with C++ you might want to try to impress him by using multithreading. I like this simple library. It's only like a 100 lines of code in a single header, and it is very simple to use.

#!/usr/bin/env bash if [ ! -d kenlm ]; then git clone https://github.com/kpu/kenlm.git echo -e "\n" fi if [ ! -d openfst-1.6.3 ]; then echo "Download and extract openfst ..." wget http://www.openfst.org/twiki/pub/FST/FstDownload/openfst-1.6.3.tar.gz tar -xzvf openfst-1.6.3.tar.gz echo -e "\n" fi if [ ! -d ThreadPool ]; then git clone https://github.com/progschj/ThreadPool.git echo -e "\n" fi echo "Install decoders ..." python setup.py install --num_processes 4

For point 2, just use this if you're lazy: https://github.com/progschj/ThreadPool

You’re spawning a new set of threads every frame. This can be extremely expensive, instead you want to reuse threads in a pool. Seeing as you’re new to C++, I wouldn’t recommend writing it yourself but instead use something like ctpl. Others, like Boost, should work fine as well.