Our great sponsors
-
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
If you just want to make a Gym environment, focus on rtgym. You will want to have a way of retrieving observations, say, raw images for instance. You can do this with pywin32 as done here. You will also want to grab a reward signal, which will probably be the most challenging thing to do because you will have to compute that from screenshots since you don't have access to the game internals (in fact you could because the game is opensource, but I assume you don't want to go down this path). If there is something like a score counter that's not moving somewhere, I suggest you capture that and read the numbers individually with the 1-NN algorithm (which is done in the un-supported "trackmania nation forever" versions of the tmrl encironment btw if you need help doing that). Then you will need to input controls. I see that osu is controller by the mouse and keyboard, there are several solutions for that. You can use pywin32 I think, pyautogui, keyboard, and probably others. Once you have these basic building blocks, it will be fairly straightforward to use the rtgym API in order to build you real time Gym environment.