Rationale for updating Value Function multiple times with same observations in spinninup's VPG-GAE implementation

• spinningup

  8 9,696 0.0 Python

  An educational resource to help anyone learn deep reinforcement learning.

  

In OpenAI's spinningup's VPG-GAE implementation , the authors update the value function V(s_t) multiple times at every epoch using the same batch of observations. Copying their code (line 237 onwards in link above):

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project