You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Each Batch runner spun up by FullParallel will attempt to do the full set of return_after_episode_num episodes...then in task_base, it'll just take the first n. This:
a. means more episodes are run than necessary
b. may prioritize faster episodes -- i.e. if one parallel process gets 6 short episodes (e.g. failures), that will return first, and be prioritized over longer runs, biasing the results of the data
(This is why current eval is done sequentially, but it is not optimal.)
The text was updated successfully, but these errors were encountered:
Each Batch runner spun up by FullParallel will attempt to do the full set of return_after_episode_num episodes...then in task_base, it'll just take the first n. This:
a. means more episodes are run than necessary
b. may prioritize faster episodes -- i.e. if one parallel process gets 6 short episodes (e.g. failures), that will return first, and be prioritized over longer runs, biasing the results of the data
(This is why current eval is done sequentially, but it is not optimal.)
The text was updated successfully, but these errors were encountered: