Hi, I faced the same issue. I checked every data that I send to the framework. Such as the reward, observations. It seems that I was sending Nans values. I recommend to verify that all your data are valid during the SetReward and SetObservations. I suspect that the python crash behind that cause a timeout during processing the replay buffer.