RL is it broken, hung or processing?

Course Name: Deep Reinforcement Learning in Trading,

The Final Training on the RL NN indicates 1/1 and simply goes unresponsive, while the processing unit keeps warming up. It is expected to be processor intensive, but without the indication of the state it could be endless loop. Why it has no VERBOSE output so that we can undesrtand if it is hung, working fine and or where it is ?

I have no idea if it is broken or not. 

Hello Antoni, 

Can you please share your system details like processor, RAM, storage available etc.?

The multiple print statements at various stages were not added to avoid flooding of the notebook with logs. 



However, if you wish to have more logs, you can add print statements in the run function available in the quantra_reinforcement_learning.py file in the data_modules folder of the zip file. For example, you can add print statements after adding a state to the memory, after creating a new Q-Table, after updating the NN model with a new Q-Table etc.



I hope this helps!



 

System Model    Aspire A517-52

Processor    11th Gen Intel(R) Core™ i7-1165G7 @ 2.80GHz, 2803 Mhz,

4 Core(s), 8 Logical Processor(s)

Installed Physical Memory (RAM)    16.0 GB

Total Physical Memory    15.8 GB

Available Physical Memory    1.10 GB

Total Virtual Memory    55.8 GB

Available Virtual Memory    30.2 GB

Page File Space    40.0 GB



 

Can you please be more specific as to where should i put print statement, what function in what file? Thanks!

The processing starts well, and comes to Trade 2, and then the notebook starts to become slugish, i let it run, then the entire VCode becomes slagish, eventually (after 3-5 hrs) i can not even stop the process manually but have to call TaskManager, end process. I never got anything written as to new Training/Memory file. But the files from the Corse do work. So i am not able to reproduce anything from the course even with the same parameters, on my local computer. Except visualize and utilize your(courses')  memory file. I appreciate your help. I feel so close to being able to start experimenting by myself, yet system gets hung. Than you!

Hello Antoni,

I see you have already added print statements to debug as guided in other queries of yours. Let's track all your queries in a single thread here for better communication.

Thank you