In this fourth and last part, we go even deeper into model, exploring how the agents are created and how the algorithms make it all work. We focus on the actual Bellman equation and how it creates the actual learning effect.

Also, I now published the model source files below so you can download the core model and examine it yourself. Please note that all rights are reserved, so do not use this without my permission on anything but learning :-)

The video

The model

The model files

You can download the actual model below. You will need AnyLogic to open it, obviously.