Model-based Value Iteration

Value Iteration effectively reducesthe evaluation stage down to a single sweep of the states. Additionally, to improve things further, it combines the Policy Evaluation and Policy Improvement stages into a single update.

References

Policy and Value Iteration. Towards Data Science. Link.