Markov Decision Process (15 points) Consider the following…
Questions
Mаrkоv Decisiоn Prоcess (15 points) Consider the following grid environment in which (1, 1) is the stаrt stаte, (3, 4) and (2, 4) are the terminal states. Given the reward value for every non-terminal state R(s) = .04, the reward values for the terminal states +1 and −1 respectively and the transition model as illustrated below, calculate the utility values of A, B, and C states up to the second iteration. Assume that the discount factor γ = 0.9 and that the initial utility value of each non-terminal state is zero. Show your calculation to find the updated utility values. Screenshot 2024-11-27 142101.png