Markov Decision Process (15 points) Consider the following…

Markov Decision Process (15 points) Consider the following grid environment in which (1, 1) is the start state, (3, 4) and (2, 4) are the terminal states. Given the reward value for every non-terminal state R(s) = .04, the reward values for the terminal states +1 and −1 respectively and the transition model as illustrated below, calculate the utility values of A, B, and C states up to the second iteration. Assume that the discount factor γ = 0.9 and that the initial utility value of each non-terminal state is zero. Show your calculation to find the updated utility values.  Screenshot 2024-11-27 142101.png

You have a population of pillbugs.  You find that some pillb…

You have a population of pillbugs.  You find that some pillbugs in the population display positive phototaxis and some pillbugs in the population display negative phototaxis.  You set up a terrarium with the following features: You place ten positive-phototaxis and 10 negative-phototaxis pillbugs in a terrarium. The terrarium has a large stone that covers half of the aquarium. Otherwise, the terrarium is lit for 24 hours a day, so that the only dark area is under the large stone.  The pillbugs are able to get under the stone. Twenty-four hours after you add the pillbugs to the terrarium, you survey their location in terrarium.  Which of theses statements most likely describes how the pillbugs will be arranged in the terrarium?