Blog

Neural Network (10 points) Screenshot 2024-11-27 143404.png

 Which of the following is not a component of a Markov decision process (MDP)?

What is a solution to an MDP problem?

Markov Decision Process (15 points) Consider the following grid environment in which (1, 1) is the start state, (3, 4) and (2, 4) are the terminal states. Given the reward value for every non-terminal state R(s) = .04, the reward values for the terminal states +1 and −1 respectively and the transition model as illustrated below, calculate the utility values of A, B, and C states up to the second iteration. Assume that the discount factor γ = 0.9 and that the initial utility value of each non-terminal state is zero. Show your calculation to find the updated utility values.  Screenshot 2024-11-27 142101.png

Briefly describe how homologous anatomical structures are indicators of evolution.  Your answer should consist of 1 to 3 complete sentences.

You have a population of pillbugs.  You find that some pillbugs in the population display positive phototaxis and some pillbugs in the population display negative phototaxis.  You set up a terrarium with the following features: You place ten positive-phototaxis and 10 negative-phototaxis pillbugs in a terrarium. The terrarium has a large stone that covers half of the aquarium. Otherwise, the terrarium is lit for 24 hours a day, so that the only dark area is under the large stone.  The pillbugs are able to get under the stone. Twenty-four hours after you add the pillbugs to the terrarium, you survey their location in terrarium.  Which of theses statements most likely describes how the pillbugs will be arranged in the terrarium?

Briefly define homologous anatomical structures as they relate to evolution.  Your answer should consist of 1 to 3 complete sentences.

One of the major motives for excuse making is to maintain your positive image.

_____ theory holds that people form relationships on the basis of attraction.

You take the terrarum from the previous question and add several centipedes to the terrarium. The centipedes are display strong negative phototaxis and eat pillbugs. After several generations, you remove 20 pillbugs from the terrarium and test them to determine if they display positive or negative phototaxis.  Assuming that phototaxis in pillbugs is a genetically-controlled behavior, which of these is the most likely result?