1. Consider the 101×3 world shown in Figure 1. In the start state the agent has a choice of two deterministic actions, Up or Down, but in the other states the agent has one deterministic actions, Right. Assuming a discounted reward function.
1. Compute the utility of each action as a function of γ.
setting the equations to solve for γ.
2. Draw the utility of each action for the range 0 ≤ γ < 1 using Matlab or your familiar numerical analysis software.
1. For , which action is recommended? Why?
We should go up. The utility is larger.
2. Consider the following data set comprised of three binary input attributes (A1,A2 and A3) and one binary output:
1. Compute Gain(A1).
.
2. Compute Gain(A2).
3. Compute Gain(A3).
3. Conider the XOR function of three binary input attributes (A1,A2 and A3). Which produces the value 1 if and only if an odd number of the three input attributes has value 1.Draw a minimalsized decision tree for the three-input XOR function.
CECS
