Blog

17. The post-2008 boom of oil and gas production is mostly due to

We would like to apply jump-point search (JPS) to this grid. Consider the scenario where v1 is being evaluated, with v6 as its parent. Which vertices can be pruned? That is, which vertices vj are such that the cost of v6-v1-vj is greater than or equal to v6-vj (if connected) or v6-vk-vj (for some vk ≄ v1)? Assume there are no obstacles.

The sum of discounted rewards from multiple trials with the same sequence of actions, and starting from the same state in an MDP is guaranteed to be the same every time.

When considering multi-armed bandits, the upper confidence bound on the reward of performing a particular action decreases every time the state is visited and the action is not performed.

Let M be a POMDP with discrete states, actions, and observations, and M’ be the belief MDP derived from M. Then M’ has a finite number of possible policies.

In the first decade of the 17th century, English attention shifted from preying on other nations’ colonial infrastructures to the business of establishing its own overseas colonies. The Caribbean initially provided England’s most important and lucrative colonies.

What is the optimal value function for a two-step horizon with a discount factor of 1 for s32?

What is the optimal value function for a one-step horizon for s24?

The optimal action for a state is independent of the discount factor.

What is the optimal value function for a two-step horizon with a discount factor of 1 for s34?