Optimal and Near-optimal Policies of Sequential Decision Problems under Uncertainty