There is an old answer of exercise 4.1 in this file: http://fumblog.um.ac.ir/gallery/839/weatherwax_sutton_solutions_manual.pdf qπ (11, down) =0 Are you sure of the answer -1 of exercise 4.1?