Yes, bad Pokey. (Test mode may confirm that for you, but it's a common behavior when the random number generator in the Pokey dies.)
You can also try swapping them, and seeing how the behavior changes (both in and out of test mode). But if you have Atari boards, you should always have at least one spare Pokey handy.