It's hard to tell from the pic, but it looks like you have line tied to one of the sockets? Depending on the type of ballast that could be the issue....some have both line and nutral go to the ballast, others have one to the ballast, one to a socket, still others to the starter...there should be a wiring diagram with the ballast.
Also, is that the right bulb for that ballast? Looks like a T8 from the pic....if that ballast is for T12s, that's not gonna work.
In any case, you would save yourself some headache by switching over to an electronic ballast and be done with the starter BS. Electronic ballast + T8 bulb = fast start, no hum, less heat, less power consumption, longer life...