I thought the reason behind why he could hit him was because he pulled it back and since accelerator unconsciously deflects it (In the anime they just say adding a - to 23 = -23 / -23 minus - = 23) instead reverses it so that it's pulled towards him.
