I used the Nemesis ship (the one with the shit guns but good boost) for my Veteran run. I kept getting killed at that point with the bullets too. What I did to eventually beat him is boost through the swarm of bullets and the boss himself until you come out the other side. This gives you the chance to blast him for a second or two before he changes the direction of his own shots.
Rinse, repeat, rejoice.