I break it down like this, If you like to shoot wide portrait shots, meaning landscape oriented go with the 35. If you shoot mostly vertical/portrait oriented go 50.
35 vertical gives an odd distorted perspective and you'll feel like you are way too close. 50 will do both, but the landscape portrait at 35 just has a really amazing look when you get the subject right in the frame.

My experience with 50 1.4, I wouldn't recommend it unless you are shooting narrower f/stops. I really dislike that lens when I owned it. If the 50 1.2 is out of budget I'd look into the Sigma. I just really disliked the canon 1.4.