I would agree.....it's probably more the effect of tough conditions with little contrast between the subject and things around it.

I have not had a ton of birds in flight experience with the R5 + RF 100-500mm but in clear conditions I have seen it track birds quite well even if they are very small in the frame.

I don't think your settings are to blame.