What you are describing SOUNDS LIKE in low light it is difficult for the contrast detect part to "lock on" the phase detect is used to "get close" and the contrast detect is fine tuning.

To test get a flash light and after the camera has a problem, add a little light to the spot with a flashlight and see if the focus lock acts more quickly.