My 70-200mm f4L focuses sharply at all focal lengths and distances. If yours doesn't, something is wrong. It is normal for shots at MFD to be slightly less sharp, but they are still excellent, just not astonishing.
I'd send it back and get a new one for the same money.