Nate,
You'll be trading a stop of background blur, a stop of shutter speed, and a bit of AF precision in exchange for gaining back some cash, lighter weight, and IS.
Only you know whether that's a good trade-off for your subjects and style. I imagine the 24-70 won't be good for BIF.