Speaking from experience, I have a 2004 HCH with a hitch mounted rack, the impact on FE in town is minimal. When you get on the open road it is a different matter all together. I was hauling a "hybrid" bike, which is a little larger than a road bike, but the FE went down at least 1 MPG over a course where I normally stay the same or improve slightly.

Billy