It is not that they think there is a benefit, IMO drivers simply don't care. You are in their way. The road is made for cars and as such you are merely getting in the way of the real traffic. And real traffic is dangerous and if you have a problem with that get off the road.
The amount of times I have had friends complain to me about being held up by cyclists (I am one so therefore am the spokesman for them all apparently!) but when I ask them why they don't rage about being held up by other traffic, traffic lights, having to wait because of parked cars on skinny roads they simply say that that is part of traffic.