Toyota wouldn't have added this feature if it would hurt the vehicle in any way. The only thing it will hurt is your FE a bit if left in this position without a full traction battery, because some regenerative braking (hybrid "free lunch"!) is replaced partially by engine drag.

Pete