I suspect that the hover mechanism could do a fair bit of the work; but I posited additional elements because it would be a bit of a downer if the hover mechanism were tuned too far in the direction of being a good thruster/steering element, since you'd be walking a potentially touchy compromise between being capable of aggressive maneuvers and being inherently stable, rather than liable to assist you in tipping over even faster and harder that gravity would cover if you leaned too far out of the equilibrium position.
Just for the sake of consumer safety and not reducing bystanders to hamburger too often, the preferred arrangement would probably be some sort of
EDF/Vectored thrust arrangement: all the advantages of a standard electric propeller (ambient-temp exhaust, none of the noise and fuel-line hassle associated with teeny internal combustion engines, runs on normal batteries rather than some sort of hobby fuel); but no exposed blades to do surprising amounts of damage upon somebody's first mistake.
You'd have to avoid going too deep into propeller-beanie-chic zones of absurdity; but if you could get the actually-hovering bit worked out, I suspect people would overlook that for the chance to zoom around at dubiously sensible speeds.