No, not on gravel. On Rob's eclipse with GAB rally springs, we removed the front sway bar, and used the stock rear sway bar. (On Steve Gingras's advise). I drove the car at LSPR '96, it drove ok..6th OA.
In general, the slicker the road surface, the less roll stiffness you want.