stabilizer bar

after a hard knock, out driveshaft is now rubbing on the stabilizer bar ball joint and wondering if taking it off will have a noticible effect. anyone else running the x2 without it?