Unless you just really need to take it off I'd just leave it. I asked this same question when I put on my lift and one guy said he took it off and didn't notice a difference, and he didn't have a lift. I took it off when I put on 6" and couldn't really tell you because obviously there are other factors in my case, but I haven't flipped it yet and I have swirved big time to miss idiots, so I guess it's not that important.
It's a Jeep thing? My Bronco thing will run over your little Jeep thing.