I don't know the reasoning for you not wanting the caffeine. And not sure even if I did know that I could tell you anything else. In the case of my wife and I we never particularly tried to quit caffeine. We still have coffee and iced and hot tea. But neither of us were particularly hooked on it either. We had modest amounts and never saw it as a problem. There was one month we basically did without it to see if it would change/help our stomachs somehow. We didn't see any difference so now as I speak am having a cup of coffee. But it is only a double cup in the morning then that is it. 

If it has to do with gerd or acid reflux that is something that my wife and I have never had, so not much help there. But as far as weight loss I don't think it is any significant part of the problem. If cutting it out (or even cutting it down) is for other health reasons I have no experience there.