Taking caffeine pills doesn't really make sense. As far as i know, the problem with coffee is the caffeine, which loosens the sphincter (LES), such that acid can leak into your esophagus. So, I suggest trying to wean off those caffeine pills, and maybe try decaffeinated coffee which has only a small amount of caffeine.