Fast talkers are always a problem for people with hearing loss. Often, our grandkids are among them. It's so important to be upfront about your hearing loss. Say something like "I don't hear as well as I used to, please slow down a bit. because I want to hear you."
You are not 'deaf', but you need help if you want fluid communication. People tend to think that hearing aids bring back 20/20 hearing like eye glasses do for vision. They don't, they are 'aids' that help. Be willing to explain that. You know that background noise is a major culprit in distorting what those of us with hearing loss can understand. Try to arrange visits with others in quiet settings. Not always easy, but it helps a ton. People tend to appreciate it when we are upfront and honest.
Your church might consider installing a system. I'd be willing to bet there are other people in your small congregation who could benefit too. It's a matter of 'coming out' to share your needs. If you do that, others probably will too.
What a wonderful gift it would be to your church to start a fund to pay for an assistive listening system. An FM system would cost a few thousand dollars and would incude 2-4 receivers. (In my church, people purchased their own receivers after finding out how well they worked.) FM may not be the preferred system by everyone, but it works. If your hearing aids have telecoils, you can purchase a personal neckloop ($50 estimate) that works with your hearing aids to plug into the FM receivers. If no telecoils, it may mean wearing a headset provided with the FM receivers. You can purchase those too if you want your own.
To get the kind of accommodations hard of hearing people need, nearly always means you have to be open about your hearing loss rather than hiding it.
Are you willing to educate others while advocating for yourself?