@gamesjr I don't know anything about Oxazepam so I just googled it. It seems to be primarily for "Oxazepam is used to treat anxiety and also acute alcohol withdrawal". I do take an occasional lorazepam. Part of the description for that includes "Taken at night, benzodiazepines can lead to next-day drowsiness and sedation. ... In practice, many of the benzodiazepines used for treating anxiety — such as lorazepam (Ativan) and alprazolam (Xanax) — are also used to induce sleep."
I take a very small dose of it and that seems to be adequate to help me sleep when I am anxious about something, and with a small dosage, I do not feel effects the next day. It sounds as if the dosage of your Oxazepam might be able to be decreased. You should speak to your doctor about that, and assuming it is not a capsule you can get a pill splitter and take half a pill.
I hope this helps you. Let us know if you do cut back and if that solves the problem.
JK