You can get a a state-issued non-driver ID card and not have to pass any test. I gather you can get them at the dmv. It is a good idea to have an ID card which you might need at the bank or in other situations. It will cost something but shouldn't be stressful to get. If it was me I'd give up on the driver's license for all the reasons you mention but get this just to have an official ID if needed. Might that work for you?