I'm with @tillymack: if you can avoid torturing yourself, then do it! Unless your nutritional needs are so stringent that you have to track everything, you probably have a good idea of what to eat and what not to eat. Maybe try building a habit of fat-free* milk/yogurt/kefir at certain times of day so that you have regular amounts of calcium that you can count on as your base. Remember that one goal is to get enough calcium, not to get as much as you can, but another important goal is to stay sane. Good luck and good cheer!

*I say fat-free because in my case I did almost exactly what you did with sodium, but with cholesterol. After my osteoporosis diagnosis I went overboard on cheese and ended up high cholesterol for the first time in my life, but it was corrected when I switched to skim milk based dairy.