Deer = fence 6' or higher with fishing line around the perimeter of the berm. Look for "deer exclusion fencing ideas."
Berms are great places to raise underground crops.

Look for articles from the UW or UMn extension service on gardening in small spaces, and start small, so it's manageable. Beans,kale, lettuces, squash and root crops are naturally more pest resistant, so few/no chemicals are required. Cabbage heads can be protected from pests by a nylon stocking.