Visit a local farmers market 30 minutes before they close and make deals on produce that is not sold out. Produce from small growers will mostly be "chemical free" instead of "organic". Get to know the farmers and they will help you.
You could either grow your own (recommended), or buy bulk from a farmer's market. The thing about the latter is that farmer's markets are only open for a few months. You'll still need to eat after that, so that's something to consider.
One way is to stop buying organic. All honest (with out an axe to grind) studies have demonstrated there is NONE if any significant difference in health benefit of spending extra for organic. A little chemical useless knowledge. The two most dangerous chemicals are??? H20 as it dissolves more substances than any known other chemical. And O2, oxygen is though to be one of the culprits of aging. O2 is though to cause problem with DNA and RNA by causing cracks and incomplete copies thus causing old age.