Growers, manufacturers and retailers alike are suffering from thin margins, high fixed costs, new sales methods and growing competition from big-box stores.