I believe you’re referring to the infamous ‘flower power’ experience exploit during the dark ages?
It was actually rather hilarious at the time, finding people deep in their basements, heads down, deep in concentration, whacking flowers…
I think the solution to this is simple. Award large amounts of experience for harvesting fully grown crops. That will skirt around the idle exploit, while also providing valuable experience for people who prefer the farming lifestyle.