I wouldn't worry about it.
I didn't notice the geocaches. I think the rule is dumb, but I don't make the rules.
Geocaches are legal in Wilderness in the GMNF in VT. But in the latest WMNF plan, environmental groups snuck in a lot of stuff that wasn't true when the Wilderness areas were designated. Most Wilderness areas in the WMNF are not that environmentally sensitive and will not be harmed by the minimal additional traffic from geocachers - the Hibbard cache for example had been found by only 15 groups since it was placed in November 2006.
Are you reading between the lines, or did you find those specifics somewhere else?
I'm trying to imagine why the plan was written that way
If you read the FS definition in the Glossary, "geocaching" includes both hiding and hunting caches - which I think agrees with the common definition of the sport
And it is not "geocaches" but "geocaching" that is forbidden in Wilderness so they apparently deliberately included hunting them
Suppose you are in an area where hunting deer isn't allowed, but you have a rifle and are folowing deer tracks so you can shoot it when it leaves the preserve. Will the warden give you a hunting citation or is it OK because you won't shoot it in the preserve?
So if you are heading to a geocache waypoint you might be assumed to be geocaching which is illegal in Wilderness. And many geocachers carry spare containers to replace broken ones or in case they see a good hiding spot - will the ranger assume you mean to use it in Wilderness and issue a citation?
Rules makers are getting wackier all the time. Five years ago, if you had told me that the FS would remove the Wilderness Trail suspension bridge as non-conforming and the NH Trails Bureau would declare it illegal to make a trail map of an area with a recreational easement, I would have said you were nuts.