Don't feel like a leper Jeff, your taking advantage of a fishery being ignored by many. Most LM Bass and sunfish in the northeast rarely if ever see a fly, making them fairly easy to catch. They typically are what I target when the jones is getting bad.
I've had the experience of sunfish and micro bass trying to attack a fly thats 2/3'rds of their size. One of my favorite flies for this type of fishing is a floating dragon fly imitation that is ~ 2" long that probably only hooks a fish out of every fifteen that hit it. Sure is fun though.