Although it was my first thought, I don't think that going to a small fly was the issue. I got more follows with the size 18, than with the 22 of the same pattern, a blue dun midge with a goose biot body & CDC wing. Switching to a BWO might have kicked the odds in my favor.
I was fishing at Wachusett in West Boyslton last saturday with my son until we got chased off by an afternooon rain. He was in an exploring mood so we covered a lot of ground and found a spot that may be good for smallmouth on the fly. Send me an e-mail if your interested and I'll give you the details.
I saw your post on FFSW and realized how close I had been to success until I went to a smaller size fly. A little dfferent body color was needed. By the time that I got to the Swift, my time on the water was limited and I tempted hypothermia by wet wading. Next time I'll spend a full day and wear the waders. It's surprising how how many people rush by the bubbler stream on the way to the honey hole