When I wear my five-fingers in the gym, I often see people funny and surprised looks. They look an extra time with a very surprised face. But they never ask anything... which perhaps a Swedish thing :-)
Anyway - do you have the same experiences? That people think that you are a bit weird/funny wearing strange shoes?
When I go to MY gym, I usually get one person that will ask me about them with great interest. Although that has been tapering off lately. I think people are becoming more and more aware of them.
I find that children will stare openly--often with a smile on their little faces...