Jay, I've had that happen once, a bunch of times. I've found goggles, or the glasses that have the spiffy shields on the sides prevent it from happening.
Although I did have one instance where I was doing a lot of work. Safety glasses and all. A few days later my eye was bothering me, and sure enough, somehow one of those little pieces of shrapnel found its way around my glasses.