How thick is the metal around a home fuse box?

Don't worry about it. You did not short anything when your were drilling and there is no reason for anything to spontaneously short in the future. If you had drilled in to a conductor you would have noticed the resulting sparks and flame I am sure.