Hi Sharky,
Do you mean the precast concrete panels that bolt together?, If so, my garage/workshop is the same, and I had the same concerns as you about drilling into them. I don't think there's sufficient depth of material to get a good fixing in.
For what it's worth, my solution was to...