astc: Return zero on out of bound bits

Avoid out of bound reads on invalid ASTC textures.
Games can bind invalid textures that make us read or write out of bounds.