Given memory should always be expected to be valid during normal
execution, this should be a debug assertion, rather than a check in
regular builds.