k_address_arbiter: Remove unnecessary usages of std::addressof

This is a useful function in a generic context or with types that
overload unary operator&. However, primitives and pointers will never do
this, so we can opt for a more straightforward syntax.