CMakeLists: Make libzip excluded from the ALL target

Likewise, we also only want to link in the libraries that we actually
make use of (so we don't need to worry about linking in test targets).