Incorporate pubkey in signature, check based on address