Ensure pinentry-gtk-2 is used so we can theme its prompt, and ensure that gpg respects XDG conventions.