The following reply in GitHub addresses your question:
>>that is more difficult to get as you'd need to install all dependencies in your home directory and prepare all the configuration files to use/point the right executables. We have nothing at the moment for bootstrapping podman and its dependencies from scratch for an unprivileged user.
The easiest would be to install it on the system, but still use the unprivileged users for running the containers.