@dave I usually solve that by installing the system package for the troublesome module. If available of course. Otherwise installing the dev libraries can help as well (with apt).
With MySQL I couldn’t install the new v5 version on the latest Perl 5.38 version so stuck with v4. For me that requires changing the version in my cpanfile.
If I’m not mistaken the official Perl Docker images come with most stuff installed.