For those using HW that still uses the stateful V4L2 API for decoding - such as the #RaspberryPi4 - I uploaded another build to the link in the first post that includes a #GStreamer patch that is not close to landing, but works well enough to make playback work.
With that I can play 1080p30fps videos (the decoder limit) on my big screen smoothly, which otherwise not possible (apart from reducing the resolution).