"It takes a village to raise a child" and it's similar with INP issues.
This metric is not a "stick to beat up websites with", as I sometimes hear, but an alert to something that could be improved.
Site owners, third-parties, and browser engineers all have a part to play to improve the web here. And yes that definitely includes Google too as a big player in all three of those categories!
nhoizey