You technically do not need more than one part library.
But practically if the single library has a gazillion parts, it will take a long time to find the parts you need. At some point it will take a shorter time to make the part from scratch, which kind of defeats the purpose.