Hey #NLP—we all know better than to use NLP tools that we can't assess, right? These folks are advertising on the #acl2023nlp Rocket.chat, but give 0 info about how their system was built or evaluated.
The link for http://generalizable.xyz goes to a page that literally just consists of their logo.
In what sense is this GPT? What training data did they use? What test data? What evaluation metric?
But more to the pt: We're here to learn from each other, not to read synthetic versions of papers.
