rOpenSci, Spanish 
📦 [A package a day - Computing Infrastructure 42]
Today's Computing Infrastructure package is tokenizers
Fast, Consistent Tokenization of Natural Language Text
🙏 Maintained by Lincoln Mullen
📝 https://docs.ropensci.org/tokenizers/Check out this article: Introduction to the {tokenizers} Package
💻 https://docs.ropensci.org/tokenizers/articles/introduction-to-tokenizers.html