To cite the tokenizers package in publications, please cite the paper in the Journal of Open Source Software:

Lincoln A. Mullen et al., "Fast, Consistent Tokenization of Natural Language Text," Journal of Open Source Software 3, no. 23 (2018): 655, https://doi.org/10.21105/joss.00655.

Corresponding BibTeX entry:

  @Article{,
    title = {Fast, Consistent Tokenization of Natural Language Text},
    author = {Lincoln A. Mullen and Kenneth Benoit and Os Keyes and
      Dmitry Selivanov and Jeffrey Arnold},
    journal = {Journal of Open Source Software},
    year = {2018},
    volume = {3},
    issue = {23},
    pages = {655},
    url = {https://doi.org/10.21105/joss.00655},
    doi = {10.21105/joss.00655},
  }