Enhancing tokenization accuracy with dynamic patterns: cumulative logic for segmenting user-generated content in logographic languages

  • Yin Zhang*
  • , Zhihuai Lin
  • , Castiel Chi-chiu Tong
  • , Sam Wai-yeung Ho
  • *Corresponding author for this work

Research output: Contribution to journalJournal articlepeer-review

Fingerprint

Dive into the research topics of 'Enhancing tokenization accuracy with dynamic patterns: cumulative logic for segmenting user-generated content in logographic languages'. Together they form a unique fingerprint.
Sort by:

Keyphrases

Computer Science