Bug#1140148: ITP: golang-github-pkoukk-tiktoken-go -- go version of tiktoken
"Andrew Lee (李健秋)" <[email protected]>
| Newsgroups | gmane.linux.debian.devel.general |
|---|---|
| Message-ID | <20260616142148.DE4AC100F53__44065.5482046836$1781619820$gmane$org@lla3.bfh.ch> |
Package: wnpp Severity: wishlist Owner: Andrew Lee (李健秋) <[email protected]> * Package name : golang-github-pkoukk-tiktoken-go Version : 0.1.8-1 Upstream Author : ImmortalFog * URL : https://github.com/pkoukk/tiktoken-go * License : Expat Programming Lang: Go Description : go version of tiktoken Tiktoken-go is a native Go port of OpenAI's fast Byte Pair Encoding (BPE) tokenizer. This reqires by golang-github-betterleaks-betterleaks.