Bug#1034307: RFP: tiktoken -- fast BPE tokeniser for use with OpenAI's models

Package: wnpp Severity: wishlist Package name: tiktoken Version : 0.3.3 Upstream Author : Shantanu Jain URL : https://github.com/openai/tiktoken License : MIT Programming Lang: Python, Rust Description : fast BPE tokeniser for use with OpenAI's

Bug#1034307: RFP: tiktoken -- fast BPE tokeniser for use with OpenAI's models

Control: retitle -1 ITP: tiktoken -- fast BPE tokeniser for use with OpenAI's models I've decided to upload this package to experimental under the umbrella of the Deep Learning Team. -- Happy hacking Petter Reinholdtsen

Processed: Re: Bug#1034307 RFP: tiktoken -- fast BPE tokeniser for use with OpenAI's models

Processing commands for cont...@bugs.debian.org: > block 1034091 by 1034307 Bug #1034091 [wnpp] RFP: whisper -- Robust Speech Recognition via Large-Scale Weak Supervision 1034091 was blocked by: 1034144 1034286 1034091 was not blocking any bugs. Added blocking bug(s) of 1034091: 1034307 > thanks

Processed: Re: Bug#1034307: RFP: tiktoken -- fast BPE tokeniser for use with OpenAI's models

Processing control commands: > retitle -1 ITP: tiktoken -- fast BPE tokeniser for use with OpenAI's models Bug #1034307 [wnpp] RFP: tiktoken -- fast BPE tokeniser for use with OpenAI's models Changed Bug title to 'ITP: tiktoken -- fast BPE tokeniser for use with OpenAI's models' from 'RFP: tikto