whisper/tests
Jong Wook Kim 839639a223
Use tiktoken (#1044)
* use tiktoken==0.3.0

* formatting

* tuple should be safer

* Update whisper/tokenizer.py

Co-authored-by: Ruhollah Majdoddin <r.majdodin@gmail.com>

* use tiktoken 0.3.1

* reflecting suggestions

* cleanup

* bypassing load_tiktoken_bpe to avoid blobfile dep

---------

Co-authored-by: Ruhollah Majdoddin <r.majdodin@gmail.com>
2023-03-13 02:34:16 -07:00
..
conftest.py word-level timestamps in transcribe() (#869) 2023-03-06 14:00:49 -08:00
jfk.flac initial commit 2022-09-22 01:09:43 +09:00
test_audio.py apply formatting with black (#1038) 2023-03-06 15:50:37 -08:00
test_normalizer.py apply formatting with black (#1038) 2023-03-06 15:50:37 -08:00
test_timing.py apply formatting with black (#1038) 2023-03-06 15:50:37 -08:00
test_tokenizer.py initial commit 2022-09-22 01:09:43 +09:00
test_transcribe.py Use tiktoken (#1044) 2023-03-13 02:34:16 -07:00