f UddlmZddlZddlZddlZddlZddlmZmZm Z m Z ddl Z ddl m Z ejZiZded<daded<ej&d d Zdd Zdd Zdd Zy)) annotationsN)AnyCallableOptionalSequence)Encodingzdict[str, Encoding] ENCODINGSz1Optional[dict[str, Callable[[], dict[str, Any]]]]ENCODING_CONSTRUCTORScg}tjtjtjdz}|D]\}}}|j ||S)N.)pkgutil iter_modules tiktoken_ext__path____name__append)mods plugin_mods_mod_names P/opt/lhia/ganansol/python/venv/lib/python3.12/site-packages/tiktoken/registry.py_available_plugin_modulesrsS D&&|'<'S>SVY>YZK%8Q H Kc xt5t dddyiatD]^}tj|} |j}|jD]'\}}|tvrt d|d||t|<)` dddy#t $r}t d|d|d}~wwxYw#1swYyxYw)Nztiktoken plugin z& does not define ENCODING_CONSTRUCTORSzDuplicate encoding name z in tiktoken plugin )_lockr r importlib import_moduleAttributeError ValueErroritems)rmod constructorseenc_name constructors r_find_constructorsr& s > , >>!#13 >H))(3C "88 *6););)= >%+44$28*%h/  > > >>"  &xj0VW >>s3B0$B0 B r:ss"44" !# #KOHO  >..+r