Formatron v0.4.2
Formatron empowers everyone to control the output format of language models with minimal overhead.
Loading...
Searching...
No Matches
_utils.py File Reference

Go to the source code of this file.

Namespaces

namespace  formatron
 
namespace  formatron.integrations
 This subpackage contains integrations with other frameworks and libraries.
 
namespace  formatron.integrations._utils
 

Functions

 formatron.integrations._utils._multiple_replace (replacements, regex, text)
 
 formatron.integrations._utils._autodetect_processors (typing.Dict[str, int] vocab)
 
typing.Dict[bytes, int] formatron.integrations._utils.get_original_characters (typing.Dict[str, int] vocab)
 
 formatron.integrations._utils.huggingface_bytelevel_decoder ()
 I hate legacy code.
 

Variables

 formatron.integrations._utils.Processors = set[typing.Literal["sentencepiece", "<0xHH>", "dot_G"]]