Formatron v0.4.9
Formatron empowers everyone to control the output format of language models with minimal overhead.
|
▼Nformatron | |
▼Nconfig | Configuration classes for Formatron |
CEngineGenerationConfig | Configuration for how an KBNF engine should be used in text generation |
▼Nextractor | Extractors for extracting data from generated strings |
CChoiceExtractor | An extractor that uses multiple extractors to extract data |
CExtractor | An abstract extractor that extracts data from a string and offers its KBNF rules definition |
CLiteralExtractor | An extractor that extracts a literal string |
CNonterminalExtractor | An extractor that extracts data corresponding to a nonterminal |
CSubstringExtractor | An extractor that extracts a substring of a given string from the input string |
▼Nformats | This subpackage contains modules that operate with concrete formats, like json |
▼Njson | The module defines the JsonExtractor class, which is used to extract data from a string in JSON format |
CJsonExtractor | An extractor that loads json data to an object from a string |
▼Nregex | This module contains the RegexExtractor class, which is used to extract data using a regular expression |
CRegexComplementExtractor | An extractor that extracts data by matching a regex complement |
CRegexExtractor | An extractor that extracts a string using a regular expression |
▼Nformatter | This module contains the Formatter class and its related classes |
CFormatter | |
CFormatterBase | An abstract Formatter that enforces a format on the string generated by a language model |
CFormatterBuilder | A builder for creating a Formatter |
▼Nintegrations | This subpackage contains integrations with other frameworks and libraries |
▼Nexllamav2 | This module integrates the ExLlamaV2 library by providing convenience utilities |
CFormatterFilter | ExLlamaV2Filter that uses a formatter to mask logits |
▼NRWKV | This module integrates the RWKV library by providing convenience utilities |
CPIPELINE | A wrapper for the pipeline of RWKV |
CPIPELINE_ARGS | A wrapper for the arguments of the pipeline of RWKV |
▼Ntransformers | This module integrates the transformers library by providing convenience utilities |
CFormattersLogitsProcessor | Logit processor that uses formatters to mask batch logits |
▼Nvllm | This module integrates the vllm library by providing convenience utilities |
CFormattersLogitsProcessor | Logit processor that uses formatters to mask batch logits |
▼Nschemas | This subpackage contains modules that define schemas creation from various sources |
▼Ndict_inference | This module contains utilities for inferring schemas from dictionaries |
CFieldInfo | |
▼Njson_schema | This module contains utilities for creating schemas from JSON schemas |
CFieldInfo | |
▼Npydantic | A module that implements the Schema interface using pydantic |
CClassSchema | A wrapper for pydantic BaseModel that implements the Schema interface |
CFieldInfo | A wrapper for pydantic FieldInfo |
▼Nschema | This module contains the Schema abstract class and FieldInfo abstract class |
CFieldInfo | An abstract field info that describes a data field in a schema |
CSchema | An abstract schema that describes some data |
CSubstringOf | A metadata class that indicates that the field is a substring of the given string |
CTypeWithMetadata | A type with metadata |