Detokenization

Overview

Expand a token to the string it represents and decode its arguments.

Classes
class	pw::tokenizer::DetokenizedString
class	pw::tokenizer::Detokenizer

Typedefs
using	pw::tokenizer::TokenizedStringEntry = std::pair< FormatString, uint32_t >
	Token database entry.
using	pw::tokenizer::DomainTokenEntriesMap = std::unordered_map< std::string, std::unordered_map< uint32_t, std::vector< TokenizedStringEntry > > >

Functions
Result< Detokenizer >	pw::tokenizer::GetDetokenizerFromThisProgram ()

Function Documentation

GetDetokenizerFromThisProgram()

Result< Detokenizer > pw::tokenizer::GetDetokenizerFromThisProgram

(

)

Constructs a detokenizer from the .pw_tokenizer.entries section of this executable program.

NOTE: This requires linking with add_detokenize_from_this_program_sections.ld or equivalent. For Bazel builds this is handled automatically. For other builds, see the corresponding build file.