Construct a set of tokens based upon the given delimiter,
and an indication of whether said delimiter should be
considered part of the left side (effectively the name).
The latter is useful with headers, since the separating
':' character should really be considered part of the
name for purposes of subsequent token matching.
Construct a set of tokens based upon the given delimiter, and an indication of whether said delimiter should be considered part of the left side (effectively the name).
The latter is useful with headers, since the separating ':' character should really be considered part of the name for purposes of subsequent token matching.