token

token — A unit of information.

Synopsis

Parents
×

token ::= × ⏵

Attributes

Common attributes and common linking attributes.

No additional attributes.

Description

A token identifies a unit of information. Usually, tokens are the result of some processing pass that has performed lexical analysis and divided a data set into the smallest units of information used for subsequent processing.

Exactly what constitutes a token varies by context.

Processing expectations

Formatted inline.

Attributes

Common attributes and common linking attributes.

any attribute

Any attribute in any other explicit namespace

Parents

56 elements contain token. × ⏵

These elements contain token: bridgehead, caption (db.html.caption), citation, citetitle, classsynopsisinfo, computeroutput, contrib, emphasis (db.emphasis), entry, enumitemdescription, firstterm (db.firstterm), funcsynopsisinfo, glosssee, glossseealso, glossterm (db.glossterm), initializer, link, literallayout, member, meta (db.meta.content), olink, orgdiv, para, phrase (db.phrase), primary, primaryie, programlisting, quote (db.quote), refdescriptor, refentrytitle, refname, refpurpose, remark, screen, secondary, secondaryie, see, seealso, seealsoie, seeie, seg, segtitle, simpara, subtitle, synopsis, synopsisinfo, td, term, termdef, tertiary, tertiaryie, th, title, titleabbrev, tocentry, userinput.

Children

29 elements occur in token. × ⏵

The following elements occur in token: text, abbrev, acronym, alt, anchor, annotation, biblioref, coref, date, emphasis (db._emphasis), firstterm (db._firstterm), footnote, footnoteref, foreignphrase (db._foreignphrase), glossterm (db._glossterm), indexterm (db.indexterm.endofrange), indexterm (db.indexterm.singular), indexterm (db.indexterm.startofrange), inlinemediaobject, link, olink, phrase (db._phrase), quote (db._quote), remark, replaceable, subscript, superscript, trademark, wordasword, xref.

See Also

Related elements: classname, property, symbol, type.

Examples

1 |<article xmlns='http://docbook.org/ns/docbook'>
  |<title>Example token</title>
  | 
  |<para>In parsing, line ends are turned into the <token>CRLF</token>, all other
5 |whitespace becomes <token>WHITESP</token>.
  |</para>
  | 
  |</article>

In parsing, line ends are turned into the CRLF, all other whitespace becomes WHITESP.