$Revision: 1666 $

$Date: 2002-06-12 07:19:37 -0400 (Wed, 12 Jun 2002) $

token — A unit of information


Mixed Content Model

token ::=


Common attributes

Parameter Entities

The following parameter entities contain token:

Parameter Entities


A Token identifies a unit of information. Usually, “tokens” are the result of some processing pass that has performed lexical analysis and divided a data set into the smallest units of information used for subsequent processing.

Exactly what constitutes a token varies by context.

Processing expectations

Formatted inline.


The following elements occur in token: beginpage, indexterm, inlinegraphic, inlinemediaobject, replaceable.

See Also

classname, interface, property, structfield, structname, symbol, type.


<!DOCTYPE para PUBLIC "-//OASIS//DTD DocBook XML V4.1.2//EN"
In parsing, line ends are turned into the <token>CRLF</token>, all other
whitespace becomes <token>WHITESP</token>.

In parsing, line ends are turned into the CRLF, all other whitespace becomes WHITESP.