One piece of a word: literal text, or a reference the line asked for.
The tokenizer records references rather than resolving them, because
resolving is asynchronous (a pronoun asks the session) and tokenizing is
not. What it must record is the QUOTING, since that is known only here:
inside single quotes a $ is text, inside double quotes a reference is
one operand however many values it carries, and bare it may become
several — the shell's rule, which the stack claims to wear.
One piece of a word: literal text, or a reference the line asked for.
The tokenizer records references rather than resolving them, because resolving is asynchronous (a pronoun asks the session) and tokenizing is not. What it must record is the QUOTING, since that is known only here: inside single quotes a
$is text, inside double quotes a reference is one operand however many values it carries, and bare it may become several — the shell's rule, which the stack claims to wear.