^ escapes to the next character, | separates tokens. Can tokenize be written as an application of sequential machine?
tokenize 'one^|uno||three^^^^|four^^^|^cuatro|' +-------++-------+------------++ |one|uno||three^^|four^|cuatro|| +-------++-------+------------++ ---------------------------------------------------------------------- For information about J forums see http://www.jsoftware.com/forums.htm
