Scilab 5.3.0
- Scilab Online Help
- Strings
- ascii
- blanks
- code2str
- convstr
- emptystr
- eval
- evstr
- grep
- isalphanum
- isascii
- isdigit
- isletter
- isnum
- justify
- length
- part
- regexp
- sci2exp
- str2code
- strcat
- strchr
- strcmp
- strcmpi
- strcspn
- strindex
- string
- strings
- stripblanks
- strncpy
- strrchr
- strrev
- strsplit
- strspn
- strstr
- strsubst
- strtod
- strtok
- tokenpos
- tokens
- tree2code
Please note that the recommended version of Scilab is 2025.0.0. This page might be outdated.
See the recommended documentation of this function
tokens
returns the tokens of a character string.
Calling Sequence
T=tokens(str [,delimiter])
Arguments
- str
A character string. The string where to search the tokens.
- delimiter
(optional) a character or a vector of characters. The tokens delimeters.
- T
column vector of found tokens
Description
T=tokens(str [,delimiter]) searches the tokens included in the
string str. The delimiter default value is [" ",<Tab>]
where <Tab> stands for ascii(9).
Examples
tokens('This is a character string') tokens('SCI/demos/scicos','/') tokens('y=a+b*2',['=','+','*'])
| << tokenpos | Strings | tree2code >> |