Scilab Website | Contribute with GitLab | Mailing list archives | ATOMS toolboxes
Scilab Online Help
5.3.3 - Français

Change language to:
English - 日本語 - Português

Please note that the recommended version of Scilab is 2025.0.0. This page might be outdated.
See the recommended documentation of this function

Aide Scilab >> Chaînes de caractères > tokens

tokens

returns the tokens of a character string.

Calling Sequence

T=tokens(str [,delimiter])

Arguments

str

A character string. The string where to search the tokens.

delimiter

(optional) a character or a vector of characters. The tokens delimeters.

T

column vector of found tokens

Description

T=tokens(str [,delimiter]) searches the tokens included in the string str. The delimiter default value is [" ",<Tab>] where <Tab> stands for ascii(9).

Examples

tokens('This is a character string')

tokens('SCI/demos/scicos','/')

tokens('y=a+b*2',['=','+','*'])

See Also

  • strindex — search position of a character string in an other string.
  • tokenpos — returns the tokens positions in a character string.
<< tokenpos Chaînes de caractères tree2code >>

Copyright (c) 2022-2024 (Dassault Systèmes)
Copyright (c) 2017-2022 (ESI Group)
Copyright (c) 2011-2017 (Scilab Enterprises)
Copyright (c) 1989-2012 (INRIA)
Copyright (c) 1989-2007 (ENPC)
with contributors
Last updated:
Wed Oct 05 12:11:02 CEST 2011