Additions:
[[http://www.pascalgamedevelopment.com/PGDLib/CodeSnippets Back to snippets]]
Additions:
type
TStringArray = array of string;
This tokeniser breaks the incoming string at numerous separators as defined in the IF under the comment 'Look for separators'. When you've done with the returned string array simply use 'finalize' to clean it up. Whilst the code doesn't handle wide chars, by changing the incoming string parameter 'src' and the variables 'achar' and 'charptr' to their wide equivalents, it should work just fine.
Deletions:
This tokeniser breaks the incoming string at numerous separators as defined in the IF under the comment 'Look for separators'.