From: Andrei Alexandrescu (andrewalex_at_[hidden])
Date: 2001-11-21 18:01:47


If ideas are a dime a dozen, then this one must be exactly 0.1/12 =
$0.008(3) worth. Here it is.

Boost has a nice tokenizer class. Also, Boost has a nice regexp class. A
very useful tool would be a tokenizer that uses a regular expression as a
separator. Very, very useful!

Nicely, tokenizer's separator parser is isolated as a policy. Currently
there are three implementations: char_delimiters_separator,
escaped_list_separator, and offset_separator. It would be very easy to
implement regex_separator using regex, and - voila! A very useful instance
of tokenizer is ready to go.

Anyone else thinks this would be cool?

Cheers,

Andrei