Re: Unicode support pre alpha

Joel de Guzman <[email protected]> Thu, 01 Apr 2010 07:32:54 +0800
Newsgroups gmane.comp.parsers.spirit.devel
Message-ID <[email protected]>
On 3/31/2010 9:54 PM, Mathias Gaunard wrote:

> I have a library for Unicode support (so-called Boost.Unicode),
> initially developed as a GSoC in 2009, that I plan to submit to Boost in
> the coming months.
>
> My aim (not necessarily achieved by the first milestone) is to provide
> all the necessary tools for a library such as Spirit to be able to
> comply with level 1 or 2 of support.
>
> For example at the lowest level it provides an access to the Unicode
> Character Database which provides various properties from a code point.
> The database is generated from Unicode.org data parsed using Spirit
> Classic, and it is intended to support versioning and even in the future
> leverage other databases already provided by the OS or platform.
>
> It also provides support for on-the-fly conversion between encodings,
> segmentation (code points, combining character sequences, graphemes,
> ...) and normalization with iterator adaptors in a similar way to John
> Maddock's iterators.
>
> I would like to know if you are aware of this library and if you believe
> it could be a viable candidate for Unicode support, or if Spirit prefers
> to maintain its own.
>
> A not up to date documentation can be found here:
> <http://blogloufoque.free.fr/unicode/doc/html/>

Hi Mathias,

Yes, I am aware of your project. There are some things that kept me from
using it. First, I started working on unicode support at a time before
your library was taking shape. I was waiting for it to get more mature.
One thing I noticed is that your library is not optimal with the use
of tables, when I had a chance to look, it was not using optimal 2 stage
tables and there is no way to pick only the features that I need. You
get to have all the databases wholesale. Correct me if I'm wrong. The
library seemed rather immature for me at the time and I couldn't see
active post GSOC activity. The "future work" section does not even
mention of an eventual Boost review (or is it in the review queue
already?). I'd love to use your library if these concerns are allayed.
Most importantly, I'd like to know what the plans are for Boost inclusion.
Spirit could very well be an incubator of your project as it has done in
the past with Fusion and Phoenix. Tell me your thoughts.

Regards,
-- 
Joel de Guzman
http://www.boostpro.com
http://spirit.sf.net
http://www.facebook.com/djowel

Meet me at BoostCon
http://www.boostcon.com/home
http://www.facebook.com/boostcon




------------------------------------------------------------------------------
Download Intel&#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev