Re: Documentation tokenization

> I have been testing my theories against
> XMLDistilled (which is extremely useful) and they are not lining up.

I tested against Jing and it seems to pass all documentation that I can
throw at it-- even when it seems it should be failing. I suppose I am a
little confused as to whether or not:

## Documentation # comment

is allowable. From my reading it is not-- but my reading could be wrong. The
grammar could be saying that when the # is encountered it is the start of a
separator (i.e., a comment) and is therefore the end of the documentation.
For that matter, is:

# Comment # Comment

allowable? Again  it seems to me that A.2 says it is not. But Jing and
XMLDistilled accept it.

> (2) Is step "C" accurate? from documentationLineContent production in A.2
it
> seems so. Again, XMLDistilled allows this.

I think that this is not accurate. I misread the " " restOfLine option. I
believe it was trying to show that in the case of

## Some text

That the resulting documentation would be "Some Text" not " Some Text". A
single initial space in documentation is discarded.

Thanks again,
Jeff Rafter