Re: Reg: PyYAML grammar

There's nothing wrong with whole-file/stream compression :-) But from what I
understand, Paul is looking for something else, which is mucking with the
internal structure, such as allowing for non-printable binary blobs.

BTW, YAML already provides a form of internal "compression". If you have
many keys with some "long value foo", you can easily add an anchor to the
1st one and specify all the rest as "*f". Think of it as a poor man's LZW.
IMO minimal-size flow-style YAML with heavy use of such anchors, plus some
streaming compression of the stream, should give you a pretty compact
format.

Of course I don't know Paul's application - he hinted that doing gzip may be
too heavy for his use case (and I don't know what is data and BW constraints
are). He's pretty much required to invent his own format which is tailored
to his specific environment (or so it seems).

Have fun,

    Oren Ben-Kiki

On Sun, Jun 26, 2011 at 5:20 AM, Trans <[email protected]> wrote:

>
>
> On Jun 13, 8:20 pm, Paul Lambert <[email protected]> wrote:
> > Ok - the YAML community and binary encoding do not appear to be
> compatible.  Too bad your world view is so limited.  Take a look a protobuf
> as an example of combining human readable and binary encodings if you want
> to see a worked hybrid.
>
> I don't understand. What's wrong with compression?
>
>
> ------------------------------------------------------------------------------
> All the data continuously generated in your IT infrastructure contains a
> definitive record of customers, application performance, security
> threats, fraudulent activity and more. Splunk takes this data and makes
> sense of it. Business sense. IT sense. Common sense..
> http://p.sf.net/sfu/splunk-d2d-c1
> _______________________________________________
> Yaml-core mailing list
> [email protected]
> https://lists.sourceforge.net/lists/listinfo/yaml-core
>

------------------------------------------------------------------------------
All the data continuously generated in your IT infrastructure contains a 
definitive record of customers, application performance, security 
threats, fraudulent activity and more. Splunk takes this data and makes 
sense of it. Business sense. IT sense. Common sense.. 
http://p.sf.net/sfu/splunk-d2d-c1

_______________________________________________
Yaml-core mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/yaml-core