ZODB as Timeseries

Leonardo Rochael Almeida <[email protected]> Thu, 19 Apr 2018 19:42:14 -0700 (PDT)
Newsgroups gmane.comp.web.zope.zodb
Message-ID <[email protected]>
Hi everyone,

I just read this article (linked from news.ycombinator.com):

https://blog.timescale.com/postgres-accidental-iot-platform-timescaledb-postgresql-time-series-data-7983d28da5af

And it basically describes how Timescale got a huge performance improvement 
by creating a specialized timeseries storage engine for PostgreSQL.

This engine can hugely optimize all sorts of operations for a tables have 
the following characteristics:

 - data is primarily indexed by two axis: a timestamp and another arbitrary 
primary key,
 - data is mostly inserted, rather than updated.

Which sounds ridiculously close to the TID/OID model of object 
modification/addressing in ZODB.

I wonder if such an engine could be used to optimize the performance of 
Relstorage / NewtDB. The article talks of 20x speed gains on insert, up to 
14000x speed gains on queries 
<https://blog.timescale.com/postgres-accidental-iot-platform-timescaledb-postgresql-time-series-data-7983d28da5af#8da9>
.

The table definitions might have to be updated to treat TID as an actual 
timestamp instead of a BIGINT 
<https://github.com/zodb/relstorage/blob/master/relstorage/adapters/postgresql/schema.py#L231>, 
but it might be worth the trouble...

Just dropping this info here.

Cheers,

Leo

-- 
You received this message because you are subscribed to the Google Groups "zodb" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [email protected].
For more options, visit https://groups.google.com/d/optout.