Re: slow insert speeds with bytea

Jeff Janes <[email protected]>
Newsgroups gmane.comp.db.postgresql.general
Message-ID <CAMkU=1zvDu2E-OFyJF1oYCNV3ayEBgZsgrNQAhrR8yyo7D0FGA@mail.gmail.com>
On Mon, Dec 2, 2019 at 4:42 AM Alex O'Ree <[email protected]> wrote:

> Is there anything I can to increase insert speeds for bytea? Currently
> running postgres 9.6.15
>
> I have a few tables without a bytea and a few with bytea. There is a large
> performance difference with inserts between the two. I'm inserting a byte[]
> that's usually less than 1MB on content. The content itself is actually
> just utf8 string data.
>
> For the non-bytea table, inserts can be as high as 40k rows/sec, whereas
> the bytea table is closer to 4k/sec or less.
>
> If this is just a limitation of postgres, then that's fine but the
> performance delta is so significant that i feel like i'm missing something
>

That does seem pretty drastic.  But I don't think we will get
anywhere unless you post your actual benchmarking program so that we can
try it for ourselves.  I certainly don't see anything that drastic in my
own testing.  Maybe the bottleneck is on the client side.

Cheers,

Jeff
lmpx.com only provides a reader for public news (NNTP) servers. It is not affiliated with the servers or forums shown here and is not responsible for the content of articles, which is written by their respective authors.