Insert too slow
"Rajkumar Narayanaswamy" <[email protected]> Wed, 02 Mar 2005 18:14:34 -0800
| Newsgroups | gmane.comp.db.mckoi |
|---|---|
| Message-ID | <[email protected]> |
Hi, I've been running into the problem with inserting into a table in mckoi database with about 150k records. The create table runs like this: CREATE TABLE REPORTS ( number VARCHAR(40) NOT NULL, name VARCHAR(100) INDEX_NONE, facility VARCHAR(20) INDEX_NONE, location VARCHAR(20), toDate VARCHAR(20), reportType VARCHAR(20), fromDate VARCHAR(20) INDEX_NONE, prid VARCHAR(20) INDEX_NONE, gpid VARCHAR(20) INDEX_NONE, status VARCHAR(2) ); This has a primary key with the following 5 coloumns: ALTER TABLE REPORTS ADD PRIMARY KEY ( number, location, toDate, reportType, status ); As you can see - it is a fairly simple table, with simple ascii columns. The problem is, after about a 100k insertions, the insert of each record takes incredibly long time - over 30 secs per insertion ... I think it is due to the full table scan that it performs to check the primary key constraint, for each record that is being added. Is there a way to avoid this, without deleting primary key constraint altogether? * Has someone else used mckoi in this kind of a scenario, with heavy use of INSERT? what are the performance numbers that you have experienced? do you have any tips? * Are there any workarounds to not having to perform a full table scan, with the multi-coloumn pk constraint? Some specifics: - I'm using prepared statements for insertion - AutoCommit turned OFF (set to false) - Commit occurs only after adding about 500-1000 records per cycle. - transaction_error_on_dirty_select enabled; the default setting is unchanged. - I've tried this with the 'dont_synch_filesystem' turned ON and OFF, with the same results; - during the time of inserting about 500-1000 records (it takes about 1 hr for this), the CPU util of the java process is almost 100% - hovers around 90% - - there are no resource issues for the process; it is a dual 3.0 G machine with 2 G of RAM in it. Thanks in advance for any help. Raj ------------------------ Rajkumar Narayanaswamy [email protected] --------------------------------------------------------------- Mckoi SQL Database mailing list http://www.mckoi.com/database/ To unsubscribe, send a message to [email protected]