Request for wider testing of the db4o branch (it's much easier now!)

The db4o branch of Freenet is rapidly approaching usability, so I'd very much 
like some more folk to try it out and let me know what they think, especially 
in terms of performance. I include instructions below. The db4o branch is a 
version of Freenet with all persistent requests kept in a database, this has 
several advantages:
- Much lower memory usage for large queues. You will need a fixed 3.7MB for 
every 10GB of queued downloads, plus obviously some temporary space; locally 
I have 4.86GB queued on a 128MB node memory limit.
- Fewer memory-related problems: Many nodes with largish queues have to do 
garbage collection very frequently, causing high CPU usage, and get 
OutOfMemoryExceptions and crashes.
- Instant request resuming: On restarting, a db4o node will immediately have 
all of your persistent downloads up and running from exactly where they were 
before your node was shut down. On the current Freenet, downloads have to 
start all over again on restart, causing the node to thrash the datastore for 
a long time, high CPU usage, I/O, and wasting time that could be used to 
fetch data. Also, startup should be significantly quicker.

Possible disadvantages: We may have slightly higher CPU usage if there is 
plenty of RAM and the node isn't restarted, and there will probably be 
slightly higher disk I/O. Also, I have put a lot of effort into debugging and 
optimising downloads, uploads seem to work but may be slow, and I haven't 
tested directory uploads yet.

If you would like to help to test the db4o branch, especially on slow systems, 
this would be very helpful. Please download the freenet-ext.jar and 
freenet-cvs-latest.jar from the CHKs below, shut down your node, replace 
freenet-ext.jar with the downloaded version, and replace 
freenet-stable-latest.jar or freenet.jar or freenet.jar.new (you may have one 
or more of these files, they're all the same thing), with the downloaded 
freenet-cvs-latest.jar.

CHK@qOcoVmDoMz2gP03I77~Ax375Ixq-Z~kvmYYEj6aJXG8,FlOIKbkwiIxp5Hl9b~~WzBq7UQD01WUf55g-QU8g7TM,AAIC--8/freenet-cvs-snapshot.jar
CHK@hgyAtyRgEujwAnx~U~emgdHHkf6SuXPMP0CnEXAlzH4,P65Gw3WRgxJc~29NkRMGw2yG-WkL5K54DgP4UBl7~3M,AAIC--8/freenet-ext-db4o.jar

(based on SVN revision 21903)

A few tips once you've got it set up:

The db4o testing howto site is now out of date, you can get it working much 
more quickly. However, you may find it a useful source of testing material to 
download (see the end); my testing collection includes files listed on the 
db4o test site, a few other linux ISOs, a few FMS binaries/source files, some 
pages/images from the Ghost Town mirror, all the CD images from the Resources 
page on my flog, all the >2MB bibles on TCR and all the big audio zip files 
from a site linked from TCR. All in an under 128MB memory footprint and ~ 15% 
CPU.

You can test with whatever you want, but bear in mind that ANY BUG REPORTS OR 
TEST RESULTS FROM USERS OBVIOUSLY ENGAGED IN COPYRIGHT INFRINGEMENT WILL BE 
IGNORED AND WILL LOSE THEIR RIGHT TO TECH SUPPORT!

USK@hiBur-SUasOR-m7qzR2HmTDLGmVQTuZKzS7va2zUyhQ,lOXQvKathjQzrbAt4Wy~puFsVvmcUDzo5z2Y59isf2c,AQACAAE/db4o-testing-howto/5

CHK@Y7JTTsam8WgSGV5gdDmYq7nEGx6cLOV3MrHpXk3V2Us,HXWDlR9VXU0woUJu~gVpJMuhhpJpo9kwI8GFjJY~NUw,AAIC--8/mandriva-linux-free-2008-spring-cd1-i586.iso
CHK@dYbLzaLYhOqVYfQcsJj5o91AwdctrbVwbJMU929P4-0,N5BUpWFeEfi5WpD49jB1XyIcmY-6SZiroUUg0~GOenA,AAIC--8/debian-40r3-i386-xfce-CD-1.iso
CHK@8WY4whItpoVvZN5HPuFi70YokL-ituk1W0Ogaqg~J4o,JJ587LGGbHi9zUqMJ~j1MqPVt0mDuD6uPeAk2fym3B8,AAIC--8/slackware-12.1-install-d1.iso
CHK@1xFD0Pes-2ON5fa2l0g1xCMH5jpRzpljk0n2ZMHZztc,uINsyVsBcuL-O5-ji7ReHiltouMSplUw-PxW1Tx8vLA,AAIC--8/ubuntu-8.04-desktop-i386.iso

Finally, note that I may still have to change data structures in a way which 
will make upgrading to a new version of the branch impossible without 
deleting your node.db4o and thus wiping your download and upload queues. I 
will indicate when this is necessary when I post a new jar.

Thanks, and looking forward to hearing from you!

_______________________________________________
Tech mailing list
[email protected]
http://emu.freenetproject.org/cgi-bin/mailman/listinfo/tech

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.6 (GNU/Linux)

iQIVAwUASLxOhnsvjZi+xPTDAQJLMA//Y/GIxkNVXgj17A+M/C9M7TIYstg7S8nP
2bXgW5e5dHXm7ePed9hthtEVSKDUW0wATanGTw1P7jG0DY3NxJFhV1Cfxsso+8Wf
fduo5mbjyPmLZD/dtvYrp9dY55fgpKTcW+gafjUB0hEMgpL66mnmC8qGQF4MrmFl
1wW3cp5BkmAnnJ+raQenu4e46b2HRB3Um/BjcDkaPfmIQHyi3jDbbxAYnpgwPiWY
FN66AdqT4Up0f8FWnHqQISY0L4iFw11f1epdUhdea5TZVKYWUSo981Hi9vXbdMK/
o7Vi/VGRxrxJ+HgYKBxiMZhK+FowJ6I4+20C0Au/QItChfLt1iPcdnjGZlW2DEOX
Y5lsPX2RhTUHGtOh3XJNuwu6OTD79tV9IP1E9AG9W6WSwtuVBRiI+Z6sGv2iikZN
71O1ypua6blQvKR8XhnM5w85ASslh16Et5Xk799jc1nT12wEpFQXwywXGlW1h1Y3
HHyKS3wegt8xmL0pqGmveR28+SDXPS+PlbIMD3zq5VVkeE+ZiIjcB8qB08tAywRo
9us3I9W0bSci6J5G/xFXwJbUsT2RQ84kZpVtVYDZKgA13scS5MBG3PhRnjQgqQqo
LHXdrqTpfKxeu1MCYZeMpHqLqUlF1gKjCDLi0dV4JR7CQldinX3E350Wwm6vHjeO
EcQG2JKg4GQ=
=lwj9
-----END PGP SIGNATURE-----