Re: data store > 500GB?

On 28-03-15 20:36, Steve Dougherty wrote:
> On 03/28/2015 12:07 PM, Eric Chadbourne wrote:
>> Hi All,
>>
>> Is it possible to use more than a 500GB data store?
>>
>> On a fresh installation the largest selectable value for the 
>> datastore is 500GB.  I would like to use 3TB if possible.  When I 
>> attempt to change the value via the web page I get an out of memory 
>> error.  If I change the value in freenet.ini the application won’t 
>> start.  I may not be setting the value correctly.
>>
>> Internal error: please report
>>
>> java.lang.OutOfMemoryError: Java heap space
> 
> What is "Maximum memory usage" under "Wrapper" on the Configuration >
> Core settings page set to? For a store that big it seems like it'll have
> to be higher.

I think this correctly identifies the problem at hand: IIRC, bloom
filters contribute to a memory usage of 1/3000th of the data store size,
which would be around 1 GB of RAM for a 3TB data store — not counting
memory consumption of other parts of Freenet, Java memory management
overhead, etc.

Your problem can probably be solved by raising the memory limit.* Apart
from the limits imposed by your storage and RAM capacities, there is no
limit to datastore size (apart from some 2^63 bytes limits imposed by
internal representation, but that should never be an issue in the
foreseeable future).

Keep in mind that other settings may need additional tweaking for
optimal performance when such a large datastore is used.

Thank you for running Freenet!

-- Bert


* You can change the memory limit through the web interface as Steve
pointed out, or change the `wrapper.java.maxmemory' option in
wrapper.conf (after stopping Freenet): the value is the memory limit in
megabytes.

_______________________________________________
Support mailing list
[email protected]
http://news.gmane.org/gmane.network.freenet.support
Unsubscribe at http://emu.freenetproject.org/cgi-bin/mailman/listinfo/support
Or mailto:[email protected]?subject=unsubscribe

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.20 (GNU/Linux)

iQEcBAEBCgAGBQJVGAMrAAoJEDmbbkE9DzHhVc0H/3i+Iw3T4yhdAG57XuwLkZ0A
fajHv7Ac+oxJl7+NvgLgBAmQEQLCOH+brpbroDq53u0p5LxiKCAdMfMzUEQW67Yq
UlJtrFe8PTgOI8XK9qY47MrQwYvwCyp2Igu/rerheTnFFy2Jg6ikNEfv+RUWzjxl
tD8O/WhrBtpEUqhxbSY3uaNWWaBZCmejkrVAwGA7QyjhLX1E5nY52ffsvnJxzeoi
oJjUNqQwfUavGNGgXN1E/khF0xdNNlNgDl215KhJYCgDw75Xw1HBTxpu2H3HA+so
pyVFX3MyTuD8wR4jDMwHObUI+erQ6WgzvL7iqCkU6tpbLDsIt3SUVtj6Pbnvt5Y=
=jnpk
-----END PGP SIGNATURE-----