Re: Performance issues with Git repositories (or in general with many small files workloads)

Ciprian Dorin Craciun <[email protected]>
Newsgroups gmane.comp.file-systems.openafs.general
Message-ID <CA+Tk8fxpj8QpExdbBZ_w0Eks3FHC9dXKDqfNnqjQSLRk_P5dHQ@mail.gmail.com>
After fiddling with the `fileserver` arguments, I think the
problematic ones were `-p 128` and `-vhandle-max-cachesize 32768`, and
perhaps the too large `-b`, `-l` and `-s`.  (Also I've switched back
to the non direct-attached variant of the servers.)

The new arguments I'm using are:
~~~~
/usr/lib/openafs/fileserver -syslog \
-sync onclose \
-p 16 \
-udpsize 67108864 -sendsize 67108864 \
-rxpck 65536 -rxmaxmtu 1400 \
-cb 1048576 -busyat 65536 \
-vc 4096 -b 4096 -l 65536 -s 262144
~~~~

Apparently by using these new options things work much better now, as
in I can now get ~500 KiB/s where previously I had only ~20 KiB/s
throughput.  Although depending on the repository I can even obtain
~10 or ~20 MiB/s if it contains larger files.

Now regarding the arguments, what is exactly `vhandle`?  The
documentation hints about "file handles";  are these the actual OS
file-handles?

Is there perhaps a bottleneck for large values of the block and vnode caches?

Thanks,
Ciprian.
lmpx.com only provides a reader for public news (NNTP) servers. It is not affiliated with the servers or forums shown here and is not responsible for the content of articles, which is written by their respective authors.