Separating frequently-accessed LOCK and LOG* from $topDir/pc/$host

This is a cryptographically signed message in MIME format.

--===============5127969231578323998==
Content-Type: multipart/signed; protocol="application/pkcs7-signature"; micalg=sha-256; boundary="------------ms080805080606040907000407"

This is a cryptographically signed message in MIME format.

--------------ms080805080606040907000407
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Language: fr
Content-Transfer-Encoding: quoted-printable

Hi,

for a tiny BackupPC instance with on an SSD+HDD-server, I want the HDD=20
to be in standby mode (spinned down) most of the time.  Hence, I only=20
store __TOPDIR__ on it, and have everything else on the SSD. This almost =

works, except for the fact that unsuccessful pings write a log entry in=20
__TOPDIR__/pc/$host/LOG.DDMMYYYY, and LOCK is touched.  Which happens on =

every wakeup when some client is not reachable; in other words, too often=
=2E

AFAICS, from what's inside pc/, actually vital for the integrity of the=20
backups are the nnn and refCnt dirs (and, to some extent, the backups=20
and config.pl files).  Those are only accessed during backup or restore=20
jobs, when the "vault" disk is active anyway.
So, in short, I want to bring __TOPDIR__/pc/$host/LOG* and LOCK from the =

HDD to somewhere else.  Note that both LOG* and nnn are moving targets,=20
so symlinks only work to a certain extent.
(By the way: LOG.DDMMYYYY is actually LOG.MMYYYY, without DD, on my=20
4.1.3 installation.)


My usual approach is anything-sync-daemon (which uses an overlayfs to=20
move some directory to tmpfs, and sync backs periodically and/or on user =

request).  However, this only works at directory level, and would=20
require moving the entire __TOPDIR__/pc directory to tmpfs.  nnn can=20
easily become large, and overlayfs is ill-suited for that.
Another approach would be to move __TOPDIR__/pc to the SSD and rsync=20
back each __TOPDIR__/pc/$host/ to the HDD in a DumpPostUserCmd and,=20
perhaps, after each nightly.  That's better, but again, the nnn can grow =

large (at least in number of files) and might become ill-suited even for =

the SSD and/or rootfs.


=3D> Question 1.) Short of patching BackupPC, does anyone have a=20
suggestion or alternate solution I didn't think of?


It would be way easier to properly separate the two kinds of data if the =

location of the per-host LOG* and LOCK files would be configurable, e.g. =

to somewhere below __LOGDIR__.  This would match the logic for the=20
global LOCK (which resides at __LOGDIR__), even though I'd typically=20
expect lock files to live below /run/lock or /var/run/lock.
Full backward compatibility could be kept, e.g., through a=20
__PERHOSTLOGDIR__ variable defaulting to __TOPDIR__/pc/.

I'd be willing to look into preparing a patch and pull request, if there =

is any interest.  But I understand that the scenario and motivation are=20
negligible in an enterprise setup, and that changing the storage layout=20
can a royal pain in the * for existing systems.  Hence,


=3D> Question 2.) Would such a change have any chance to be integrated in=
=20
BackupPC?  If so, under what constraints for the interface?  Any=20
recommendations for locations?  What about=20
{Xfer,Restore,Archive}{ERR,LOG,Info}*?



Best,
Alex


--------------ms080805080606040907000407
Content-Type: application/pkcs7-signature; name="smime.p7s"
Content-Transfer-Encoding: base64
Content-Disposition: attachment; filename="smime.p7s"
Content-Description: S/MIME Cryptographic Signature

MIAGCSqGSIb3DQEHAqCAMIACAQExDzANBglghkgBZQMEAgEFADCABgkqhkiG9w0BBwEAAKCC
EHkwggUSMIID+qADAgECAgkA4wvV+K8l2YEwDQYJKoZIhvcNAQELBQAwgYIxCzAJBgNVBAYT
AkRFMSswKQYDVQQKDCJULVN5c3RlbXMgRW50ZXJwcmlzZSBTZXJ2aWNlcyBHbWJIMR8wHQYD
VQQLDBZULVN5c3RlbXMgVHJ1c3QgQ2VudGVyMSUwIwYDVQQDDBxULVRlbGVTZWMgR2xvYmFs
Um9vdCBDbGFzcyAyMB4XDTE2MDIyMjEzMzgyMloXDTMxMDIyMjIzNTk1OVowgZUxCzAJBgNV
BAYTAkRFMUUwQwYDVQQKEzxWZXJlaW4genVyIEZvZXJkZXJ1bmcgZWluZXMgRGV1dHNjaGVu
IEZvcnNjaHVuZ3NuZXR6ZXMgZS4gVi4xEDAOBgNVBAsTB0RGTi1QS0kxLTArBgNVBAMTJERG
Ti1WZXJlaW4gQ2VydGlmaWNhdGlvbiBBdXRob3JpdHkgMjCCASIwDQYJKoZIhvcNAQEBBQAD
ggEPADCCAQoCggEBAMtg1/9moUHN0vqHl4pzq5lN6mc5WqFggEcVToyVsuXPztNXS43O+FZs
FVV2B+pG/cgDRWM+cNSrVICxI5y+NyipCf8FXRgPxJiZN7Mg9mZ4F4fCnQ7MSjLnFp2uDo0p
eQcAIFTcFV9Kltd4tjTTwXS1nem/wHdN6r1ZB+BaL2w8pQDcNb1lDY9/Mm3yWmpLYgHurDg0
WUU2SQXaeMpqbVvAgWsRzNI8qIv4cRrKO+KA3Ra0Z3qLNupOkSk9s1FcragMvp0049ENF4N1
xDkesJQLEvHVaY4l9Lg9K7/AjsMeO6W/VRCrKq4Xl14zzsjz9AkH4wKGMUZrAcUQDBHHWekC
AwEAAaOCAXQwggFwMA4GA1UdDwEB/wQEAwIBBjAdBgNVHQ4EFgQUk+PYMiba1fFKpZFK4OpL
4qIMz+EwHwYDVR0jBBgwFoAUv1kgNgB5oKAia4zV8mHSuCzLgkowEgYDVR0TAQH/BAgwBgEB
/wIBAjAzBgNVHSAELDAqMA8GDSsGAQQBga0hgiwBAQQwDQYLKwYBBAGBrSGCLB4wCAYGZ4EM
AQICMEwGA1UdHwRFMEMwQaA/oD2GO2h0dHA6Ly9wa2kwMzM2LnRlbGVzZWMuZGUvcmwvVGVs
ZVNlY19HbG9iYWxSb290X0NsYXNzXzIuY3JsMIGGBggrBgEFBQcBAQR6MHgwLAYIKwYBBQUH
MAGGIGh0dHA6Ly9vY3NwMDMzNi50ZWxlc2VjLmRlL29jc3ByMEgGCCsGAQUFBzAChjxodHRw
Oi8vcGtpMDMzNi50ZWxlc2VjLmRlL2NydC9UZWxlU2VjX0dsb2JhbFJvb3RfQ2xhc3NfMi5j
ZXIwDQYJKoZIhvcNAQELBQADggEBAIcL/z4Cm2XIVi3WO5qYi3FP2ropqiH5Ri71sqQPrhE4
eTizDnS6dl2e6BiClmLbTDPo3flq3zK9LExHYFV/53RrtCyD2HlrtrdNUAtmB7Xts5et6u5/
MOaZ/SLick0+hFvu+c+Z6n/XUjkurJgARH5pO7917tALOxrN5fcPImxHhPalR6D90Bo0fa3S
PXez7vTXTf/D6OWST1k+kEcQSrCFWMBvf/iu7QhCnh7U3xQuTY+8npTD5+32GPg8SecmqKc2
2CzeIs2LgtjZeOJVEqM7h0S2EQvVDFKvaYwPBt/QolOLV5h7z/0HJPT8vcP9SpIClxvyt7bP
ZYoaorVyGTkwggWNMIIEdaADAgECAgwcOtRQhH7u81j4jncwDQYJKoZIhvcNAQELBQAwgZUx
CzAJBgNVBAYTAkRFMUUwQwYDVQQKEzxWZXJlaW4genVyIEZvZXJkZXJ1bmcgZWluZXMgRGV1
dHNjaGVuIEZvcnNjaHVuZ3NuZXR6ZXMgZS4gVi4xEDAOBgNVBAsTB0RGTi1QS0kxLTArBgNV
BAMTJERGTi1WZXJlaW4gQ2VydGlmaWNhdGlvbiBBdXRob3JpdHkgMjAeFw0xNjExMDMxNTI0
NDhaFw0zMTAyMjIyMzU5NTlaMGoxCzAJBgNVBAYTAkRFMQ8wDQYDVQQIDAZCYXllcm4xETAP
BgNVBAcMCE11ZW5jaGVuMSAwHgYDVQQKDBdNYXgtUGxhbmNrLUdlc2VsbHNjaGFmdDEVMBMG
A1UEAwwMTVBHIENBIC0gRzAyMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAnhx4
59Lh4WqgOs/Md04XxU2yFtfM15ZuJV0PZP7BmqSJKLLPyqmOrADfNdJ5PIGBto2JBhtRRBHd
G0GROOvTRHjzOga95WOTeura79T21FWwwAwa29OFnD3ZplQs6HgdwQrZWNi1WHNJxn/4mA19
rNEBUc5urSIpZPvZi5XmlF3v3JHOlx3KWV7mUteB4pwEEfGTg4npPAJbp2o7arxQdoIq+Pu2
OsvqhD7Rk4QeaX+EM1QS4lqd1otW4hE70h/ODPy1xffgbZiuotWQLC6nIwa65Qv6byqlIX0q
Zuu99Vsu+r3sWYsL5SBkgecNI7fMJ5tfHrjoxfrKl/ErTAt8GQIDAQABo4ICBTCCAgEwEgYD
VR0TAQH/BAgwBgEB/wIBATAOBgNVHQ8BAf8EBAMCAQYwKQYDVR0gBCIwIDANBgsrBgEEAYGt
IYIsHjAPBg0rBgEEAYGtIYIsAQEEMB0GA1UdDgQWBBTEiKUH7rh7qgwTv9opdGNSG0lwFjAf
BgNVHSMEGDAWgBST49gyJtrV8UqlkUrg6kviogzP4TCBjwYDVR0fBIGHMIGEMECgPqA8hjpo
dHRwOi8vY2RwMS5wY2EuZGZuLmRlL2dsb2JhbC1yb290LWcyLWNhL3B1Yi9jcmwvY2Fjcmwu
Y3JsMECgPqA8hjpodHRwOi8vY2RwMi5wY2EuZGZuLmRlL2dsb2JhbC1yb290LWcyLWNhL3B1
Yi9jcmwvY2FjcmwuY3JsMIHdBggrBgEFBQcBAQSB0DCBzTAzBggrBgEFBQcwAYYnaHR0cDov
L29jc3AucGNhLmRmbi5kZS9PQ1NQLVNlcnZlci9PQ1NQMEoGCCsGAQUFBzAChj5odHRwOi8v
Y2RwMS5wY2EuZGZuLmRlL2dsb2JhbC1yb290LWcyLWNhL3B1Yi9jYWNlcnQvY2FjZXJ0LmNy
dDBKBggrBgEFBQcwAoY+aHR0cDovL2NkcDIucGNhLmRmbi5kZS9nbG9iYWwtcm9vdC1nMi1j
YS9wdWIvY2FjZXJ0L2NhY2VydC5jcnQwDQYJKoZIhvcNAQELBQADggEBABLpeD5FygzqOjj+
/lAOy20UQOGWlx0RMuPcI4nuyFT8SGmK9lD7QCg/HoaJlfU/r78ex+SEide326evlFAoJXIF
jVyzNltDhpMKrPIDuh2N12zyn1EtagqPL6hu4pVRzcBpl/F2HCvtmMx5K4WN1L1fmHWLcSap
dhXLvAZ9RG/B3rqyULLSNN8xHXYXpmtvG0VGJAndZ+lj+BH7uvd3nHWnXEHC2q7iQlDUqg0a
wIqWJgdLlx1Q8Dg/sodv0m+LN0kOzGvVDRCmowBdWGhhusD+duKV66pBl+qhC+4LipariWaM
qK5ppMQROATjYeNRvwI+nDcEXr2vDaKmdbxgDVwwggXOMIIEtqADAgECAgwc17kLLbbkVxsv
ZlkwDQYJKoZIhvcNAQELBQAwajELMAkGA1UEBhMCREUxDzANBgNVBAgMBkJheWVybjERMA8G
A1UEBwwITXVlbmNoZW4xIDAeBgNVBAoMF01heC1QbGFuY2stR2VzZWxsc2NoYWZ0MRUwEwYD
VQQDDAxNUEcgQ0EgLSBHMDIwHhcNMTcwMzAyMTUzNDE5WhcNMjAwMzAxMTUzNDE5WjB3MQsw
CQYDVQQGEwJERTEgMB4GA1UECgwXTWF4LVBsYW5jay1HZXNlbGxzY2hhZnQxLDAqBgNVBAsM
I01heC1QbGFuY2stSW5zdGl0dXQgZnVlciBJbmZvcm1hdGlrMRgwFgYDVQQDDA9BbGV4YW5k
ZXIgS29iZWwwggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQCx9gdQ9DrYiwcDERHN
T7L1NtWuoMM4Wgkf6DDIi+RsDm3E2gcaEb17H5M8KHieoPr7oqH5dnYBePZsX2cYes8I1Qeo
fN5P9tUQL17fo5m6lyVGSHNKmyiRXXqV3nz+s65zLA8JmsdtwL6WH1PHFTFJPwn54ez7sFZB
GuYnhdn+3MzTz+Y17oaR0NerwxsXul5+b8NROSgEyd/odZ0Ux7SBJy3zEkaK/wZYDYOy4ZU6
qdblFZJg/IjimHxuIdn4CogyTQEBXOAGYQOKeffGESYlhzsDjp7hjLDzruozBO2Awsl8rIQ8
BhKpCyNWXScK+ow9c3N7HQjrVeUlb2e46vHNAgMBAAGjggJlMIICYTAJBgNVHRMEAjAAMA4G
A1UdDwEB/wQEAwIF4DAdBgNVHSUEFjAUBggrBgEFBQcDAgYIKwYBBQUHAwQwHQYDVR0OBBYE
FIirYA0Eob1ft3ReFFiBNzVInjF3MB8GA1UdIwQYMBaAFMSIpQfuuHuqDBO/2il0Y1IbSXAW
MFQGA1UdEQRNMEuBFWFrb2JlbEBtcGktaW5mLm1wZy5kZYEeYWxleGFuZGVyLmtvYmVsQG1w
aS1pbmYubXBnLmRlgRJhLWtvYmVsQGEta29iZWwuZGUwfQYDVR0fBHYwdDA4oDagNIYyaHR0
cDovL2NkcDEucGNhLmRmbi5kZS9tcGctZzItY2EvcHViL2NybC9jYWNybC5jcmwwOKA2oDSG
Mmh0dHA6Ly9jZHAyLnBjYS5kZm4uZGUvbXBnLWcyLWNhL3B1Yi9jcmwvY2FjcmwuY3JsMIHN
BggrBgEFBQcBAQSBwDCBvTAzBggrBgEFBQcwAYYnaHR0cDovL29jc3AucGNhLmRmbi5kZS9P
Q1NQLVNlcnZlci9PQ1NQMEIGCCsGAQUFBzAChjZodHRwOi8vY2RwMS5wY2EuZGZuLmRlL21w
Zy1nMi1jYS9wdWIvY2FjZXJ0L2NhY2VydC5jcnQwQgYIKwYBBQUHMAKGNmh0dHA6Ly9jZHAy
LnBjYS5kZm4uZGUvbXBnLWcyLWNhL3B1Yi9jYWNlcnQvY2FjZXJ0LmNydDBABgNVHSAEOTA3
MBEGDysGAQQBga0hgiwBAQQDBTARBg8rBgEEAYGtIYIsAgEEAwEwDwYNKwYBBAGBrSGCLAEB
BDANBgkqhkiG9w0BAQsFAAOCAQEAhW0m9px5N9kguBPUsjWkns2IcutCvbYFFcYwcVnRF7Nz
WnH+9CCVUn7zH7zyM21dyAJazh8hqwHcGrWPBHFe4firdVa+Y4MoiVyjfCYujoa06TougzLS
ogtRqXFVRagy+nJUQU8EmMljt8sDh7SieuBDkP6MHJ6Ga7RI40j5id1kFfCAPDh/to0GuOPL
KaqwejyijdZOTdVA/u57folnulzZ3vm79S0qNd49ZatXT7pdxgr187xPmanmO8QPV/HtatDW
n9vFq+uZB2rYTpVSAVwxgrX8d5E9yQhhWIaoVEzgbhIxRq99cA9unAGh1e5vTQQWcmpvLmfn
0F2/8BLkWjGCA5owggOWAgEBMHowajELMAkGA1UEBhMCREUxDzANBgNVBAgMBkJheWVybjER
MA8GA1UEBwwITXVlbmNoZW4xIDAeBgNVBAoMF01heC1QbGFuY2stR2VzZWxsc2NoYWZ0MRUw
EwYDVQQDDAxNUEcgQ0EgLSBHMDICDBzXuQsttuRXGy9mWTANBglghkgBZQMEAgEFAKCCAfEw
GAYJKoZIhvcNAQkDMQsGCSqGSIb3DQEHATAcBgkqhkiG9w0BCQUxDxcNMTcxMjA1MDkzMzM5
WjAvBgkqhkiG9w0BCQQxIgQgHJasXyKUTI1BSv/C2s8BOBXr5xm8fUPHL4i+3e26u50wbAYJ
KoZIhvcNAQkPMV8wXTALBglghkgBZQMEASowCwYJYIZIAWUDBAECMAoGCCqGSIb3DQMHMA4G
CCqGSIb3DQMCAgIAgDANBggqhkiG9w0DAgIBQDAHBgUrDgMCBzANBggqhkiG9w0DAgIBKDCB
iQYJKwYBBAGCNxAEMXwwejBqMQswCQYDVQQGEwJERTEPMA0GA1UECAwGQmF5ZXJuMREwDwYD
VQQHDAhNdWVuY2hlbjEgMB4GA1UECgwXTWF4LVBsYW5jay1HZXNlbGxzY2hhZnQxFTATBgNV
BAMMDE1QRyBDQSAtIEcwMgIMHNe5Cy225FcbL2ZZMIGLBgsqhkiG9w0BCRACCzF8oHowajEL
MAkGA1UEBhMCREUxDzANBgNVBAgMBkJheWVybjERMA8GA1UEBwwITXVlbmNoZW4xIDAeBgNV
BAoMF01heC1QbGFuY2stR2VzZWxsc2NoYWZ0MRUwEwYDVQQDDAxNUEcgQ0EgLSBHMDICDBzX
uQsttuRXGy9mWTANBgkqhkiG9w0BAQEFAASCAQB6M2eWDIH3UdE5qI+SKoLHcHVqp/yMu72F
Ch+fmPnNu8/HCmEY07fTaaa4YkoIr1pYyc3IP25IJSW1TIwYgb/qQ+o50JBNK3dJcMyqtEsx
QeKuqsDaHKURMs+8XRqEwyheITlHnea/sBljtfqs3Gh9xnv17iTBPHM97Gwf8b8Jb46/xRjE
kjh/O++R7AfaX4q4PcfL9AvY0KKiDzmu6aWfMtT5gtPM45Ft7xgaqBhP7SWLET0eI5R9BAp9
H7CbzrQjNW4hzaDwhBRW8umiPUSeM9Qz1fgYqfKIkgqn81tusjCUDQGesM2Thq/CTWI9ZQMl
yRKkTaSsCPvBBKYoqz/tAAAAAAAA
--------------ms080805080606040907000407--


--===============5127969231578323998==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
--===============5127969231578323998==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

_______________________________________________
BackupPC-devel mailing list
[email protected]
List:    https://lists.sourceforge.net/lists/listinfo/backuppc-devel
Wiki:    http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

--===============5127969231578323998==--