Re: ipropd slow when pushing complete database

This is a cryptographically signed message in MIME format.

--------------ms080500060104080904000406
Content-Type: text/plain; charset=utf-8
Content-Language: en-US
Content-Transfer-Encoding: quoted-printable

On 12/19/2018 1:21 PM, [email protected] wrote:
> I sometimes push the entire master database to a replica. I do this
> using ipropd. The process is to stop ipropd-slave on the slave, delete
> the database and log files, and then restart the ipropd-slave service.
> The entire database is then pushed to the slave.
>=20
> When pushing the database via ipropd to a traditional VM the process
> takes a very long time, upwards of 5 to 6 *minutes*. I also get these
> speeds when pushing to a stretch container running as a slave. In the
> past, when using Heimdal 7.1 and pushing to a jessie container, the
> speed was quite fast, around 10 seconds.
>=20
> For comparison, I did an scp of a copy of the database file from the
> master to the slave, and that only took about 6 seconds.
>=20
> I realize that doing an ssh copy is not at all the same thing as doing
> an ipropd copy from version 0, but something must be wrong if the iprop=
d
> copy is 50 to 60 times slower.
>=20
> I am running Heimdal version 7.5 on Debian stretch machines. The
> database file is around 430 MB and the log file is around 23MB.
>=20
> Anyone have any troubleshooting steps to find out why ipropd is so slow=
?
>=20
> Thanks, Adam Lewenberg

Looking at the changes from 7.1 to 7.5 there isn't anything obvious in
ipropd that could alter the performance.

  git log -p heimdal-7.1.0..heimdal-7.5.0 lib/kadm5/

I would start by comparing heimdal 7.5 on jessie with 7.1 on jessie or
7.1 on stretch with 7.5 on stretch.

I'm sure that there have been many changes in the network plumping
between jessie and stretch with regards to containers.  Start by
reducing the variables.

Jeffrey Altman



--------------ms080500060104080904000406
Content-Type: application/pkcs7-signature; name="smime.p7s"
Content-Transfer-Encoding: base64
Content-Disposition: attachment; filename="smime.p7s"
Content-Description: S/MIME Cryptographic Signature

MIAGCSqGSIb3DQEHAqCAMIACAQExDzANBglghkgBZQMEAgEFADCABgkqhkiG9w0BBwEAAKCC
DJowggYBMIIE6aADAgECAhBAAWafTz5dAElKUO3y42hlMA0GCSqGSIb3DQEBCwUAMDoxCzAJ
BgNVBAYTAlVTMRIwEAYDVQQKEwlJZGVuVHJ1c3QxFzAVBgNVBAMTDlRydXN0SUQgQ0EgQTEy
MB4XDTE4MTAyMzA1MDQyMloXDTE5MTEwMzA1MDQyMlowgZUxNTAzBgNVBAsMLFZlcmlmaWVk
IEVtYWlsOiBqYWx0bWFuQHNlY3VyZS1lbmRwb2ludHMuY29tMSswKQYJKoZIhvcNAQkBFhxq
YWx0bWFuQHNlY3VyZS1lbmRwb2ludHMuY29tMS8wLQYKCZImiZPyLGQBARMfQTAxNDI3RTAw
MDAwMTY2OUY0RjNFMjcwMDAwMzFGQjCCASIwDQYJKoZIhvcNAQEBBQADggEPADCCAQoCggEB
AJTyhcbPAvKyN1Vs9gjMN6oYnNwvoje6fdgl1mlqAkeIjASHSt1rupAuwXDcTCNVo7k4veY3
bmY9/q32DigX84dt/a15AQDBYhuCn0b5KKTkxOFTq0feIg2NjTz5w4Qnl7fsycxOeJurQXKT
wS655O4M3iGb0Y+txxCLwFfWD9p2TQ/nbZXmiCk0Kb+Zsd3IIMwpQ9JU9lSsQqIUzNZ+/3gE
eY9oAz7gEWHiOxp/0rnR0DKSqVIS0e7kVhBXjJ59G8iCWMoeSNVy1iVBcLz2TUt8HsEVUPjI
rsasYjbBt/PoHXZsNvJ/eN7I3KNiWf00ubf+4kzo92l31VJ/PkwEQNcCAwEAAaOCAqUwggKh
MA4GA1UdDwEB/wQEAwIFoDCBhAYIKwYBBQUHAQEEeDB2MDAGCCsGAQUFBzABhiRodHRwOi8v
Y29tbWVyY2lhbC5vY3NwLmlkZW50cnVzdC5jb20wQgYIKwYBBQUHMAKGNmh0dHA6Ly92YWxp
ZGF0aW9uLmlkZW50cnVzdC5jb20vY2VydHMvdHJ1c3RpZGNhYTEyLnA3YzAfBgNVHSMEGDAW
gBSkc9rvaTWKdcygGXsIMvhrieRC7DAJBgNVHRMEAjAAMIIBLAYDVR0gBIIBIzCCAR8wggEb
BgtghkgBhvkvAAYLATCCAQowSgYIKwYBBQUHAgEWPmh0dHBzOi8vc2VjdXJlLmlkZW50cnVz
dC5jb20vY2VydGlmaWNhdGVzL3BvbGljeS90cy9pbmRleC5odG1sMIG7BggrBgEFBQcCAjCB
rhqBq1RoaXMgVHJ1c3RJRCBDZXJ0aWZpY2F0ZSBoYXMgYmVlbiBpc3N1ZWQgaW4gYWNjb3Jk
YW5jZSB3aXRoIApJZGVuVHJ1c3QncyBUcnVzdElEIENlcnRpZmljYXRlIFBvbGljeSBmb3Vu
ZCBhdCBodHRwczovL3NlY3VyZS5pZGVudHJ1c3QuY29tL2NlcnRpZmljYXRlcy9wb2xpY3kv
dHMvaW5kZXguaHRtbDBFBgNVHR8EPjA8MDqgOKA2hjRodHRwOi8vdmFsaWRhdGlvbi5pZGVu
dHJ1c3QuY29tL2NybC90cnVzdGlkY2FhMTIuY3JsMCcGA1UdEQQgMB6BHGphbHRtYW5Ac2Vj
dXJlLWVuZHBvaW50cy5jb20wHQYDVR0OBBYEFJdlICa5IVm/mQsa1LIql1jf/0BXMB0GA1Ud
JQQWMBQGCCsGAQUFBwMCBggrBgEFBQcDBDANBgkqhkiG9w0BAQsFAAOCAQEAvSWHh+2vqTbu
65C4E+eXKv9Wz5LzqJNGWbkMq0a4/LswbvpWgG3AmFqeWXmbjfoFxWjnltt4mAYH2s/YCE9X
74kc7TXcRW+GKLGbazW2v/gffBYHudxjtIJRvQpcsiqqYRI0eVCer3kRdAPuEYz+62y1CACP
qwvaNo4fSHCSEqLDglgxFw7bNs0xV4Fb0yw4L4bv1zsnT6hrNQ4ibJEqQ7Ciq1sDRAGc4SmV
P9I0rbCV6mYlxxOEvvUPFfppp4/YAKTLtXuzB+QeTW8fR1HvVbRZitnvTEBVP8ChDwhlj6NA
l16ZeJWeo+Wru3Lv4HCV2PuKyJjKoFYyr6Y3GjZ3ZzCCBpEwggR5oAMCAQICEQD53lZ/yU0M
d3D5YBtS2hU7MA0GCSqGSIb3DQEBCwUAMEoxCzAJBgNVBAYTAlVTMRIwEAYDVQQKEwlJZGVu
VHJ1c3QxJzAlBgNVBAMTHklkZW5UcnVzdCBDb21tZXJjaWFsIFJvb3QgQ0EgMTAeFw0xNTAy
MTgyMjI1MTlaFw0yMzAyMTgyMjI1MTlaMDoxCzAJBgNVBAYTAlVTMRIwEAYDVQQKEwlJZGVu
VHJ1c3QxFzAVBgNVBAMTDlRydXN0SUQgQ0EgQTEyMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8A
MIIBCgKCAQEA0ZFNPM8KJzSSrkvpmtQla3ksT+fq1s9c+Ea3YSC/umUkygSm9UkkOoaoNjKZ
oCx3wef1kwC4pQQV2XHk+AKR+7uMvnOCIw2cAVUP0/Kuy4X6miqaXGGVDTqwVjaFuFCRVVDT
QoI2BTMpwFQi+O/TjD5+E0+TAZbkzsB7krk4YUbA6hFyT0YboxRUq9M2QHDb+80w53b1UZVO
1HS2Mfk9LnINeyzjxiXU/iENK07YvjBOxbY/ftAYPbv/9cY3wrpqZYHoXZc6B9/8+aVCNA45
FP3k+YuTDC+ZrmePQBLQJWnyS/QrZEdXsaieWUqkUMxPQKTExArCiP61YRYlOIMpKwIDAQAB
o4ICgDCCAnwwgYkGCCsGAQUFBwEBBH0wezAwBggrBgEFBQcwAYYkaHR0cDovL2NvbW1lcmNp
YWwub2NzcC5pZGVudHJ1c3QuY29tMEcGCCsGAQUFBzAChjtodHRwOi8vdmFsaWRhdGlvbi5p
ZGVudHJ1c3QuY29tL3Jvb3RzL2NvbW1lcmNpYWxyb290Y2ExLnA3YzAfBgNVHSMEGDAWgBTt
RBnA0/AGi+6ke75C5yZUyI42djAPBgNVHRMBAf8EBTADAQH/MIIBIAYDVR0gBIIBFzCCARMw
ggEPBgRVHSAAMIIBBTCCAQEGCCsGAQUFBwICMIH0MEUWPmh0dHBzOi8vc2VjdXJlLmlkZW50
cnVzdC5jb20vY2VydGlmaWNhdGVzL3BvbGljeS90cy9pbmRleC5odG1sMAMCAQEagapUaGlz
IFRydXN0SUQgQ2VydGlmaWNhdGUgaGFzIGJlZW4gaXNzdWVkIGluIGFjY29yZGFuY2Ugd2l0
aCBJZGVuVHJ1c3QncyBUcnVzdElEIENlcnRpZmljYXRlIFBvbGljeSBmb3VuZCBhdCBodHRw
czovL3NlY3VyZS5pZGVudHJ1c3QuY29tL2NlcnRpZmljYXRlcy9wb2xpY3kvdHMvaW5kZXgu
aHRtbDBKBgNVHR8EQzBBMD+gPaA7hjlodHRwOi8vdmFsaWRhdGlvbi5pZGVudHJ1c3QuY29t
L2NybC9jb21tZXJjaWFscm9vdGNhMS5jcmwwHQYDVR0lBBYwFAYIKwYBBQUHAwIGCCsGAQUF
BwMEMA4GA1UdDwEB/wQEAwIBhjAdBgNVHQ4EFgQUpHPa72k1inXMoBl7CDL4a4nkQuwwDQYJ
KoZIhvcNAQELBQADggIBAA3hgq7S+/TrYxl+D7ExI1Rdgq8fC9kiT7ofWlSaK/IMjgjoDfBb
PGWvzdkmbSgYgXo8GxuAon9+HLIjNv68BgUmbIjwj/SYaVz6chA25XZdjxzKk+hUkqCmfOn/
twQJeRfxHg3I+0Sfwp5xs10YF0RobhrsCRne6OUmh9mph0fE3b21k90OVnx9Hfr+YAV4ISrT
A6045zQTKGzb370whliPLFo+hNL6XzEty5hfdFaWKtHIfpE994CLmTJI4SEbWq40d7TpAjCm
KCPIVPq/+9GqggGvtakM5K3VXNc9VtKPU9xYGCTDIYoeVBQ65JsdsdyM4PzDzAdINsv4vaF7
yE03nh2jLV7XAkcqad9vS4EB4hKjFFsmcwxa+ACUfkVWtBaWBqN4f/o1thsFJHEAu4Q6oRB6
mYkzqrPigPazF2rgYw3lp0B1gSzCRj+jRtErIVdMPeZ2p5Fdx7SNhBtabuhqmpJkFxwW9SBg
6sHvy0HpzVvEiBpApFKG1ZHXMwzQl+pR8P27wWDsblJU7Qgb8ZzGRK9l5GOFhxtN+oXZ4CCm
unLMtaZ2vSai7du/VKrg64GGZNAKerEBevjJVNFgeSnmUK9GB4kCZ7U5NWlU+2H87scntW4Q
/0Y6vqQJcJeaMHg/dQnahTQ2p+hB1xJJK32GWIAucTFMSOKLbQHadIOiMYIDFDCCAxACAQEw
TjA6MQswCQYDVQQGEwJVUzESMBAGA1UEChMJSWRlblRydXN0MRcwFQYDVQQDEw5UcnVzdElE
IENBIEExMgIQQAFmn08+XQBJSlDt8uNoZTANBglghkgBZQMEAgEFAKCCAZcwGAYJKoZIhvcN
AQkDMQsGCSqGSIb3DQEHATAcBgkqhkiG9w0BCQUxDxcNMTgxMjE5MTk1NDM5WjAvBgkqhkiG
9w0BCQQxIgQg6Jf17nGJe5WXK/4v+gQHOGanIxfPpzoL38XZCOo630YwXQYJKwYBBAGCNxAE
MVAwTjA6MQswCQYDVQQGEwJVUzESMBAGA1UEChMJSWRlblRydXN0MRcwFQYDVQQDEw5UcnVz
dElEIENBIEExMgIQQAFmn08+XQBJSlDt8uNoZTBfBgsqhkiG9w0BCRACCzFQoE4wOjELMAkG
A1UEBhMCVVMxEjAQBgNVBAoTCUlkZW5UcnVzdDEXMBUGA1UEAxMOVHJ1c3RJRCBDQSBBMTIC
EEABZp9PPl0ASUpQ7fLjaGUwbAYJKoZIhvcNAQkPMV8wXTALBglghkgBZQMEASowCwYJYIZI
AWUDBAECMAoGCCqGSIb3DQMHMA4GCCqGSIb3DQMCAgIAgDANBggqhkiG9w0DAgIBQDAHBgUr
DgMCBzANBggqhkiG9w0DAgIBKDANBgkqhkiG9w0BAQEFAASCAQBmgexRMszbzU/3ejxKmz+1
dRFPFZo+Ka4GTiMW6D5fx1srZFs34he0jUzFgyRghucdOxxeIZKhv+rih7tdRsaDtgam1vOI
8ijbZpv9gv5zYZcBbvxwxjojYSjCcQvLeTNd3qUgxO3u4GQOqsLAMWCNHXOZ62cTCvyITE64
kcdxTXkupDKHi6f0+ajN8p9P04bl0klSM47cYIFNrpts2bmcog0uCxXX8iMPJERs8Ede6c1v
0aM3+hc1ETj1YYtzpOwviY315LrU0nq+lfg333UrB8SZOfAcSF8Qjay39OFH9PPmbPz5ovle
xuDAnGaKuSAqMOaoZgmKIvfVc/lGbmjNAAAAAAAA
--------------ms080500060104080904000406--