fix for partial reads from cache
Raven Kopelman <[email protected]> Tue, 27 Oct 2020 13:00:24 -0700
| Newsgroups | gmane.comp.programming.tools.scons.devel |
|---|---|
| Message-ID | <CAHoKKaqC7vSToj88Xp8OOnTo=KTQV4syBQ1zKoSu8t6kWLUs0Q@mail.gmail.com> |
--0000000000000ca79805b2ac80c4 Content-Type: multipart/alternative; boundary="0000000000000ca79605b2ac80c2" --0000000000000ca79605b2ac80c2 Content-Type: text/plain; charset="UTF-8" Hi scons devs, Here's a fix to clean up reads from the cache that fail part way through. Absolutely experienced by us in production (non-local shared cache). This may be what my last UUID temp name fix was really trying to address, but I can imagine edge cases that the UUID fix could still improve. This could also have been fixed in Taskmaster.py near my comment change, but the reasons for cleanup seemed different enough to keep them distinct. Also cleaned up the logged message tense, as message is logged before the cache retrieval begins. Thanks! -- *Raven Kopelman* | Team Lead, Senior Developer Safe Software Inc. *T* 604.501.9985 x 331 | *F* 604.501.9965 [email protected] | www.safe.com <http://www.safe.com/emailsignature> --0000000000000ca79605b2ac80c2 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable <div dir=3D"ltr"><div>Hi scons devs,</div><div><br></div><div>Here's a = fix to clean up reads from the cache that fail part way through.=C2=A0 Abso= lutely experienced by us in production (non-local shared cache).=C2=A0 This= may be what my last UUID temp name fix was really trying to address, but I= can imagine edge cases that the UUID fix could still improve.</div><div><b= r></div><div>This could also have been fixed in Taskmaster.py near my comme= nt change, but the reasons for cleanup seemed different enough to keep them= distinct.<br></div><div><br></div><div>Also cleaned up the logged message = tense, as message is logged before the cache retrieval begins.</div><div><b= r></div><div>Thanks!<br></div><div><div><div dir=3D"ltr" class=3D"gmail_sig= nature" data-smartmail=3D"gmail_signature"><div dir=3D"ltr"><div><div dir= =3D"ltr"><div><div dir=3D"ltr"><div><div dir=3D"ltr"><div><div dir=3D"ltr">= <div><div dir=3D"ltr"><div><div dir=3D"ltr"><div><div dir=3D"ltr"><div><div= dir=3D"ltr">--<br><b>Raven Kopelman</b> | Team Lead, Senior Developer<br><= br><div dir=3D"ltr">Safe Software Inc.</div><b>T</b> 604.501.9985 x 331 | <= b>F</b> 604.501.9965</div><div dir=3D"ltr"><a href=3D"mailto:raven.kopelman= @safe.com" target=3D"_blank">[email protected]</a> | <a href=3D"http:= //www.safe.com" target=3D"_blank">www.safe.com</a></div><div dir=3D"ltr"><d= iv><br></div><div><div><a href=3D"http://www.safe.com/emailsignature" targe= t=3D"_blank"><img src=3D"http://cdn.safe.com/emailsignature.jpg"></a><br></= div></div></div></div></div></div></div></div></div></div></div></div></div= ></div></div></div></div></div></div></div></div></div></div> --0000000000000ca79605b2ac80c2-- --0000000000000ca79805b2ac80c4 Content-Type: text/x-patch; charset="US-ASCII"; name="partialReadFix.patch" Content-Disposition: attachment; filename="partialReadFix.patch" Content-Transfer-Encoding: base64 Content-ID: <f_kgse74bc0> X-Attachment-Id: f_kgse74bc0 ZGlmZiAtcnUgLXggJyoucHljJyBTQ29ucy5vcmlnL0NhY2hlRGlyLnB5IC91c3IvbG9jYWwvbGli L3B5dGhvbjIuNy9kaXN0LXBhY2thZ2VzL3Njb25zL1NDb25zL0NhY2hlRGlyLnB5Ci0tLSBTQ29u cy5vcmlnL0NhY2hlRGlyLnB5CTIwMjAtMTAtMjMgMTY6MTI6NDQuNzczMzQ5Mjg1IC0wNzAwCisr KyAvdXNyL2xvY2FsL2xpYi9weXRob24yLjcvZGlzdC1wYWNrYWdlcy9zY29ucy9TQ29ucy9DYWNo ZURpci5weQkyMDIwLTEwLTIzIDE2OjE5OjQ4LjY3NjU3MDM4MiAtMDcwMApAQCAtNTYsNyArNTYs MjAgQEAKICAgICAgICAgaWYgZnMuaXNsaW5rKGNhY2hlZmlsZSk6CiAgICAgICAgICAgICBmcy5z eW1saW5rKGZzLnJlYWRsaW5rKGNhY2hlZmlsZSksIHQuZ2V0X2ludGVybmFsX3BhdGgoKSkKICAg ICAgICAgZWxzZToKLSAgICAgICAgICAgIGVudi5jb3B5X2Zyb21fY2FjaGUoY2FjaGVmaWxlLCB0 LmdldF9pbnRlcm5hbF9wYXRoKCkpCisgICAgICAgICAgICB0cnk6CisgICAgICAgICAgICAgICAg ZW52LmNvcHlfZnJvbV9jYWNoZShjYWNoZWZpbGUsIHQuZ2V0X2ludGVybmFsX3BhdGgoKSkKKyAg ICAgICAgICAgIGV4Y2VwdDoKKyAgICAgICAgICAgICAgICB0cnk6CisgICAgICAgICAgICAgICAg ICAgICMgSW4gY2FzZSBmaWxlIHdhcyBwYXJ0aWFsbHkgcmV0cmlldmVkIChhbmQgbm93IGNvcnJ1 cHQpCisgICAgICAgICAgICAgICAgICAgICMgZGVsZXRlIGl0IHRvIGF2b2lkIHBvaXNvbmluZyBj b21tYW5kcyBsaWtlICdhcicgdGhhdAorICAgICAgICAgICAgICAgICAgICAjIHJlYWQgZnJvbSB0 aGUgaW5pdGlhbCBzdGF0ZSBvZiB0aGUgZmlsZSB0aGV5IGFyZSB3cml0aW5nCisgICAgICAgICAg ICAgICAgICAgICMgdG8uCisgICAgICAgICAgICAgICAgICAgIHQuZnMudW5saW5rKHQuZ2V0X2lu dGVybmFsX3BhdGgoKSkKKyAgICAgICAgICAgICAgICBleGNlcHQ6CisgICAgICAgICAgICAgICAg ICAgIHBhc3MKKworICAgICAgICAgICAgICAgIHJhaXNlCisKICAgICAgICAgICAgIHRyeToKICAg ICAgICAgICAgICAgICBvcy51dGltZShjYWNoZWZpbGUsIE5vbmUpCiAgICAgICAgICAgICBleGNl cHQgT1NFcnJvcjoKQEAgLTcxLDcgKzg0LDcgQEAKICAgICBjZCA9IGVudi5nZXRfQ2FjaGVEaXIo KQogICAgIGNhY2hlZGlyLCBjYWNoZWZpbGUgPSBjZC5jYWNoZXBhdGgodCkKICAgICBpZiB0LmZz LmV4aXN0cyhjYWNoZWZpbGUpOgotICAgICAgICByZXR1cm4gIlJldHJpZXZlZCBgJXMnIGZyb20g Y2FjaGUiICUgdC5nZXRfaW50ZXJuYWxfcGF0aCgpCisgICAgICAgIHJldHVybiAiUmV0cmlldmlu ZyBgJXMnIGZyb20gY2FjaGUiICUgdC5nZXRfaW50ZXJuYWxfcGF0aCgpCiAgICAgcmV0dXJuIE5v bmUKIAogQ2FjaGVSZXRyaWV2ZSA9IFNDb25zLkFjdGlvbi5BY3Rpb24oQ2FjaGVSZXRyaWV2ZUZ1 bmMsIENhY2hlUmV0cmlldmVTdHJpbmcpCmRpZmYgLXJ1IC14ICcqLnB5YycgU0NvbnMub3JpZy9U YXNrbWFzdGVyLnB5IC91c3IvbG9jYWwvbGliL3B5dGhvbjIuNy9kaXN0LXBhY2thZ2VzL3Njb25z L1NDb25zL1Rhc2ttYXN0ZXIucHkKLS0tIFNDb25zLm9yaWcvVGFza21hc3Rlci5weQkyMDIwLTEw LTIzIDE2OjEyOjQ0Ljc4NTM0OTM3OCAtMDcwMAorKysgL3Vzci9sb2NhbC9saWIvcHl0aG9uMi43 L2Rpc3QtcGFja2FnZXMvc2NvbnMvU0NvbnMvVGFza21hc3Rlci5weQkyMDIwLTEwLTIzIDE1OjU1 OjQxLjUyMTc1ODc2MiAtMDcwMApAQCAtMjQzLDEwICsyNDMsMTMgQEAKICAgICAgICAgICAgICAg ICBjYWNoZWRfdGFyZ2V0cy5hcHBlbmQodCkKICAgICAgICAgICAgIGlmIGxlbihjYWNoZWRfdGFy Z2V0cykgPCBsZW4oc2VsZi50YXJnZXRzKToKICAgICAgICAgICAgICAgICAjIFJlbW92ZSB0YXJn ZXRzIGJlZm9yZSBidWlsZGluZy4gSXQncyBwb3NzaWJsZSB0aGF0IHdlCi0gICAgICAgICAgICAg ICAgIyBwYXJ0aWFsbHkgcmV0cmlldmVkIHRhcmdldHMgZnJvbSB0aGUgY2FjaGUsIGxlYXZpbmcK LSAgICAgICAgICAgICAgICAjIHRoZW0gaW4gcmVhZC1vbmx5IG1vZGUuIFRoYXQgbWlnaHQgY2F1 c2UgdGhlIGNvbW1hbmQKKyAgICAgICAgICAgICAgICAjIHJldHJpZXZlZCBhIHN1YnNldCBvZiB0 YXJnZXRzIGZyb20gdGhlIGNhY2hlLCBsZWF2aW5nCisgICAgICAgICAgICAgICAgIyB0aGVtIGlu IGFuIGluY29uc2lzdGVudCBzdGF0ZS4gVGhhdCBtaWdodCBjYXVzZSB0aGUgY29tbWFuZAogICAg ICAgICAgICAgICAgICMgdG8gZmFpbC4KICAgICAgICAgICAgICAgICAjCisgICAgICAgICAgICAg ICAgIyBOb3RlIHRoYXQgcmV0cmlldmVfZnJvbV9jYWNoZSgpIGVuc3VyZXMgbm8gc2luZ2xlIHRh cmdldCBjYW4KKyAgICAgICAgICAgICAgICAjIGJlIHBhcnRpYWxseSByZXRyaWV2ZWQgKGZpbGUg bGVmdCBpbiBjb3JydXB0IHN0YXRlKS4KKyAgICAgICAgICAgICAgICAjCiAgICAgICAgICAgICAg ICAgZm9yIHQgaW4gY2FjaGVkX3RhcmdldHM6CiAgICAgICAgICAgICAgICAgICAgIHRyeToKICAg ICAgICAgICAgICAgICAgICAgICAgIHQuZnMudW5saW5rKHQuZ2V0X2ludGVybmFsX3BhdGgoKSkK --0000000000000ca79805b2ac80c4 Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Scons-dev mailing list [email protected] https://pairlist2.pair.net/mailman/listinfo/scons-dev --0000000000000ca79805b2ac80c4--