Re: bash 5.3: here-document larger than PIPE_BUF deadlocks on macOS (pipe-backed heredoc, body written before reader is forked)

--00000000000092fa860656522deb
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

Thanks for the fast and detailed reply, and for the pointer to msg00126, I
really appreciate it! That explains it completely, and corrects my
diagnosis. You're right that PIPE_BUF is about write atomicity, not
capacity; I conflated the two because the numbers coincide.

I now agree this is a duplicate of msg00126. I can confirm the maxpipekva
theory directly on the affected machine. Measuring the actual capacity of a
fresh pipe with no reader:

    python3 -c 'import os;r,w=3Dos.pipe();os.set_blocking(w,False);t=3D0
    try:
      while True: t+=3Dos.write(w,b"x"*64)
    except BlockingIOError: print(t)'

    -> 512

So this machine is sitting above the 16 MiB maxpipekva high-water mark and
the kernel is handing out minimum-size (512-byte) pipes, while the Homebrew
bash was built with HEREDOC_PIPESIZE=3D65536.

That also explains what previously looked like nondeterministic behaviour
to me: the hang only happens when the whole-system pipe memory is above the
threshold, so it's not just the here-document size. A reboot drops pipe kva
back under the mark and the same script runs fine (that explains why it
does not reproduce in your machine). In my case, I'm running a lot of
long-lived pipes (tmus, editors, claude-code, bats test suites, etc). I now
have a python script that reproduces this by first creating several pipes
(attached only in case it helps), providing the path to the bash binary as
the first argument can be used to deterministically verify if the issue is
solved.

Happy to test the devel-branch fix on macOS 26 when it lands.

System details, in case they help:
  macOS 26.5.1 (Darwin 25.5.0, arm64, xnu-12377.121.6)
  bash 5.3.15, Homebrew, poured from a prebuilt bottle (not built locally)

On Fri, 10 Jul 2026 at 14:06, Chet Ramey <[email protected]> wrote:

> On 7/10/26 6:28 AM, Juli=C3=A1n Mateu wrote:
>
> > Bash Version: 5.3
> > Patch Level: 15
> > Release Status: release (installed via Homebrew; per the mechanism
> below, a
> > from-source build should also reproduce)
>
> This appears to be very system-specific and the result of changes in rece=
nt
> versions of macOS; see
>
> https://lists.gnu.org/archive/html/bug-bash/2026-06/msg00126.html
>
> for a detailed explanation.
>
> Bash computes the pipe size at build time and assumes it doesn't change,
> and, that if it does, there is a way to determine it at runtime.
>
> I've never hit this on macOS 15 or 26, and the bash test suite uses here-
> documents with sizes 512 <=3D doc <=3D 4096, 4096 <=3D doc <=3D 65536, an=
d larger
> than 65536. I would be shocked if the person who packaged bash for
> homebrew didn't run the test suite, so we can assume they didn't encounte=
r
> this, either.
>
> > Description:
> > On macOS, a here-document whose body exceeds PIPE_BUF (512 bytes on
> Darwin)
> > makes bash 5.3 hang forever.
>
> As above, the issue is a little bit more dynamic than that. Plus PIPE_BUF
> is about write atomicity on pipes, not pipe capacity.
>
>
> > bash on Linux (64 KB pipe buffers) are
> > unaffected.
>
> One nice feature Linux has is the ability to dyamically determine the pip=
e
> buffer size using F_GETPIPE_SZ. It would be nice if macOS offered somethi=
ng
> similar.
>
> >
> > Repeat-By (self-contained, no external tools; run under bash 5.3 on
> macOS):
> >
> >        printf -v body '%*s' 600 ''    # 600-byte body
> >        body=3D${body// /x}
> >        cat <<EOF
> >        $body
> >        EOF
> >        echo done # never printed on bash 5.3 / macOS
>
> This is bash-5.3 on macOS: the first is a locally-built bash-5.3.15; the
> second is from Macports.
>
> $ uname -a
> Darwin Mac.lan 24.6.0 Darwin Kernel Version 24.6.0: Tue Apr 21 20:15:34
> PDT
> 2026; root:xnu-11417.140.69.710.16~1/RELEASE_ARM64_T6031 arm64
> $ cat x2
> printf -v body '%*s' 600 ''    # 600-byte body
> body=3D${body// /x}
> cat <<EOF
> $body
> EOF
> echo done # never printed on bash 5.3 / macOS
> $ ../bash-5.3-patched/bash ./x2
>
> xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx=
xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx=
xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx=
xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx=
xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx=
xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx=
xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx=
xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx=
xx
> done
> $ /opt/local/bin/bash ./x2
>
> xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx=
xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx=
xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx=
xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx=
xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx=
xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx=
xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx=
xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx=
xx
> done
>
> There will be a fix derived from the bug-bash message above in the next
> devel branch push.
>
> Chet
> --
> ``The lyf so short, the craft so long to lerne.'' - Chaucer
>                  ``Ars longa, vita brevis'' - Hippocrates
> Chet Ramey, UTech, CWRU    [email protected]    http://tiswww.cwru.edu/~chet/
>

--00000000000092fa860656522deb
Content-Type: text/x-python-script; charset="US-ASCII"; name="pipes.py"
Content-Disposition: attachment; filename="pipes.py"
Content-Transfer-Encoding: base64
Content-ID: <f_mrg4ytqz0>
X-Attachment-Id: f_mrg4ytqz0

IyEvdXNyL2Jpbi9lbnYgcHl0aG9uMwoiIiIKRGV0ZXJtaW5pc3RpYyByZXByb2R1Y2VyIGZvciB0
aGUgYmFzaCA1LjIgbWFjT1MgaGVyZS1kb2N1bWVudCBoYW5nLgoKTWVjaGFuaXNtIChwZXIgYnVn
LWJhc2ggMjAyNi0wMi9tc2cwMDEyNik6IHJlY2VudCBYTlUgc2l6ZXMgcGllcyBkeW5hbWljYWxs
eQooNTEyIEIgLi4gNjQgS2lCKSBidXQgb25seSAqZ3Jvd3MqIHRoZW0gd2hpbGUgdG90YWwgc3lz
dGVtIHBpcGUgbWVtb3J5IGlzIHVuZGVyCnRoZSAxNiBNaUIgYG1heHBpcGVrdmFgIGhpZ2gtd2F0
ZXIgbWFyay4gSG9tZWJyZXcgYmFzaCB3YXMgYnVpbHQgYmVsaWV2aW5nIGEKcGlwZSBob2xkcyA2
NCBLaUIgKEhFUkVET0NfUElQRVNJWkUpLCBzbyBpdCB3cml0ZXMgYSBtZWRpdW0gaGVyZWRvYyBp
bnRvIGEgcGlwZQpCRUZPUkUgZm9ya2luZyB0aGUgcmVhZGVyLiBJZiB0aGUgbWFjaGluZSBpcyBv
dmVyIHRoZSBtYXJrLCB0aGF0IHBpcGUgaXMgb25seQo1MjEgQiAtPiB0aGUgd3JpdGUgYmxvY2tz
IHdpdGggbm8gcmVhZGVyIC0+IGRlYWRsb2NrLgoKVGhpcyBzY3JpcHQgZm9yY2VzIHRoZSBtYWNo
aW5lIG92ZXIgdGhlIG1hcmsgKDI1NiBwaXBlcyB4IDY0IEtpQiA9IDE2IE1pQiwgaGVsZApvcGVu
KSBhbmQgc2hvd3MgdGhlIGJlZm9yZS9hZnRlcjogb24gYSBmcmVzaGx5LWJvb3RlZCBtYWNoaW5l
IHlvdSBzZWUKNjU1MzYgLT4gNTEyIGFuZCBPSyAtPiBIQU5HLiBPbiBhbiBhbHJlYWR5LW92ZXIt
YnVkZ2V0IG1hY2hpbmUgYm90aCBhcmUgNTEyL0hBTkcuCiIiIgppbXBvcnQgb3MsIHN1YnByb2Nl
c3MsIHN5cywgcmVzb3VyY2UKCiMgMjU2IGdyb3duIHBpcGVzIG5lZWQgfjUxMiBmZHM7IG1hY09T
IGRlZmF1bHRzIHRoZSBzb2Z0IGxpbWl0IHRvIDI1Ni4gUmFpc2UgaXQuCl8sIGhhcmQgPSByZXNv
dXJjZS5nZXRybGltaXQocmVzb3VyY2UuUkxJTUlUX05PRklMRSkKZm9yIHRhcmdldCBpbiAoNDA5
NiwgMjA0OCwgMTAyNCk6CiAgICB0cnk6CiAgICAgICAgcmVzb3VyY2Uuc2V0cmxpbWl0KHJlc291
cmNlLlJMSU1JVF9OT0ZJTEUsICh0YXJnZXQsIGhhcmQpKQogICAgICAgIGJyZWFrCiAgICBleGNl
cHQgKFZhbHVlRXJyb3IsIE9TRXJyb3IpOgogICAgICAgIGNvbnRpbnVlCkZEX1NPRlQgPSByZXNv
dXJjZS5nZXRybGltaXQocmVzb3VyY2UuUkxJTUlUX05PRklMRSlbMF0KCkJBU0ggPSAiL29wdC9o
b21lYnJldy9iaW4vYmFzaCIgaWYgbGVuKHN5cy5hcmd2KSA9PSAxIGVsc2Ugc3lzLmFyZ3ZbMV0K
IyBCQVNIID0gIi9iaW4vYmFzaCIKIyA1MTMtYnl0ZSBoZXJlLXN0cmluZyBib2R5OiB0aGUgbWlu
aW1hbCBjYXNlICg+NTEyLCA8PSA2NCBLaUIpLgpURVNUID0gW0JBU0gsICctYycsICdjYXQgPDw8
ICIkKHByaW50ZiAlMDUxM2QgMCkiID4gL2Rldi9udWxsICYmIGVjaG8gT0snXQoKZGVmIHBpcGVf
Y2FwYWNpdHkoKToKICAgICIiIkNhcGFjaXR5IG9mIGEgYnJhbmQtbmV3IHBpcGUgd2l0aCBubyBy
ZWFkZXIgKGdyb3dzIHRvIDY0IEtpQiBpZiB0aGUga2VybmVsIGNhbikuIiIiCiAgICByLCB3ID0g
b3MucGlwZSgpOyBvcy5zZXRfYmxvY2tpbmcodywgRmFsc2UpOyBuID0gMAogICAgdHJ5OgogICAg
ICAgIHdoaWxlIFRydWU6IG4gKz0gb3Mud3JpdGUodywgYiJ4IiAqIDQwOTYpCiAgICBleGNlcHQg
KEJsb2NraW5nSU9FcnJvciwgT1NFcnJvcik6IHBhc3MKICAgIG9zLmNsb3NlKHIpOyBvcy5jbG9z
ZSh3KQogICAgcmV0dXJuIG4KCmRlZiBiYXNoX2hlcmVkb2MobGFiZWwpOgogICAgdHJ5OgogICAg
ICAgIHN1YnByb2Nlc3MucnVuKFRFU1QsIHRpbWVvdXQ9NSwgY2FwdHVyZV9vdXRwdXQ9VHJ1ZSkK
ICAgICAgICBwcmludChmIiAge2xhYmVsfTogYmFzaCA1MTMtYnl0ZSBoZXJlZG9jIC0+IE9LIChj
b21wbGV0ZWQpIikKICAgIGV4Y2VwdCBzdWJwcm9jZXNzLlRpbWVvdXRFeHBpcmVkOgogICAgICAg
IHByaW50KGYiICB7bGFiZWx9OiBiYXNoIDUxMy1ieXRlIGhlcmVkb2MgLT4gSEFORyAoZGVhZGxv
Y2tlZCwga2lsbGVkIGF0IDVzKSIpCgpwcmludChmImZkIHNvZnQgbGltaXQgaXMgbm93IHtGRF9T
T0ZUfSIpCmJhc2UgPSBwaXBlX2NhcGFjaXR5KCkKcHJpbnQoZiJiYXNlbGluZSBmcmVzaC1waXBl
IGNhcGFjaXR5OiB7YmFzZX0gYnl0ZXMgKDY1NTM2PWhlYWx0aHksIDUxMj1vdmVyLW1hcmspIikK
YmFzaF9oZXJlZG9jKCJCRUZPUkUiKQoKaWYgYmFzZSA8PSAxMDI0OgogICAgcHJpbnQoZiI+Pj4g
QUxSRUFEWSBvdmVyIHRoZSBtYXJrLiBUaGUgaGFuZCBpcyBhbHJlYWR5IGRldGVybWluaXN0aWMg
aGVyZTsgcmVib290IHRvIHJlc2V0LiIpCiAgICByYWlzZSBTeXN0ZW1FeGl0CgoKaGVsZCwgY3Jv
c3NlZCA9IFtdLCBGYWxzZQp0cnk6CiAgICBmb3IgaSBpbiByYW5nZSg2MDApOgogICAgICAgIHIs
IHcgPSBvcy5waXBlKCk7IG9zLnNldF9ibG9ja2luZyh3LCBGYWxzZSkKICAgICAgICB0cnk6CiAg
ICAgICAgICAgIHdoaWxlIFRydWU6IG9zLndyaXRlKHcsIGIieCIgKiA0MDk2KSAjIGdyb3cgdG8g
fjY0IEtpQiwgaG9sZCB0aGUgZGF0YQogICAgICAgIGV4Y2VwdCAoQmxvY2tpbmdJT0Vycm9yLCBP
U0Vycm9yKTogcGFzcwogICAgICAgIGhlbGQuYXBwZW5kKChyLCB3KSkKICAgICAgICBpZiBwaXBl
X2NhcGFjaXR5KCkgPD0gMTAyNDogIyBhIG5ldyBwaXBlIGNhbiBubyBsb25nZXIgZ3JvdwogICAg
ICAgICAgICBwcmludChmImNyb3NzZWQgdGhlIDE2IE1pQiBtYXhwaXBla3ZhIG1hcmsgYWZ0ZXIg
YWxsb2NhdGluZyB7aSsxfSBmdWxsIHBpcGVzIikKICAgICAgICAgICAgY3Jvc3NlZCA9IFRydWUK
ICAgICAgICAgICAgYnJlYWsKZXhjZXB0IE9TRXJyb3IgYXMgZToKICAgIHByaW50KGYicmFuIG91
dCBvZiBmZHMgYWZ0ZXIge2xlbihoZWxkKX0gcGlwZXMgKHtlfSk7IHJ1biAndWxpbWl0IC1uIDQw
OTYnIGZpcnN0IikKCmlmIG5vdCBjcm9zc2VkOgogICAgcHJpbnQoZiJkaWQgbm90IGNyb3NzIHRo
ZSBtYXJrIHdpdGhpbiB0aGUgcGlwZS9mZCBidWRnZXQgYXZhaWxhYmxlIikKcHJpbnQoZiJhZnRl
ci1maWxsIGZyZXNoLXBpcGUgY2FwYWNpdHk6IHtwaXBlX2NhcGFjaXR5KCl9IGJ5dGVzICg2NTUz
Nj1oZWFsdGh5LCA1MTI9b3Zlci1tYXJrKSIpCmJhc2hfaGVyZWRvYygiQUZURVIgIikKcHJpbnQo
ZiIoaG9sZGluZyB7bGVuKGhlbGQpfSBwaXBlczsgdGhleSBmcmVlIHdoZW4gdGhpcyBwcm9jZXNz
IGV4aXRzKSIpCg==
--00000000000092fa860656522deb--