weird occasional "Resource exhaustion" errors when linking GENERIC_KASLR

"Greg A. Woods" <[email protected]>
Newsgroups gmane.os.netbsd.current,gmane.os.netbsd.ports.x86-64
Message-ID <[email protected]>
I've been using a stock 9.0 amd64 install to build my -current tree and
found it failing with a "Resource exhaustion" error (also "Out of
memory") when linking the GENERIC_KASLR kernel.

Here I leant on ^T while it built and this is the last message before it
died (with the "nbmake" lines edited out):

	[ 155166.4979147] load: 1.54  cmd: nbctfmerge 7370 [iowait 0x45fc5f/4] 46.23u 1.99s 148% 1628476k
	Out of memory

Again, but with the different error message:

	[ 155250.5722602] load: 1.41  cmd: nbctfmerge 18682 [iowait 0x45fc5f/7] 46.18u 1.43s 152% 1444080k
	ERROR: nbctfmerge: netbsd: Cannot get sect .debug_line.1 data: Resource exhaustion


Then without "warning" it will ramp up to near twice as much memory and
just work A-OK:

	[ 155591.1865138] load: 0.81  cmd: nbctfmerge 15691 [iowait 0x42522a/4] 46.28u 3.71s 142% 2382048k
	[ 155591.2765553] load: 0.81  cmd: nbctfmerge 15691 [iowait 0x42522a/4] 46.28u 3.80s 142% 2382048k
	[ 155591.3665934] load: 0.81  cmd: nbctfmerge 15691 [iowait 0x45ab1a/5] 46.28u 3.89s 142% 2076944k
	[ 155591.4566282] load: 0.81  cmd: nbctfmerge 15691 [0x45e35a/0] 46.28u 3.98s 142% 0k
	[ 155591.5466663] load: 0.81  cmd: nbctfmerge 15691 [0x45e35a/0] 46.28u 4.07s 142% 0k
	[ 155591.6467075] load: 0.82  cmd: nbctfmerge 15691 [0x45e35a/0] 46.28u 4.16s 140% 0k
	[ 155591.7367458] load: 0.82  cmd: nbctfmerge 15691 [0x45e35a/0] 46.28u 4.25s 140% 0k
	mv -f netbsd netbsd.gdb
	/build/woods/xentastic/current-amd64-amd64-tools/bin/x86_64--netbsd-strip -g -o netbsd netbsd.gdb


This did not happen with the exact same source tree when building on
either an 8.99.32 or 9.99.64 system running in a Xen domU on similar
hardware.


For the record, thinking this might be an rlimit issue, I opened things
up to the max to no avail, but even with these limits the link often
fails:

	$ ulimit -a
	time(cpu-seconds)    unlimited
	file(blocks)         unlimited
	coredump(blocks)     unlimited
	data(kbytes)         8388608
	stack(kbytes)        32768
	lockedmem(kbytes)    524288
	memory(kbytes)       2048000
	nofiles(descriptors) 3404
	processes            420
	threads              2048
	vmemory(kbytes)      2097152
	sbsize(bytes)        unlimited


Also for the record, this is 9.0/amd64 running on a bare machine with 8
cores, 32GB of RAM, and everything is on local filesystems:

NetBSD 9.0 (GENERIC) #0: Fri Feb 14 00:06:28 UTC 2020
        [email protected]:/usr/src/sys/arch/amd64/compile/GENERIC
total memory = 32762 MB
avail memory = 31788 MB
....
Dell Inc. PowerEdge 2950
....
cpu7: Intel(R) Xeon(R) CPU           X5460  @ 3.16GHz, id 0x10676
....
mfi0: PERC 6/i Integrated version 6.3.3.0002
mfi0: logical drives 2, 256MB RAM, BBU type BBU, status good
scsibus0 at mfi0: 64 targets, 8 luns per target
....
sd0 at scsibus0 target 0 lun 0: <DELL, PERC 6/i, 1.22> disk fixed
sd0: 465 GB, 476416 cyl, 64 head, 32 sec, 512 bytes/sect x 975699968 sectors
....
sd1 at scsibus0 target 1 lun 0: <DELL, PERC 6/i, 1.22> disk fixed
sd1: 544 GB, 557568 cyl, 64 head, 32 sec, 512 bytes/sect x 1141899264 sectors



--
					Greg A. Woods <[email protected]>

Kelowna, BC     +1 250 762-7675           RoboHack <[email protected]>
Planix, Inc. <[email protected]>     Avoncote Farms <[email protected]>
signature.asc (application/pgp-signature, 195 B)
-----BEGIN PGP SIGNATURE-----

iF0EABECAB0WIQRuK6dmwVAucmRxuh9mfXG3eL/0fwUCXv0w5AAKCRBmfXG3eL/0
f9IGAJ9UBfiOCyySYb79FpEcSHWRtiTjYwCg7M8vOrtIGtocCaXEtPSlCFj6VkU=
=ItHV
-----END PGP SIGNATURE-----
lmpx.com only provides a reader for public news (NNTP) servers. It is not affiliated with the servers or forums shown here and is not responsible for the content of articles, which is written by their respective authors.