Re: Memory leak (possibly connected to postgis) leading to server crash
Roman Cervenak <[email protected]>
| Newsgroups | gmane.comp.db.postgresql.bugs |
|---|---|
| Message-ID | <CAGjExY0sFbx+JytMkY-h8=NWqD_f0DOwB8QXrQ4SqJ+BttoX6g@mail.gmail.com> |
Yes, it was killed by oom killer: [2037990.376427] oom-kill:constraint=CONSTRAINT_NONE,nodemask=(null),cpuset=/,mems_allowed=0,global_oom,task_memcg=/system.slice/system-postgresql.slice,task=postgres,pid=52059,uid=111 [2037990.376433] Out of memory: Kill process 52059 (postgres) score 294 or sacrifice child [2037990.384186] Killed process 52059 (postgres) total-vm:17508832kB, anon-rss:4309296kB, file-rss:108kB, shmem-rss:12641580kB [2037990.516504] oom_reaper: reaped process 52059 (postgres), now anon-rss:0kB, file-rss:0kB, shmem-rss:12641580kB (full dmesg.log attached, if it is interesting; there are more postgres backends visible, but they were inactive at the time) I can try the gdb dump next time I will see it. But I cannot imagine giving you reproducible case - it is 500 GB proprietary database, and without it, queries would be hardly useful, I presume? I can try to make "sample" with generated data and find out if I can reproduce the issue with my queries that way, but that will be quite time consuming. Would it help to dump the memory of the backend process and deliver the dump (by some private channel) to somebody to identify who is consuming all that memory? (that is the usual drill in windows) On Fri, Dec 6, 2019 at 12:02 PM Tomas Vondra <[email protected]> wrote: > On Fri, Dec 06, 2019 at 10:22:42AM +0100, Roman Cervenak wrote: > >Hello, > >this may be a serious issue and I am not very experienced with reporting > >this kind of stuff, I will try my best. I believe there may be a memory > >leak somewhere in postgres/postgis, which can eat up all the available > >memory, leading to postgres crash (signal 9 kill of backend, postmaster > >terminating others, recovery). > > > >My setup and workload: > >Postgres 12.1 (Ubuntu 12.1-1.pgdg18.04+1) installed via apt on Ubuntu > >server 18.04 LTS, in VM in Azure cloud. > >PostGIS version: 3.0 USE_GEOS=1 USE_PROJ=1 USE_STATS=1 > >VM has 8cores, 56 GB RAM, 7 TB RAID from managed disks (azure network > >storage) > > > >shared_buffers = 12GB > >work_mem = 256MB > >maintenance_work_mem = 2GB > > > >I was running 8 clients (on different VMs, over network) using the > >database, batch processing geographic stuff. Each worker is running one > >query at a time, so pretty much 8 parallel queries 100% of the time. > >Queries themselves are fairly short (5-60 seconds), SELECTing rows by > >geometry index (GIST) and doing stuff like ST_SimplifyPreserveTopology, > >ST_Buffer, ST_Union on them, essentially using all 8 cores to 100%. There > >is a lot of things to process, so this was going on for maybe 12 hours, > >when I noticed (in "htop") that memory usage is unusually high, somewhere > >about 50 GB. It was suspicious, because it is way higher than it should be > >with 12 GB shared buffers and 256MB work_mem with 8 clients, and it > >continued to grow slowly (I could see numbers in RES column in htop slowly > >rise for all backends). Until eventually: > > > >2019-12-06 00:04:24 UTC [21487-8] LOG: server process (PID 52059) was > >terminated by signal 9: Killed > >2019-12-06 00:04:24 UTC [21487-10] LOG: terminating any other active > >server processes > >2019-12-06 00:04:24 UTC [91091-1] WARNING: terminating connection > because > >of crash of another server process > >2019-12-06 00:04:24 UTC [91091-2] DETAIL: The postmaster has commanded > >this server process to roll back the current transaction and exit, because > >another server process exited abnormally and possibly corrupted shared > >memory. > >... > >FATAL: the database system is in recovery mode > >... > > > >I realize, this is probably not enough for you. But I will be running this > >workload again soon, so if this repeats, what should I do to help you > >diagnose this? > > The kill was initiated by oom killer, I suppose? It might be interesting > to see the message written to dmesg by it, it usually includes info > about how much memory was used by the backend etc. > > The other thing that might be useful is dump of memory contexts - you'll > have to wait until the memory usage gets excessive (i.e. shortly before > the oom killer would kick in), attach gdb to a backend and call > MemoryContextStats on TopMemoryContext. So, something like this: > > $ gdb -p $PID > (gdb) p MemoryContextStats(TopMemoryContext) > (gdb) q > > which writes a bunch of info about memory contexts into the server log. > > But, I'm not sure this will actually help. Based on what you wrote, the > memory stays allocated across queries. So either it's allocated in one > of the long-lived contexts (which queries usually don't do), or it's > allocated directly through malloc() and not through our memory context > infrastructure (hence it'll be invisible in the context stats). > > I'm not particularly familiar with PostGIS, but AFAIK it's using various > libraries, and those are naturally using malloc/free directly. So maybe > it's not freeing the memory in some cases. > > What would really help is having some sort of reproducer, and/or running > the queries with valgrind, which can detect memory leaks. > > regards > > -- > Tomas Vondra http://www.2ndQuadrant.com > PostgreSQL Development, 24x7 Support, Remote DBA, Training & Services >
dmesg.log
(application/octet-stream, 75.5 KB)
[ 0.000000] Linux version 5.0.0-1023-azure (buildd@lcy01-amd64-008) (gcc version 7.4.0 (Ubuntu 7.4.0-1ubuntu1~18.04.1)) #24~18.04.1-Ubuntu SMP Wed Oct 2 20:23:29 UTC 2019 (Ubuntu 5.0.0-1023.24~18.04.1-azure 5.0.21)
[ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-5.0.0-1023-azure root=LABEL=cloudimg-rootfs ro console=tty1 console=ttyS0 earlyprintk=ttyS0 rootdelay=300
[ 0.000000] KERNEL supported cpus:
[ 0.000000] Intel GenuineIntel
[ 0.000000] AMD AuthenticAMD
[ 0.000000] Hygon HygonGenuine
[ 0.000000] Centaur CentaurHauls
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
[ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256
[ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format.
[ 0.000000] BIOS-provided physical RAM map:
[ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable
[ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
[ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000003ffeffff] usable
[ 0.000000] BIOS-e820: [mem 0x000000003fff0000-0x000000003fffefff] ACPI data
[ 0.000000] BIOS-e820: [mem 0x000000003ffff000-0x000000003fffffff] ACPI NVS
[ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x0000000ebfffffff] usable
[ 0.000000] printk: bootconsole [earlyser0] enabled
[ 0.000000] NX (Execute Disable) protection: active
[ 0.000000] SMBIOS 2.3 present.
[ 0.000000] DMI: Microsoft Corporation Virtual Machine/Virtual Machine, BIOS 090007 06/02/2017
[ 0.000000] Hypervisor detected: Microsoft Hyper-V
[ 0.000000] Hyper-V: features 0x2e7f, hints 0x40c2c
[ 0.000000] Hyper-V Host Build:14393-10.0-0-0.305
[ 0.000000] Hyper-V: LAPIC Timer Frequency: 0xc3500
[ 0.000000] tsc: Marking TSC unstable due to running on Hyper-V
[ 0.000000] Hyper-V: Using hypercall for remote TLB flush
[ 0.000000] tsc: Detected 2294.689 MHz processor
[ 0.001280] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[ 0.001282] e820: remove [mem 0x000a0000-0x000fffff] usable
[ 0.001285] last_pfn = 0xec0000 max_arch_pfn = 0x400000000
[ 0.005708] MTRR default type: uncachable
[ 0.005709] MTRR fixed ranges enabled:
[ 0.005710] 00000-9FFFF write-back
[ 0.005710] A0000-DFFFF uncachable
[ 0.005711] E0000-FFFFF write-back
[ 0.005711] MTRR variable ranges enabled:
[ 0.005712] 0 base 00000000000 mask FFFC0000000 write-back
[ 0.005713] 1 base 00100000000 mask FF000000000 write-back
[ 0.005713] 2 disabled
[ 0.005714] 3 disabled
[ 0.005714] 4 disabled
[ 0.005714] 5 disabled
[ 0.005715] 6 disabled
[ 0.005715] 7 disabled
[ 0.005723] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT
[ 0.010951] e820: update [mem 0x40000000-0xffffffff] usable ==> reserved
[ 0.013308] last_pfn = 0x3fff0 max_arch_pfn = 0x400000000
[ 0.024442] found SMP MP-table at [mem 0x000ff780-0x000ff78f]
[ 0.029256] check: Scanning 1 areas for low memory corruption
[ 0.034229] Using GB pages for direct mapping
[ 0.037759] BRK [0x57c802000, 0x57c802fff] PGTABLE
[ 0.037761] BRK [0x57c803000, 0x57c803fff] PGTABLE
[ 0.037762] BRK [0x57c804000, 0x57c804fff] PGTABLE
[ 0.037779] BRK [0x57c805000, 0x57c805fff] PGTABLE
[ 0.037781] BRK [0x57c806000, 0x57c806fff] PGTABLE
[ 0.037824] BRK [0x57c807000, 0x57c807fff] PGTABLE
[ 0.037846] RAMDISK: [mem 0x35999000-0x36cc3fff]
[ 0.041204] ACPI: Early table checksum verification disabled
[ 0.045548] ACPI: RSDP 0x00000000000F5BF0 000014 (v00 ACPIAM)
[ 0.049979] ACPI: RSDT 0x000000003FFF0000 000040 (v01 VRTUAL MICROSFT 06001702 MSFT 00000097)
[ 0.056298] ACPI: FACP 0x000000003FFF0200 000081 (v02 VRTUAL MICROSFT 06001702 MSFT 00000097)
[ 0.063655] ACPI: DSDT 0x000000003FFF1D24 003CBE (v01 MSFTVM MSFTVM02 00000002 INTL 02002026)
[ 0.070885] ACPI: FACS 0x000000003FFFF000 000040
[ 0.074985] ACPI: WAET 0x000000003FFF1A80 000028 (v01 VRTUAL MICROSFT 06001702 MSFT 00000097)
[ 0.082808] ACPI: SLIC 0x000000003FFF1AC0 000176 (v01 VRTUAL MICROSFT 06001702 MSFT 00000097)
[ 0.089101] ACPI: OEM0 0x000000003FFF1CC0 000064 (v01 VRTUAL MICROSFT 06001702 MSFT 00000097)
[ 0.095691] ACPI: SRAT 0x000000003FFF0800 0001A0 (v02 VRTUAL MICROSFT 00000001 MSFT 00000001)
[ 0.102086] ACPI: APIC 0x000000003FFF0300 000452 (v01 VRTUAL MICROSFT 06001702 MSFT 00000097)
[ 0.109042] ACPI: OEMB 0x000000003FFFF040 000064 (v01 VRTUAL MICROSFT 06001702 MSFT 00000097)
[ 0.115861] ACPI: Local APIC address 0xfee00000
[ 0.115897] SRAT: PXM 0 -> APIC 0x00 -> Node 0
[ 0.119648] SRAT: PXM 0 -> APIC 0x01 -> Node 0
[ 0.123537] SRAT: PXM 0 -> APIC 0x02 -> Node 0
[ 0.126829] SRAT: PXM 0 -> APIC 0x03 -> Node 0
[ 0.129926] SRAT: PXM 0 -> APIC 0x04 -> Node 0
[ 0.133243] SRAT: PXM 0 -> APIC 0x05 -> Node 0
[ 0.136520] SRAT: PXM 0 -> APIC 0x06 -> Node 0
[ 0.139851] SRAT: PXM 0 -> APIC 0x07 -> Node 0
[ 0.143293] ACPI: SRAT: Node 0 PXM 0 [mem 0x00000000-0x3fffffff] hotplug
[ 0.148856] ACPI: SRAT: Node 0 PXM 0 [mem 0x100000000-0xebfffffff] hotplug
[ 0.154266] ACPI: SRAT: Node 0 PXM 0 [mem 0xec0200000-0xfdfffffff] hotplug
[ 0.159943] ACPI: SRAT: Node 0 PXM 0 [mem 0x1000000000-0xffffffffff] hotplug
[ 0.166116] ACPI: SRAT: Node 0 PXM 0 [mem 0x10000200000-0x1ffffffffff] hotplug
[ 0.172456] ACPI: SRAT: Node 0 PXM 0 [mem 0x20000200000-0x3ffffffffff] hotplug
[ 0.178842] NUMA: Node 0 [mem 0x00000000-0x3fffffff] + [mem 0x100000000-0xebfffffff] -> [mem 0x00000000-0xebfffffff]
[ 0.187837] NODE_DATA(0) allocated [mem 0xebffd5000-0xebfffffff]
[ 0.193096] Zone ranges:
[ 0.195027] DMA [mem 0x0000000000001000-0x0000000000ffffff]
[ 0.199656] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]
[ 0.204354] Normal [mem 0x0000000100000000-0x0000000ebfffffff]
[ 0.209525] Device empty
[ 0.211948] Movable zone start for each node
[ 0.215558] Early memory node ranges
[ 0.218490] node 0: [mem 0x0000000000001000-0x000000000009efff]
[ 0.223555] node 0: [mem 0x0000000000100000-0x000000003ffeffff]
[ 0.228582] node 0: [mem 0x0000000100000000-0x0000000ebfffffff]
[ 0.233130] Zeroed struct page in unavailable ranges: 114 pages
[ 0.233131] Initmem setup node 0 [mem 0x0000000000001000-0x0000000ebfffffff]
[ 0.243034] On node 0 totalpages: 14679950
[ 0.243035] DMA zone: 64 pages used for memmap
[ 0.243035] DMA zone: 21 pages reserved
[ 0.243036] DMA zone: 3998 pages, LIFO batch:0
[ 0.243165] DMA32 zone: 4032 pages used for memmap
[ 0.243165] DMA32 zone: 258032 pages, LIFO batch:63
[ 0.251263] Normal zone: 225280 pages used for memmap
[ 0.251264] Normal zone: 14417920 pages, LIFO batch:63
[ 0.566505] ACPI: PM-Timer IO Port: 0x408
[ 0.569451] ACPI: Local APIC address 0xfee00000
[ 0.569462] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
[ 0.575358] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23
[ 0.581162] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[ 0.586357] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[ 0.591764] ACPI: IRQ0 used by override.
[ 0.591765] ACPI: IRQ9 used by override.
[ 0.591767] Using ACPI (MADT) for SMP configuration information
[ 0.596452] smpboot: Allowing 128 CPUs, 120 hotplug CPUs
[ 0.600755] PM: Registered nosave memory: [mem 0x00000000-0x00000fff]
[ 0.605782] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff]
[ 0.610153] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff]
[ 0.614709] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff]
[ 0.620006] PM: Registered nosave memory: [mem 0x3fff0000-0x3fffefff]
[ 0.625155] PM: Registered nosave memory: [mem 0x3ffff000-0x3fffffff]
[ 0.630080] PM: Registered nosave memory: [mem 0x40000000-0xffffffff]
[ 0.635064] [mem 0x40000000-0xffffffff] available for PCI devices
[ 0.639184] Booting paravirtualized kernel on bare hardware
[ 0.643056] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns
[ 0.650274] random: get_random_bytes called from start_kernel+0x93/0x503 with crng_init=0
[ 0.656535] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:128 nr_cpu_ids:128 nr_node_ids:1
[ 0.670401] percpu: Embedded 46 pages/cpu s151552 r8192 d28672 u262144
[ 0.675657] pcpu-alloc: s151552 r8192 d28672 u262144 alloc=1*2097152
[ 0.675659] pcpu-alloc: [0] 000 001 002 003 004 005 006 007
[ 0.675661] pcpu-alloc: [0] 008 009 010 011 012 013 014 015
[ 0.675663] pcpu-alloc: [0] 016 017 018 019 020 021 022 023
[ 0.675665] pcpu-alloc: [0] 024 025 026 027 028 029 030 031
[ 0.675666] pcpu-alloc: [0] 032 033 034 035 036 037 038 039
[ 0.675668] pcpu-alloc: [0] 040 041 042 043 044 045 046 047
[ 0.675670] pcpu-alloc: [0] 048 049 050 051 052 053 054 055
[ 0.675672] pcpu-alloc: [0] 056 057 058 059 060 061 062 063
[ 0.675673] pcpu-alloc: [0] 064 065 066 067 068 069 070 071
[ 0.675675] pcpu-alloc: [0] 072 073 074 075 076 077 078 079
[ 0.675677] pcpu-alloc: [0] 080 081 082 083 084 085 086 087
[ 0.675678] pcpu-alloc: [0] 088 089 090 091 092 093 094 095
[ 0.675680] pcpu-alloc: [0] 096 097 098 099 100 101 102 103
[ 0.675682] pcpu-alloc: [0] 104 105 106 107 108 109 110 111
[ 0.675683] pcpu-alloc: [0] 112 113 114 115 116 117 118 119
[ 0.675685] pcpu-alloc: [0] 120 121 122 123 124 125 126 127
[ 0.675727] Hyper-V: PV spinlocks enabled
[ 0.678892] PV qspinlock hash table entries: 512 (order: 1, 8192 bytes)
[ 0.684171] Built 1 zonelists, mobility grouping on. Total pages: 14450553
[ 0.689519] Policy zone: Normal
[ 0.691783] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-5.0.0-1023-azure root=LABEL=cloudimg-rootfs ro console=tty1 console=ttyS0 earlyprintk=ttyS0 rootdelay=300
[ 0.703223] printk: log_buf_len individual max cpu contribution: 4096 bytes
[ 0.708969] printk: log_buf_len total cpu_extra contributions: 520192 bytes
[ 0.714929] printk: log_buf_len min size: 262144 bytes
[ 0.719150] printk: log_buf_len: 1048576 bytes
[ 0.722587] printk: early log buf free: 251568(95%)
[ 0.740059] Calgary: detecting Calgary via BIOS EBDA area
[ 0.740061] Calgary: Unable to locate Rio Grande table in EBDA - bailing!
[ 0.896166] Memory: 57662848K/58719800K available (12292K kernel code, 2232K rwdata, 3932K rodata, 2360K init, 5528K bss, 1056952K reserved, 0K cma-reserved)
[ 0.909457] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=128, Nodes=1
[ 0.914355] Kernel/User page tables isolation: enabled
[ 0.918311] ftrace: allocating 38625 entries in 151 pages
[ 0.936633] rcu: Hierarchical RCU implementation.
[ 0.939761] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=128.
[ 0.944389] Tasks RCU enabled.
[ 0.946481] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.
[ 0.952450] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=128
[ 0.961074] NR_IRQS: 524544, nr_irqs: 1448, preallocated irqs: 16
[ 0.972416] Console: colour VGA+ 80x25
[ 1.654793] printk: console [tty1] enabled
[ 1.658775] printk: console [ttyS0] enabled
[ 1.666488] printk: bootconsole [earlyser0] disabled
[ 1.675850] ACPI: Core revision 20181213
[ 1.680650] APIC: Switch to symmetric I/O mode setup
[ 1.685607] Switched APIC routing to physical flat.
[ 1.690050] Hyper-V: Using IPI hypercalls
[ 1.694624] Hyper-V: Using MSR based APIC access
[ 1.699835] clocksource: hyperv_clocksource_tsc_page: mask: 0xffffffffffffffff max_cycles: 0x24e6a1710, max_idle_ns: 440795202120 ns
[ 1.740379] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[ 1.746798] Calibrating delay loop (skipped), value calculated using timer frequency.. 4589.37 BogoMIPS (lpj=9178756)
[ 1.750788] pid_max: default: 131072 minimum: 1024
[ 1.754963] LSM: Security Framework initializing
[ 1.758804] Yama: becoming mindful.
[ 1.762927] AppArmor: AppArmor initialized
[ 1.780182] Dentry cache hash table entries: 8388608 (order: 14, 67108864 bytes)
[ 1.792497] Inode-cache hash table entries: 4194304 (order: 13, 33554432 bytes)
[ 1.795082] Mount-cache hash table entries: 131072 (order: 8, 1048576 bytes)
[ 1.798980] Mountpoint-cache hash table entries: 131072 (order: 8, 1048576 bytes)
[ 1.803568] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8
[ 1.806788] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4
[ 1.810787] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization
[ 1.814787] Spectre V2 : Mitigation: Full generic retpoline
[ 1.818787] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch
[ 1.822787] Speculative Store Bypass: Vulnerable
[ 1.826823] MDS: Mitigation: Clear CPU buffers
[ 1.831004] Freeing SMP alternatives memory: 36K
[ 1.839322] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz (family: 0x6, model: 0x4f, stepping: 0x1)
[ 1.842991] Performance Events: unsupported p6 CPU model 79 no PMU driver, software events only.
[ 1.846833] rcu: Hierarchical SRCU implementation.
[ 1.851393] random: crng done (trusting CPU's manufacturer)
[ 1.854823] NMI watchdog: Perf NMI watchdog permanently disabled
[ 1.863848] smp: Bringing up secondary CPUs ...
[ 1.866908] x86: Booting SMP configuration:
[ 1.870790] .... node #0, CPUs: #1 #2 #3 #4 #5 #6 #7
[ 1.875622] smp: Brought up 1 node, 8 CPUs
[ 1.882788] smpboot: Max logical packages: 16
[ 1.886789] smpboot: Total of 8 processors activated (36715.02 BogoMIPS)
[ 1.892421] devtmpfs: initialized
[ 1.894836] x86/mm: Memory block size: 128MB
[ 1.904999] PM: Registering ACPI NVS region [mem 0x3ffff000-0x3fffffff] (4096 bytes)
[ 1.907007] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[ 1.910868] futex hash table entries: 32768 (order: 9, 2097152 bytes)
[ 1.915486] pinctrl core: initialized pinctrl subsystem
[ 1.941854] RTC time: 09:57:54, date: 2019-11-12
[ 1.947075] NET: Registered protocol family 16
[ 1.950869] audit: initializing netlink subsys (disabled)
[ 1.954820] audit: type=2000 audit(1573552673.256:1): state=initialized audit_enabled=0 res=1
[ 1.954961] EISA bus registered
[ 1.962848] cpuidle: using governor ladder
[ 1.966812] cpuidle: using governor menu
[ 1.970854] ACPI: bus type PCI registered
[ 1.974788] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[ 1.979424] PCI: Using configuration type 1 for base access
[ 1.987789] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages
[ 1.990797] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages
[ 1.998924] ACPI: Added _OSI(Module Device)
[ 2.002793] ACPI: Added _OSI(Processor Device)
[ 2.006788] ACPI: Added _OSI(3.0 _SCP Extensions)
[ 2.010788] ACPI: Added _OSI(Processor Aggregator Device)
[ 2.014788] ACPI: Added _OSI(Linux-Dell-Video)
[ 2.018788] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio)
[ 2.022788] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics)
[ 2.028150] ACPI: 1 ACPI AML tables successfully acquired and loaded
[ 2.036228] ACPI: Interpreter enabled
[ 2.038798] ACPI: (supports S0 S5)
[ 2.042788] ACPI: Using IOAPIC for interrupt routing
[ 2.046826] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[ 2.051067] ACPI: Enabled 1 GPEs in block 00 to 0F
[ 2.079035] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
[ 2.082791] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI]
[ 2.086798] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.
[ 2.091017] PCI host bridge to bus 0000:00
[ 2.094789] pci_bus 0000:00: root bus resource [mem 0xfe0000000-0xfffffffff window]
[ 2.098790] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]
[ 2.102789] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]
[ 2.106789] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[ 2.110793] pci_bus 0000:00: root bus resource [mem 0x40000000-0xfffbffff window]
[ 2.114789] pci_bus 0000:00: root bus resource [bus 00-ff]
[ 2.119065] pci 0000:00:00.0: [8086:7192] type 00 class 0x060000
[ 2.125262] pci 0000:00:07.0: [8086:7110] type 00 class 0x060100
[ 2.129812] pci 0000:00:07.1: [8086:7111] type 00 class 0x010180
[ 2.133264] pci 0000:00:07.1: reg 0x20: [io 0xffa0-0xffaf]
[ 2.134640] pci 0000:00:07.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7]
[ 2.134788] pci 0000:00:07.1: legacy IDE quirk: reg 0x14: [io 0x03f6]
[ 2.138787] pci 0000:00:07.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177]
[ 2.142787] pci 0000:00:07.1: legacy IDE quirk: reg 0x1c: [io 0x0376]
[ 2.150957] pci 0000:00:07.3: [8086:7113] type 00 class 0x068000
[ 2.151008] * Found PM-Timer Bug on the chipset. Due to workarounds for a bug,
* this clock source is slow. Consider trying other clock sources
[ 2.159665] pci 0000:00:07.3: quirk: [io 0x0400-0x043f] claimed by PIIX4 ACPI
[ 2.164312] pci 0000:00:08.0: [1414:5353] type 00 class 0x030000
[ 2.165232] pci 0000:00:08.0: reg 0x10: [mem 0xf8000000-0xfbffffff]
[ 2.189013] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 7 9 10 *11 12 14 15)
[ 2.191085] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 7 9 10 11 12 14 15) *0, disabled.
[ 2.195078] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 5 7 9 10 11 12 14 15) *0, disabled.
[ 2.199084] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 7 9 10 11 12 14 15) *0, disabled.
[ 2.203166] SCSI subsystem initialized
[ 2.206937] libata version 3.00 loaded.
[ 2.206937] pci 0000:00:08.0: vgaarb: setting as boot VGA device
[ 2.210785] pci 0000:00:08.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
[ 2.210789] pci 0000:00:08.0: vgaarb: bridge control possible
[ 2.214788] vgaarb: loaded
[ 2.218824] pps_core: LinuxPPS API ver. 1 registered
[ 2.222806] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <[email protected]>
[ 2.226791] PTP clock support registered
[ 2.230885] EDAC MC: Ver: 3.0.0
[ 2.235064] hv_vmbus: Vmbus version:4.0
[ 2.238880] PCI: Using ACPI for IRQ routing
[ 2.242785] PCI: pci_cache_line_size set to 64 bytes
[ 2.242785] e820: reserve RAM buffer [mem 0x0009fc00-0x0009ffff]
[ 2.242785] e820: reserve RAM buffer [mem 0x3fff0000-0x3fffffff]
[ 2.242787] NetLabel: Initializing
[ 2.246791] NetLabel: domain hash size = 128
[ 2.250788] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO
[ 2.254802] NetLabel: unlabeled traffic allowed by default
[ 2.262964] clocksource: Switched to clocksource hyperv_clocksource_tsc_page
[ 2.282837] VFS: Disk quotas dquot_6.6.0
[ 2.286618] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[ 2.292883] AppArmor: AppArmor Filesystem Enabled
[ 2.296879] pnp: PnP ACPI init
[ 2.299915] pnp 00:00: Plug and Play ACPI device, IDs PNP0b00 (active)
[ 2.299978] pnp 00:01: Plug and Play ACPI device, IDs PNP0303 PNP030b (active)
[ 2.300014] pnp 00:02: Plug and Play ACPI device, IDs PNP0f03 PNP0f13 (active)
[ 2.300894] pnp 00:03: [dma 0 disabled]
[ 2.300912] pnp 00:03: Plug and Play ACPI device, IDs PNP0501 (active)
[ 2.301707] pnp 00:04: [dma 0 disabled]
[ 2.301741] pnp 00:04: Plug and Play ACPI device, IDs PNP0501 (active)
[ 2.302520] pnp 00:05: [dma 2]
[ 2.302563] pnp 00:05: Plug and Play ACPI device, IDs PNP0700 (active)
[ 2.302595] system 00:06: [io 0x01e0-0x01ef] has been reserved
[ 2.307523] system 00:06: [io 0x0160-0x016f] has been reserved
[ 2.312846] system 00:06: [io 0x0278-0x027f] has been reserved
[ 2.318918] system 00:06: [io 0x0378-0x037f] has been reserved
[ 2.324807] system 00:06: [io 0x0678-0x067f] has been reserved
[ 2.330518] system 00:06: [io 0x0778-0x077f] has been reserved
[ 2.335999] system 00:06: [io 0x04d0-0x04d1] has been reserved
[ 2.341471] system 00:06: Plug and Play ACPI device, IDs PNP0c02 (active)
[ 2.341613] system 00:07: [io 0x0400-0x043f] has been reserved
[ 2.347222] system 00:07: [io 0x0370-0x0371] has been reserved
[ 2.352782] system 00:07: [io 0x0440-0x044f] has been reserved
[ 2.358864] system 00:07: [mem 0xfec00000-0xfec00fff] could not be reserved
[ 2.365411] system 00:07: [mem 0xfee00000-0xfee00fff] has been reserved
[ 2.371492] system 00:07: Plug and Play ACPI device, IDs PNP0c02 (active)
[ 2.371619] system 00:08: [mem 0x00000000-0x0009ffff] could not be reserved
[ 2.377892] system 00:08: [mem 0x000c0000-0x000dffff] could not be reserved
[ 2.384666] system 00:08: [mem 0x000e0000-0x000fffff] could not be reserved
[ 2.391468] system 00:08: [mem 0x00100000-0x3fffffff] could not be reserved
[ 2.398096] system 00:08: [mem 0xfffc0000-0xffffffff] has been reserved
[ 2.405178] system 00:08: Plug and Play ACPI device, IDs PNP0c01 (active)
[ 2.405500] pnp: PnP ACPI: found 9 devices
[ 2.418169] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[ 2.426482] pci_bus 0000:00: resource 4 [mem 0xfe0000000-0xfffffffff window]
[ 2.426484] pci_bus 0000:00: resource 5 [io 0x0000-0x0cf7 window]
[ 2.426485] pci_bus 0000:00: resource 6 [io 0x0d00-0xffff window]
[ 2.426486] pci_bus 0000:00: resource 7 [mem 0x000a0000-0x000bffff window]
[ 2.426487] pci_bus 0000:00: resource 8 [mem 0x40000000-0xfffbffff window]
[ 2.426613] NET: Registered protocol family 2
[ 2.431518] tcp_listen_portaddr_hash hash table entries: 32768 (order: 7, 524288 bytes)
[ 2.439037] TCP established hash table entries: 524288 (order: 10, 4194304 bytes)
[ 2.446496] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[ 2.453188] TCP: Hash tables configured (established 524288 bind 65536)
[ 2.460090] UDP hash table entries: 32768 (order: 8, 1048576 bytes)
[ 2.466875] UDP-Lite hash table entries: 32768 (order: 8, 1048576 bytes)
[ 2.475536] NET: Registered protocol family 1
[ 2.479521] NET: Registered protocol family 44
[ 2.483910] pci 0000:00:00.0: Limiting direct PCI/PCI transfers
[ 2.489971] pci 0000:00:08.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]
[ 2.497673] PCI: CLS 0 bytes, default 64
[ 2.497738] Unpacking initramfs...
[ 2.760755] Freeing initrd memory: 19628K
[ 2.765393] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[ 2.771085] software IO TLB: mapped [mem 0x3bff0000-0x3fff0000] (64MB)
[ 2.776172] check: Scanning for low memory corruption every 60 seconds
[ 2.784123] Initialise system trusted keyrings
[ 2.787957] Key type blacklist registered
[ 2.791447] workingset: timestamp_bits=36 max_order=24 bucket_order=0
[ 2.797890] zbud: loaded
[ 2.801170] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[ 2.806205] fuse init (API version 7.28)
[ 2.848163] Key type asymmetric registered
[ 2.852644] Asymmetric key parser 'x509' registered
[ 2.858244] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 243)
[ 2.866126] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[ 2.872664] intel_idle: Please enable MWAIT in BIOS SETUP
[ 2.872746] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[ 2.879863] ACPI: Power Button [PWRF]
[ 2.884533] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled
[ 2.922619] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
[ 2.961900] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A
[ 2.971241] Linux agpgart interface v0.103
[ 2.988407] loop: module loaded
[ 2.992012] hv_vmbus: registering driver hv_storvsc
[ 2.998151] ata_piix 0000:00:07.1: version 2.13
[ 2.998579] ata_piix 0000:00:07.1: Hyper-V Virtual Machine detected, ATA device ignore set
[ 2.999833] scsi host0: storvsc_host_t
[ 3.010042] scsi host1: ata_piix
[ 3.014279] scsi host2: ata_piix
[ 3.015560] scsi 0:0:0:0: Direct-Access Msft Virtual Disk 1.0 PQ: 0 ANSI: 5
[ 3.018066] ata1: PATA max UDMA/33 cmd 0x1f0 ctl 0x3f6 bmdma 0xffa0 irq 14
[ 3.027129] sd 0:0:0:0: Attached scsi generic sg0 type 0
[ 3.035054] ata2: PATA max UDMA/33 cmd 0x170 ctl 0x376 bmdma 0xffa8 irq 15
[ 3.040053] sd 0:0:0:0: [sda] 62916608 512-byte logical blocks: (32.2 GB/30.0 GiB)
[ 3.041566] scsi host3: storvsc_host_t
[ 3.045856] scsi 3:0:1:0: Direct-Access Msft Virtual Disk 1.0 PQ: 0 ANSI: 5
[ 3.046211] sd 3:0:1:0: Attached scsi generic sg1 type 0
[ 3.046716] sd 3:0:1:0: [sdb] 234881024 512-byte logical blocks: (120 GB/112 GiB)
[ 3.046718] sd 3:0:1:0: [sdb] 4096-byte physical blocks
[ 3.046798] sd 3:0:1:0: [sdb] Write Protect is off
[ 3.046799] sd 3:0:1:0: [sdb] Mode Sense: 0f 00 10 00
[ 3.046890] sd 3:0:1:0: [sdb] Write cache: disabled, read cache: enabled, supports DPO and FUA
[ 3.047073] libphy: Fixed MDIO Bus: probed
[ 3.047990] sdb: sdb1
[ 3.050184] sd 3:0:1:0: [sdb] Attached SCSI disk
[ 3.053732] sd 0:0:0:0: [sda] 4096-byte physical blocks
[ 3.053854] sd 0:0:0:0: [sda] Write Protect is off
[ 3.057910] tun: Universal TUN/TAP device driver, 1.6
[ 3.065559] sd 0:0:0:0: [sda] Mode Sense: 0f 00 10 00
[ 3.065703] sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, supports DPO and FUA
[ 3.070268] PPP generic driver version 2.4.2
[ 3.070417] scsi host4: storvsc_host_t
[ 3.088166] scsi host5: storvsc_host_t
[ 3.096328] i8042: PNP: PS/2 Controller [PNP0303:PS2K,PNP0f03:PS2M] at 0x60,0x64 irq 1,12
[ 3.107144] GPT:Primary header thinks Alt. header is not at the end of the disk.
[ 3.118907] serio: i8042 KBD port at 0x60,0x64 irq 1
[ 3.120319] GPT:4612095 != 62916607
[ 3.120319] GPT:Alternate GPT header not at the end of the disk.
[ 3.120320] GPT:4612095 != 62916607
[ 3.120320] GPT: Use GNU Parted to correct GPT errors.
[ 3.120332] sda: sda1 sda14 sda15
[ 3.120404] scsi 5:0:0:0: Direct-Access Msft Virtual Disk 1.0 PQ: 0 ANSI: 5
[ 3.121128] scsi 5:0:0:5: Direct-Access Msft Virtual Disk 1.0 PQ: 0 ANSI: 5
[ 3.122877] sd 0:0:0:0: [sda] Attached SCSI disk
[ 3.126234] serio: i8042 AUX port at 0x60,0x64 irq 12
[ 3.143220] scsi 5:0:0:4: Direct-Access Msft Virtual Disk 1.0 PQ: 0 ANSI: 5
[ 3.150462] mousedev: PS/2 mouse device common for all mice
[ 3.154236] scsi 5:0:0:6: Direct-Access Msft Virtual Disk 1.0 PQ: 0 ANSI: 5
[ 3.159191] rtc_cmos 00:00: RTC can wake from S4
[ 3.165973] scsi 5:0:0:1: Direct-Access Msft Virtual Disk 1.0 PQ: 0 ANSI: 5
[ 3.174270] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1
[ 3.178183] scsi 5:0:0:3: Direct-Access Msft Virtual Disk 1.0 PQ: 0 ANSI: 5
[ 3.196412] rtc_cmos 00:00: registered as rtc0
[ 3.198196] scsi 5:0:0:2: Direct-Access Msft Virtual Disk 1.0 PQ: 0 ANSI: 5
[ 3.201552] rtc_cmos 00:00: alarms up to one month, 114 bytes nvram
[ 3.217506] sd 5:0:0:0: Attached scsi generic sg2 type 0
[ 3.217955] sd 5:0:0:0: [sdc] 2147483648 512-byte logical blocks: (1.10 TB/1.00 TiB)
[ 3.217957] sd 5:0:0:0: [sdc] 4096-byte physical blocks
[ 3.218914] sd 5:0:0:0: [sdc] Write Protect is off
[ 3.218916] sd 5:0:0:0: [sdc] Mode Sense: 0f 00 10 00
[ 3.220109] sd 5:0:0:0: [sdc] Write cache: disabled, read cache: enabled, supports DPO and FUA
[ 3.224541] device-mapper: uevent: version 1.0.3
[ 3.229027] sd 5:0:0:5: Attached scsi generic sg3 type 0
[ 3.229641] sd 5:0:0:5: [sdd] 2147483648 512-byte logical blocks: (1.10 TB/1.00 TiB)
[ 3.229643] sd 5:0:0:5: [sdd] 4096-byte physical blocks
[ 3.229720] sd 5:0:0:5: [sdd] Write Protect is off
[ 3.229721] sd 5:0:0:5: [sdd] Mode Sense: 0f 00 10 00
[ 3.229827] sd 5:0:0:5: [sdd] Write cache: disabled, read cache: enabled, supports DPO and FUA
[ 3.235947] device-mapper: ioctl: 4.39.0-ioctl (2018-04-03) initialised: [email protected]
[ 3.237732] sd 5:0:0:5: [sdd] Attached SCSI disk
[ 3.241454] sd 5:0:0:4: Attached scsi generic sg4 type 0
[ 3.241869] sd 5:0:0:4: [sde] 2147483648 512-byte logical blocks: (1.10 TB/1.00 TiB)
[ 3.241870] sd 5:0:0:4: [sde] 4096-byte physical blocks
[ 3.241919] sd 5:0:0:4: [sde] Write Protect is off
[ 3.241920] sd 5:0:0:4: [sde] Mode Sense: 0f 00 10 00
[ 3.242076] sd 5:0:0:4: [sde] Write cache: disabled, read cache: enabled, supports DPO and FUA
[ 3.247937] platform eisa.0: Probing EISA bus 0
[ 3.249595] sd 5:0:0:4: [sde] Attached SCSI disk
[ 3.252724] sd 5:0:0:6: [sdf] 2147483648 512-byte logical blocks: (1.10 TB/1.00 TiB)
[ 3.253187] sd 5:0:0:6: Attached scsi generic sg5 type 0
[ 3.253433] sd 5:0:0:1: Attached scsi generic sg6 type 0
[ 3.254165] sd 5:0:0:3: Attached scsi generic sg7 type 0
[ 3.254407] sd 5:0:0:2: Attached scsi generic sg8 type 0
[ 3.255281] sd 5:0:0:2: [sdi] 2147483648 512-byte logical blocks: (1.10 TB/1.00 TiB)
[ 3.255283] sd 5:0:0:2: [sdi] 4096-byte physical blocks
[ 3.255413] sd 5:0:0:2: [sdi] Write Protect is off
[ 3.255414] sd 5:0:0:2: [sdi] Mode Sense: 0f 00 10 00
[ 3.255607] sd 5:0:0:2: [sdi] Write cache: disabled, read cache: enabled, supports DPO and FUA
[ 3.261233] platform eisa.0: EISA: Cannot allocate resource for mainboard
[ 3.261235] platform eisa.0: Cannot allocate resource for EISA slot 1
[ 3.261236] platform eisa.0: Cannot allocate resource for EISA slot 2
[ 3.261237] platform eisa.0: Cannot allocate resource for EISA slot 3
[ 3.261237] platform eisa.0: Cannot allocate resource for EISA slot 4
[ 3.261238] platform eisa.0: Cannot allocate resource for EISA slot 5
[ 3.261239] platform eisa.0: Cannot allocate resource for EISA slot 6
[ 3.261240] platform eisa.0: Cannot allocate resource for EISA slot 7
[ 3.261240] platform eisa.0: Cannot allocate resource for EISA slot 8
[ 3.261242] platform eisa.0: EISA: Detected 0 cards
[ 3.261557] sd 5:0:0:1: [sdg] 2147483648 512-byte logical blocks: (1.10 TB/1.00 TiB)
[ 3.261559] sd 5:0:0:1: [sdg] 4096-byte physical blocks
[ 3.261607] sd 5:0:0:1: [sdg] Write Protect is off
[ 3.261609] sd 5:0:0:1: [sdg] Mode Sense: 0f 00 10 00
[ 3.261717] sd 5:0:0:1: [sdg] Write cache: disabled, read cache: enabled, supports DPO and FUA
[ 3.263477] sd 5:0:0:2: [sdi] Attached SCSI disk
[ 3.268893] sd 5:0:0:6: [sdf] 4096-byte physical blocks
[ 3.277395] NET: Registered protocol family 10
[ 3.281249] sd 5:0:0:6: [sdf] Write Protect is off
[ 3.296400] sd 5:0:0:3: [sdh] 2147483648 512-byte logical blocks: (1.10 TB/1.00 TiB)
[ 3.301634] sd 5:0:0:6: [sdf] Mode Sense: 0f 00 10 00
[ 3.308464] sd 5:0:0:3: [sdh] 4096-byte physical blocks
[ 3.313584] sd 5:0:0:6: [sdf] Write cache: disabled, read cache: enabled, supports DPO and FUA
[ 3.317652] sd 5:0:0:3: [sdh] Write Protect is off
[ 3.318621] Segment Routing with IPv6
[ 3.318641] NET: Registered protocol family 17
[ 3.318711] Key type dns_resolver registered
[ 3.334638] sd 5:0:0:6: [sdf] Attached SCSI disk
[ 3.335403] sd 5:0:0:3: [sdh] Mode Sense: 0f 00 10 00
[ 3.392155] ata2.01: NODEV after polling detection
[ 3.393678] sd 5:0:0:3: [sdh] Write cache: disabled, read cache: enabled, supports DPO and FUA
[ 3.472197] ata1.01: host indicates ignore ATA devices, ignored
[ 3.472432] mce: Using 1 MCE banks
[ 3.472457] RAS: Correctable Errors collector initialized.
[ 3.472659] registered taskstats version 1
[ 3.479552] ata2.00: ATAPI: Virtual CD, , max MWDMA2
[ 3.485069] Loading compiled-in X.509 certificates
[ 3.487223] Loaded X.509 cert 'Build time autogenerated kernel key: 22c14434e57802e8fc486c2bbe516b8246f4aebd'
[ 3.492896] ata1.00: host indicates ignore ATA devices, ignored
[ 3.493770] sd 5:0:0:3: [sdh] Attached SCSI disk
[ 3.497213] zswap: loaded using pool lzo/zbud
[ 3.506315] scsi 2:0:0:0: CD-ROM Msft Virtual CD/ROM 1.0 PQ: 0 ANSI: 5
[ 3.560873] Key type big_key registered
[ 3.566227] sd 5:0:0:0: [sdc] Attached SCSI disk
[ 3.568099] Key type trusted registered
[ 3.568446] sr 2:0:0:0: [sr0] scsi3-mmc drive: 0x/0x tray
[ 3.568447] cdrom: Uniform CD-ROM driver Revision: 3.20
[ 3.569669] sr 2:0:0:0: Attached scsi CD-ROM sr0
[ 3.569840] sr 2:0:0:0: Attached scsi generic sg9 type 5
[ 3.591518] sd 5:0:0:1: [sdg] Attached SCSI disk
[ 3.594248] Key type encrypted registered
[ 3.703884] AppArmor: AppArmor sha1 policy hashing enabled
[ 3.708505] ima: No TPM chip found, activating TPM-bypass!
[ 3.713370] ima: Allocated hash algorithm: sha1
[ 3.717993] No architecture policies found
[ 3.722546] evm: Initialising EVM extended attributes:
[ 3.727727] evm: security.selinux
[ 3.731216] evm: security.SMACK64
[ 3.734217] evm: security.SMACK64EXEC
[ 3.737571] evm: security.SMACK64TRANSMUTE
[ 3.741741] evm: security.SMACK64MMAP
[ 3.745621] evm: security.apparmor
[ 3.749282] evm: security.ima
[ 3.752708] evm: security.capability
[ 3.756634] evm: HMAC attrs: 0x1
[ 3.760713] Magic number: 11:328:980
[ 3.764951] clockevents clockevent57: hash matches
[ 3.770268] memory memory391: hash matches
[ 3.775930] rtc_cmos 00:00: setting system clock to 2019-11-12T09:57:56 UTC (1573552676)
[ 3.788597] Unstable clock detected, switching default tracing clock to "global"
If you want to keep using the local clock, then add:
"trace_clock=local"
on the kernel command line
[ 3.812285] Freeing unused decrypted memory: 2040K
[ 3.818235] Freeing unused kernel image memory: 2360K
[ 3.838851] Write protecting the kernel read-only data: 18432k
[ 3.845644] Freeing unused kernel image memory: 2008K
[ 3.850940] Freeing unused kernel image memory: 164K
[ 3.865859] x86/mm: Checked W+X mappings: passed, no W+X pages found.
[ 3.872466] x86/mm: Checking user space page tables
[ 3.887690] x86/mm: Checked W+X mappings: passed, no W+X pages found.
[ 3.894243] Run /init as init process
[ 4.020300] hv_utils: Registering HyperV Utility Driver
[ 4.020309] hv_vmbus: registering driver hyperv_keyboard
[ 4.027109] hv_vmbus: registering driver hv_utils
[ 4.040132] input: AT Translated Set 2 keyboard as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0A03:00/device:07/VMBUS:01/d34b2567-b9b6-42b9-8778-0a4ec0b955bf/serio2/input/input3
[ 4.052913] hv_vmbus: registering driver hv_netvsc
[ 4.053038] hv_utils: Heartbeat IC version 3.0
[ 4.063536] hidraw: raw HID events driver (C) Jiri Kosina
[ 4.063604] hv_utils: Shutdown IC version 3.0
[ 4.073594] hv_utils: TimeSync IC version 4.0
[ 4.078236] hv_utils: VSS IC version 5.0
[ 4.085075] cryptd: max_cpu_qlen set to 1000
[ 4.093696] hv_vmbus: registering driver hid_hyperv
[ 4.099487] input: Microsoft Vmbus HID-compliant Mouse as /devices/0006:045E:0621.0001/input/input4
[ 4.109266] hid 0006:045E:0621.0001: input: <UNKNOWN> HID v0.01 Mouse [Microsoft Vmbus HID-compliant Mouse] on
[ 4.122302] hv_vmbus: registering driver hyperv_fb
[ 4.127764] hyperv_fb: Screen resolution: 1152x864, Color depth: 32
[ 4.138567] AVX2 version of gcm_enc/dec engaged.
[ 4.138568] AES CTR mode by8 optimization enabled
[ 4.140292] Console: switching to colour frame buffer device 144x54
[ 4.457478] hv_netvsc 000d3aaa-3b94-000d-3aaa-3b94000d3aaa eth0: VF slot 1 added
[ 5.638858] raid6: avx2x4 gen() 22774 MB/s
[ 5.686858] raid6: avx2x4 xor() 15530 MB/s
[ 5.734858] raid6: avx2x2 gen() 19163 MB/s
[ 5.782840] raid6: avx2x2 xor() 13525 MB/s
[ 5.830859] raid6: avx2x1 gen() 16220 MB/s
[ 5.878863] raid6: avx2x1 xor() 13058 MB/s
[ 5.926862] raid6: sse2x4 gen() 11292 MB/s
[ 5.974858] raid6: sse2x4 xor() 8340 MB/s
[ 6.022875] raid6: sse2x2 gen() 8738 MB/s
[ 6.074860] raid6: sse2x2 xor() 7132 MB/s
[ 6.122794] raid6: sse2x1 gen() 8672 MB/s
[ 6.170857] raid6: sse2x1 xor() 6681 MB/s
[ 6.174705] raid6: using algorithm avx2x4 gen() 22774 MB/s
[ 6.179382] raid6: .... xor() 15530 MB/s, rmw enabled
[ 6.183868] raid6: using avx2x2 recovery algorithm
[ 6.189374] xor: automatically using best checksumming function avx
[ 6.196610] async_tx: api initialized (async)
[ 6.255124] Btrfs loaded, crc32c=crc32c-intel
[ 6.344668] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null)
[ 7.573390] systemd[1]: systemd 237 running in system mode. (+PAM +AUDIT +SELINUX +IMA +APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD -IDN2 +IDN -PCRE2 default-hierarchy=hybrid)
[ 7.589946] systemd[1]: Detected virtualization microsoft.
[ 7.593527] systemd[1]: Detected architecture x86-64.
[ 7.620782] systemd[1]: Set hostname to <ubuntu>.
[ 7.652035] systemd[1]: Initializing machine ID from random generator.
[ 7.657655] systemd[1]: Installed transient /etc/machine-id file.
[ 8.390215] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point.
[ 8.406582] systemd[1]: Created slice User and Session Slice.
[ 8.417183] systemd[1]: Reached target User and Group Name Lookups.
[ 8.427548] systemd[1]: Started Forward Password Requests to Wall Directory Watch.
[ 8.530240] EXT4-fs (sda1): re-mounted. Opts: discard
[ 8.553536] Loading iSCSI transport class v2.0-870.
[ 8.613952] iscsi: registered transport (tcp)
[ 8.663673] systemd-journald[573]: Received request to flush runtime journal from PID 1
[ 8.812059] iscsi: registered transport (iser)
[ 9.008340] hv_utils: KVP IC version 4.0
[ 9.167130] hv_vmbus: registering driver hv_balloon
[ 9.168099] hv_balloon: Using Dynamic Memory protocol version 2.0
[ 9.170043] hv_vmbus: registering driver hv_pci
[ 9.171221] hv_pci 6a388f3a-0228-4c2c-9c1d-d00da3811f8c: PCI VMBus probing: Using version 0x10002
[ 9.174529] hv_pci 6a388f3a-0228-4c2c-9c1d-d00da3811f8c: PCI host bridge to bus 0001:00
[ 9.174531] pci_bus 0001:00: root bus resource [mem 0xfe0000000-0xfe07fffff window]
[ 9.177531] pci 0001:00:02.0: [15b3:1004] type 00 class 0x020000
[ 9.198823] pci 0001:00:02.0: reg 0x18: [mem 0xfe0000000-0xfe07fffff 64bit pref]
[ 9.238574] pci 0001:00:02.0: BAR 2: assigned [mem 0xfe0000000-0xfe07fffff 64bit pref]
[ 9.333861] mlx4_core: Mellanox ConnectX core driver v4.0-0
[ 9.333888] mlx4_core: Initializing 0001:00:02.0
[ 9.336032] mlx4_core 0001:00:02.0: Detected virtual function - running in slave mode
[ 9.336060] mlx4_core 0001:00:02.0: Sending reset
[ 9.336175] mlx4_core 0001:00:02.0: Sending vhcr0
[ 9.337638] mlx4_core 0001:00:02.0: HCA minimum page size:512
[ 9.338173] mlx4_core 0001:00:02.0: Timestamping is not supported in slave mode
[ 9.389139] mlx4_en: Mellanox ConnectX HCA Ethernet driver v4.0-0
[ 9.389951] mlx4_en 0001:00:02.0: Activating port:1
[ 9.421417] mlx4_en: 0001:00:02.0: Port 1: Using 8 TX rings
[ 9.421418] mlx4_en: 0001:00:02.0: Port 1: Using 8 RX rings
[ 9.421585] mlx4_en: 0001:00:02.0: Port 1: Initializing port
[ 9.423394] hv_netvsc 000d3aaa-3b94-000d-3aaa-3b94000d3aaa eth0: VF registering: eth1
[ 9.423521] mlx4_core 0001:00:02.0 eth1: joined to eth0
[ 9.431869] mlx4_core 0001:00:02.0 enP1s1: renamed from eth1
[ 10.470364] audit: type=1400 audit(1573552683.935:2): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/bin/lxc-start" pid=1118 comm="apparmor_parser"
[ 10.523949] audit: type=1400 audit(1573552683.991:3): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/bin/man" pid=1120 comm="apparmor_parser"
[ 10.524244] audit: type=1400 audit(1573552683.991:4): apparmor="STATUS" operation="profile_load" profile="unconfined" name="man_filter" pid=1120 comm="apparmor_parser"
[ 10.524629] audit: type=1400 audit(1573552683.991:5): apparmor="STATUS" operation="profile_load" profile="unconfined" name="man_groff" pid=1120 comm="apparmor_parser"
[ 10.580848] audit: type=1400 audit(1573552684.047:6): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/sbin/tcpdump" pid=1123 comm="apparmor_parser"
[ 10.663572] audit: type=1400 audit(1573552684.131:7): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/sbin/dhclient" pid=1115 comm="apparmor_parser"
[ 10.664408] audit: type=1400 audit(1573552684.131:8): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/lib/NetworkManager/nm-dhcp-client.action" pid=1115 comm="apparmor_parser"
[ 10.664908] audit: type=1400 audit(1573552684.131:9): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/lib/NetworkManager/nm-dhcp-helper" pid=1115 comm="apparmor_parser"
[ 10.665036] audit: type=1400 audit(1573552684.131:10): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/lib/snapd/snap-confine" pid=1121 comm="apparmor_parser"
[ 10.665227] audit: type=1400 audit(1573552684.131:11): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/lib/snapd/snap-confine//mount-namespace-capture-helper" pid=1121 comm="apparmor_parser"
[ 14.299791] UDF-fs: INFO Mounting volume 'UDF Volume', timestamp 2019/11/13 00:00 (1000)
[ 14.460645] mlx4_en: enP1s1: Steering Mode 2
[ 14.495574] mlx4_en: enP1s1: Link Up
[ 14.499525] hv_netvsc 000d3aaa-3b94-000d-3aaa-3b94000d3aaa eth0: Data path switched to VF: enP1s1
[ 14.501381] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
[ 14.759394] mlx4_en: enP1s1: Close port called
[ 14.813284] hv_netvsc 000d3aaa-3b94-000d-3aaa-3b94000d3aaa eth0: Data path switched from VF: enP1s1
[ 15.291378] mlx4_en: enP1s1: Steering Mode 2
[ 15.318215] hv_netvsc 000d3aaa-3b94-000d-3aaa-3b94000d3aaa eth0: Data path switched to VF: enP1s1
[ 15.318431] mlx4_en: enP1s1: Link Up
[ 24.701601] EXT4-fs (sda1): resizing filesystem from 548091 to 7836155 blocks
[ 25.672938] EXT4-fs (sda1): resized filesystem to 7836155
[ 26.163407] sdb: sdb1
[ 28.598444] EXT4-fs (sdb1): mounted filesystem with ordered data mode. Opts: (null)
[ 29.755886] hv_utils: VSS: userspace daemon ver. 129 connected
[ 29.811303] new mount options do not match the existing superblock, will be ignored
[ 32.388699] bpfilter: Loaded bpfilter_umh pid 1919
[ 57.255190] hv_balloon: Max. dynamic memory size: 57344 MB
[ 1782.475763] md0: detected capacity change from 0 to 7695634530304
[ 2058.545391] EXT4-fs (md0): mounted filesystem with ordered data mode. Opts: (null)
[37339.774881] INFO: task jbd2/sda1-8:506 blocked for more than 120 seconds.
[37339.781631] Not tainted 5.0.0-1023-azure #24~18.04.1-Ubuntu
[37339.787215] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[37339.794284] jbd2/sda1-8 D 0 506 2 0x80000000
[37339.794286] Call Trace:
[37339.794293] __schedule+0x2a2/0x850
[37339.794296] ? __switch_to_asm+0x41/0x70
[37339.794297] ? __switch_to_asm+0x35/0x70
[37339.794299] ? bit_wait+0x60/0x60
[37339.794300] schedule+0x2c/0x70
[37339.794302] io_schedule+0x16/0x40
[37339.794303] bit_wait_io+0x11/0x60
[37339.794304] __wait_on_bit+0x4c/0x90
[37339.794306] out_of_line_wait_on_bit+0x90/0xb0
[37339.794310] ? init_wait_var_entry+0x50/0x50
[37339.794314] __wait_on_buffer+0x32/0x40
[37339.794317] jbd2_journal_commit_transaction+0xf6a/0x1770
[37339.794318] ? __switch_to_asm+0x41/0x70
[37339.794322] ? finish_task_switch+0x74/0x2a0
[37339.794324] kjournald2+0xc8/0x270
[37339.794326] ? kjournald2+0xc8/0x270
[37339.794327] ? wait_woken+0x80/0x80
[37339.794330] kthread+0x121/0x140
[37339.794331] ? commit_timeout+0x20/0x20
[37339.794332] ? kthread_park+0xb0/0xb0
[37339.794334] ret_from_fork+0x35/0x40
[37339.794356] INFO: task postgres:44862 blocked for more than 120 seconds.
[37339.801214] Not tainted 5.0.0-1023-azure #24~18.04.1-Ubuntu
[37339.806387] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[37339.813604] postgres D 0 44862 30844 0x00000000
[37339.813606] Call Trace:
[37339.813610] __schedule+0x2a2/0x850
[37339.813612] schedule+0x2c/0x70
[37339.813613] io_schedule+0x16/0x40
[37339.813617] wait_on_page_bit+0x149/0x220
[37339.813619] ? file_check_and_advance_wb_err+0xe0/0xe0
[37339.813621] truncate_inode_pages_range+0x5d1/0x950
[37339.813625] ? crypto_shash_update+0x1e/0x30
[37339.813628] ? ext4_inode_csum.isra.63+0x1a2/0x210
[37339.813630] ? __wake_up_common_lock+0x8e/0xc0
[37339.813633] ? jbd2_journal_stop+0xf6/0x3e0
[37339.813634] ? ext4_unlink+0x320/0x340
[37339.813635] ? ext4_mark_iloc_dirty+0x62/0x80
[37339.813637] truncate_inode_pages_final+0x46/0x50
[37339.813638] ext4_evict_inode+0x10a/0x5a0
[37339.813640] evict+0xca/0x1a0
[37339.813641] iput+0x189/0x220
[37339.813643] do_unlinkat+0x19c/0x320
[37339.813645] __x64_sys_unlink+0x23/0x30
[37339.813648] do_syscall_64+0x64/0x1b0
[37339.813649] entry_SYSCALL_64_after_hwframe+0x44/0xa9
[37339.813651] RIP: 0033:0x7f0d7d04cd47
[37339.813655] Code: Bad RIP value.
[37339.813655] RSP: 002b:00007fffdde47ba8 EFLAGS: 00000246 ORIG_RAX: 0000000000000057
[37339.813657] RAX: ffffffffffffffda RBX: 00007fffdde47d30 RCX: 00007f0d7d04cd47
[37339.813657] RDX: 00007fffdde47bb0 RSI: 00007fffdde47bb0 RDI: 00007fffdde47d30
[37339.813658] RBP: 00007fffdde47c70 R08: 000055e344ca91f5 R09: 0000000000000000
[37339.813658] R10: 0000000000000000 R11: 0000000000000246 R12: 000000000000000f
[37339.813659] R13: 0000000000000000 R14: 000055e344cd3e1d R15: 00007fffdde47d30
[38427.262858] INFO: task jbd2/sda1-8:506 blocked for more than 120 seconds.
[38427.269741] Not tainted 5.0.0-1023-azure #24~18.04.1-Ubuntu
[38427.275314] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[38427.283261] jbd2/sda1-8 D 0 506 2 0x80000000
[38427.283264] Call Trace:
[38427.283272] __schedule+0x2a2/0x850
[38427.283274] ? __switch_to_asm+0x41/0x70
[38427.283276] ? __switch_to_asm+0x35/0x70
[38427.283278] ? bit_wait+0x60/0x60
[38427.283279] schedule+0x2c/0x70
[38427.283281] io_schedule+0x16/0x40
[38427.283283] bit_wait_io+0x11/0x60
[38427.283285] __wait_on_bit+0x4c/0x90
[38427.283286] out_of_line_wait_on_bit+0x90/0xb0
[38427.283291] ? init_wait_var_entry+0x50/0x50
[38427.283295] __wait_on_buffer+0x32/0x40
[38427.283298] jbd2_journal_commit_transaction+0xf6a/0x1770
[38427.283299] ? __switch_to_asm+0x41/0x70
[38427.283304] kjournald2+0xc8/0x270
[38427.283305] ? kjournald2+0xc8/0x270
[38427.283307] ? wait_woken+0x80/0x80
[38427.283310] kthread+0x121/0x140
[38427.283311] ? commit_timeout+0x20/0x20
[38427.283313] ? kthread_park+0xb0/0xb0
[38427.283314] ret_from_fork+0x35/0x40
[38427.283317] INFO: task journal-offline:76334 blocked for more than 120 seconds.
[38427.289795] Not tainted 5.0.0-1023-azure #24~18.04.1-Ubuntu
[38427.294937] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[38427.302213] journal-offline D 0 76334 1 0x00000100
[38427.302216] Call Trace:
[38427.302220] __schedule+0x2a2/0x850
[38427.302222] schedule+0x2c/0x70
[38427.302225] jbd2_log_wait_commit+0xb0/0x120
[38427.302229] ? wait_woken+0x80/0x80
[38427.302232] jbd2_complete_transaction+0x5c/0xa0
[38427.302237] ext4_sync_file+0x312/0x3f0
[38427.302240] vfs_fsync_range+0x48/0x80
[38427.302243] ? __fget_light+0x54/0x60
[38427.302244] do_fsync+0x3d/0x70
[38427.302246] __x64_sys_fsync+0x14/0x20
[38427.302249] do_syscall_64+0x64/0x1b0
[38427.302250] entry_SYSCALL_64_after_hwframe+0x44/0xa9
[38427.302252] RIP: 0033:0x7f5450156237
[38427.302258] Code: Bad RIP value.
[38427.302259] RSP: 002b:00007f544b854cb0 EFLAGS: 00000293 ORIG_RAX: 000000000000004a
[38427.302260] RAX: ffffffffffffffda RBX: 0000000000000018 RCX: 00007f5450156237
[38427.302261] RDX: 0000000000000000 RSI: 00007f544fd6362c RDI: 0000000000000018
[38427.302262] RBP: 00007f544fd64da0 R08: 00007f544b855700 R09: 00007f544b855700
[38427.302262] R10: 000000000000000c R11: 0000000000000293 R12: 0000000000000002
[38427.302263] R13: 0000000000000000 R14: 00005592b48f0e00 R15: 00007ffe30a77240
[38427.302274] INFO: task postgres:30851 blocked for more than 120 seconds.
[38427.308107] Not tainted 5.0.0-1023-azure #24~18.04.1-Ubuntu
[38427.314035] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[38427.321073] postgres D 0 30851 30844 0x00000004
[38427.321074] Call Trace:
[38427.321095] __schedule+0x2a2/0x850
[38427.321096] schedule+0x2c/0x70
[38427.321098] jbd2_log_wait_commit+0xb0/0x120
[38427.321100] ? wait_woken+0x80/0x80
[38427.321102] jbd2_complete_transaction+0x5c/0xa0
[38427.321103] ext4_sync_file+0x312/0x3f0
[38427.321117] vfs_fsync_range+0x48/0x80
[38427.321118] do_fsync+0x3d/0x70
[38427.321119] __x64_sys_fsync+0x14/0x20
[38427.321120] do_syscall_64+0x64/0x1b0
[38427.321122] entry_SYSCALL_64_after_hwframe+0x44/0xa9
[38427.321123] RIP: 0033:0x7f0d7f787ae1
[38427.321142] Code: e5 84 20 00 f7 d8 64 89 02 48 c7 c0 ff ff ff ff eb b1 0f 1f 80 00 00 00 00 8b 05 2a c9 20 00 85 c0 75 16 b8 4a 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 3f f3 c3 0f 1f 44 00 00 53 89 fb 48 83 ec 10
[38427.321143] RSP: 002b:00007fffdde492c8 EFLAGS: 00000246 ORIG_RAX: 000000000000004a
[38427.321144] RAX: ffffffffffffffda RBX: 0000000000000039 RCX: 00007f0d7f787ae1
[38427.321145] RDX: 0000000000000002 RSI: 000055e344c9e740 RDI: 0000000000000039
[38427.321146] RBP: 00007fffdde49310 R08: 0000000000000001 R09: 0000000000000010
[38427.321147] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000
[38427.321147] R13: 000055e344c9e740 R14: 0000000000000000 R15: 0000000000000016
[38427.321159] INFO: task logrotate:76233 blocked for more than 120 seconds.
[38427.326211] Not tainted 5.0.0-1023-azure #24~18.04.1-Ubuntu
[38427.331629] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[38427.338518] logrotate D 0 76233 76229 0x00000000
[38427.338520] Call Trace:
[38427.338523] __schedule+0x2a2/0x850
[38427.338525] schedule+0x2c/0x70
[38427.338527] jbd2_log_wait_commit+0xb0/0x120
[38427.338529] ? wait_woken+0x80/0x80
[38427.338532] jbd2_complete_transaction+0x5c/0xa0
[38427.338534] ext4_sync_file+0x312/0x3f0
[38427.338537] vfs_fsync_range+0x48/0x80
[38427.338539] do_fsync+0x3d/0x70
[38427.338540] __x64_sys_fsync+0x14/0x20
[38427.338541] do_syscall_64+0x64/0x1b0
[38427.338543] entry_SYSCALL_64_after_hwframe+0x44/0xa9
[38427.338544] RIP: 0033:0x7f953487f214
[38427.338547] Code: Bad RIP value.
[38427.338548] RSP: 002b:00007ffc1dc28b28 EFLAGS: 00000246 ORIG_RAX: 000000000000004a
[38427.338549] RAX: ffffffffffffffda RBX: 000055aa5b09c837 RCX: 00007f953487f214
[38427.338549] RDX: 000000000000003f RSI: 0000000000000013 RDI: 0000000000000003
[38427.338567] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000
[38427.338568] R10: 0000000000000000 R11: 0000000000000246 R12: 000055aa5b098260
[38427.338568] R13: 0000000000000000 R14: 00007ffc1dc28b70 R15: 0000000000000000
[38789.758889] INFO: task jbd2/sda1-8:506 blocked for more than 120 seconds.
[38789.765984] Not tainted 5.0.0-1023-azure #24~18.04.1-Ubuntu
[38789.772066] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[38789.779516] jbd2/sda1-8 D 0 506 2 0x80000000
[38789.779519] Call Trace:
[38789.779528] __schedule+0x2a2/0x850
[38789.779533] ? __switch_to_asm+0x41/0x70
[38789.779535] ? __switch_to_asm+0x35/0x70
[38789.779538] ? bit_wait+0x60/0x60
[38789.779539] schedule+0x2c/0x70
[38789.779541] io_schedule+0x16/0x40
[38789.779543] bit_wait_io+0x11/0x60
[38789.779544] __wait_on_bit+0x4c/0x90
[38789.779546] out_of_line_wait_on_bit+0x90/0xb0
[38789.779575] ? init_wait_var_entry+0x50/0x50
[38789.779579] __wait_on_buffer+0x32/0x40
[38789.779582] jbd2_journal_commit_transaction+0xf6a/0x1770
[38789.779584] ? __switch_to_asm+0x41/0x70
[38789.779589] ? finish_task_switch+0x74/0x2a0
[38789.779594] kjournald2+0xc8/0x270
[38789.779597] ? kjournald2+0xc8/0x270
[38789.779600] ? wait_woken+0x80/0x80
[38789.779605] kthread+0x121/0x140
[38789.779606] ? commit_timeout+0x20/0x20
[38789.779608] ? kthread_park+0xb0/0xb0
[38789.779609] ret_from_fork+0x35/0x40
[38789.779611] INFO: task journal-offline:76789 blocked for more than 120 seconds.
[38789.786688] Not tainted 5.0.0-1023-azure #24~18.04.1-Ubuntu
[38789.792136] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[38789.798870] journal-offline D 0 76789 1 0x00000100
[38789.798871] Call Trace:
[38789.798892] __schedule+0x2a2/0x850
[38789.798894] schedule+0x2c/0x70
[38789.798896] jbd2_log_wait_commit+0xb0/0x120
[38789.798898] ? wait_woken+0x80/0x80
[38789.798899] jbd2_complete_transaction+0x5c/0xa0
[38789.798902] ext4_sync_file+0x32e/0x3f0
[38789.798904] vfs_fsync_range+0x48/0x80
[38789.798906] ? __fget_light+0x54/0x60
[38789.798907] do_fsync+0x3d/0x70
[38789.798908] __x64_sys_fsync+0x14/0x20
[38789.798911] do_syscall_64+0x64/0x1b0
[38789.798912] entry_SYSCALL_64_after_hwframe+0x44/0xa9
[38789.798915] RIP: 0033:0x7f5450156237
[38789.798921] Code: Bad RIP value.
[38789.798922] RSP: 002b:00007f544b854cb0 EFLAGS: 00000293 ORIG_RAX: 000000000000004a
[38789.798923] RAX: ffffffffffffffda RBX: 0000000000000018 RCX: 00007f5450156237
[38789.798924] RDX: 0000000000000000 RSI: 00007f544fd6362c RDI: 0000000000000018
[38789.798924] RBP: 00007f544fd64da0 R08: 00007f544b855700 R09: 00007f544b855700
[38789.798925] R10: 000000000000000c R11: 0000000000000293 R12: 0000000000000002
[38789.798926] R13: 0000000000000000 R14: 00005592b48f0e00 R15: 00007ffe30a77240
[38789.798934] INFO: task python3:1999 blocked for more than 120 seconds.
[38789.805065] Not tainted 5.0.0-1023-azure #24~18.04.1-Ubuntu
[38789.810730] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[38789.817230] python3 D 0 1999 1483 0x00000000
[38789.817265] Call Trace:
[38789.817268] __schedule+0x2a2/0x850
[38789.817290] ? wbt_cleanup_cb+0x20/0x20
[38789.817293] ? __wbt_done+0x40/0x40
[38789.817298] schedule+0x2c/0x70
[38789.817301] io_schedule+0x16/0x40
[38789.817302] rq_qos_wait+0xba/0x170
[38789.817304] ? sysv68_partition+0x2d0/0x2d0
[38789.817306] ? wbt_cleanup_cb+0x20/0x20
[38789.817308] wbt_wait+0x9f/0xe0
[38789.817310] __rq_qos_throttle+0x28/0x40
[38789.817313] blk_mq_make_request+0xe4/0x4d0
[38789.817315] ? generic_make_request_checks+0x251/0x690
[38789.817317] generic_make_request+0x19e/0x3f0
[38789.817320] ? ext4_writepages+0xc3c/0xe90
[38789.817321] submit_bio+0x73/0x140
[38789.817322] ? submit_bio+0x73/0x140
[38789.817324] ext4_io_submit+0x4d/0x60
[38789.817326] ext4_writepages+0x5dd/0xe90
[38789.817332] do_writepages+0x4b/0xe0
[38789.817335] ? ext4_mark_inode_dirty+0x1d0/0x1d0
[38789.817339] ? do_writepages+0x4b/0xe0
[38789.817344] ? __generic_file_write_iter+0x1aa/0x1d0
[38789.817347] ? generic_write_checks+0x4e/0xb0
[38789.817350] __filemap_fdatawrite_range+0xc1/0x100
[38789.817353] ? __filemap_fdatawrite_range+0xc1/0x100
[38789.817356] filemap_flush+0x1c/0x20
[38789.817357] ext4_alloc_da_blocks+0x2c/0x70
[38789.817359] ext4_release_file+0x76/0xb0
[38789.817362] __fput+0xbc/0x230
[38789.817364] ____fput+0xe/0x10
[38789.817366] task_work_run+0x97/0xc0
[38789.817368] exit_to_usermode_loop+0xe6/0xf0
[38789.817369] do_syscall_64+0x1a3/0x1b0
[38789.817371] entry_SYSCALL_64_after_hwframe+0x44/0xa9
[38789.817373] RIP: 0033:0x7f436d50c8f7
[38789.817376] Code: Bad RIP value.
[38789.817377] RSP: 002b:00007fffeef6fe10 EFLAGS: 00000293 ORIG_RAX: 0000000000000003
[38789.817378] RAX: 0000000000000000 RBX: 0000000000000005 RCX: 00007f436d50c8f7
[38789.817378] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000005
[38789.817379] RBP: 00000000009d4380 R08: 0000000000000000 R09: 0000000000000001
[38789.817380] R10: ffffffffffffffff R11: 0000000000000293 R12: 0000000000000005
[38789.817380] R13: 0000000001efddd0 R14: 00000000004cbaa0 R15: 00007fffeef6ff70
[38789.817394] INFO: task output.rb:140:41539 blocked for more than 120 seconds.
[38789.823102] Not tainted 5.0.0-1023-azure #24~18.04.1-Ubuntu
[38789.828845] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[38789.835578] output.rb:140 D 0 41539 1 0x00000000
[38789.835580] Call Trace:
[38789.835583] __schedule+0x2a2/0x850
[38789.835602] ? wbt_cleanup_cb+0x20/0x20
[38789.835603] ? __wbt_done+0x40/0x40
[38789.835605] schedule+0x2c/0x70
[38789.835606] io_schedule+0x16/0x40
[38789.835607] rq_qos_wait+0xba/0x170
[38789.835609] ? sysv68_partition+0x2d0/0x2d0
[38789.835611] ? wbt_cleanup_cb+0x20/0x20
[38789.835613] wbt_wait+0x9f/0xe0
[38789.835636] __rq_qos_throttle+0x28/0x40
[38789.835638] blk_mq_make_request+0xe4/0x4d0
[38789.835639] ? generic_make_request_checks+0x251/0x690
[38789.835640] generic_make_request+0x19e/0x3f0
[38789.835642] ? ext4_writepages+0xc3c/0xe90
[38789.835643] submit_bio+0x73/0x140
[38789.835644] ? submit_bio+0x73/0x140
[38789.835645] ext4_io_submit+0x4d/0x60
[38789.835646] ext4_writepages+0x5dd/0xe90
[38789.835649] do_writepages+0x4b/0xe0
[38789.835651] ? ext4_mark_inode_dirty+0x1d0/0x1d0
[38789.835652] ? do_writepages+0x4b/0xe0
[38789.835654] ? __generic_file_write_iter+0x1aa/0x1d0
[38789.835655] ? generic_write_checks+0x4e/0xb0
[38789.835674] __filemap_fdatawrite_range+0xc1/0x100
[38789.835675] ? __filemap_fdatawrite_range+0xc1/0x100
[38789.835677] filemap_flush+0x1c/0x20
[38789.835678] ext4_alloc_da_blocks+0x2c/0x70
[38789.835679] ext4_release_file+0x76/0xb0
[38789.835681] __fput+0xbc/0x230
[38789.835683] ____fput+0xe/0x10
[38789.835686] task_work_run+0x97/0xc0
[38789.835689] exit_to_usermode_loop+0xe6/0xf0
[38789.835693] do_syscall_64+0x1a3/0x1b0
[38789.835696] entry_SYSCALL_64_after_hwframe+0x44/0xa9
[38789.835699] RIP: 0033:0x7f85009df447
[38789.835702] Code: 00 00 0f 05 48 3d 00 f0 ff ff 77 3f f3 c3 0f 1f 44 00 00 53 89 fb 48 83 ec 10 e8 c4 fb ff ff 89 df 89 c2 b8 03 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 2b 89 d7 89 44 24 0c e8 06 fc ff ff 8b 44 24
[38789.835705] RSP: 002b:00007f84fcff8100 EFLAGS: 00000293 ORIG_RAX: 0000000000000003
[38789.835708] RAX: 0000000000000000 RBX: 000000000000000e RCX: 00007f85009df447
[38789.835711] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 000000000000000e
[38789.835713] RBP: 00007f84f6f2d448 R08: 0000000000000000 R09: 0000000000000000
[38789.835716] R10: 0000000000000000 R11: 0000000000000293 R12: 00007f84f76f86c0
[38789.835718] R13: 0000000000000000 R14: 000055e61fe135f0 R15: 00007f84f76f8600
[74396.120516] hv_utils: VSS: userspace daemon ver. 129 connected
[74470.501794] SGI XFS with ACLs, security attributes, realtime, no debug enabled
[160033.002102] hv_utils: VSS: userspace daemon ver. 129 connected
[1738462.462053] kauditd_printk_skb: 5 callbacks suppressed
[1738462.462054] audit: type=1400 audit(1575291135.929:17): apparmor="DENIED" operation="capable" profile="/usr/bin/man" pid=55258 comm="man" capability=2 capname="dac_read_search"
[1738462.462059] audit: type=1400 audit(1575291135.929:18): apparmor="DENIED" operation="capable" profile="/usr/bin/man" pid=55258 comm="man" capability=1 capname="dac_override"
[1738462.464344] audit: type=1400 audit(1575291135.933:19): apparmor="DENIED" operation="capable" profile="/usr/bin/man" pid=55272 comm="pager" capability=2 capname="dac_read_search"
[1738462.464348] audit: type=1400 audit(1575291135.933:20): apparmor="DENIED" operation="capable" profile="/usr/bin/man" pid=55272 comm="pager" capability=1 capname="dac_override"
[1738462.469286] audit: type=1400 audit(1575291135.937:21): apparmor="DENIED" operation="capable" profile="/usr/bin/man" pid=55270 comm="nroff" capability=2 capname="dac_read_search"
[1738462.469290] audit: type=1400 audit(1575291135.937:22): apparmor="DENIED" operation="capable" profile="/usr/bin/man" pid=55270 comm="nroff" capability=1 capname="dac_override"
[1889031.582532] hv_utils: VSS: userspace daemon ver. 129 connected
[2037990.376135] postgres invoked oom-killer: gfp_mask=0x6200ca(GFP_HIGHUSER_MOVABLE), order=0, oom_score_adj=0
[2037990.376139] CPU: 5 PID: 52052 Comm: postgres Not tainted 5.0.0-1023-azure #24~18.04.1-Ubuntu
[2037990.376140] Hardware name: Microsoft Corporation Virtual Machine/Virtual Machine, BIOS 090007 06/02/2017
[2037990.376141] Call Trace:
[2037990.376149] dump_stack+0x4d/0x65
[2037990.376152] dump_header+0x57/0x315
[2037990.376156] ? sched_clock_local+0x17/0x90
[2037990.376158] oom_kill_process+0x254/0x280
[2037990.376159] out_of_memory+0x2bf/0x500
[2037990.376162] __alloc_pages_slowpath+0xb32/0xe80
[2037990.376164] __alloc_pages_nodemask+0x2a7/0x2c0
[2037990.376169] alloc_pages_current+0x6a/0xe0
[2037990.376172] __page_cache_alloc+0x6a/0xa0
[2037990.376174] filemap_fault+0x395/0x830
[2037990.376177] ? unlock_page_memcg+0x12/0x20
[2037990.376178] ? page_add_file_rmap+0x5f/0x230
[2037990.376181] ? xas_load+0xc/0x80
[2037990.376183] ? xas_find+0x15b/0x1a0
[2037990.376185] ? filemap_map_pages+0x18b/0x380
[2037990.376189] ext4_filemap_fault+0x31/0x44
[2037990.376192] __do_fault+0x57/0x115
[2037990.376193] __handle_mm_fault+0xe00/0x1340
[2037990.376196] ? __switch_to_asm+0x41/0x70
[2037990.376197] ? __switch_to_asm+0x41/0x70
[2037990.376199] handle_mm_fault+0xcd/0x230
[2037990.376201] __do_page_fault+0x291/0x4c0
[2037990.376203] do_page_fault+0x31/0x110
[2037990.376204] ? page_fault+0x8/0x30
[2037990.376206] page_fault+0x1e/0x30
[2037990.376207] RIP: 0033:0x7f4a1d967c20
[2037990.376212] Code: Bad RIP value.
[2037990.376213] RSP: 002b:00007ffc81209e08 EFLAGS: 00010206
[2037990.376214] RAX: 00000000fffffff8 RBX: 0000000000000006 RCX: 0000000000000006
[2037990.376215] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 00007ffc81209e30
[2037990.376215] RBP: 000055f805d31390 R08: 0000000000000000 R09: 0000000000000000
[2037990.376216] R10: 0000000000000000 R11: 000055f805d31390 R12: 00007ffc81209f70
[2037990.376217] R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000
[2037990.376218] Mem-Info:
[2037990.376221] active_anon:13735462 inactive_anon:24635 isolated_anon:0
active_file:1138 inactive_file:1130 isolated_file:0
unevictable:0 dirty:0 writeback:0 unstable:0
slab_reclaimable:181506 slab_unreclaimable:48795
mapped:3188203 shmem:3242903 pagetables:233192 bounce:0
free:85819 free_pcp:1987 free_cma:0
[2037990.376224] Node 0 active_anon:54941848kB inactive_anon:98540kB active_file:4552kB inactive_file:4520kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:12752812kB dirty:0kB writeback:0kB shmem:12971612kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 3735552kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no
[2037990.376225] Node 0 DMA free:15844kB min:16kB low:28kB high:40kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15992kB managed:15908kB mlocked:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
[2037990.376228] lowmem_reserve[]: 0 924 56295 56295 56295
[2037990.376229] Node 0 DMA32 free:222064kB min:1108kB low:2052kB high:2996kB active_anon:731324kB inactive_anon:312kB active_file:60kB inactive_file:0kB unevictable:0kB writepending:0kB present:1032128kB managed:966592kB mlocked:0kB kernel_stack:32kB pagetables:216kB bounce:0kB free_pcp:756kB local_pcp:4kB free_cma:0kB
[2037990.376232] lowmem_reserve[]: 0 0 55371 55371 55371
[2037990.376234] Node 0 Normal free:105368kB min:109460kB low:166160kB high:222860kB active_anon:54210524kB inactive_anon:97316kB active_file:5648kB inactive_file:5252kB unevictable:0kB writepending:0kB present:57671680kB managed:56706592kB mlocked:0kB kernel_stack:6944kB pagetables:932552kB bounce:0kB free_pcp:7192kB local_pcp:920kB free_cma:0kB
[2037990.376236] lowmem_reserve[]: 0 0 0 0 0
[2037990.376238] Node 0 DMA: 1*4kB (U) 0*8kB 0*16kB 1*32kB (U) 1*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15844kB
[2037990.376243] Node 0 DMA32: 102*4kB (UEH) 187*8kB (UEH) 160*16kB (UEH) 189*32kB (UMEH) 156*64kB (UMEH) 87*128kB (UME) 64*256kB (UME) 44*512kB (ME) 36*1024kB (UME) 0*2048kB 28*4096kB (M) = 222096kB
[2037990.376248] Node 0 Normal: 1966*4kB (UME) 3623*8kB (UME) 953*16kB (UME) 1350*32kB (UME) 96*64kB (UME) 0*128kB 0*256kB 0*512kB 0*1024kB 1*2048kB (H) 0*4096kB = 103488kB
[2037990.376254] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
[2037990.376255] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
[2037990.376255] 3245227 total pagecache pages
[2037990.376256] 0 pages in swap cache
[2037990.376257] Swap cache stats: add 0, delete 0, find 0/0
[2037990.376258] Free swap = 0kB
[2037990.376258] Total swap = 0kB
[2037990.376259] 14679950 pages RAM
[2037990.376259] 0 pages HighMem/MovableOnly
[2037990.376260] 257677 pages reserved
[2037990.376260] 0 pages cma reserved
[2037990.376260] 0 pages hwpoisoned
[2037990.376261] Tasks state (memory values in pages):
[2037990.376261] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name
[2037990.376267] [ 573] 0 573 30486 2851 208896 0 0 systemd-journal
[2037990.376269] [ 629] 0 629 11049 519 114688 0 -1000 systemd-udevd
[2037990.376271] [ 632] 0 632 26475 45 98304 0 0 lvmetad
[2037990.376272] [ 1015] 62583 1015 35481 149 184320 0 0 systemd-timesyn
[2037990.376274] [ 1213] 100 1213 20042 183 172032 0 0 systemd-network
[2037990.376275] [ 1241] 101 1241 17686 200 176128 0 0 systemd-resolve
[2037990.376277] [ 1483] 0 1483 18369 3145 184320 0 0 python3
[2037990.376278] [ 1489] 0 1489 42705 1943 229376 0 0 networkd-dispat
[2037990.376280] [ 1491] 0 1491 17869 424 176128 0 0 systemd-logind
[2037990.376281] [ 1492] 0 1492 27634 89 110592 0 0 irqbalance
[2037990.376283] [ 1510] 0 1510 132603 708 118784 0 0 lxcfs
[2037990.376284] [ 1535] 0 1535 7961 75 106496 0 0 cron
[2037990.376285] [ 1564] 0 1564 7082 53 98304 0 0 atd
[2037990.376287] [ 1580] 0 1580 72020 246 200704 0 0 accounts-daemon
[2037990.376289] [ 1586] 103 1586 12541 196 147456 0 -900 dbus-daemon
[2037990.376290] [ 1654] 0 1654 46916 1978 262144 0 0 unattended-upgr
[2037990.376291] [ 1681] 0 1681 73687 307 217088 0 0 polkitd
[2037990.376293] [ 1723] 0 1723 4102 36 73728 0 0 agetty
[2037990.376295] [ 1763] 0 1763 3721 34 77824 0 0 agetty
[2037990.376296] [ 1919] 0 1919 1126 16 57344 0 0 none
[2037990.376298] [ 2122] 0 2122 18073 188 176128 0 -1000 sshd
[2037990.376299] [ 2879] 0 2879 26422 249 245760 0 0 sshd
[2037990.376300] [ 2921] 1001 2921 19191 307 188416 0 0 systemd
[2037990.376302] [ 2922] 1001 2922 28003 658 249856 0 0 (sd-pam)
[2037990.376304] [ 2996] 1001 2996 27099 332 253952 0 0 sshd
[2037990.376305] [ 2997] 1001 2997 5779 427 81920 0 0 bash
[2037990.376306] [ 3077] 1001 3077 7970 67 102400 0 0 screen
[2037990.376308] [ 3078] 1001 3078 8716 840 102400 0 0 screen
[2037990.376309] [ 3079] 1001 3079 5807 439 86016 0 0 bash
[2037990.376311] [ 36493] 998 36493 23441 76 90112 0 0 gpg-agent
[2037990.376313] [ 36667] 0 36667 8039 126 98304 0 0 omiserver
[2037990.376314] [ 36669] 999 36669 8037 142 106496 0 0 omiengine
[2037990.376316] [ 36972] 102 36972 66816 346 167936 0 0 rsyslogd
[2037990.376317] [ 37148] 998 37148 48300 273 167936 0 0 omiagent
[2037990.376319] [ 37180] 0 37180 48299 727 176128 0 0 omiagent
[2037990.376320] [ 109198] 1001 109198 5817 441 90112 0 0 bash
[2037990.376322] [ 109325] 0 109325 17077 136 184320 0 0 sudo
[2037990.376323] [ 109326] 0 109326 15868 116 176128 0 0 su
[2037990.376325] [ 109327] 0 109327 5501 126 81920 0 0 bash
[2037990.376326] [ 67523] 0 67523 17115 165 172032 0 0 sudo
[2037990.376327] [ 67528] 0 67528 15868 116 172032 0 0 su
[2037990.376329] [ 67529] 0 67529 5501 132 86016 0 0 bash
[2037990.376330] [ 69559] 0 69559 13933 601 147456 0 0 mc
[2037990.376332] [ 69561] 0 69561 5507 141 94208 0 0 bash
[2037990.376333] [ 84328] 1001 84328 5898 547 86016 0 0 bash
[2037990.376335] [ 119112] 1001 119112 5834 463 94208 0 0 bash
[2037990.376336] [ 111545] 0 111545 26422 249 245760 0 0 sshd
[2037990.376337] [ 111711] 1001 111711 27067 322 249856 0 0 sshd
[2037990.376339] [ 111712] 1001 111712 3301 90 77824 0 0 sftp-server
[2037990.376340] [ 121334] 1001 121334 3360 59 73728 0 0 process_world.s
[2037990.376342] [ 121335] 1001 121335 3327 71 69632 0 0 bash
[2037990.376343] [ 123581] 1001 123581 3327 77 69632 0 0 bash
[2037990.376345] [ 123592] 1001 123592 3329 60 61440 0 0 bash
[2037990.376346] [ 123593] 1001 123593 29678 317 253952 0 0 psql
[2037990.376347] [ 123594] 1001 123594 29643 312 249856 0 0 psql
[2037990.376349] [ 23173] 997 23173 10423 1161 126976 0 0 python
[2037990.376350] [ 23202] 997 23202 109048 2611 221184 0 0 python
[2037990.376351] [ 66945] 111 66945 9162 333 98304 0 0 pgbouncer
[2037990.376353] [ 107362] 1001 107362 5816 454 94208 0 0 bash
[2037990.376354] [ 107669] 0 107669 61031 5369 249856 0 0 python3
[2037990.376356] [ 107856] 998 107856 88969 29860 811008 0 0 omsagent
[2037990.376357] [ 107965] 0 107965 54926 2395 200704 0 0 python
[2037990.376359] [ 27614] 0 27614 2973 198 65536 0 0 hv_kvp_daemon
[2037990.376360] [ 27620] 0 27620 1128 15 53248 0 0 hv_vss_daemon
[2037990.376362] [ 21487] 111 21487 3271603 72813 913408 0 -900 postgres
[2037990.376364] [ 21488] 111 21488 43417 502 286720 0 0 postgres
[2037990.376365] [ 21509] 111 21509 3271631 25582 618496 0 0 postgres
[2037990.376366] [ 21510] 111 21510 3271603 25203 520192 0 0 postgres
[2037990.376368] [ 21511] 111 21511 3271603 4685 331776 0 0 postgres
[2037990.376369] [ 21512] 111 21512 3271831 885 352256 0 0 postgres
[2037990.376370] [ 21513] 111 21513 64862 18227 442368 0 0 postgres
[2037990.376371] [ 21514] 111 21514 3271748 750 331776 0 0 postgres
[2037990.376372] [ 21515] 111 21515 3275252 7587 536576 0 0 postgres
[2037990.376373] [ 21516] 111 21516 3278732 9729 557056 0 0 postgres
[2037990.376375] [ 21528] 111 21528 3378379 2784608 26701824 0 0 postgres
[2037990.376376] [ 21530] 111 21530 3374378 2789398 26669056 0 0 postgres
[2037990.376378] [ 21533] 111 21533 3370167 2783593 26636288 0 0 postgres
[2037990.376379] [ 21534] 111 21534 3367551 2781349 26615808 0 0 postgres
[2037990.376380] [ 21535] 111 21535 3370830 2772355 26644480 0 0 postgres
[2037990.376381] [ 21536] 111 21536 3374811 2809090 26673152 0 0 postgres
[2037990.376382] [ 21537] 111 21537 3373994 2790304 26664960 0 0 postgres
[2037990.376384] [ 21541] 111 21541 3373974 2774417 26669056 0 0 postgres
[2037990.376385] [ 21562] 111 21562 3370022 2779916 26636288 0 0 postgres
[2037990.376386] [ 21569] 111 21569 3371040 2794893 26644480 0 0 postgres
[2037990.376387] [ 21570] 111 21570 3373917 2785815 26652672 0 0 postgres
[2037990.376389] [ 21575] 0 21575 8325 445 110592 0 0 htop
[2037990.376390] [ 21581] 111 21581 3375112 2767402 26677248 0 0 postgres
[2037990.376392] [ 21582] 111 21582 3373641 2779497 26652672 0 0 postgres
[2037990.376393] [ 21588] 111 21588 3373169 2780581 26652672 0 0 postgres
[2037990.376394] [ 21590] 111 21590 3372261 2789580 26656768 0 0 postgres
[2037990.376395] [ 21619] 111 21619 3374390 2795606 26664960 0 0 postgres
[2037990.376396] [ 21620] 111 21620 3372210 2769614 26652672 0 0 postgres
[2037990.376398] [ 21629] 111 21629 3373474 2803078 26664960 0 0 postgres
[2037990.376399] [ 21630] 111 21630 3375118 2774006 26673152 0 0 postgres
[2037990.376400] [ 21631] 111 21631 3370089 2780639 26636288 0 0 postgres
[2037990.376401] [ 21637] 111 21637 3374481 2792633 26669056 0 0 postgres
[2037990.376403] [ 21638] 111 21638 3374916 2791077 26677248 0 0 postgres
[2037990.376404] [ 21654] 111 21654 3372934 2784415 26648576 0 0 postgres
[2037990.376405] [ 21655] 111 21655 3374146 2760902 26669056 0 0 postgres
[2037990.376406] [ 21661] 111 21661 3369758 2783650 26628096 0 0 postgres
[2037990.376408] [ 52039] 111 52039 4373484 4234158 34701312 0 0 postgres
[2037990.376411] [ 52051] 111 52051 4375654 4235454 34705408 0 0 postgres
[2037990.376413] [ 52052] 111 52052 4376278 4236632 34717696 0 0 postgres
[2037990.376414] [ 52053] 111 52053 4372560 4232984 34689024 0 0 postgres
[2037990.376415] [ 52054] 111 52054 4374132 4233725 34693120 0 0 postgres
[2037990.376417] [ 52057] 111 52057 4376328 4237007 34713600 0 0 postgres
[2037990.376418] [ 52058] 111 52058 4375531 4235356 34705408 0 0 postgres
[2037990.376419] [ 52059] 111 52059 4377208 4237956 34725888 0 0 postgres
[2037990.376421] [ 91084] 998 91084 4732 33 77824 0 0 sh
[2037990.376423] [ 91087] 998 91087 13492 187 126976 0 0 omicli
[2037990.376424] [ 91089] 998 91089 6747 71 90112 0 0 grep
[2037990.376426] [ 91091] 111 91091 3271857 2250 475136 0 0 postgres
[2037990.376427] oom-kill:constraint=CONSTRAINT_NONE,nodemask=(null),cpuset=/,mems_allowed=0,global_oom,task_memcg=/system.slice/system-postgresql.slice,task=postgres,pid=52059,uid=111
[2037990.376433] Out of memory: Kill process 52059 (postgres) score 294 or sacrifice child
[2037990.384186] Killed process 52059 (postgres) total-vm:17508832kB, anon-rss:4309296kB, file-rss:108kB, shmem-rss:12641580kB
[2037990.516504] oom_reaper: reaped process 52059 (postgres), now anon-rss:0kB, file-rss:0kB, shmem-rss:12641580kB