btt bug report: Fewer I2D and D2C Counts in btt Parsing Results When IO Requests Are Split

user Freshmaker <[email protected]> Fri, 14 Feb 2025 10:36:51 +0800
Newsgroups org.kernel.vger.linux-btrace
Message-ID <CAPVOfWd13yzj_ydSikF+KxpVZmNtg-=mAk10VFSb7xyt5MrObA@mail.gmail.com>
Software Information:
kernelversion=6.6.0
blktraceversion=1.3.0

Detailed Reproduction Steps:
1.Set the max_sectors_kb of the sda disk to 64.
[root@oe2403 ~]# find /sys/devices -name "max_sectors_kb"
/sys/devices/pci0000:00/0000:00:16.0/0000:0b:00.0/nvme/nvme0/nvme0n1/queue/max_sectors_kb
/sys/devices/pci0000:00/0000:00:11.0/0000:02:03.0/host2/target2:0:0/2:0:0:0/block/sda/queue/max_sectors_kb
/sys/devices/virtual/block/dm-1/queue/max_sectors_kb
/sys/devices/virtual/block/dm-0/queue/max_sectors_kb
[root@oe2403 ~]# cat
/sys/devices/pci0000:00/0000:00:11.0/0000:02:03.0/host2/target2:0:0/2:0:0:0/block/sda/queue/max_sectors_kb
1280
[root@oe2403 ~]# echo 64 >
/sys/devices/pci0000:00/0000:00:11.0/0000:02:03.0/host2/target2:0:0/2:0:0:0/block/sda/queue/max_sectors_kb
[root@oe2403 ~]# cat
/sys/devices/pci0000:00/0000:00:11.0/0000:02:03.0/host2/target2:0:0/2:0:0:0/block/sda/queue/max_sectors_kb
64

2.Use blktrace to collect IO data from the sda disk while writing
128KB of data to it via dd.
[root@oe2403 0212]# blktrace -d /dev/sda
^C=== sda ===
  CPU  0:                    6 events,        1 KiB data
  CPU  1:                    3 events,        1 KiB data
  CPU  2:                  389 events,       19 KiB data
  CPU  3:                    2 events,        1 KiB data
  Total:                   400 events (dropped 0),       19 KiB data

[root@oe2403 0212]# dd if=/dev/zero of=/dev/sda bs=128K count=1 seek=0
oflag=direct
1+0 records in
1+0 records out
131072 bytes (131 kB, 128 KiB) copied, 0.00165445 s, 79.2 MB/s

3.Merge the collected data into sda.blktrace.bin.
[root@oe2403 0212]# blkparse -i sda -d sda.blktrace.bin

4.Parse the blktrace data using btt.
[root@oe2403 0212]# blkparse -i sda.blktrace.bin > blkparse.log
[root@oe2403 0212]# btt -i sda.blktrace.bin > btt.log -p bttp.log -q bttq.log

Issue Observations:
1.In the btt.log, there are 49 entries for Q, Q2G, G2I, and Q2C, but
only 45 entries for I2D and D2C.
==================== All Devices ====================

            ALL           MIN           AVG           MAX           N
--------------- ------------- ------------- ------------- -----------

Q2Q               0.000042614   0.000391863   0.012673966          48
Q2G               0.000000594   0.000001281   0.000007439          49
G2I               0.000000442   0.000001279   0.000010852          49
I2D               0.000001189   0.000002046   0.000010545          45
D2C               0.000031109   0.000047115   0.000100012          45
Q2C               0.000033475   0.000061946   0.000294852          49

Analysis via bttp.log and blkparse.log confirms that 4 split Q
requests failed to match D actions. Consequently, these 4 Q entries
lack corresponding D entries, resulting in 4 fewer I2D and D2C entries
compared to Q2G/G2I/Q2C.
-----------------------------------------
  8,0  :     0.000000000 Q          0+256
             0.000007439 G          0+256
             0.000018291 I          0+256
             0.000191487 C          0+256

  8,0    3        1     0.000000000  3786  Q  WS 0 + 256 [dd]
  8,0    3        2     0.000003093  3786  X  WS 0 / 128 [dd]
  8,0    3        3     0.000007439  3786  G  WS 0 + 128 [dd]
  8,0    3        4     0.000018291  3786  I  WS 0 + 128 [dd]
  8,0    3        5     0.000025103  3786  G  WS 128 + 128 [dd]
  8,0    3        6     0.000025294  3786  I  WS 128 + 128 [dd]
  8,0    3        7     0.000036664    64  D  WS 0 + 128 [kworker/3:1H]
  8,0    3        8     0.000125797    64  D  WS 128 + 128 [kworker/3:1H]
  8,0    2        1     0.000184364     0  C  WS 0 + 128 [0]
  8,0    2        2     0.000191487     0  C  WS 0 + 256 [0]

2.When Q requests are split, the timestamps for Q2G and G2I are
calculated using the first block of the split Q request's G and I
timestamps, instead of the last block's timestamps. This is verified
in bttp.log and blkparse.log.
btt.log (application/octet-stream, 4.3 KB)
==================== All Devices ====================

            ALL           MIN           AVG           MAX           N
--------------- ------------- ------------- ------------- -----------

Q2Q               0.000042614   0.000391863   0.012673966          48
Q2G               0.000000594   0.000001281   0.000007439          49
G2I               0.000000442   0.000001279   0.000010852          49
I2D               0.000001189   0.000002046   0.000010545          45
D2C               0.000031109   0.000047115   0.000100012          45
Q2C               0.000033475   0.000061946   0.000294852          49

==================== Device Overhead ====================

       DEV |       Q2G       G2I       Q2M       I2D       D2C
---------- | --------- --------- --------- --------- ---------
 (  8,  0) |   2.0683%   2.0639%   0.0000%   3.0328%  69.8499%
---------- | --------- --------- --------- --------- ---------
   Overall |   2.0683%   2.0639%   0.0000%   3.0328%  69.8499%

==================== Device Merge Information ====================

       DEV |       #Q       #D   Ratio |   BLKmin   BLKavg   BLKmax    Total
---------- | -------- -------- ------- | -------- -------- -------- --------
 (  8,  0) |       55       55     1.0 |        8       65      504     3624

==================== Device Q2Q Seek Information ====================

       DEV |          NSEEKS            MEAN          MEDIAN | MODE           
---------- | --------------- --------------- --------------- | ---------------
 (  8,  0) |              49        256765.9               0 | 8(12)
---------- | --------------- --------------- --------------- | ---------------
   Overall |          NSEEKS            MEAN          MEDIAN | MODE           
   Average |              49        256765.9               0 | 8(12)

==================== Device D2D Seek Information ====================

       DEV |          NSEEKS            MEAN          MEDIAN | MODE           
---------- | --------------- --------------- --------------- | ---------------
 (  8,  0) |              55        228757.4               0 | 8(12)
---------- | --------------- --------------- --------------- | ---------------
   Overall |          NSEEKS            MEAN          MEDIAN | MODE           
   Average |              55        228757.4               0 | 8(12)

==================== Plug Information ====================

       DEV |    # Plugs # Timer Us  | % Time Q Plugged
---------- | ---------- ----------  | ----------------
 (  8,  0) |         46(         0) |   0.058050236%

       DEV |    IOs/Unp   IOs/Unp(to)
---------- | ----------   ----------
 (  8,  0) |        1.1          0.0
---------- | ----------   ----------
   Overall |    IOs/Unp   IOs/Unp(to)
   Average |        1.1          0.0

==================== Active Requests At Q Information ====================

       DEV |  Avg Reqs @ Q
---------- | -------------
 (  8,  0) |           0.0

==================== I/O Active Period Information ====================

       DEV |     # Live      Avg. Act     Avg. !Act % Live
---------- | ---------- ------------- ------------- ------
 (  8,  0) |         45   0.000047115   0.000380244  11.25
---------- | ---------- ------------- ------------- ------
 Total Sys |         45   0.000047115   0.000380244  11.25

# Total System
#     Total System : q activity
  0.000000000   0.0
  0.000000000   0.4
  0.018809419   0.4
  0.018809419   0.0

#     Total System : c activity
  0.000184364   0.5
  0.000184364   0.9
  0.018850914   0.9
  0.018850914   0.5

# Per process
#    (udev-worker) : q activity
  0.014878189   1.0
  0.014878189   1.4
  0.018809419   1.4
  0.018809419   1.0

#    (udev-worker) : c activity
  0.014951122   1.5
  0.014951122   1.9
  0.018850914   1.9
  0.018850914   1.5

#               dd : q activity
  0.000000000   2.0
  0.000000000   2.4
  0.000000000   2.4
  0.000000000   2.0

#               dd : c activity

#           kernel : q activity

#           kernel : c activity
  0.000184364   3.5
  0.000184364   3.9
  0.002286085   3.9
  0.002286085   3.5

#          kworker : q activity

#          kworker : c activity
  0.002108533   4.5
  0.002108533   4.9
  0.002108533   4.9
  0.002108533   4.5

#    systemd-udevd : q activity
  0.002048154   7.0
  0.002048154   7.4
  0.002204223   7.4
  0.002204223   7.0

#    systemd-udevd : c activity
bttp.log (application/octet-stream, 12.4 KB)
-----------------------------------------
  8,0  :     0.000000000 Q          0+256 
             0.000007439 G          0+256 
             0.000018291 I          0+256 
             0.000191487 C          0+256 

-----------------------------------------
  8,0  :     0.002048154 Q          0+8   
             0.002050247 G          0+8   
             0.002057984 I          0+8   
             0.002068529 D          0+8   
             0.002108533 C          0+8   

-----------------------------------------
  8,0  :     0.002204223 Q          8+8   
             0.002206526 G          8+8   
             0.002211743 I          8+8   
             0.002221126 D          8+8   
             0.002286085 C          8+8   

-----------------------------------------
  8,0  :     0.014878189 Q         32+8   
             0.014881917 G         32+8   
             0.014890900 I         32+8   
             0.014895077 D         32+8   
             0.014951122 C         32+8   

-----------------------------------------
  8,0  :     0.014964022 Q         64+8   
             0.014964884 G         64+8   
             0.014965553 I         64+8   
             0.014967150 D         64+8   
             0.015001364 C         64+8   

-----------------------------------------
  8,0  :     0.015011421 Q        128+8   
             0.015012163 G        128+8   
             0.015012669 I        128+8   
             0.015014034 D        128+8   
             0.015065485 C          0+136 

-----------------------------------------
  8,0  :     0.015073697 Q        256+8   
             0.015074308 G        256+8   
             0.015074835 I        256+8   
             0.015076063 D        256+8   
             0.015107172 C        256+8   

-----------------------------------------
  8,0  :     0.015117632 Q        512+8   
             0.015118378 G        512+8   
             0.015118924 I        512+8   
             0.015120216 D        512+8   
             0.015155347 C        512+8   

-----------------------------------------
  8,0  :     0.015164042 Q       1024+8   
             0.015164703 G       1024+8   
             0.015165239 I       1024+8   
             0.015166506 D       1024+8   
             0.015229923 C       1024+8   

-----------------------------------------
  8,0  :     0.015240577 Q       2048+8   
             0.015241456 G       2048+8   
             0.015242049 I       2048+8   
             0.015243636 D       2048+8   
             0.015284702 C       2048+8   

-----------------------------------------
  8,0  :     0.015299496 Q       4096+8   
             0.015300190 G       4096+8   
             0.015300679 I       4096+8   
             0.015302191 D       4096+8   
             0.015343002 C       4096+8   

-----------------------------------------
  8,0  :     0.015357310 Q       8192+8   
             0.015358310 G       8192+8   
             0.015358941 I       8192+8   
             0.015360575 D       8192+8   
             0.015397083 C       8192+8   

-----------------------------------------
  8,0  :     0.015406594 Q    4194176+8   
             0.015407928 G    4194176+8   
             0.015408476 I    4194176+8   
             0.015409805 D    4194176+8   
             0.015442211 C    4194176+8   

-----------------------------------------
  8,0  :     0.015451008 Q    4194288+8   
             0.015451663 G    4194288+8   
             0.015452154 I    4194288+8   
             0.015453395 D    4194288+8   
             0.015491747 C    4194288+8   

-----------------------------------------
  8,0  :     0.015503027 Q    4194296+8   
             0.015503756 G    4194296+8   
             0.015504240 I    4194296+8   
             0.015505493 D    4194296+8   
             0.015542958 C    4194296+8   

-----------------------------------------
  8,0  :     0.015551864 Q    4194040+8   
             0.015552566 G    4194040+8   
             0.015553051 I    4194040+8   
             0.015554427 D    4194040+8   
             0.015589530 C    4194040+8   

-----------------------------------------
  8,0  :     0.015604481 Q    4194240+8   
             0.015605200 G    4194240+8   
             0.015605657 I    4194240+8   
             0.015606981 D    4194240+8   
             0.015638314 C    4194240+8   

-----------------------------------------
  8,0  :     0.015647095 Q    4194048+8   
             0.015647783 G    4194048+8   
             0.015648287 I    4194048+8   
             0.015649513 D    4194048+8   
             0.015687568 C    4194048+8   

-----------------------------------------
  8,0  :     0.015697482 Q    4193904+8   
             0.015698156 G    4193904+8   
             0.015698637 I    4193904+8   
             0.015699939 D    4193904+8   
             0.015735267 C    4193904+8   

-----------------------------------------
  8,0  :     0.015743920 Q    4193712+8   
             0.015744568 G    4193712+8   
             0.015745062 I    4193712+8   
             0.015746257 D    4193712+8   
             0.015794981 C    4193712+8   

-----------------------------------------
  8,0  :     0.015808759 Q    4193624+8   
             0.015809978 G    4193624+8   
             0.015810756 I    4193624+8   
             0.015813059 D    4193624+8   
             0.015853718 C    4193624+8   

-----------------------------------------
  8,0  :     0.015864145 Q    4193568+8   
             0.015864957 G    4193568+8   
             0.015865531 I    4193568+8   
             0.015866948 D    4193568+8   
             0.015906042 C    4193568+8   

-----------------------------------------
  8,0  :     0.015915473 Q    4193392+8   
             0.015916240 G    4193392+8   
             0.015916726 I    4193392+8   
             0.015917992 D    4193392+8   
             0.015953897 C    4193392+8   

-----------------------------------------
  8,0  :     0.015962676 Q    4193328+8   
             0.015963313 G    4193328+8   
             0.015963838 I    4193328+8   
             0.015965027 D    4193328+8   
             0.016003232 C    4193328+8   

-----------------------------------------
  8,0  :     0.016012124 Q    4193312+8   
             0.016012807 G    4193312+8   
             0.016013287 I    4193312+8   
             0.016014549 D    4193312+8   
             0.016052136 C    4193312+8   

-----------------------------------------
  8,0  :     0.016060951 Q    4193352+8   
             0.016061545 G    4193352+8   
             0.016062023 I    4193352+8   
             0.016063332 D    4193352+8   
             0.016094754 C    4193352+8   

-----------------------------------------
  8,0  :     0.016104297 Q    4191216+8   
             0.016104963 G    4191216+8   
             0.016105410 I    4191216+8   
             0.016106628 D    4191216+8   
             0.016157001 C    4191216+8   

-----------------------------------------
  8,0  :     0.016191505 Q         24+8   
             0.016192628 G         24+8   
             0.016193224 I         24+8   
             0.016194911 D         24+8   
             0.016229132 C         24+8   

-----------------------------------------
  8,0  :     0.016251344 Q         56+8   
             0.016252380 G         56+8   
             0.016252939 I         56+8   
             0.016254580 D         56+8   
             0.016294664 C         56+8   

-----------------------------------------
  8,0  :     0.016332707 Q        120+8   
             0.016334219 G        120+8   
             0.016334988 I        120+8   
             0.016337320 D        120+8   
             0.016410032 C        120+8   

-----------------------------------------
  8,0  :     0.016646789 Q         16+8   
             0.016648465 G         16+8   
             0.016649265 I         16+8   
             0.016651548 D         16+8   
             0.016691838 C         16+8   

-----------------------------------------
  8,0  :     0.016700090 Q         40+16  
             0.016701192 G         40+16  
             0.016701664 I         40+16  
             0.016702899 D         40+16  
             0.016751055 C         40+16  

-----------------------------------------
  8,0  :     0.016759531 Q         72+48  
             0.016760399 G         72+48  
             0.016760906 I         72+48  
             0.016762749 D         72+48  
             0.016807229 C         72+48  

-----------------------------------------
  8,0  :     0.016817901 Q        136+120 
             0.016818713 G        136+120 
             0.016819192 I        136+120 
             0.016820921 D        136+120 
             0.016902526 C        136+120 

-----------------------------------------
-----------------------------------------
  8,0  :     0.016922900 Q        264+248 
             0.016924957 G        264+248 
             0.016926269 I        264+248 
             0.017051024 C        264+248 

-----------------------------------------
-----------------------------------------
-----------------------------------------
-----------------------------------------
  8,0  :     0.017186547 Q        520+504 
             0.017188650 G        520+504 
             0.017190870 I        520+504 
             0.017481399 C        520+504 

-----------------------------------------
  8,0  :     0.017707012 Q    4193280+32  
             0.017708986 G    4193280+32  
             0.017710040 I    4193280+32  
             0.017713005 D    4193280+32  
             0.017770703 C    4193280+32  

-----------------------------------------
  8,0  :     0.017794656 Q    4193320+8   
             0.017796702 G    4193320+8   
             0.017797783 I    4193320+8   
             0.017800866 D    4193320+8   
             0.017848104 C    4193320+8   

-----------------------------------------
  8,0  :     0.017857559 Q    4193336+16  
             0.017859227 G    4193336+16  
             0.017860242 I    4193336+16  
             0.017862806 D    4193336+16  
             0.017927632 C    4193336+16  

-----------------------------------------
  8,0  :     0.017937426 Q    4193360+32  
             0.017939168 G    4193360+32  
             0.017940104 I    4193360+32  
             0.017942589 D    4193360+32  
             0.017996037 C    4193360+32  

-----------------------------------------
-----------------------------------------
  8,0  :     0.018012736 Q    4193400+168 
             0.018014475 G    4193400+168 
             0.018015772 I    4193400+168 
             0.018124966 C    4193400+168 

-----------------------------------------
  8,0  :     0.018134451 Q    4193576+48  
             0.018135775 G    4193576+48  
             0.018136590 I    4193576+48  
             0.018138639 D    4193576+48  
             0.018192880 C    4193576+48  

-----------------------------------------
  8,0  :     0.018202699 Q    4193632+80  
             0.018203959 G    4193632+80  
             0.018204540 I    4193632+80  
             0.018206248 D    4193632+80  
             0.018259953 C    4193632+80  

-----------------------------------------
  8,0  :     0.018267956 Q    4193720+72  
             0.018268691 G    4193720+72  
             0.018269158 I    4193720+72  
             0.018270418 D    4193720+72  
             0.018322047 C    4193720+72  

-----------------------------------------
  8,0  :     0.018487534 Q    4193792+112 
             0.018488673 G    4193792+112 
             0.018489311 I    4193792+112 
             0.018490972 D    4193792+112 
             0.018590984 C    4193792+112 

-----------------------------------------
  8,0  :     0.018602333 Q    4193912+128 
             0.018603607 G    4193912+128 
             0.018604268 I    4193912+128 
             0.018605960 D    4193912+128 
             0.018668465 C    4193912+128 

-----------------------------------------
  8,0  :     0.018680191 Q    4194056+120 
             0.018680941 G    4194056+120 
             0.018681432 I    4194056+120 
             0.018682809 D    4194056+120 
             0.018744293 C    4194056+120 

-----------------------------------------
  8,0  :     0.018751171 Q    4194184+56  
             0.018751920 G    4194184+56  
             0.018752377 I    4194184+56  
             0.018753649 D    4194184+56  
             0.018801908 C    4194184+56  

-----------------------------------------
  8,0  :     0.018809419 Q    4194248+40  
             0.018810224 G    4194248+40  
             0.018810666 I    4194248+40  
             0.018812058 D    4194248+40  
             0.018850914 C    4194248+40  

-----------------------------------------
sda.blktrace.0 (application/octet-stream, 312 B) - not displayed
bttq.log_8,0_q2c.dat (application/octet-stream, 882 B) - not displayed
blkparse.log (application/octet-stream, 30.1 KB)
  8,0    3        1     0.000000000  3786  Q  WS 0 + 256 [dd]
  8,0    3        2     0.000003093  3786  X  WS 0 / 128 [dd]
  8,0    3        3     0.000007439  3786  G  WS 0 + 128 [dd]
  8,0    3        4     0.000018291  3786  I  WS 0 + 128 [dd]
  8,0    3        5     0.000025103  3786  G  WS 128 + 128 [dd]
  8,0    3        6     0.000025294  3786  I  WS 128 + 128 [dd]
  8,0    3        7     0.000036664    64  D  WS 0 + 128 [kworker/3:1H]
  8,0    3        8     0.000125797    64  D  WS 128 + 128 [kworker/3:1H]
  8,0    2        1     0.000184364     0  C  WS 0 + 128 [0]
  8,0    2        2     0.000191487     0  C  WS 0 + 256 [0]
  8,0    2        3     0.001718643   803  D   N 0 [systemd-udevd]
  8,0    2        4     0.001760202   803  C   N [0]
  8,0    2        5     0.001768416   803  D   R 8 [systemd-udevd]
  8,0    2        6     0.001907428   803  C   R [0]
  8,0    2        7     0.001914068   803  D   R 4 [systemd-udevd]
  8,0    2        8     0.001943024   803  C   R [0]
  8,0    2        9     0.001947745   803  D   R 4 [systemd-udevd]
  8,0    2       10     0.002007550   803  C   R [65415]
  8,0    2       11     0.002048154   803  Q   R 0 + 8 [systemd-udevd]
  8,0    2       12     0.002050247   803  G   R 0 + 8 [systemd-udevd]
  8,0    2       13     0.002057984   803  I   R 0 + 8 [systemd-udevd]
  8,0    2       14     0.002068529   109  D   R 0 + 8 [kworker/2:1H]
  8,0    2       15     0.002108533   109  C   R 0 + 8 [0]
  8,0    0        1     0.002204223   803  Q   R 8 + 8 [systemd-udevd]
  8,0    0        2     0.002206526   803  G   R 8 + 8 [systemd-udevd]
  8,0    0        3     0.002211743   803  I   R 8 + 8 [systemd-udevd]
  8,0    0        4     0.002221126   221  D   R 8 + 8 [kworker/0:1H]
  8,0    2       16     0.002286085     0  C   R 8 + 8 [0]
  8,0    3        9     0.011864957  3788  D   R 254 [scsi_id]
  8,0    2       17     0.012584229     0  C   R [0]
  8,0    3       10     0.013111629  3788  D   R 254 [scsi_id]
  8,0    2       18     0.013542041     0  C   R [0]
  8,0    2       19     0.014878189  3787  Q  RA 32 + 8 [(udev-worker)]
  8,0    2       20     0.014881917  3787  G  RA 32 + 8 [(udev-worker)]
  8,0    2       21     0.014889701  3787  P   N [(udev-worker)]
  8,0    2       22     0.014890266  3787  U   N [(udev-worker)] 1
  8,0    2       23     0.014890900  3787  I  RA 32 + 8 [(udev-worker)]
  8,0    2       24     0.014895077  3787  D  RA 32 + 8 [(udev-worker)]
  8,0    2       25     0.014951122  3787  C  RA 32 + 8 [0]
  8,0    2       26     0.014964022  3787  Q  RA 64 + 8 [(udev-worker)]
  8,0    2       27     0.014964884  3787  G  RA 64 + 8 [(udev-worker)]
  8,0    2       28     0.014965125  3787  P   N [(udev-worker)]
  8,0    2       29     0.014965297  3787  U   N [(udev-worker)] 1
  8,0    2       30     0.014965553  3787  I  RA 64 + 8 [(udev-worker)]
  8,0    2       31     0.014967150  3787  D  RA 64 + 8 [(udev-worker)]
  8,0    2       32     0.015001364  3787  C  RA 64 + 8 [0]
  8,0    2       33     0.015011421  3787  Q  RA 128 + 8 [(udev-worker)]
  8,0    2       34     0.015012163  3787  G  RA 128 + 8 [(udev-worker)]
  8,0    2       35     0.015012363  3787  P   N [(udev-worker)]
  8,0    2       36     0.015012479  3787  U   N [(udev-worker)] 1
  8,0    2       37     0.015012669  3787  I  RA 128 + 8 [(udev-worker)]
  8,0    2       38     0.015014034  3787  D  RA 128 + 8 [(udev-worker)]
  8,0    2       39     0.015065485  3787  C  RA 0 + 136 [0]
  8,0    2       40     0.015073697  3787  Q  RA 256 + 8 [(udev-worker)]
  8,0    2       41     0.015074308  3787  G  RA 256 + 8 [(udev-worker)]
  8,0    2       42     0.015074509  3787  P   N [(udev-worker)]
  8,0    2       43     0.015074627  3787  U   N [(udev-worker)] 1
  8,0    2       44     0.015074835  3787  I  RA 256 + 8 [(udev-worker)]
  8,0    2       45     0.015076063  3787  D  RA 256 + 8 [(udev-worker)]
  8,0    2       46     0.015107172  3787  C  RA 256 + 8 [0]
  8,0    2       47     0.015117632  3787  Q  RA 512 + 8 [(udev-worker)]
  8,0    2       48     0.015118378  3787  G  RA 512 + 8 [(udev-worker)]
  8,0    2       49     0.015118581  3787  P   N [(udev-worker)]
  8,0    2       50     0.015118705  3787  U   N [(udev-worker)] 1
  8,0    2       51     0.015118924  3787  I  RA 512 + 8 [(udev-worker)]
  8,0    2       52     0.015120216  3787  D  RA 512 + 8 [(udev-worker)]
  8,0    2       53     0.015155347  3787  C  RA 512 + 8 [0]
  8,0    2       54     0.015164042  3787  Q  RA 1024 + 8 [(udev-worker)]
  8,0    2       55     0.015164703  3787  G  RA 1024 + 8 [(udev-worker)]
  8,0    2       56     0.015164914  3787  P   N [(udev-worker)]
  8,0    2       57     0.015165039  3787  U   N [(udev-worker)] 1
  8,0    2       58     0.015165239  3787  I  RA 1024 + 8 [(udev-worker)]
  8,0    2       59     0.015166506  3787  D  RA 1024 + 8 [(udev-worker)]
  8,0    2       60     0.015229923  3787  C  RA 1024 + 8 [0]
  8,0    2       61     0.015240577  3787  Q  RA 2048 + 8 [(udev-worker)]
  8,0    2       62     0.015241456  3787  G  RA 2048 + 8 [(udev-worker)]
  8,0    2       63     0.015241656  3787  P   N [(udev-worker)]
  8,0    2       64     0.015241831  3787  U   N [(udev-worker)] 1
  8,0    2       65     0.015242049  3787  I  RA 2048 + 8 [(udev-worker)]
  8,0    2       66     0.015243636  3787  D  RA 2048 + 8 [(udev-worker)]
  8,0    2       67     0.015284702  3787  C  RA 2048 + 8 [0]
  8,0    2       68     0.015299496  3787  Q  RA 4096 + 8 [(udev-worker)]
  8,0    2       69     0.015300190  3787  G  RA 4096 + 8 [(udev-worker)]
  8,0    2       70     0.015300369  3787  P   N [(udev-worker)]
  8,0    2       71     0.015300477  3787  U   N [(udev-worker)] 1
  8,0    2       72     0.015300679  3787  I  RA 4096 + 8 [(udev-worker)]
  8,0    2       73     0.015302191  3787  D  RA 4096 + 8 [(udev-worker)]
  8,0    2       74     0.015343002  3787  C  RA 4096 + 8 [0]
  8,0    2       75     0.015357310  3787  Q  RA 8192 + 8 [(udev-worker)]
  8,0    2       76     0.015358310  3787  G  RA 8192 + 8 [(udev-worker)]
  8,0    2       77     0.015358541  3787  P   N [(udev-worker)]
  8,0    2       78     0.015358733  3787  U   N [(udev-worker)] 1
  8,0    2       79     0.015358941  3787  I  RA 8192 + 8 [(udev-worker)]
  8,0    2       80     0.015360575  3787  D  RA 8192 + 8 [(udev-worker)]
  8,0    2       81     0.015397083  3787  C  RA 8192 + 8 [0]
  8,0    2       82     0.015406594  3787  Q  RA 4194176 + 8 [(udev-worker)]
  8,0    2       83     0.015407928  3787  G  RA 4194176 + 8 [(udev-worker)]
  8,0    2       84     0.015408122  3787  P   N [(udev-worker)]
  8,0    2       85     0.015408257  3787  U   N [(udev-worker)] 1
  8,0    2       86     0.015408476  3787  I  RA 4194176 + 8 [(udev-worker)]
  8,0    2       87     0.015409805  3787  D  RA 4194176 + 8 [(udev-worker)]
  8,0    2       88     0.015442211  3787  C  RA 4194176 + 8 [0]
  8,0    2       89     0.015451008  3787  Q  RA 4194288 + 8 [(udev-worker)]
  8,0    2       90     0.015451663  3787  G  RA 4194288 + 8 [(udev-worker)]
  8,0    2       91     0.015451838  3787  P   N [(udev-worker)]
  8,0    2       92     0.015451966  3787  U   N [(udev-worker)] 1
  8,0    2       93     0.015452154  3787  I  RA 4194288 + 8 [(udev-worker)]
  8,0    2       94     0.015453395  3787  D  RA 4194288 + 8 [(udev-worker)]
  8,0    2       95     0.015491747  3787  C  RA 4194288 + 8 [0]
  8,0    2       96     0.015503027  3787  Q  RA 4194296 + 8 [(udev-worker)]
  8,0    2       97     0.015503756  3787  G  RA 4194296 + 8 [(udev-worker)]
  8,0    2       98     0.015503928  3787  P   N [(udev-worker)]
  8,0    2       99     0.015504036  3787  U   N [(udev-worker)] 1
  8,0    2      100     0.015504240  3787  I  RA 4194296 + 8 [(udev-worker)]
  8,0    2      101     0.015505493  3787  D  RA 4194296 + 8 [(udev-worker)]
  8,0    2      102     0.015542958  3787  C  RA 4194296 + 8 [0]
  8,0    2      103     0.015551864  3787  Q  RA 4194040 + 8 [(udev-worker)]
  8,0    2      104     0.015552566  3787  G  RA 4194040 + 8 [(udev-worker)]
  8,0    2      105     0.015552755  3787  P   N [(udev-worker)]
  8,0    2      106     0.015552860  3787  U   N [(udev-worker)] 1
  8,0    2      107     0.015553051  3787  I  RA 4194040 + 8 [(udev-worker)]
  8,0    2      108     0.015554427  3787  D  RA 4194040 + 8 [(udev-worker)]
  8,0    2      109     0.015589530  3787  C  RA 4194040 + 8 [0]
  8,0    2      110     0.015604481  3787  Q  RA 4194240 + 8 [(udev-worker)]
  8,0    2      111     0.015605200  3787  G  RA 4194240 + 8 [(udev-worker)]
  8,0    2      112     0.015605336  3787  P   N [(udev-worker)]
  8,0    2      113     0.015605467  3787  U   N [(udev-worker)] 1
  8,0    2      114     0.015605657  3787  I  RA 4194240 + 8 [(udev-worker)]
  8,0    2      115     0.015606981  3787  D  RA 4194240 + 8 [(udev-worker)]
  8,0    2      116     0.015638314  3787  C  RA 4194240 + 8 [0]
  8,0    2      117     0.015647095  3787  Q  RA 4194048 + 8 [(udev-worker)]
  8,0    2      118     0.015647783  3787  G  RA 4194048 + 8 [(udev-worker)]
  8,0    2      119     0.015647965  3787  P   N [(udev-worker)]
  8,0    2      120     0.015648084  3787  U   N [(udev-worker)] 1
  8,0    2      121     0.015648287  3787  I  RA 4194048 + 8 [(udev-worker)]
  8,0    2      122     0.015649513  3787  D  RA 4194048 + 8 [(udev-worker)]
  8,0    2      123     0.015687568  3787  C  RA 4194048 + 8 [0]
  8,0    2      124     0.015697482  3787  Q  RA 4193904 + 8 [(udev-worker)]
  8,0    2      125     0.015698156  3787  G  RA 4193904 + 8 [(udev-worker)]
  8,0    2      126     0.015698326  3787  P   N [(udev-worker)]
  8,0    2      127     0.015698432  3787  U   N [(udev-worker)] 1
  8,0    2      128     0.015698637  3787  I  RA 4193904 + 8 [(udev-worker)]
  8,0    2      129     0.015699939  3787  D  RA 4193904 + 8 [(udev-worker)]
  8,0    2      130     0.015735267  3787  C  RA 4193904 + 8 [0]
  8,0    2      131     0.015743920  3787  Q  RA 4193712 + 8 [(udev-worker)]
  8,0    2      132     0.015744568  3787  G  RA 4193712 + 8 [(udev-worker)]
  8,0    2      133     0.015744758  3787  P   N [(udev-worker)]
  8,0    2      134     0.015744863  3787  U   N [(udev-worker)] 1
  8,0    2      135     0.015745062  3787  I  RA 4193712 + 8 [(udev-worker)]
  8,0    2      136     0.015746257  3787  D  RA 4193712 + 8 [(udev-worker)]
  8,0    2      137     0.015794981  3787  C  RA 4193712 + 8 [0]
  8,0    2      138     0.015808759  3787  Q  RA 4193624 + 8 [(udev-worker)]
  8,0    2      139     0.015809978  3787  G  RA 4193624 + 8 [(udev-worker)]
  8,0    2      140     0.015810223  3787  P   N [(udev-worker)]
  8,0    2      141     0.015810490  3787  U   N [(udev-worker)] 1
  8,0    2      142     0.015810756  3787  I  RA 4193624 + 8 [(udev-worker)]
  8,0    2      143     0.015813059  3787  D  RA 4193624 + 8 [(udev-worker)]
  8,0    2      144     0.015853718  3787  C  RA 4193624 + 8 [0]
  8,0    2      145     0.015864145  3787  Q  RA 4193568 + 8 [(udev-worker)]
  8,0    2      146     0.015864957  3787  G  RA 4193568 + 8 [(udev-worker)]
  8,0    2      147     0.015865158  3787  P   N [(udev-worker)]
  8,0    2      148     0.015865321  3787  U   N [(udev-worker)] 1
  8,0    2      149     0.015865531  3787  I  RA 4193568 + 8 [(udev-worker)]
  8,0    2      150     0.015866948  3787  D  RA 4193568 + 8 [(udev-worker)]
  8,0    2      151     0.015906042  3787  C  RA 4193568 + 8 [0]
  8,0    2      152     0.015915473  3787  Q  RA 4193392 + 8 [(udev-worker)]
  8,0    2      153     0.015916240  3787  G  RA 4193392 + 8 [(udev-worker)]
  8,0    2      154     0.015916400  3787  P   N [(udev-worker)]
  8,0    2      155     0.015916521  3787  U   N [(udev-worker)] 1
  8,0    2      156     0.015916726  3787  I  RA 4193392 + 8 [(udev-worker)]
  8,0    2      157     0.015917992  3787  D  RA 4193392 + 8 [(udev-worker)]
  8,0    2      158     0.015953897  3787  C  RA 4193392 + 8 [0]
  8,0    2      159     0.015962676  3787  Q  RA 4193328 + 8 [(udev-worker)]
  8,0    2      160     0.015963313  3787  G  RA 4193328 + 8 [(udev-worker)]
  8,0    2      161     0.015963521  3787  P   N [(udev-worker)]
  8,0    2      162     0.015963643  3787  U   N [(udev-worker)] 1
  8,0    2      163     0.015963838  3787  I  RA 4193328 + 8 [(udev-worker)]
  8,0    2      164     0.015965027  3787  D  RA 4193328 + 8 [(udev-worker)]
  8,0    2      165     0.016003232  3787  C  RA 4193328 + 8 [0]
  8,0    2      166     0.016012124  3787  Q  RA 4193312 + 8 [(udev-worker)]
  8,0    2      167     0.016012807  3787  G  RA 4193312 + 8 [(udev-worker)]
  8,0    2      168     0.016012981  3787  P   N [(udev-worker)]
  8,0    2      169     0.016013088  3787  U   N [(udev-worker)] 1
  8,0    2      170     0.016013287  3787  I  RA 4193312 + 8 [(udev-worker)]
  8,0    2      171     0.016014549  3787  D  RA 4193312 + 8 [(udev-worker)]
  8,0    2      172     0.016052136  3787  C  RA 4193312 + 8 [0]
  8,0    2      173     0.016060951  3787  Q  RA 4193352 + 8 [(udev-worker)]
  8,0    2      174     0.016061545  3787  G  RA 4193352 + 8 [(udev-worker)]
  8,0    2      175     0.016061734  3787  P   N [(udev-worker)]
  8,0    2      176     0.016061839  3787  U   N [(udev-worker)] 1
  8,0    2      177     0.016062023  3787  I  RA 4193352 + 8 [(udev-worker)]
  8,0    2      178     0.016063332  3787  D  RA 4193352 + 8 [(udev-worker)]
  8,0    2      179     0.016094754  3787  C  RA 4193352 + 8 [0]
  8,0    2      180     0.016104297  3787  Q  RA 4191216 + 8 [(udev-worker)]
  8,0    2      181     0.016104963  3787  G  RA 4191216 + 8 [(udev-worker)]
  8,0    2      182     0.016105119  3787  P   N [(udev-worker)]
  8,0    2      183     0.016105242  3787  U   N [(udev-worker)] 1
  8,0    2      184     0.016105410  3787  I  RA 4191216 + 8 [(udev-worker)]
  8,0    2      185     0.016106628  3787  D  RA 4191216 + 8 [(udev-worker)]
  8,0    2      186     0.016157001  3787  C  RA 4191216 + 8 [0]
  8,0    2      187     0.016191505  3787  Q  RA 24 + 8 [(udev-worker)]
  8,0    2      188     0.016192628  3787  G  RA 24 + 8 [(udev-worker)]
  8,0    2      189     0.016192850  3787  P   N [(udev-worker)]
  8,0    2      190     0.016192987  3787  U   N [(udev-worker)] 1
  8,0    2      191     0.016193224  3787  I  RA 24 + 8 [(udev-worker)]
  8,0    2      192     0.016194911  3787  D  RA 24 + 8 [(udev-worker)]
  8,0    2      193     0.016229132  3787  C  RA 24 + 8 [0]
  8,0    2      194     0.016251344  3787  Q  RA 56 + 8 [(udev-worker)]
  8,0    2      195     0.016252380  3787  G  RA 56 + 8 [(udev-worker)]
  8,0    2      196     0.016252603  3787  P   N [(udev-worker)]
  8,0    2      197     0.016252725  3787  U   N [(udev-worker)] 1
  8,0    2      198     0.016252939  3787  I  RA 56 + 8 [(udev-worker)]
  8,0    2      199     0.016254580  3787  D  RA 56 + 8 [(udev-worker)]
  8,0    2      200     0.016294664  3787  C  RA 56 + 8 [0]
  8,0    2      201     0.016332707  3787  Q  RA 120 + 8 [(udev-worker)]
  8,0    2      202     0.016334219  3787  G  RA 120 + 8 [(udev-worker)]
  8,0    2      203     0.016334470  3787  P   N [(udev-worker)]
  8,0    2      204     0.016334678  3787  U   N [(udev-worker)] 1
  8,0    2      205     0.016334988  3787  I  RA 120 + 8 [(udev-worker)]
  8,0    2      206     0.016337320  3787  D  RA 120 + 8 [(udev-worker)]
  8,0    2      207     0.016410032  3787  C  RA 120 + 8 [0]
  8,0    2      208     0.016646789  3787  Q  RA 16 + 8 [(udev-worker)]
  8,0    2      209     0.016648465  3787  G  RA 16 + 8 [(udev-worker)]
  8,0    2      210     0.016648712  3787  P   N [(udev-worker)]
  8,0    2      211     0.016648992  3787  U   N [(udev-worker)] 1
  8,0    2      212     0.016649265  3787  I  RA 16 + 8 [(udev-worker)]
  8,0    2      213     0.016651548  3787  D  RA 16 + 8 [(udev-worker)]
  8,0    2      214     0.016691838  3787  C  RA 16 + 8 [0]
  8,0    2      215     0.016700090  3787  Q  RA 40 + 16 [(udev-worker)]
  8,0    2      216     0.016701192  3787  G  RA 40 + 16 [(udev-worker)]
  8,0    2      217     0.016701380  3787  P   N [(udev-worker)]
  8,0    2      218     0.016701485  3787  U   N [(udev-worker)] 1
  8,0    2      219     0.016701664  3787  I  RA 40 + 16 [(udev-worker)]
  8,0    2      220     0.016702899  3787  D  RA 40 + 16 [(udev-worker)]
  8,0    2      221     0.016751055  3787  C  RA 40 + 16 [0]
  8,0    2      222     0.016759531  3787  Q  RA 72 + 48 [(udev-worker)]
  8,0    2      223     0.016760399  3787  G  RA 72 + 48 [(udev-worker)]
  8,0    2      224     0.016760622  3787  P   N [(udev-worker)]
  8,0    2      225     0.016760728  3787  U   N [(udev-worker)] 1
  8,0    2      226     0.016760906  3787  I  RA 72 + 48 [(udev-worker)]
  8,0    2      227     0.016762749  3787  D  RA 72 + 48 [(udev-worker)]
  8,0    2      228     0.016807229  3787  C  RA 72 + 48 [0]
  8,0    2      229     0.016817901  3787  Q  RA 136 + 120 [(udev-worker)]
  8,0    2      230     0.016818713  3787  G  RA 136 + 120 [(udev-worker)]
  8,0    2      231     0.016818914  3787  P   N [(udev-worker)]
  8,0    2      232     0.016819013  3787  U   N [(udev-worker)] 1
  8,0    2      233     0.016819192  3787  I  RA 136 + 120 [(udev-worker)]
  8,0    2      234     0.016820921  3787  D  RA 136 + 120 [(udev-worker)]
  8,0    2      235     0.016902526  3787  C  RA 136 + 120 [0]
  8,0    2      236     0.016922900  3787  Q  RA 264 + 248 [(udev-worker)]
  8,0    2      237     0.016924169  3787  X  RA 264 / 392 [(udev-worker)]
  8,0    2      238     0.016924957  3787  G  RA 264 + 128 [(udev-worker)]
  8,0    2      239     0.016925162  3787  P   N [(udev-worker)]
  8,0    2      240     0.016925813  3787  G  RA 392 + 120 [(udev-worker)]
  8,0    2      241     0.016926050  3787  U   N [(udev-worker)] 2
  8,0    2      242     0.016926269  3787  I  RA 264 + 128 [(udev-worker)]
  8,0    2      243     0.016926427  3787  I  RA 392 + 120 [(udev-worker)]
  8,0    2      244     0.016928438  3787  D  RA 264 + 128 [(udev-worker)]
  8,0    2      245     0.016991826  3787  C  RA 264 + 128 [0]
  8,0    2      246     0.016994925  3787  D  RA 392 + 120 [(udev-worker)]
  8,0    2      247     0.017051024  3787  C  RA 264 + 248 [0]
  8,0    2      248     0.017186547  3787  Q  RA 520 + 504 [(udev-worker)]
  8,0    2      249     0.017187423  3787  X  RA 520 / 648 [(udev-worker)]
  8,0    2      250     0.017188650  3787  G  RA 520 + 128 [(udev-worker)]
  8,0    2      251     0.017188866  3787  P   N [(udev-worker)]
  8,0    2      252     0.017189199  3787  X  RA 648 / 776 [(udev-worker)]
  8,0    2      253     0.017189423  3787  G  RA 648 + 128 [(udev-worker)]
  8,0    2      254     0.017189696  3787  X  RA 776 / 904 [(udev-worker)]
  8,0    2      255     0.017189930  3787  G  RA 776 + 128 [(udev-worker)]
  8,0    2      256     0.017190435  3787  G  RA 904 + 120 [(udev-worker)]
  8,0    2      257     0.017190661  3787  U   N [(udev-worker)] 4
  8,0    2      258     0.017190870  3787  I  RA 520 + 128 [(udev-worker)]
  8,0    2      259     0.017190998  3787  I  RA 648 + 128 [(udev-worker)]
  8,0    2      260     0.017191127  3787  I  RA 776 + 128 [(udev-worker)]
  8,0    2      261     0.017191328  3787  I  RA 904 + 120 [(udev-worker)]
  8,0    2      262     0.017194225  3787  D  RA 520 + 128 [(udev-worker)]
  8,0    2      263     0.017273730  3787  C  RA 520 + 128 [0]
  8,0    2      264     0.017277384  3787  D  RA 648 + 128 [(udev-worker)]
  8,0    2      265     0.017333257  3787  C  RA 520 + 256 [0]
  8,0    2      266     0.017335690  3787  D  RA 776 + 128 [(udev-worker)]
  8,0    2      267     0.017405906  3787  C  RA 520 + 384 [0]
  8,0    2      268     0.017408335  3787  D  RA 904 + 120 [(udev-worker)]
  8,0    2      269     0.017481399  3787  C  RA 520 + 504 [0]
  8,0    2      270     0.017707012  3787  Q  RA 4193280 + 32 [(udev-worker)]
  8,0    2      271     0.017708986  3787  G  RA 4193280 + 32 [(udev-worker)]
  8,0    2      272     0.017709280  3787  P   N [(udev-worker)]
  8,0    2      273     0.017709667  3787  U   N [(udev-worker)] 1
  8,0    2      274     0.017710040  3787  I  RA 4193280 + 32 [(udev-worker)]
  8,0    2      275     0.017713005  3787  D  RA 4193280 + 32 [(udev-worker)]
  8,0    2      276     0.017770703  3787  C  RA 4193280 + 32 [0]
  8,0    2      277     0.017794656  3787  Q  RA 4193320 + 8 [(udev-worker)]
  8,0    2      278     0.017796702  3787  G  RA 4193320 + 8 [(udev-worker)]
  8,0    2      279     0.017797003  3787  P   N [(udev-worker)]
  8,0    2      280     0.017797377  3787  U   N [(udev-worker)] 1
  8,0    2      281     0.017797783  3787  I  RA 4193320 + 8 [(udev-worker)]
  8,0    2      282     0.017800866  3787  D  RA 4193320 + 8 [(udev-worker)]
  8,0    2      283     0.017848104  3787  C  RA 4193320 + 8 [0]
  8,0    2      284     0.017857559  3787  Q  RA 4193336 + 16 [(udev-worker)]
  8,0    2      285     0.017859227  3787  G  RA 4193336 + 16 [(udev-worker)]
  8,0    2      286     0.017859575  3787  P   N [(udev-worker)]
  8,0    2      287     0.017859907  3787  U   N [(udev-worker)] 1
  8,0    2      288     0.017860242  3787  I  RA 4193336 + 16 [(udev-worker)]
  8,0    2      289     0.017862806  3787  D  RA 4193336 + 16 [(udev-worker)]
  8,0    2      290     0.017927632  3787  C  RA 4193336 + 16 [0]
  8,0    2      291     0.017937426  3787  Q  RA 4193360 + 32 [(udev-worker)]
  8,0    2      292     0.017939168  3787  G  RA 4193360 + 32 [(udev-worker)]
  8,0    2      293     0.017939474  3787  P   N [(udev-worker)]
  8,0    2      294     0.017939764  3787  U   N [(udev-worker)] 1
  8,0    2      295     0.017940104  3787  I  RA 4193360 + 32 [(udev-worker)]
  8,0    2      296     0.017942589  3787  D  RA 4193360 + 32 [(udev-worker)]
  8,0    2      297     0.017996037  3787  C  RA 4193360 + 32 [0]
  8,0    2      298     0.018012736  3787  Q  RA 4193400 + 168 [(udev-worker)]
  8,0    2      299     0.018013628  3787  X  RA 4193400 / 4193528 [(udev-worker)]
  8,0    2      300     0.018014475  3787  G  RA 4193400 + 128 [(udev-worker)]
  8,0    2      301     0.018014728  3787  P   N [(udev-worker)]
  8,0    2      302     0.018015265  3787  G  RA 4193528 + 40 [(udev-worker)]
  8,0    2      303     0.018015564  3787  U   N [(udev-worker)] 2
  8,0    2      304     0.018015772  3787  I  RA 4193400 + 128 [(udev-worker)]
  8,0    2      305     0.018015981  3787  I  RA 4193528 + 40 [(udev-worker)]
  8,0    2      306     0.018018113  3787  D  RA 4193400 + 128 [(udev-worker)]
  8,0    2      307     0.018082781  3787  C  RA 4193400 + 128 [0]
  8,0    2      308     0.018085622  3787  D  RA 4193528 + 40 [(udev-worker)]
  8,0    2      309     0.018124966  3787  C  RA 4193400 + 168 [0]
  8,0    2      310     0.018134451  3787  Q  RA 4193576 + 48 [(udev-worker)]
  8,0    2      311     0.018135775  3787  G  RA 4193576 + 48 [(udev-worker)]
  8,0    2      312     0.018136047  3787  P   N [(udev-worker)]
  8,0    2      313     0.018136298  3787  U   N [(udev-worker)] 1
  8,0    2      314     0.018136590  3787  I  RA 4193576 + 48 [(udev-worker)]
  8,0    2      315     0.018138639  3787  D  RA 4193576 + 48 [(udev-worker)]
  8,0    2      316     0.018192880  3787  C  RA 4193576 + 48 [0]
  8,0    2      317     0.018202699  3787  Q  RA 4193632 + 80 [(udev-worker)]
  8,0    2      318     0.018203959  3787  G  RA 4193632 + 80 [(udev-worker)]
  8,0    2      319     0.018204155  3787  P   N [(udev-worker)]
  8,0    2      320     0.018204333  3787  U   N [(udev-worker)] 1
  8,0    2      321     0.018204540  3787  I  RA 4193632 + 80 [(udev-worker)]
  8,0    2      322     0.018206248  3787  D  RA 4193632 + 80 [(udev-worker)]
  8,0    2      323     0.018259953  3787  C  RA 4193632 + 80 [0]
  8,0    2      324     0.018267956  3787  Q  RA 4193720 + 72 [(udev-worker)]
  8,0    2      325     0.018268691  3787  G  RA 4193720 + 72 [(udev-worker)]
  8,0    2      326     0.018268860  3787  P   N [(udev-worker)]
  8,0    2      327     0.018268978  3787  U   N [(udev-worker)] 1
  8,0    2      328     0.018269158  3787  I  RA 4193720 + 72 [(udev-worker)]
  8,0    2      329     0.018270418  3787  D  RA 4193720 + 72 [(udev-worker)]
  8,0    2      330     0.018322047  3787  C  RA 4193720 + 72 [0]
  8,0    2      331     0.018487534  3787  Q  RA 4193792 + 112 [(udev-worker)]
  8,0    2      332     0.018488673  3787  G  RA 4193792 + 112 [(udev-worker)]
  8,0    2      333     0.018488903  3787  P   N [(udev-worker)]
  8,0    2      334     0.018489070  3787  U   N [(udev-worker)] 1
  8,0    2      335     0.018489311  3787  I  RA 4193792 + 112 [(udev-worker)]
  8,0    2      336     0.018490972  3787  D  RA 4193792 + 112 [(udev-worker)]
  8,0    2      337     0.018590984  3787  C  RA 4193792 + 112 [0]
  8,0    2      338     0.018602333  3787  Q  RA 4193912 + 128 [(udev-worker)]
  8,0    2      339     0.018603607  3787  G  RA 4193912 + 128 [(udev-worker)]
  8,0    2      340     0.018603787  3787  P   N [(udev-worker)]
  8,0    2      341     0.018604051  3787  U   N [(udev-worker)] 1
  8,0    2      342     0.018604268  3787  I  RA 4193912 + 128 [(udev-worker)]
  8,0    2      343     0.018605960  3787  D  RA 4193912 + 128 [(udev-worker)]
  8,0    2      344     0.018668465  3787  C  RA 4193912 + 128 [0]
  8,0    2      345     0.018680191  3787  Q  RA 4194056 + 120 [(udev-worker)]
  8,0    2      346     0.018680941  3787  G  RA 4194056 + 120 [(udev-worker)]
  8,0    2      347     0.018681111  3787  P   N [(udev-worker)]
  8,0    2      348     0.018681241  3787  U   N [(udev-worker)] 1
  8,0    2      349     0.018681432  3787  I  RA 4194056 + 120 [(udev-worker)]
  8,0    2      350     0.018682809  3787  D  RA 4194056 + 120 [(udev-worker)]
  8,0    2      351     0.018744293  3787  C  RA 4194056 + 120 [0]
  8,0    2      352     0.018751171  3787  Q  RA 4194184 + 56 [(udev-worker)]
  8,0    2      353     0.018751920  3787  G  RA 4194184 + 56 [(udev-worker)]
  8,0    2      354     0.018752071  3787  P   N [(udev-worker)]
  8,0    2      355     0.018752185  3787  U   N [(udev-worker)] 1
  8,0    2      356     0.018752377  3787  I  RA 4194184 + 56 [(udev-worker)]
  8,0    2      357     0.018753649  3787  D  RA 4194184 + 56 [(udev-worker)]
  8,0    2      358     0.018801908  3787  C  RA 4194184 + 56 [0]
  8,0    2      359     0.018809419  3787  Q  RA 4194248 + 40 [(udev-worker)]
  8,0    2      360     0.018810224  3787  G  RA 4194248 + 40 [(udev-worker)]
  8,0    2      361     0.018810372  3787  P   N [(udev-worker)]
  8,0    2      362     0.018810494  3787  U   N [(udev-worker)] 1
  8,0    2      363     0.018810666  3787  I  RA 4194248 + 40 [(udev-worker)]
  8,0    2      364     0.018812058  3787  D  RA 4194248 + 40 [(udev-worker)]
  8,0    2      365     0.018850914  3787  C  RA 4194248 + 40 [0]
  8,0    1        1     0.024665622  3789  D   R 254 [multipath]
  8,0    2      366     0.024775038     0  C   R [65415]
CPU0 (sda):
 Reads Queued:           1,        4KiB	 Writes Queued:           0,        0KiB
 Read Dispatches:        1,        4KiB	 Write Dispatches:        0,        0KiB
 Reads Requeued:         0		 Writes Requeued:         0
 Reads Completed:        0,        0KiB	 Writes Completed:        0,        0KiB
 Read Merges:            0,        0KiB	 Write Merges:            0,        0KiB
 Read depth:             1        	 Write depth:             2
 IO unplugs:             0        	 Timer unplugs:           0
CPU1 (sda):
 Reads Queued:           0,        0KiB	 Writes Queued:           0,        0KiB
 Read Dispatches:        0,        0KiB	 Write Dispatches:        0,        0KiB
 Reads Requeued:         0		 Writes Requeued:         0
 Reads Completed:        0,        0KiB	 Writes Completed:        0,        0KiB
 Read Merges:            0,        0KiB	 Write Merges:            0,        0KiB
 Read depth:             1        	 Write depth:             2
 PC Reads Queued:        0,        0KiB	 PC Writes Queued:        0,        0KiB
 PC Read Disp.:          1,        0KiB	 PC Write Disp.:          0,        0KiB
 PC Reads Req.:          0		 PC Writes Req.:          0
 PC Reads Compl.:        0		 PC Writes Compl.:        0
 IO unplugs:             0        	 Timer unplugs:           0
CPU2 (sda):
 Reads Queued:          47,    1,040KiB	 Writes Queued:           0,        0KiB
 Read Dispatches:       52,    1,040KiB	 Write Dispatches:        0,        0KiB
 Reads Requeued:         0		 Writes Requeued:         0
 Reads Completed:       53,    1,620KiB	 Writes Completed:        2,      192KiB
 Read Merges:            0,        0KiB	 Write Merges:            0,        0KiB
 Read depth:             1        	 Write depth:             2
 PC Reads Queued:        0,        0KiB	 PC Writes Queued:        0,        0KiB
 PC Read Disp.:          4,        0KiB	 PC Write Disp.:          0,        0KiB
 PC Reads Req.:          0		 PC Writes Req.:          0
 PC Reads Compl.:        7		 PC Writes Compl.:        0
 IO unplugs:            46        	 Timer unplugs:           0
CPU3 (sda):
 Reads Queued:           0,        0KiB	 Writes Queued:           1,      128KiB
 Read Dispatches:        0,        0KiB	 Write Dispatches:        2,      128KiB
 Reads Requeued:         0		 Writes Requeued:         0
 Reads Completed:        0,        0KiB	 Writes Completed:        0,        0KiB
 Read Merges:            0,        0KiB	 Write Merges:            0,        0KiB
 Read depth:             1        	 Write depth:             2
 PC Reads Queued:        0,        0KiB	 PC Writes Queued:        0,        0KiB
 PC Read Disp.:          2,        0KiB	 PC Write Disp.:          0,        0KiB
 PC Reads Req.:          0		 PC Writes Req.:          0
 PC Reads Compl.:        0		 PC Writes Compl.:        0
 IO unplugs:             0        	 Timer unplugs:           0

Total (sda):
 Reads Queued:          48,    1,044KiB	 Writes Queued:           1,      128KiB
 Read Dispatches:       53,    1,044KiB	 Write Dispatches:        2,      128KiB
 Reads Requeued:         0		 Writes Requeued:         0
 Reads Completed:       53,    1,620KiB	 Writes Completed:        2,      192KiB
 Read Merges:            0,        0KiB	 Write Merges:            0,        0KiB
 PC Reads Queued:        0,        0KiB	 PC Writes Queued:        0,        0KiB
 PC Read Disp.:          7,        0KiB	 PC Write Disp.:          0,        0KiB
 PC Reads Req.:          0		 PC Writes Req.:          0
 PC Reads Compl.:        7		 PC Writes Compl.:        0
 IO unplugs:            46        	 Timer unplugs:           0

Throughput (R/W): 67,500KiB/s / 8,000KiB/s
Events (sda): 381 entries
Skips: 0 forward (0 -   0.0%)
Trace started at Tue Feb 11 23:15:13 2025

Input file sda.blktrace.0 added
Input file sda.blktrace.1 added
Input file sda.blktrace.2 added
Input file sda.blktrace.3 added
sda.blktrace.1 (application/octet-stream, 112 B) - not displayed
sda.blktrace.2 (application/octet-stream, 17.8 KB) - not displayed
sda.blktrace.bin (application/octet-stream, 18.9 KB) - not displayed
sda.blktrace.3 (application/octet-stream, 680 B) - not displayed