Re: btrfs with multiple subvolumes in one partition

Christoph Pleger <[email protected]>
Newsgroups gmane.linux.debian.fai
Message-ID <[email protected]>
Hello,

> > > > > 
>     > when setting up btrfs with setup-storage, is it possible to
> configure
>     > multiple subvolumes in one partition, like I tried to configure
> with
> 
>     > disk_config btrfs fstabkey:uuid
>     > btrfs single / disk1.3 subvol=@root
>     > btrfs single /var disk1.3 subvol=@root/var
>     > btrfs single /usr disk1.3 subvol=@root/usr
> I think this is related to https://bugs.debian.org/964761
> The output of format.log would help for the bug report.

I guess that you mean the debug output of setup-storage. I attached
that.

The log in short: It is a really a race condition; setup-storage tries
to create @root/usr before @root exists. And like described in the
link, sometimes the order is correct.

Regards
  Christoph
format.log (text/x-log, 20.4 KB)
disklist: sda
Starting setup-storage 2.3
Using config file: aspects.cfg
Input was:
disk_config disk1 disklabel:gpt bootable:1 fstabkey:uuid
primary /boot/efi 512 vfat umask=0077
primary swap 4096 swap sw
primary - 65536- - -

disk_config btrfs fstabkey:uuid
btrfs single / disk1.3 subvol=@root
btrfs single /var disk1.3 subvol=@root/var
btrfs single /usr disk1.3 subvol=@root/usr

disk_config tmpfs
tmpfs /tmp RAM:25% defaults
(CMD) parted -s /dev/sda unit TiB print 1> /tmp/sH5Y_Bu5i3 2> /tmp/5ZJKpPciQC
Executing: parted -s /dev/sda unit TiB print
(STDOUT) Model: ATA WDC WD2500AAKX-0 (scsi)
(STDOUT) Disk /dev/sda: 0.23TiB
(STDOUT) Sector size (logical/physical): 512B/512B
(STDOUT) Partition Table: gpt
(STDOUT) Disk Flags: 
(STDOUT) 
(STDOUT) Number  Start    End      Size     File system  Name     Flags
(STDOUT)  1      0.00TiB  0.00TiB  0.00TiB               primary  boot, esp
(STDOUT)  2      0.00TiB  0.00TiB  0.00TiB               primary  swap
(STDOUT)  3      0.00TiB  0.23TiB  0.22TiB  btrfs        primary
(STDOUT) 
(CMD) parted -s /dev/sda unit B print free 1> /tmp/JXWHkB6oiD 2> /tmp/HoiKTawqBr
Executing: parted -s /dev/sda unit B print free
(STDOUT) Model: ATA WDC WD2500AAKX-0 (scsi)
(STDOUT) Disk /dev/sda: 250059350016B
(STDOUT) Sector size (logical/physical): 512B/512B
(STDOUT) Partition Table: gpt
(STDOUT) Disk Flags: 
(STDOUT) 
(STDOUT) Number  Start        End            Size           File system  Name     Flags
(STDOUT)         17408B       1048575B       1031168B       Free Space
(STDOUT)  1      1048576B     537919487B     536870912B                  primary  boot, esp
(STDOUT)  2      537919488B   4832886783B    4294967296B                 primary  swap
(STDOUT)  3      4832886784B  250059333119B  245226446336B  btrfs        primary
(STDOUT) 
(CMD) parted -s /dev/sda unit chs print free 1> /tmp/i8RLXYq9HE 2> /tmp/2V0fN3Ia4N
Executing: parted -s /dev/sda unit chs print free
(STDOUT) Model: ATA WDC WD2500AAKX-0 (scsi)
(STDOUT) Disk /dev/sda: 957641,128,1
(STDOUT) Sector size (logical/physical): 512B/512B
(STDOUT) BIOS cylinder,head,sector geometry: 957641,255,2.  Each cylinder is 261kB.
(STDOUT) Partition Table: gpt
(STDOUT) Disk Flags: 
(STDOUT) 
(STDOUT) Number  Start       End           File system  Name     Flags
(STDOUT)         0,17,0      4,3,1         Free Space
(STDOUT)  1      4,4,0       2060,11,1                  primary  boot, esp
(STDOUT)  2      2060,12,0   18508,75,1                 primary  swap
(STDOUT)  3      18508,76,0  957641,112,0  btrfs        primary
(STDOUT) 
Current disk layout in %current_config
$VAR1 = {
          '/dev/sda' => {
                          'sector_size' => '512',
                          'end_byte' => '250059350015',
                          'partitions' => {
                                            '1' => {
                                                     'filesystem' => '',
                                                     'is_extended' => 0,
                                                     'flags' => 'boot,esp',
                                                     'end_byte' => '537919487',
                                                     'begin_byte' => '1048576',
                                                     'count_byte' => '536870912'
                                                   },
                                            '2' => {
                                                     'count_byte' => '4294967296',
                                                     'begin_byte' => '537919488',
                                                     'end_byte' => '4832886783',
                                                     'flags' => 'swap',
                                                     'is_extended' => 0,
                                                     'filesystem' => ''
                                                   },
                                            '3' => {
                                                     'filesystem' => 'btrfs',
                                                     'is_extended' => 0,
                                                     'flags' => '',
                                                     'end_byte' => '250059333119',
                                                     'begin_byte' => '4832886784',
                                                     'count_byte' => '245226446336'
                                                   }
                                          },
                          'size' => '250059350016',
                          'disklabel' => 'gpt',
                          'bios_heads' => '255',
                          'bios_cylinders' => '957641',
                          'begin_byte' => 0,
                          'bios_sectors_per_track' => '2'
                        }
        };
Current LVM layout in %current_lvm_config
$VAR1 = {};
Current RAID layout in %current_raid_config
$VAR1 = {};
Current device tree in %current_dev_children
$VAR1 = {
          '/dev/sda' => [
                          '/dev/sda1',
                          '/dev/sda2',
                          '/dev/sda3'
                        ]
        };
Desired disk layout in %FAI::configs
$VAR1 = {
          'TMPFS' => {
                       'volumes' => {
                                      '0' => {
                                               'mountpoint' => '/tmp',
                                               'mount_options' => 'defaults',
                                               'size' => '25%',
                                               'encrypt' => 0,
                                               'filesystem' => 'tmpfs',
                                               'device' => 'tmpfs',
                                               'preserve' => 0
                                             }
                                    },
                       'fstabkey' => 'device'
                     },
          'PHY_/dev/sda' => {
                              'preserveparts' => 0,
                              'fstabkey' => 'uuid',
                              'opts_all' => {},
                              'virtual' => 0,
                              'partitions' => {
                                                '3' => {
                                                         'start_byte' => 4832886784,
                                                         'end_byte' => '250059333119',
                                                         'mount_options' => '-',
                                                         'mountpoint' => '-',
                                                         'size' => {
                                                                     'eff_size' => '245226446336',
                                                                     'always_format' => 0,
                                                                     'preserve' => 0,
                                                                     'resize' => 0,
                                                                     'extended' => 0,
                                                                     'range' => '245226446336-245226446336'
                                                                   },
                                                         'encrypt' => 0,
                                                         'filesystem' => '-'
                                                       },
                                                '2' => {
                                                         'mountpoint' => 'none',
                                                         'mount_options' => 'sw',
                                                         'size' => {
                                                                     'always_format' => 0,
                                                                     'eff_size' => 4294967296,
                                                                     'range' => '4294967296-4294967296',
                                                                     'extended' => 0,
                                                                     'resize' => 0,
                                                                     'preserve' => 0
                                                                   },
                                                         'encrypt' => 0,
                                                         'filesystem' => 'swap',
                                                         'end_byte' => 4832886783,
                                                         'start_byte' => 537919488
                                                       },
                                                '1' => {
                                                         'filesystem' => 'vfat',
                                                         'encrypt' => 0,
                                                         'size' => {
                                                                     'resize' => 0,
                                                                     'preserve' => 0,
                                                                     'extended' => 0,
                                                                     'range' => '536870912-536870912',
                                                                     'eff_size' => 536870912,
                                                                     'always_format' => 0
                                                                   },
                                                         'mountpoint' => '/boot/efi',
                                                         'mount_options' => 'umask=0077',
                                                         'end_byte' => 537919487,
                                                         'start_byte' => 1048576,
                                                         'journal_dev' => undef
                                                       }
                                              },
                              'bootable' => '1',
                              'disklabel' => 'gpt'
                            },
          'BTRFS' => {
                       'volumes' => {
                                      '1' => {
                                               'devices' => {
                                                              '/dev/sda3' => {}
                                                            },
                                               'filesystem' => 'btrfs',
                                               'raidlevel' => 'single',
                                               'encrypt' => 0,
                                               'mount_options' => 'subvol=@root/var',
                                               'mountpoint' => '/var'
                                             },
                                      '2' => {
                                               'mount_options' => 'subvol=@root/usr',
                                               'mountpoint' => '/usr',
                                               'raidlevel' => 'single',
                                               'encrypt' => 0,
                                               'filesystem' => 'btrfs',
                                               'devices' => {
                                                              '/dev/sda3' => {}
                                                            }
                                             },
                                      '0' => {
                                               'devices' => {
                                                              '/dev/sda3' => {}
                                                            },
                                               'raidlevel' => 'single',
                                               'encrypt' => 0,
                                               'filesystem' => 'btrfs',
                                               'mount_options' => 'subvol=@root',
                                               'mountpoint' => '/'
                                             }
                                    },
                       'opts_all' => {},
                       'fstabkey' => 'uuid'
                     }
        };
Desired device tree in %FAI::dev_children
$VAR1 = {
          '/dev/sda' => [
                          '/dev/sda1',
                          '/dev/sda2',
                          '/dev/sda3'
                        ]
        };
Adding mkfs command for '/dev/sda3'.
Trying to add CMD: true
PRE: 
POST: exist_/dev/sda
Trying to add CMD: wipefs -af /dev/sda1
PRE: exist_/dev/sda
POST: wipefs_/dev/sda1
Trying to add CMD: wipefs -af /dev/sda2
PRE: exist_/dev/sda,wipefs_/dev/sda1
POST: wipefs_/dev/sda2
Trying to add CMD: wipefs -af /dev/sda3
PRE: exist_/dev/sda,wipefs_/dev/sda1,wipefs_/dev/sda2
POST: wipefs_/dev/sda3
Trying to add CMD: true
PRE: exist_/dev/sda,wipefs_/dev/sda1,wipefs_/dev/sda2,wipefs_/dev/sda3
POST: cleared1_/dev/sda
Trying to add CMD: parted -s /dev/sda mklabel gpt
PRE: cleared1_/dev/sda
POST: cleared2_/dev/sda
Trying to add CMD: parted -s /dev/sda mkpart primary "fat32" 1048576B 537919487B
PRE: cleared2_/dev/sda
POST: prep2_/dev/sda1
Trying to add CMD: true
PRE: prep2_/dev/sda1
POST: exist_/dev/sda1
Trying to add CMD: parted -s /dev/sda set 1 boot on
PRE: exist_/dev/sda1,cleared2_/dev/sda
POST: flag_boot_/dev/sda1
Trying to add CMD: parted -s /dev/sda mkpart primary "linux-swap" 537919488B 4832886783B
PRE: cleared2_/dev/sda,exist_/dev/sda1
POST: prep2_/dev/sda2
Trying to add CMD: true
PRE: prep2_/dev/sda2
POST: exist_/dev/sda2
Trying to add CMD: parted -s /dev/sda mkpart primary "" 4832886784B 250059333119B
PRE: cleared2_/dev/sda,exist_/dev/sda2
POST: prep2_/dev/sda3
Trying to add CMD: true
PRE: prep2_/dev/sda3
POST: exist_/dev/sda3
Trying to add CMD: parted /dev/sda set 1 boot on
PRE: pt_complete_/dev/sda
POST: gpt_bios_fake_bootable
Trying to add CMD: mkfs.vfat  /dev/sda1
PRE: exist_/dev/sda1
POST: has_fs_/dev/sda1
Trying to add CMD: mkswap  /dev/sda2
PRE: exist_/dev/sda2
POST: has_fs_/dev/sda2
Trying to add CMD: mkfs.btrfs -d single  -f /dev/sda3
PRE: exist_/dev/sda3
POST: btrfs_built_raid_1
Trying to add CMD: mount /dev/sda3 /mnt
PRE: btrfs_built_raid_1
POST: btrfs_mounted_1
Trying to add CMD: btrfs subvolume create   /mnt/@root/var
PRE: btrfs_mounted_1
POST: btrfs_created_@root/var
Trying to add CMD: umount /dev/sda3
PRE: btrfs_created_@root/var
POST: 
Trying to add CMD: true
PRE: exist_/dev/sda3
POST: btrfs_built_raid_2
Trying to add CMD: mount /dev/sda3 /mnt
PRE: btrfs_built_raid_2
POST: btrfs_mounted_2
Trying to add CMD: btrfs subvolume create   /mnt/@root/usr
PRE: btrfs_mounted_2
POST: btrfs_created_@root/usr
Trying to add CMD: umount /dev/sda3
PRE: btrfs_created_@root/usr
POST: 
Trying to add CMD: true
PRE: exist_/dev/sda3
POST: btrfs_built_raid_0
Trying to add CMD: mount /dev/sda3 /mnt
PRE: btrfs_built_raid_0
POST: btrfs_mounted_0
Trying to add CMD: btrfs subvolume create   /mnt/@root
PRE: btrfs_mounted_0
POST: btrfs_created_@root
Trying to add CMD: umount /dev/sda3
PRE: btrfs_created_@root
POST: 
Trying to add CMD: true
PRE: cleared2_/dev/sda,exist_/dev/sda3
POST: pt_complete_/dev/sda
Trying to add CMD: parted /dev/sda set 1 boot on
PRE: pt_complete_/dev/sda
POST: gpt_bios_fake_bootable
1:true
	pre: 
	post: exist_/dev/sda
2:wipefs -af /dev/sda1
	pre: exist_/dev/sda
	post: wipefs_/dev/sda1
3:wipefs -af /dev/sda2
	pre: exist_/dev/sda,wipefs_/dev/sda1
	post: wipefs_/dev/sda2
4:wipefs -af /dev/sda3
	pre: exist_/dev/sda,wipefs_/dev/sda1,wipefs_/dev/sda2
	post: wipefs_/dev/sda3
5:true
	pre: exist_/dev/sda,wipefs_/dev/sda1,wipefs_/dev/sda2,wipefs_/dev/sda3
	post: cleared1_/dev/sda
6:parted -s /dev/sda mklabel gpt
	pre: cleared1_/dev/sda
	post: cleared2_/dev/sda
7:parted -s /dev/sda mkpart primary "fat32" 1048576B 537919487B
	pre: cleared2_/dev/sda
	post: prep2_/dev/sda1
8:true
	pre: prep2_/dev/sda1
	post: exist_/dev/sda1
9:parted -s /dev/sda set 1 boot on
	pre: exist_/dev/sda1,cleared2_/dev/sda
	post: flag_boot_/dev/sda1
10:parted -s /dev/sda mkpart primary "linux-swap" 537919488B 4832886783B
	pre: cleared2_/dev/sda,exist_/dev/sda1
	post: prep2_/dev/sda2
11:true
	pre: prep2_/dev/sda2
	post: exist_/dev/sda2
12:parted -s /dev/sda mkpart primary "" 4832886784B 250059333119B
	pre: cleared2_/dev/sda,exist_/dev/sda2
	post: prep2_/dev/sda3
13:true
	pre: prep2_/dev/sda3
	post: exist_/dev/sda3
15:mkfs.vfat  /dev/sda1
	pre: exist_/dev/sda1
	post: has_fs_/dev/sda1
16:mkswap  /dev/sda2
	pre: exist_/dev/sda2
	post: has_fs_/dev/sda2
17:mkfs.btrfs -d single  -f /dev/sda3
	pre: exist_/dev/sda3
	post: btrfs_built_raid_1
18:mount /dev/sda3 /mnt
	pre: btrfs_built_raid_1
	post: btrfs_mounted_1
19:btrfs subvolume create   /mnt/@root/var
	pre: btrfs_mounted_1
	post: btrfs_created_@root/var
20:umount /dev/sda3
	pre: btrfs_created_@root/var
	post: 
21:true
	pre: exist_/dev/sda3
	post: btrfs_built_raid_2
22:mount /dev/sda3 /mnt
	pre: btrfs_built_raid_2
	post: btrfs_mounted_2
23:btrfs subvolume create   /mnt/@root/usr
	pre: btrfs_mounted_2
	post: btrfs_created_@root/usr
24:umount /dev/sda3
	pre: btrfs_created_@root/usr
	post: 
25:true
	pre: exist_/dev/sda3
	post: btrfs_built_raid_0
26:mount /dev/sda3 /mnt
	pre: btrfs_built_raid_0
	post: btrfs_mounted_0
27:btrfs subvolume create   /mnt/@root
	pre: btrfs_mounted_0
	post: btrfs_created_@root
28:umount /dev/sda3
	pre: btrfs_created_@root
	post: 
29:true
	pre: cleared2_/dev/sda,exist_/dev/sda3
	post: pt_complete_/dev/sda
30:parted /dev/sda set 1 boot on
	pre: pt_complete_/dev/sda
	post: gpt_bios_fake_bootable
(CMD) wipefs -af /dev/sda1 1> /tmp/NXOZrdVxw3 2> /tmp/Ef9bFTt5td
Executing: wipefs -af /dev/sda1
(CMD) wipefs -af /dev/sda2 1> /tmp/TUEZET6mNm 2> /tmp/izatdMgc4p
Executing: wipefs -af /dev/sda2
(CMD) wipefs -af /dev/sda3 1> /tmp/N3MUUj5wG1 2> /tmp/DBhHJU9QiI
Executing: wipefs -af /dev/sda3
(STDOUT) /dev/sda3: 8 bytes were erased at offset 0x00010040 (btrfs): 5f 42 48 52 66 53 5f 4d
(CMD) parted -s /dev/sda mklabel gpt 1> /tmp/KbhnfVHhcx 2> /tmp/S7MyDf7OcM
Executing: parted -s /dev/sda mklabel gpt
(CMD) parted -s /dev/sda mkpart primary "fat32" 1048576B 537919487B 1> /tmp/DwVNSFjC8t 2> /tmp/wNFXCz0SJU
Executing: parted -s /dev/sda mkpart primary "fat32" 1048576B 537919487B
(CMD) parted -s /dev/sda set 1 boot on 1> /tmp/G9Xc2PgXft 2> /tmp/xGzNb6hK4B
Executing: parted -s /dev/sda set 1 boot on
(CMD) parted -s /dev/sda mkpart primary "linux-swap" 537919488B 4832886783B 1> /tmp/AnaE3n5Kpj 2> /tmp/R1jQc3YLc8
Executing: parted -s /dev/sda mkpart primary "linux-swap" 537919488B 4832886783B
(CMD) parted -s /dev/sda mkpart primary "" 4832886784B 250059333119B 1> /tmp/rwuUgZntAR 2> /tmp/ZnA5pabuyu
Executing: parted -s /dev/sda mkpart primary "" 4832886784B 250059333119B
(CMD) mkfs.vfat  /dev/sda1 1> /tmp/wNfm1khWrU 2> /tmp/oZ2CIHLOx3
Executing: mkfs.vfat  /dev/sda1
(STDOUT) mkfs.fat 4.2 (2021-01-31)
(CMD) mkswap  /dev/sda2 1> /tmp/6zXVYQstO6 2> /tmp/zptos0PMEI
Executing: mkswap  /dev/sda2
(STDOUT) Setting up swapspace version 1, size = 4 GiB (4294963200 bytes)
(STDOUT) no label, UUID=12daeab2-7783-4eaa-950b-ef1ff0f0b6e1
(CMD) mkfs.btrfs -d single  -f /dev/sda3 1> /tmp/GjYMQiA2Kc 2> /tmp/XkgYPdEK1q
Executing: mkfs.btrfs -d single  -f /dev/sda3
(STDOUT) btrfs-progs v5.10.1 
(STDOUT) See http://btrfs.wiki.kernel.org for more information.
(STDOUT) 
(STDOUT) Label:              (null)
(STDOUT) UUID:               27251245-395a-42f6-b73a-25e867180584
(STDOUT) Node size:          16384
(STDOUT) Sector size:        4096
(STDOUT) Filesystem size:    228.38GiB
(STDOUT) Block group profiles:
(STDOUT)   Data:             single            8.00MiB
(STDOUT)   Metadata:         DUP               1.00GiB
(STDOUT)   System:           DUP               8.00MiB
(STDOUT) SSD detected:       no
(STDOUT) Incompat features:  extref, skinny-metadata
(STDOUT) Runtime features:   
(STDOUT) Checksum:           crc32c
(STDOUT) Number of devices:  1
(STDOUT) Devices:
(STDOUT)    ID        SIZE  PATH
(STDOUT)     1   228.38GiB  /dev/sda3
(STDOUT) 
(CMD) mount /dev/sda3 /mnt 1> /tmp/6B7zRE6D3Q 2> /tmp/kaULXSOq9d
Executing: mount /dev/sda3 /mnt
(CMD) btrfs subvolume create   /mnt/@root/var 1> /tmp/vW8_UZf_lo 2> /tmp/IMJZt0MYvV
Executing: btrfs subvolume create   /mnt/@root/var
(STDERR) ERROR: cannot access '/mnt/@root': No such file or directory
btrfs subvolume create   /mnt/@root/var had exit code 1
(STDERR) ERROR: cannot access '/mnt/@root': No such file or directory
Command had non-zero exit code
signature.asc (application/pgp-signature, 833 B)
-----BEGIN PGP SIGNATURE-----

iQIzBAABCgAdFiEEHeqYcooFjlnR4zwFcOXIip7d3fEFAmOPVj0ACgkQcOXIip7d
3fFn9w//dalMq9OgOMhxbIfxj43QfRbuz0sxxe/kDLMXxaBU6sH63EeyNML9i/il
3Ug+C3K9SZihRFnvCfKhAHkAQNDs9DkQmWuqex9BUv9T1f5Txj45UIjJ+t/JvNAz
sOocDzajJ5McdMg6QUNnMEQjpkOmyae1KNNcWQisR6L7g5uS3LJlXsGuwJJO0u6o
nlIr71R8kBSmgzoSd7r/2AmMigQRG+OQ2HarBw2ofHHoqdrtZ5i9+WrY++yIl/fq
7ddLzh8V/xj/yJpGQCSZKVlcX/mskMY1dg+9BjwBVdauqbTEzTm4EfTPoKtyFkqO
rxBFiAxoe1qDKWWmftBvetuyyc8BJ5581IdmvU5CjiehnhgR+It5Es64Ur9ee+3z
XJ3r6yMMIwPLeqYiX1xhxyhrYj5QtyVk2gko1Qq/9smtnDxqgMYXODADWZ1gjVQT
7cnhMFXdyFbn+fo7NRFSGk0v9U8Kh3aHNwzLhvLjFeSA+pNT5sLCGkYC7/kJa3Z0
k961E5t4lzDOzm8ZhcHpdYMUMSxCOoj5fejjNNXj6uso28TtQN49p8I6AnZlKBkc
pyQ0Kr0Zu5iDTurM/hudYdN2YzqQryA3YCLlNXe4O4ApDZua7oVFSItw93pVGVOk
J9rMh0qllgddDJkUjOkh9kczBbVrvUQvI7tT+vAqwZM1i44O9Og=
=gwfV
-----END PGP SIGNATURE-----
lmpx.com only provides a reader for public news (NNTP) servers. It is not affiliated with the servers or forums shown here and is not responsible for the content of articles, which is written by their respective authors.