Re: diskless enbd-client/enbd on initrd

Peter T. Breuer wrote:
> "Also sprach Rudolph Bott:"
> 
> 
> VM? Are you using the mount for swap or something?
as i mentioned earlier, i'm testing the whole thing on a Xen host and i 
meant 'virtual machine' (or domU in xen-terms)

> 
> 
>>enbd-client   595: #1927 mainloop: Client times out waiting 60s in 
>>mainloop. Breaking off
> 
> 
> Well, the server didn't talk back for 60s. Net failed?
> 
The Xen-machine shares a private LAN with the storage server - ssh 
sessions work just fine between the two hosts
So i don't see a reason for network failures right now (althought things 
somehow indicate that :S )
And as i also mentioned before, the whole system worked on top of nbd 
before.

> Well, the signature given by the server is not the same as before.  Did
> you specify it (or is that my fault)?  You could always vamoosh the
> signature check for the moment.
I modified both the client and server paramters to include -i xenoo and 
-b 512 now


below is the output on the server-side and the client-side:
to explain the network adresses:
172.16.20.1 is the enbd-server
172.16.20.2 is the xen host, which is not directly involved right now 
(it acts as a bridge and pushes packets for the enbd-client-host to its 
virtual interface inside the virtual machine)
172.16.20.3 is the enbd-client

client-side:

enbd-client   592: client says target 0 is 172.16.20.1:1111
enbd-client   592: client (-1) opened device /dev/nda
enbd-client   592: client (-1) opened NBD device /dev/nda (2b00)
warning: process `enbd-client' used the obsolete bdflush system call Fix 
your initscripts?
enbd-client   592: client (-1) left kernel bdflush sync boundary at 
134988640%
warning: process `enbd-client' used the obsolete bdflush system call
Fix your initscripts?
warning: process `enbd-client' used the obsolete bdflush system call
Fix your initscripts?
enbd-client   592: client (-1) set kernel bdflush async boundary to 25% 
from 134971615%
enbd-client   592: client (-1) detaches from shell
nbd/pidfile   593: # 147 lockpidfile: returning err -30 for lock attempt
enbd-client   593: #4268 main: Warning - couldn't make a new pidfile 
/var/run/enbd-client-xenoo.pid!
enbd-client   593: client (-1) starts introduction sequence on 
172.16.20.1:1111
Sleeping 20 seconds...
enbd-client   593: client (-1) got size 21474836480
enbd-client   593: client (-1) got signature [xenoo], had []
enbd-client   593: client (-1) negotiated blksize 512
enbd-client   593: client (-1) negotiated pulse_intvl 10
enbd-client   593: client (-1) got session port 1112 ok
enbd-client   593: client (-1) introduction sequence ends ok
enbd-client   593: client (-1) enters setsig
enbd-client   593: client (-1) set sig uses subdevice 0
ENBD #3931[0]: fixup_slot failed to find slot for pid 593 ioctl 
MY_NBD_SET_SIG arg (user 6f6e6578) in user addr bfcfccd0
enbd-client   593: client (-1) set sig or passed sigchk OK
enbd-client   593: client (-1) copied sig OK
enbd-client   593: client (-1) set device size 21474836480
enbd-client   593: #1695 setdeviceblksize: client (-1) Warning! kernel 
says blksz is 4096 != 512
enbd-client   593: client (-1) sets session slots to 0-1
enbd-client   594: client (0) opened device /dev/nda
enbd-client   594: client (0) opened socket (4) to 172.16.20.1:1112
enbd-client   594: client (0) read passwd ok from 172.16.20.1:1112
enbd-client   594: client (0) got cliserv magic ok from 172.16.20.1:1112
enbd-client   594: client (0) got a signature ok from 172.16.20.1:1112
enbd-client   594: client (0) enters setsig
enbd-client   594: client (0) set sig uses whole disk, wants slot 1
enbd-client   594: client (0) set sig or passed sigchk OK
enbd-client   594: client (0) sig matched OK
ENBD #2820[0]: enbd_set_sock increased socket count on nda to 1
ENBD #2824[0]: enbd_set_sock upping openers count on nda
ENBD #2610[0]: enbd_enable_and_notify set ENABLED on nda
enbd-client   593: client (-1) launched daemon 0 (594) for 172.16.20.1:1112
ENBD #875[0]: enbd_open DISK CHECK wanted in open on device nda
ENBD #4640[0]: enbd_media_changed MEDIA CHANGED called
enbd-client   593: client (-1) launched daemon 1 (596) for 172.16.20.1:1112
ENBD #2575[0]: enbd_notify_hot_add_thread_fn running thread MD notify 
HOT_ADD fn for nda
enbd-client   594: client (0) begins main loop
ENBD #4696[0]: enbd_media_changed REMOTE CHECK still has REMOTE VALID on nda
ENBD #875[1]: enbd_open DISK CHECK wanted in open on device nda
ENBD #4640[1]: enbd_media_changed MEDIA CHANGED called
ENBD #4696[1]: enbd_media_changed REMOTE CHECK still has REMOTE VALID on nda
ENBD #875[2]: enbd_open DISK CHECK wanted in open on device nda
ENBD #4640[2]: enbd_media_changed MEDIA CHANGED called
ENBD #4696[2]: enbd_media_changed REMOTE CHECK still has REMOTE VALID on nda
enbd-client   596: client (1) opened device /dev/nda
enbd-client   596: client (1) opened socket (4) to 172.16.20.1:1112
enbd-client   596: client (1) read passwd ok from 172.16.20.1:1112
enbd-client   596: client (1) got cliserv magic ok from 172.16.20.1:1112
enbd-client   596: client (1) got a signature ok from 172.16.20.1:1112
enbd-client   596: client (1) enters setsig
enbd-client   596: client (1) set sig uses whole disk, wants slot 2
enbd-client   596: client (1) set sig or passed sigchk OK
enbd-client   596: client (1) sig matched OK
ENBD #2820[1]: enbd_set_sock increased socket count on nda to 2
enbd-client   596: client (1) begins main loop
ENBD #875[4]: enbd_open DISK CHECK wanted in open on device nda
ENBD #4640[4]: enbd_media_changed MEDIA CHANGED called
ENBD #4696[4]: enbd_media_changed REMOTE CHECK still has REMOTE VALID on nda
EXT3-fs: INFO: recovery required on readonly filesystem.
EXT3-fs: write access will be enabled during recovery.
kjournald starting.  Commit interval 5 seconds
EXT3-fs: nda: orphan cleanup on readonly fs
EXT3-fs: nda: 3 orphan inodes deleted
EXT3-fs: recovery complete.
EXT3-fs: mounted filesystem with ordered data mode.
INIT: version 2.86 booting
Activating swap.
EXT3 FS on nda, internal journal
System time was Fri Mar  3 12:45:55 UTC 2006.
Setting the System Clock using the Hardware Clock as reference...
System Clock set. System local time is now Fri Mar  3 13:45:57 CET 2006.
Cleaning up ifupdown...done.
Calculating module dependencies... done.
Loading modules...
All modules loaded.
Checking all file systems...
fsck 1.37 (21-Mar-2005)
Setting kernel variables ...
... done.
Mounting local filesystems...
Cleaning /tmp /var/run /var/lock.
Running 0dns-down to make sure resolv.conf is ok...done.
Setting up networking...done.
Setting up IP spoofing protection: rp_filter.
Configuring network interfaces...done.

Setting the System Clock using the Hardware Clock as reference...
System Clock set. Local time: Fri Mar  3 13:45:59 CET 2006

Initializing random number generator...done.
Recovering nvi editor sessions... done.
INIT: Entering runlevel: 2
Starting system log daemon: syslogd.
Starting kernel log daemon: klogd.
Starting internet superserver: inetd.
Starting MySQL database server: mysqld.
Checking for crashed MySQL tables in the background.
Starting PostgreSQL database server: postmaster (Removing stale PID file 
and socket).
Starting OpenBSD Secure Shell server: sshd.
Starting periodic command scheduler: cron.
Starting web server: Apache2apache2: Could not determine the server's 
fully qualified domain name, using 127.0.0.1 for ServerName
.
Starting munin-node: done.

Debian GNU/Linux 3.1 ndbtest tty1

ndbtest login:

enbd-client   594: #1927 mainloop: Client times out waiting 60s in 
mainloop. Breaking off
enbd-client   596: #1927 mainloop: Client times out waiting 60s in 
mainloop. Breaking off
enbd-client   594: client (0) opened socket (4) to 172.16.20.1:1112
enbd-client   594: client (0) read passwd ok from 172.16.20.1:1112
enbd-client   594: client (0) got cliserv magic ok from 172.16.20.1:1112
enbd-client   594: client (0) got a signature ok from 172.16.20.1:1112
enbd-client   594: client (0) enters setsig
enbd-client   594: client (0) set sig uses whole disk, wants slot 1
ENBD #3150[0]: my_nbd_set_sig (0): failed sigcheck wth -22
enbd-client   594: #1885 setdevicesig: client (0) FAIL set sig or pass 
sigchk
enbd-client   594: #2099 setkernelslot: client (0) failed sig check on fd 3
enbd-client   594: #3279 negotiate: Failed to confirm signature with 
kernel: Invalid argument
enbd-client   594: #3327 negotiate: client (0) negotiation bails out on 
172.16.20.1:1112
ENBD #1160[0]: enbd_rollback (1): rollback req d803d20c!
ENBD #4470[0]: enbd_release (1): erasing slot pid 596

...



server-side:

killer-nas:~# enbd-server 1111 -b 512 -i xenoo /path/to/LVM_volume
enbd-server 25946: server: will open resources in mode linear
file 25946: looking for size of fd 4 with seek SEEK_END...
file 25946: set size of fd 4 to 21474836480
enbd-server 25946: size of exported file/device is 21474836480B 
(41943040 blocks)
nbd/pidfile 25947: # 147 lockpidfile: returning err 0 for lock attempt
enbd-server 25947: server (-2) locked /var/state/nbd/server-xenoo.client_ips
killer-nas:~# enbd-server 25947: #3763 notify_clients: (ERROR) server 
(-2) failed connect to 172.16.20.3 on port 5051
enbd-server 25947: server (-2) unlocked 
/var/state/nbd/server-xenoo.client_ips
enbd-server 25947: server (-2) set new signal handlers
enbd-server 25947: server (-2) opened port 1111 (socket 4) for client 
172.16.20.3
nbd-shmem 25948: shmem area total size 139264
nbd-shmem 25948: shmem hash area starts at offset 4096
nbd-shmem 25948: shmem hash area size 135168
nbd/hash 25948: hash area total size 135168
nbd/hash 25948: hash buckets 256
nbd/hash 25948: reduce hash area effective size to 134992
nbd/gm 25948: pre-seeding gz heap with unit size 65536
nbd/gm 25948: pre-seeding gz heap with unit size 32768
nbd/gm 25948: pre-seeding gz heap with unit size 16384
nbd/gm 25948: pre-seeding gz heap with unit size 8192
nbd/gm 25948: pre-seeding gz heap with unit size 4096
nbd/gm 25948: pre-seeding gz heap with unit size 2048
nbd/gm 25948: pre-seeding gz heap with unit size 1024
nbd/gm 25948: pre-seeding gz heap with unit size 512
nbd/gm 25948: pre-seeding gz heap with unit size 256
nbd/gm 25948: pre-seeding gz heap with unit size 64
nbd/gm 25948: pre-seeding gz heap with unit size 16
nbd/hash 25948: hash size 4096 header + 130896 data = 134992
nbd/hash 25948: hash entries initial lo/hi limits set at 2198/2443 entries
enbd-server 25948: server (-1) set default signal handlers
enbd-server 25948: server (-1) sent hello ok
enbd-server 25948: server (-1) sent passwd ok
enbd-server 25948: server (-1) got cliserv magic ok
enbd-server 25948: server (-1) received id device 2b00 ok
enbd-server 25948: server (-1) sent size 21474836480 ok
enbd-server 25948: server (-1) sent sig [xenoo] ok
enbd-server 25948: server (-1) suggested ro flags 0 ok
enbd-server 25948: server (-1) received blksize 512 ok
enbd-server 25948: server (-1) sent/negotiated blksize 512 ok
enbd-server 25948: server (-1) received pulse_intvl 10 ok
enbd-server 25948: server (-1) sent/negotiated pulse interval 10 ok
enbd-server 25948: server (-1) agreed 2 channels ok
enbd-server 25948: server (-1) selected free port at 1112
enbd-server 25948: server (-1) posted port 1112 ok
checking 172.16.20.3
enbd-server 25948: server (-1) manager started new process group 25948
enbd-server 25949: server (0) set default signal handlers
enbd-server 25950: server (1) set default signal handlers
enbd-server 25948: server (-1) set new signal handlers
enbd-server 25950: server (1) opened port 1112 (socket 9) for client 
172.16.20.3
enbd-server 25950: server (1) sent hello ok
enbd-server 25950: server (1) sent passwd ok
enbd-server 25950: server (1) got cliserv magic ok
enbd-server 25950: server (1) sent sig [xenoo] ok
enbd-server 25950: server (1) set new signal handlers
enbd-server 25949: server (0) opened port 1112 (socket 9) for client 
172.16.20.3
enbd-server 25949: server (0) sent hello ok
enbd-server 25949: server (0) sent passwd ok
enbd-server 25949: server (0) got cliserv magic ok
enbd-server 25949: server (0) sent sig [xenoo] ok
enbd-server 25949: server (0) set new signal handlers
enbd-server 25950: #2008 newproto: (ERROR) Not enough magic in packet. 
Breaking off.
enbd-server 25950: #2258 mainloop: (ERROR) Server time out waiting 30s 
in mainloop. Breaking off
enbd-server 25950: #1243 slavesighandler: (WARNING) server (1) activates 
slave sighandler for signal 15
enbd-server 25950: server (1) sighandler terminates slave 25950 safely
enbd-server 25950: #1243 slavesighandler: (WARNING) server (1) activates 
slave sighandler for signal 11
enbd-server 25950: server (1) sighandler terminates slave 25950 safely
enbd-server 25948: server (-1) session relaunches child after SIGCHLD
enbd-server 25948: server (-1) slave pid 25950 is down, launching new
enbd-server 25951: server (1) set default signal handlers
.....

-- 
Mit freundlichen Gruessen / with kind regards
  Rudolph Bott

-------------------------------------------------------------------
Megabit Informationstechnik GmbH  Karstr.25  41068 Moenchengladbach
Tel: 02161/308980   mailto:[email protected]       ftp://megabit.net
Fax: 02161/3089818  mailto:[email protected]   http://megabit.net
-------------------------------------------------------------------