Raid5 with enbd on 2.6.17-3

Hi all,

I try to build a raid5 out of 3 enbd-devices exported from 3 servers. 
Each underlying blockdevice (the one exported) is a md-device in raid1 
mode build from 2 sata partitions with 140Gbyte each.
Then every server exports 1 and mounts all 3 so that in the end every 
machine has the same 3 devices.
On top of this i want to build a raid5 with ocfs2 on it.
I used the debian package i found on this list a few days ago and used them.

Some thoughts :
Can i use enbd to export md devices ? Or should i better go ahead and 
export the partitions directly and build a raidset then ?
What about fr1 patch for 2.6.17 is there someone already working on that 
? Since a 140Gbyte full sync will take some time i guess...

What did i miss ? Have i misunderstood the concept in any way ?

Thanks in advance for any help.

My Problem is the enbd devices where connected - but if i try to use 
cfdisk or build a array with them it fails with
something like that :

Buffer I/O error on device nda, logical block 0
 unable to read partition table
EXT3-fs: unable to read superblock
ENBD #878[8]: enbd_open DISK CHECK wanted in open on device nda
ENBD #4737[8]: enbd_media_changed MEDIA CHANGED called
ENBD #4743[8]: enbd_media_changed REMOTE CHECK done locally, no remote 
ioctl!
ENBD #4841[16]: enbd_revalidate REVALIDATE called on nda
ENBD #4847[16]: enbd_revalidate asked to revalidate remotely dead drive nda
ENBD #4841[17]: enbd_revalidate REVALIDATE called on nda
ENBD #4847[17]: enbd_revalidate asked to revalidate remotely dead drive nda
 nda: unable to read partition table
ENBD #878[9]: enbd_open DISK CHECK wanted in open on device nda
ENBD #4737[9]: enbd_media_changed MEDIA CHANGED called
ENBD #4743[9]: enbd_media_changed REMOTE CHECK done locally, no remote 
ioctl!
ENBD #4841[18]: enbd_revalidate REVALIDATE called on nda
ENBD #4847[18]: enbd_revalidate asked to revalidate remotely dead drive nda
ENBD #4841[19]: enbd_revalidate REVALIDATE called on nda
ENBD #4847[19]: enbd_revalidate asked to revalidate remotely dead drive nda
 nda:<4>printk: 9 messages suppressed.
Buffer I/O error on device nda, logical block 1
 unable to read partition table
EXT3-fs: unable to read superblock
ENBD #878[10]: enbd_open DISK CHECK wanted in open on device nda
ENBD #4737[10]: enbd_media_changed MEDIA CHANGED called
ENBD #4743[10]: enbd_media_changed REMOTE CHECK done locally, no remote 
ioctl!
ENBD #4841[20]: enbd_revalidate REVALIDATE called on nda
ENBD #4847[20]: enbd_revalidate asked to revalidate remotely dead drive nda
ENBD #4841[21]: enbd_revalidate REVALIDATE called on nda
ENBD #4847[21]: enbd_revalidate asked to revalidate remotely dead drive nda
 nda: unable to read partition table

^^here i tried to make a ext3fs on the md -device and mount the nda then 
- but failing.


Afaik all 3 drives are there - but what causes the error ?

root@www4:/# cat /proc/nbdinfo
Device a:       Open
[a] State:      verify, rw, enabled, remote invalid, last error 0, lives 
2, bp 0
[a] Queued:     +0R/0W curr (check 0R/0W) +0R/0W max
[a] Buffersize: 262144  (sectors=512, blocks=64)
[a] Blocksize:  4096    (log=12)
[a] Size:       144030656KB
[a] Blocks:     36007664
[a] Sockets:    4       (+)     (*)     (+)     (+)
[a] Requested:  0       (0)     (0)     (0)     (0)     0R/0W   max 0
[a] Despatched: 0       (0)     (0)     (0)     (0)     0R/0W   md5 0W 
(0 eq, 0 ne, 0 dn)
[a] Errored:    342     (0)     (0)     (0)     (0)     0+342
[a] Pending:    0       (0)     (0)     (0)     (0)     0R/0W+0R/0W
[a] B/s now:    0       (0R+0W)
[a] B/s ave:    0       (0R+0W)
[a] B/s max:    0       (0R+0W)
[a] Spectrum:
[a] Kthreads:   0       (0 waiting/0 running/1 max)
[a] Cthreads:   4       (+)     (+)     (+)     (+)
[a] Cpids:      4       (5129)  (5130)  (5131)  (5132)
Device b:       Open
[b] State:      verify, rw, enabled, remote invalid, last error 0, lives 
2, bp 0
[b] Queued:     +0R/0W curr (check 0R/0W) +0R/0W max
[b] Buffersize: 262144  (sectors=512, blocks=64)
[b] Blocksize:  4096    (log=12)
[b] Size:       144030656KB
[b] Blocks:     36007664
[b] Sockets:    4       (+)     (+)     (*)     (+)
[b] Requested:  0       (0)     (0)     (0)     (0)     0R/0W   max 0
[b] Despatched: 0       (0)     (0)     (0)     (0)     0R/0W   md5 0W 
(0 eq, 0 ne, 0 dn)
[b] Errored:    348     (0)     (0)     (0)     (0)     0+348
[b] Pending:    0       (0)     (0)     (0)     (0)     0R/0W+0R/0W
[b] B/s now:    0       (0R+0W)
[b] B/s ave:    0       (0R+0W)
[b] B/s max:    0       (0R+0W)
[b] Spectrum:
[b] Kthreads:   0       (0 waiting/0 running/1 max)
[b] Cthreads:   4       (+)     (+)     (+)     (+)
[b] Cpids:      4       (5109)  (5110)  (5111)  (5112)
Device c:       Open
[c] State:      verify, rw, enabled, remote invalid, last error 0, lives 
2, bp 0
[c] Queued:     +0R/0W curr (check 0R/0W) +0R/0W max
[c] Buffersize: 262144  (sectors=512, blocks=64)
[c] Blocksize:  4096    (log=12)
[c] Size:       144030656KB
[c] Blocks:     36007664
[c] Sockets:    4       (+)     (*)     (+)     (+)
[c] Requested:  0       (0)     (0)     (0)     (0)     0R/0W   max 0
[c] Despatched: 0       (0)     (0)     (0)     (0)     0R/0W   md5 0W 
(0 eq, 0 ne, 0 dn)
[c] Errored:    332     (0)     (0)     (0)     (0)     0+332
[c] Pending:    0       (0)     (0)     (0)     (0)     0R/0W+0R/0W
[c] B/s now:    0       (0R+0W)
[c] B/s ave:    0       (0R+0W)
[c] B/s max:    0       (0R+0W)
[c] Spectrum:
[c] Kthreads:   0       (0 waiting/0 running/1 max)
[c] Cthreads:   4       (+)     (+)     (+)     (+)
[c] Cpids:      4       (5113)  (5114)  (5115)  (5116)
Device d-p:     Closed
*** glibc detected *** double free or corruption (!prev): 0x0804d038 ***
Aborted


So i went down and build a enbd.conf like this :
I use different port-numbers on the servers.

Serv1
#
#We export One and import ourselves + 2 others order matters!
#
#module specific
module 0 merge_requests=512 sync_intvl=0 rahead=20 show_errs=1
#
# Now we mount some ;)
client 0 /dev/nda www4   10034 -n 4
client 1 /dev/ndb www5   10035 -n 4
client 2 /dev/ndc www6   10036 -n 4
#
#
server 0 10034 /dev/md2 -w1000 -M

###################################snap

a restart of enbd server & client brings the following up :

/etc/init.d/enbd restart all
removing nbd module...done
stopping enbd-server 0stopping enbd-client 0stopping enbd-client 
1stopping enbd-client 2done
checking 88.X.4
checking 88.X.3
checking 88.X.4
checking 88.X.3
checking 88.X.4
ACK notice OK
done
checking 88.X.4
checking 88.X.3
checking 88.X.4
checking 88.X.3
checking 88.X.4
ACK notice OK
done
checking 88.X.4
checking 88.X.3
checking 88.X.4
checking 88.X.3
checking 88.X.4
ACK notice OK
done
starting enbd-client 0starting enbd-client 1starting enbd-client 
2root@www4:/# /etc/init.d/enbd: line 114: kill: (4887) - No such process
/etc/init.d/enbd: line 114: kill: (4887) - No such process
/etc/init.d/enbd: line 114: kill: (4887) - No such process
/etc/init.d/enbd: line 114: kill: (4887) - No such process
starting enbd-server 0enbd-client  5527: client says target 0 is www4:10034
enbd-client  5527: client (-1) opened device /dev/nda
enbd-client  5527: client (-1) opened NBD device /dev/nda (2b00)
enbd-client  5527: client (-1) left kernel bdflush sync boundary at 80%
enbd-client  5527: client (-1) left kernel bdflush async boundary at 10%
enbd-client  5527: client (-1) detaches from shell
enbd-client  5528: client (-1) made pidfile /var/run/enbd-client-0.pid 
with pid 5528
enbd-client  5528: client (-1) starts introduction sequence on www4:10034
done
enbd-client  5529: client says target 0 is www5:10035
enbd-client  5529: client (-1) opened device /dev/ndb
enbd-client  5529: client (-1) opened NBD device /dev/ndb (2b10)
enbd-client  5529: client (-1) left kernel bdflush sync boundary at 80%
enbd-client  5529: client (-1) left kernel bdflush async boundary at 10%
enbd-client  5529: client (-1) detaches from shell
enbd-client  5530: client (-1) made pidfile /var/run/enbd-client-1.pid 
with pid 5530
enbd-client  5530: client (-1) starts introduction sequence on www5:10035
done
enbd-client  5531: client says target 0 is www6:10036
enbd-client  5531: client (-1) opened device /dev/ndc
enbd-client  5531: client (-1) opened NBD device /dev/ndc (2b20)
enbd-client  5531: client (-1) left kernel bdflush sync boundary at 80%
enbd-client  5531: client (-1) left kernel bdflush async boundary at 10%
enbd-client  5531: client (-1) detaches from shell
enbd-client  5532: client (-1) made pidfile /var/run/enbd-client-2.pid 
with pid 5532
enbd-client  5532: client (-1) starts introduction sequence on www6:10036
done
enbd-server  5534: server: will open resources in mode linear
file  5534: looking for blksize of /dev/md2 with fstat...
file  5534: blksize of /dev/md2 is 4096
file  5534: set final blksize of whole resource to 4096
file  5534: looking for size of fd 4 with seek SEEK_END...
file  5534: set size of fd 4 to 147487391744
enbd-server  5534: server: set blksize to 4096.
enbd-server  5534: size of exported file/device is 147487391744B 
(36007664 blocks)
enbd-server  5535: server (-2) locked /var/lib/enbd/server-0.client_ips
done
stream  5528: # 497 connect_sock: client socket connect failed 
Connection refused on port 10034
enbd-client  5528: #3370 introduction: client (-1) introduction sequence 
ends FAIL
enbd-client  5528: #3441 introduction: client (-1) introduction bails 
out on www4:10034
enbd-client  5528: client (-1) waits 10s after 0s before retry 1
enbd-server  5535: server (-2) pinged service enbd-cstatd at 88.X.4:5051
enbd-server  5535: with news "notice server-start 10034 127.0.0.1 88.X.3 
0.0.0.0
quit
"
enbd-server  5535: server (-2) unlocked /var/lib/enbd/server-0.client_ips
enbd-server  5535: server (-2) set new signal handlers
enbd-client  5532: client (-1) got size 147487391744
enbd-client  5530: client (-1) got size 147487391744
enbd-client  5532: client (-1) got signature [0], had []
enbd-client  5532: client (-1) negotiated blksize 4096
enbd-client  5530: client (-1) got signature [0], had []
enbd-client  5532: client (-1) negotiated pulse_intvl 10
enbd-client  5532: client (-1) got session port 10038 ok
enbd-client  5532: client (-1) introduction sequence ends ok
enbd-client  5532: client (-1) set sig or passed sigchk OK
enbd-client  5532: client (-1) set device size 147487391744
enbd-client  5532: client (-1) sets session slots to 0-3
enbd-client  5530: client (-1) negotiated blksize 4096
enbd-client  5530: client (-1) negotiated pulse_intvl 10
enbd-client  5530: client (-1) got session port 10038 ok
enbd-client  5530: client (-1) introduction sequence ends ok
enbd-client  5530: client (-1) set sig or passed sigchk OK
enbd-client  5530: client (-1) set device size 147487391744
enbd-client  5530: client (-1) sets session slots to 0-3
enbd-client  5536: client (0) opened device /dev/ndc
enbd-client  5532: client (-1) launched daemon 0 (5536) for www6:10038
enbd-client  5537: client (1) opened device /dev/ndc
enbd-client  5532: client (-1) launched daemon 1 (5537) for www6:10038
enbd-client  5539: client (0) opened device /dev/ndb
enbd-client  5530: client (-1) launched daemon 0 (5539) for www5:10038
enbd-client  5540: client (1) opened device /dev/ndb
enbd-client  5530: client (-1) launched daemon 1 (5540) for www5:10038
enbd-client  5538: client (2) opened device /dev/ndc
enbd-client  5532: client (-1) launched daemon 2 (5538) for www6:10038
enbd-client  5542: client (3) opened device /dev/ndc
enbd-client  5532: client (-1) launched daemon 3 (5542) for www6:10038
enbd-client  5541: client (2) opened device /dev/ndb
enbd-client  5530: client (-1) launched daemon 2 (5541) for www5:10038
enbd-client  5543: client (3) opened device /dev/ndb
enbd-client  5530: client (-1) launched daemon 3 (5543) for www5:10038
enbd-client  5536: client (0) opened socket (6) to www6:10038
enbd-client  5537: client (1) opened socket (6) to www6:10038
enbd-client  5539: client (0) opened socket (6) to www5:10038
enbd-client  5540: client (1) opened socket (6) to www5:10038
enbd-client  5538: client (2) opened socket (6) to www6:10038
enbd-client  5542: client (3) opened socket (6) to www6:10038
enbd-client  5541: client (2) opened socket (6) to www5:10038
enbd-client  5543: client (3) opened socket (6) to www5:10038
enbd-client  5536: client (0) read passwd ok from www6:10038
enbd-client  5536: client (0) got cliserv magic ok from www6:10038
enbd-client  5536: client (0) got a signature ok from www6:10038
enbd-client  5536: #2248 setdevicesig: client (0) FAIL set sig or pass 
sigchk
enbd-client  5536: #2465 setkernelslot: client (0) failed sig check on fd 4
enbd-client  5536: #3647 negotiate: Failed to confirm signature with 
kernel: Invalid argument
enbd-client  5536: #3695 negotiate: client (0) negotiation bails out on 
www6:10038
enbd-client  5539: client (0) read passwd ok from www5:10038
enbd-client  5539: client (0) got cliserv magic ok from www5:10038
enbd-client  5537: client (1) read passwd ok from www6:10038
enbd-client  5537: client (1) got cliserv magic ok from www6:10038
enbd-client  5539: client (0) got a signature ok from www5:10038
enbd-client  5539: client (0) set sig or passed sigchk OK
enbd-client  5539: client (0) begins main loop
enbd-client  5537: client (1) got a signature ok from www6:10038
enbd-client  5537: client (1) set sig or passed sigchk OK
enbd-client  5537: client (1) begins main loop
enbd-client  5540: client (1) read passwd ok from www5:10038
enbd-client  5540: client (1) got cliserv magic ok from www5:10038
enbd-client  5540: client (1) got a signature ok from www5:10038
enbd-client  5540: client (1) set sig or passed sigchk OK
enbd-client  5540: client (1) begins main loop
enbd-server  5535: server (-2) opened port 10034 (socket 4) for client 
88.X.4
nbd-shmem  5544: shmem area total size 139264
nbd-shmem  5544: shmem hash area starts at offset 4096
nbd-shmem  5544: shmem hash area size 135168
nbd/hash  5544: hash area total size 135168
nbd/hash  5544: hash buckets 256
nbd/hash  5544: reduce hash area effective size to 134992
nbd/gm  5544: pre-seeding gz heap with unit size 65536
nbd/gm  5544: pre-seeding gz heap with unit size 32768
nbd/gm  5544: pre-seeding gz heap with unit size 16384
nbd/gm  5544: pre-seeding gz heap with unit size 8192
nbd/gm  5544: pre-seeding gz heap with unit size 4096
nbd/gm  5544: pre-seeding gz heap with unit size 2048
nbd/gm  5544: pre-seeding gz heap with unit size 1024
nbd/gm  5544: pre-seeding gz heap with unit size 512
nbd/gm  5544: pre-seeding gz heap with unit size 256
nbd/gm  5544: pre-seeding gz heap with unit size 64
nbd/gm  5544: pre-seeding gz heap with unit size 16
nbd/hash  5544: hash size 4096 header + 130896 data = 134992
nbd/hash  5544: hash entries initial lo/hi limits set at 2198/2443 entries
enbd-server  5544: server (-1) set default signal handlers
enbd-server  5544: server (-1) sent hello ok
enbd-server  5544: server (-1) sent passwd ok
enbd-server  5544: server (-1) got cliserv magic ok
enbd-server  5544: server (-1) received id device 2b00 ok
enbd-server  5544: server (-1) sent size 147487391744 ok
enbd-server  5544: server (-1) sent sig [0] ok
enbd-server  5544: server (-1) suggested ro flags 0 ok
enbd-server  5544: server (-1) received blksize 4096 ok
enbd-server  5544: server (-1) sent/negotiated blksize 4096 ok
enbd-server  5544: server (-1) received pulse_intvl 10 ok
enbd-server  5544: server (-1) sent/negotiated pulse interval 10 ok
enbd-server  5544: server (-1) agreed 4 channels ok
enbd-server  5544: server (-1) selected free port at 10035
enbd-server  5544: server (-1) posted port 10035 ok
checking 88.X.4
enbd-server  5544: server (-1) manager started new process group 5544
enbd-server  5545: server (0) set default signal handlers
enbd-server  5546: server (1) set default signal handlers
enbd-server  5547: server (2) set default signal handlers
enbd-server  5548: server (3) set default signal handlers
enbd-server  5544: server (-1) set new signal handlers
enbd-server  5548: server (3) opened port 10035 (socket 10) for client 
88.X.4
enbd-server  5548: server (3) sent hello ok
enbd-server  5548: server (3) sent passwd ok
enbd-server  5548: server (3) got cliserv magic ok
enbd-server  5548: server (3) sent sig [0] ok
enbd-server  5548: server (3) set new signal handlers
enbd-server  5547: server (2) opened port 10035 (socket 10) for client 
88.X.4
enbd-server  5547: server (2) sent hello ok
enbd-server  5547: server (2) sent passwd ok
enbd-server  5547: server (2) got cliserv magic ok
enbd-server  5547: server (2) sent sig [0] ok
enbd-server  5547: server (2) set new signal handlers
enbd-server  5546: server (1) opened port 10035 (socket 10) for client 
88.X.4
enbd-server  5546: server (1) sent hello ok
enbd-server  5546: server (1) sent passwd ok
enbd-server  5546: server (1) got cliserv magic ok
enbd-server  5546: server (1) sent sig [0] ok
enbd-server  5546: server (1) set new signal handlers
enbd-client  5541: client (2) read passwd ok from www5:10038
enbd-client  5541: client (2) got cliserv magic ok from www5:10038
enbd-client  5538: client (2) read passwd ok from www6:10038
enbd-client  5538: client (2) got cliserv magic ok from www6:10038
enbd-client  5541: client (2) got a signature ok from www5:10038
enbd-client  5541: client (2) set sig or passed sigchk OK
enbd-client  5541: client (2) begins main loop
enbd-client  5538: client (2) got a signature ok from www6:10038
enbd-client  5538: client (2) set sig or passed sigchk OK
enbd-client  5538: client (2) begins main loop
enbd-client  5543: client (3) read passwd ok from www5:10038
enbd-client  5543: client (3) got cliserv magic ok from www5:10038
enbd-client  5542: client (3) read passwd ok from www6:10038
enbd-client  5542: client (3) got cliserv magic ok from www6:10038
enbd-client  5543: client (3) got a signature ok from www5:10038
enbd-client  5543: client (3) set sig or passed sigchk OK
enbd-client  5543: client (3) begins main loop
enbd-client  5542: client (3) got a signature ok from www6:10038
enbd-client  5542: client (3) set sig or passed sigchk OK
enbd-client  5542: client (3) begins main loop
enbd-client  5532: client (-1) opened device /dev/ndc
enbd-client  5530: client (-1) opened device /dev/ndb
enbd-server  5545: server (0) opened port 10035 (socket 10) for client 
88.X.4
enbd-server  5545: server (0) sent hello ok
enbd-server  5545: server (0) sent passwd ok
enbd-server  5545: server (0) got cliserv magic ok
enbd-server  5545: server (0) sent sig [0] ok
enbd-server  5545: server (0) set new signal handlers
enbd-server  5535: server (-2) opened port 10034 (socket 4) for client 
88.X.4
nbd-shmem  5549: shmem area total size 139264
nbd-shmem  5549: shmem hash area starts at offset 4096
nbd-shmem  5549: shmem hash area size 135168
nbd/hash  5549: hash area total size 135168
nbd/hash  5549: hash buckets 256
nbd/hash  5549: reduce hash area effective size to 134992
nbd/gm  5549: pre-seeding gz heap with unit size 65536
nbd/gm  5549: pre-seeding gz heap with unit size 32768
nbd/gm  5549: pre-seeding gz heap with unit size 16384
nbd/gm  5549: pre-seeding gz heap with unit size 8192
nbd/gm  5549: pre-seeding gz heap with unit size 4096
nbd/gm  5549: pre-seeding gz heap with unit size 2048
nbd/gm  5549: pre-seeding gz heap with unit size 1024
nbd/gm  5549: pre-seeding gz heap with unit size 512
nbd/gm  5549: pre-seeding gz heap with unit size 256
nbd/gm  5549: pre-seeding gz heap with unit size 64
nbd/gm  5549: pre-seeding gz heap with unit size 16
nbd/hash  5549: hash size 4096 header + 130896 data = 134992
nbd/hash  5549: hash entries initial lo/hi limits set at 2198/2443 entries
enbd-server  5549: server (-1) set default signal handlers
enbd-server  5549: server (-1) sent hello ok
enbd-server  5549: server (-1) sent passwd ok
enbd-server  5549: server (-1) got cliserv magic ok
enbd-server  5549: server (-1) received id device 2b00 ok
enbd-server  5549: server (-1) sent size 147487391744 ok
enbd-server  5549: server (-1) sent sig [0] ok
enbd-server  5549: server (-1) suggested ro flags 0 ok
enbd-server  5549: server (-1) received blksize 4096 ok
enbd-server  5549: server (-1) sent/negotiated blksize 4096 ok
enbd-server  5549: server (-1) received pulse_intvl 10 ok
enbd-server  5549: server (-1) sent/negotiated pulse interval 10 ok
enbd-server  5549: server (-1) agreed 4 channels ok
enbd-server  5549: server (-1) selected free port at 10037
enbd-server  5549: server (-1) posted port 10037 ok
enbd-server  5549: #3959 kill_previous_sessions: (ERROR) killing live 
session manager pid 5544 on addr 58c62404
enbd-server  5544: server (-1) propagated signal 15 to live process 5545
enbd-server  5544: server (-1) propagated signal 15 to live process 5546
enbd-server  5544: server (-1) propagated signal 15 to live process 5547
enbd-server  5544: server (-1) propagated signal 15 to live process 5548
enbd-server  5544: server (-1) session sighandler propagates signal 15
enbd-server  5545: #1190 slavesighandler: (WARNING) server (0) activates 
slave sighandler for signal 15
enbd-server  5545: server (0) sighandler terminates slave 5545 safely
enbd-server  5545: #1190 slavesighandler: (WARNING) server (0) activates 
slave sighandler for signal 11
enbd-server  5545: server (0) sighandler terminates slave 5545 safely
enbd-server  5546: #1190 slavesighandler: (WARNING) server (1) activates 
slave sighandler for signal 15
enbd-server  5546: server (1) sighandler terminates slave 5546 safely
enbd-server  5546: #1190 slavesighandler: (WARNING) server (1) activates 
slave sighandler for signal 11
enbd-server  5546: server (1) sighandler terminates slave 5546 safely
enbd-server  5547: #1190 slavesighandler: (WARNING) server (2) activates 
slave sighandler for signal 15
enbd-server  5547: server (2) sighandler terminates slave 5547 safely
enbd-server  5547: #1190 slavesighandler: (WARNING) server (2) activates 
slave sighandler for signal 11
enbd-server  5547: server (2) sighandler terminates slave 5547 safely
enbd-server  5548: #1190 slavesighandler: (WARNING) server (3) activates 
slave sighandler for signal 15
enbd-server  5548: server (3) sighandler terminates slave 5548 safely
enbd-server  5548: #1190 slavesighandler: (WARNING) server (3) activates 
slave sighandler for signal 11
enbd-server  5548: server (3) sighandler terminates slave 5548 safely
enbd-client  5528: client (-1) starts introduction sequence on www4:10034
enbd-server  5544: server (-1) propagated signal 9 to live process 5545
enbd-server  5544: server (-1) propagated signal 9 to live process 5546
enbd-server  5544: server (-1) propagated signal 9 to live process 5547
enbd-server  5544: server (-1) propagated signal 9 to live process 5548
enbd-server  5544: server (-1) session sighandler terminates manager safely
enbd-server  5535: server (-2) sighandler acks SIGCHLD
enbd-server  5535: #1175 nullsigchldhandler: (ERROR) child with pid 5544 
died, remove from DB?
checking 88.X.4
enbd-server  5549: server (-1) manager started new process group 5549
enbd-server  5550: server (0) set default signal handlers
enbd-server  5550: server (0) opened port 10037 (socket 10) for client 
88.X.4
enbd-server  5550: server (0) sent hello ok
enbd-server  5550: server (0) sent passwd ok
enbd-server  5550: server (0) got cliserv magic ok
enbd-server  5550: server (0) sent sig [0] ok
enbd-server  5550: server (0) set new signal handlers
enbd-server  5550: #1962 newproto: (ERROR) net errored (header 128 got 
0) on req. Breaking off.
enbd-server  5551: server (1) set default signal handlers
enbd-server  5551: server (1) opened port 10037 (socket 10) for client 
88.X.4
enbd-server  5551: server (1) sent hello ok
enbd-server  5551: server (1) sent passwd ok
enbd-server  5551: server (1) got cliserv magic ok
enbd-server  5551: server (1) sent sig [0] ok
enbd-server  5551: server (1) set new signal handlers
enbd-server  5552: server (2) set default signal handlers
enbd-server  5553: server (3) set default signal handlers
enbd-server  5549: server (-1) set new signal handlers
enbd-server  5551: #1962 newproto: (ERROR) net errored (header 128 got 
0) on req. Breaking off.
enbd-client  5536: client (0) opened socket (6) to www6:10038
enbd-client  5536: client (0) read passwd ok from www6:10038
enbd-client  5536: client (0) got cliserv magic ok from www6:10038
enbd-client  5536: client (0) got a signature ok from www6:10038
enbd-client  5536: client (0) set sig or passed sigchk OK
enbd-client  5536: client (0) begins main loop
enbd-server  5553: server (3) opened port 10037 (socket 10) for client 
88.X.4
enbd-server  5553: server (3) sent hello ok
enbd-server  5553: server (3) sent passwd ok
enbd-server  5553: server (3) got cliserv magic ok
enbd-server  5553: server (3) sent sig [0] ok
enbd-server  5553: server (3) set new signal handlers
enbd-server  5553: #1962 newproto: (ERROR) net errored (header 128 got 
0) on req. Breaking off.
enbd-server  5552: server (2) opened port 10037 (socket 10) for client 
88.X.4
enbd-server  5552: server (2) sent hello ok
enbd-server  5552: server (2) sent passwd ok
enbd-server  5552: server (2) got cliserv magic ok
enbd-server  5552: server (2) sent sig [0] ok
enbd-server  5552: server (2) set new signal handlers
enbd-server  5552: #1962 newproto: (ERROR) net errored (header 128 got 
0) on req. Breaking off.
enbd-server  5535: server (-2) opened port 10034 (socket 4) for client 
88.X.3
nbd-shmem  5554: shmem area total size 139264
nbd-shmem  5554: shmem hash area starts at offset 4096
nbd-shmem  5554: shmem hash area size 135168
nbd/hash  5554: hash area total size 135168
nbd/hash  5554: hash buckets 256
nbd/hash  5554: reduce hash area effective size to 134992
nbd/gm  5554: pre-seeding gz heap with unit size 65536
nbd/gm  5554: pre-seeding gz heap with unit size 32768
nbd/gm  5554: pre-seeding gz heap with unit size 16384
nbd/gm  5554: pre-seeding gz heap with unit size 8192
nbd/gm  5554: pre-seeding gz heap with unit size 4096
nbd/gm  5554: pre-seeding gz heap with unit size 2048
nbd/gm  5554: pre-seeding gz heap with unit size 1024
nbd/gm  5554: pre-seeding gz heap with unit size 512
nbd/gm  5554: pre-seeding gz heap with unit size 256
nbd/gm  5554: pre-seeding gz heap with unit size 64
nbd/gm  5554: pre-seeding gz heap with unit size 16
nbd/hash  5554: hash size 4096 header + 130896 data = 134992
nbd/hash  5554: hash entries initial lo/hi limits set at 2198/2443 entries
enbd-server  5554: server (-1) set default signal handlers
enbd-server  5554: server (-1) sent hello ok
enbd-server  5554: server (-1) sent passwd ok
enbd-server  5554: server (-1) got cliserv magic ok
enbd-server  5554: server (-1) received id device 2b00 ok
enbd-server  5554: server (-1) sent size 147487391744 ok
enbd-server  5554: server (-1) sent sig [0] ok
enbd-server  5554: server (-1) suggested ro flags 0 ok
enbd-client  5528: client (-1) got size 147487391744
enbd-client  5528: client (-1) got signature [0], had []
enbd-server  5554: server (-1) received blksize 1024 ok
enbd-client  5528: client (-1) negotiated blksize 4096
enbd-server  5554: server (-1) sent/negotiated blksize 4096 ok
enbd-server  5554: server (-1) received pulse_intvl 10 ok
enbd-client  5528: client (-1) negotiated pulse_intvl 10
enbd-server  5554: server (-1) sent/negotiated pulse interval 10 ok
enbd-server  5554: server (-1) agreed 4 channels ok
enbd-server  5554: server (-1) selected free port at 10038
enbd-server  5554: server (-1) posted port 10038 ok
checking 88.X.4
enbd-server  5554: server (-1) manager started new process group 5554
enbd-server  5555: server (0) set default signal handlers
enbd-server  5556: server (1) set default signal handlers
enbd-server  5557: server (2) set default signal handlers
enbd-server  5558: server (3) set default signal handlers
enbd-server  5554: server (-1) set new signal handlers
enbd-client  5528: client (-1) got session port 10038 ok
enbd-client  5528: client (-1) introduction sequence ends ok
enbd-client  5528: client (-1) set sig or passed sigchk OK
enbd-client  5528: client (-1) set device size 147487391744
enbd-client  5528: client (-1) sets session slots to 0-3
enbd-client  5559: client (0) opened device /dev/nda
enbd-client  5528: client (-1) launched daemon 0 (5559) for www4:10038
enbd-client  5560: client (1) opened device /dev/nda
enbd-client  5528: client (-1) launched daemon 1 (5560) for www4:10038
enbd-client  5528: client (-1) launched daemon 2 (5561) for www4:10038
enbd-client  5562: client (3) opened device /dev/nda
enbd-client  5528: client (-1) launched daemon 3 (5562) for www4:10038
enbd-client  5559: client (0) opened socket (6) to www4:10038
enbd-client  5561: client (2) opened device /dev/nda
enbd-client  5560: client (1) opened socket (6) to www4:10038
enbd-client  5562: client (3) opened socket (6) to www4:10038
enbd-server  5558: server (3) opened port 10038 (socket 10) for client 
88.X.3
enbd-client  5561: client (2) opened socket (6) to www4:10038
enbd-server  5558: server (3) sent hello ok
enbd-client  5559: client (0) read passwd ok from www4:10038
enbd-server  5558: server (3) sent passwd ok
enbd-client  5559: client (0) got cliserv magic ok from www4:10038
enbd-server  5558: server (3) got cliserv magic ok
enbd-server  5557: server (2) opened port 10038 (socket 10) for client 
88.X.3
enbd-server  5557: server (2) sent hello ok
enbd-client  5560: client (1) read passwd ok from www4:10038
enbd-server  5557: server (2) sent passwd ok
enbd-client  5560: client (1) got cliserv magic ok from www4:10038
enbd-server  5557: server (2) got cliserv magic ok
enbd-client  5560: client (1) got a signature ok from www4:10038
enbd-client  5560: client (1) set sig or passed sigchk OK
enbd-client  5560: client (1) begins main loop
enbd-server  5557: server (2) sent sig [0] ok
enbd-server  5556: server (1) opened port 10038 (socket 10) for client 
88.X.3
enbd-server  5556: server (1) sent hello ok
enbd-client  5562: client (3) read passwd ok from www4:10038
enbd-server  5556: server (1) sent passwd ok
enbd-client  5562: client (3) got cliserv magic ok from www4:10038
enbd-server  5556: server (1) got cliserv magic ok
enbd-client  5562: client (3) got a signature ok from www4:10038
enbd-client  5562: client (3) set sig or passed sigchk OK
enbd-client  5562: client (3) begins main loop
enbd-server  5556: server (1) sent sig [0] ok
enbd-server  5556: server (1) set new signal handlers
enbd-client  5559: client (0) got a signature ok from www4:10038
enbd-client  5559: client (0) set sig or passed sigchk OK
enbd-client  5559: client (0) begins main loop
enbd-server  5558: server (3) sent sig [0] ok
enbd-server  5558: server (3) set new signal handlers
enbd-server  5557: server (2) set new signal handlers
enbd-server  5555: server (0) opened port 10038 (socket 10) for client 
88.X.3
enbd-server  5555: server (0) sent hello ok
enbd-server  5555: server (0) sent passwd ok
enbd-server  5555: server (0) got cliserv magic ok
enbd-server  5555: server (0) sent sig [0] ok
enbd-server  5555: server (0) set new signal handlers
enbd-client  5561: client (2) read passwd ok from www4:10038
enbd-client  5561: client (2) got cliserv magic ok from www4:10038
enbd-client  5561: client (2) got a signature ok from www4:10038
enbd-client  5561: client (2) set sig or passed sigchk OK
enbd-client  5561: client (2) begins main loop
enbd-server  5550: #1190 slavesighandler: (WARNING) server (0) activates 
slave sighandler for signal 15
enbd-server  5550: server (0) sighandler terminates slave 5550 safely
enbd-server  5550: #1190 slavesighandler: (WARNING) server (0) activates 
slave sighandler for signal 11
enbd-server  5550: server (0) sighandler terminates slave 5550 safely
enbd-server  5549: server (-1) session relaunches child after SIGCHLD
enbd-server  5549: server (-1) slave pid 5550 is down, launching new
enbd-server  5563: server (0) set default signal handlers
enbd-server  5549: server (-1) launched slave pid 5563
enbd-server  5551: #1190 slavesighandler: (WARNING) server (1) activates 
slave sighandler for signal 15
enbd-server  5551: server (1) sighandler terminates slave 5551 safely
enbd-server  5551: #1190 slavesighandler: (WARNING) server (1) activates 
slave sighandler for signal 11
enbd-server  5551: server (1) sighandler terminates slave 5551 safely
enbd-server  5549: server (-1) session relaunches child after SIGCHLD
enbd-server  5549: server (-1) slave pid 5551 is down, launching new
enbd-server  5564: server (1) set default signal handlers
enbd-server  5549: server (-1) launched slave pid 5564
enbd-server  5564: server (1) opened port 10037 (socket 10) for client 
88.X.4
enbd-server  5564: server (1) sent hello ok
enbd-server  5564: server (1) sent passwd ok
enbd-server  5564: server (1) got cliserv magic ok
enbd-server  5564: server (1) sent sig [0] ok
enbd-server  5564: server (1) set new signal handlers
enbd-client  5528: client (-1) opened device /dev/nda
enbd-server  5563: server (0) opened port 10037 (socket 10) for client 
88.X.4
enbd-server  5563: server (0) sent hello ok
enbd-server  5563: server (0) sent passwd ok
enbd-server  5563: server (0) got cliserv magic ok
enbd-server  5563: server (0) sent sig [0] ok
enbd-server  5563: server (0) set new signal handlers
enbd-server  5553: #1190 slavesighandler: (WARNING) server (3) activates 
slave sighandler for signal 15
enbd-server  5553: server (3) sighandler terminates slave 5553 safely
enbd-server  5553: #1190 slavesighandler: (WARNING) server (3) activates 
slave sighandler for signal 11
enbd-server  5553: server (3) sighandler terminates slave 5553 safely
enbd-server  5549: server (-1) session relaunches child after SIGCHLD
enbd-server  5549: server (-1) slave pid 5553 is down, launching new
enbd-server  5565: server (3) set default signal handlers
enbd-server  5549: server (-1) launched slave pid 5565
enbd-server  5552: #1190 slavesighandler: (WARNING) server (2) activates 
slave sighandler for signal 15
enbd-server  5552: server (2) sighandler terminates slave 5552 safely
enbd-server  5552: #1190 slavesighandler: (WARNING) server (2) activates 
slave sighandler for signal 11
enbd-server  5552: server (2) sighandler terminates slave 5552 safely
enbd-server  5549: server (-1) session relaunches child after SIGCHLD
enbd-server  5549: server (-1) slave pid 5552 is down, launching new
enbd-server  5566: server (2) set default signal handlers
enbd-server  5549: server (-1) launched slave pid 5566
enbd-server  5566: server (2) opened port 10037 (socket 10) for client 
88.X.4
enbd-server  5566: server (2) sent hello ok
enbd-server  5566: server (2) sent passwd ok
enbd-server  5566: server (2) got cliserv magic ok
enbd-server  5566: server (2) sent sig [0] ok
enbd-server  5566: server (2) set new signal handlers
enbd-server  5565: server (3) opened port 10037 (socket 10) for client 
88.X.4
enbd-server  5565: server (3) sent hello ok
enbd-server  5565: server (3) sent passwd ok
enbd-server  5565: server (3) got cliserv magic ok
enbd-server  5565: server (3) sent sig [0] ok
enbd-server  5565: server (3) set new signal handlers
root@www4:/#