Re: NFS fails to start

Jim Kinney <[email protected]> Thu, 2 May 2013 01:20:47 -0400
Newsgroups	gmane.linux.redhat.k12osn
Message-ID	<CAEo=5Pwf-xr2ZHiZCkey--rqJ76jxFqpSAj+mQ-zcWQuJN2RSg@mail.gmail.com>
Totally strange.

I saw a blurb on a Ubuntu page where there was a kernel bug related to ext4
filesystem shared out by NFS. However, even though it showed the same
error, it was still mountable from a remote machine.

I have a vanilla CentOS 6.4 with kernel 2.6.32-358 I tested the NFS server
on with no issues.

/etc/exports:
/home *(rw,no_root_squash,async)

disables NFSv4 in /etc/sysconfig/nfs

turned off iptables for the test

actually have selinux in enforcing mode

mounted remotely with no issues or errors on starting nfs service.

At this point, I think there's a problem with the hard drive. The top level
inode collections are screwed up and NFS can't "do it's thing" because it
can't read the filesystem metadata.

I would run 'badblocks' on the drive and reinstall (lousy answer and bad
sysadmin solution but short of running strace on everything it may be the
fastest way to working) with a fresh drive format.


On Thu, May 2, 2013 at 12:39 AM, Kenneth Lundström <
[email protected]> wrote:

> Hi,
>
> I also tried to mount /opt/ltsp shared on the new server on the old
> server, just to test the share, so doing
> mount -t nfs 192.168.0.1:/opt/ltsp /mnt/test/
>
> I get these four rows of text in the new servers /var/log/messages:
> May  2 07:37:00 ltsp rpc.mountd[2186]: authenticated mount request from
> 192.168.0.11:978 for /opt/ltsp (/opt/ltsp)
> May  2 07:37:00 ltsp rpc.mountd[2186]: qword_eol: fflush failed: errno 22
> (Invalid argument)
> May  2 07:37:00 ltsp rpc.mountd[2186]: qword_eol: fflush failed: errno 2
> (No such file or directory)
> May  2 07:37:00 ltsp rpc.mountd[2186]: Cannot export /opt/ltsp, possibly
> unsupported filesystem or fsid= required
>
>
>
> > check contents of /etc/auto.misc for /opt/ltsp. Comment it out if found
>
> don't have any files called /etc/auto.misc
>
> > lsmod | grep nfs
>
> nfsd                  304962  11
> lockd                  73534  1 nfsd
> nfs_acl                 2647  1 nfsd
> auth_rpcgss            44917  1 nfsd
> exportfs                4236  1 nfsd
> sunrpc                261299  17 nfsd,lockd,nfs_acl,auth_rpcgss
>
> Looks to me OK?
>
> > grep -R ltsp /etc/*
>
> Binary file /etc/aliases.db matches
> /etc/cron.daily/ltsp-swapfile-**delete:[ -f /etc/ltsp/ltsp.conf ] && .
> /etc/ltsp/ltsp.conf
> /etc/cron.daily/ltsp-swapfile-**delete:[ "$LTSP_SWAP_DIR" ] ||
> LTSP_SWAP_DIR=/var/lib/ltsp/**swapfiles/
> /etc/exports:/opt/ltsp *(ro,async,no_root_squash)
> /etc/exports~:/opt/ltsp *(ro,async,no_root_squash)
> /etc/fstab:/dev/mapper/vg_**ltsp-lv_root / ext4    defaults        1 1
> /etc/fstab:/dev/mapper/vg_**ltsp-lv_home /home ext4    defaults        1 2
> /etc/fstab:/dev/mapper/vg_**ltsp-lv_swap swap swap    defaults        0 0
> /etc/grub.conf:#          kernel /vmlinuz-version ro
> root=/dev/mapper/vg_ltsp-lv_**root
> /etc/grub.conf: kernel /vmlinuz-2.6.32-358.2.1.el6.**x86_64 ro
> root=/dev/mapper/vg_ltsp-lv_**root rd_NO_LUKS LANG=en_US.UTF-8
> rd_LVM_LV=vg_ltsp/lv_root rd_NO_MD SYSFONT=latarcyrheb-sun16
> crashkernel=auto  KEYBOA
> RDTYPE=pc KEYTABLE=fi rd_LVM_LV=vg_ltsp/lv_swap rd_NO_DM rhgb quiet
> /etc/grub.conf: kernel /vmlinuz-2.6.32-279.22.1.el6.**x86_64 ro
> root=/dev/mapper/vg_ltsp-lv_**root rd_NO_LUKS LANG=en_US.UTF-8
> rd_LVM_LV=vg_ltsp/lv_root rd_NO_MD SYSFONT=latarcyrheb-sun16
> crashkernel=auto  KEYBO
> ARDTYPE=pc KEYTABLE=fi rd_LVM_LV=vg_ltsp/lv_swap rd_NO_DM rhgb quiet
> /etc/grub.conf: kernel /vmlinuz-2.6.32-279.el6.x86_64 ro
> root=/dev/mapper/vg_ltsp-lv_**root rd_NO_LUKS LANG=en_US.UTF-8
> rd_LVM_LV=vg_ltsp/lv_root rd_NO_MD SYSFONT=latarcyrheb-sun16
> crashkernel=auto  KEYBOARDTY
> PE=pc KEYTABLE=fi rd_LVM_LV=vg_ltsp/lv_swap rd_NO_DM rhgb quiet
> /etc/init.d/ltsp-dhcpd:# Provides: ltsp-dhcpd
> /etc/init.d/ltsp-dhcpd:# config: /etc/ltsp/dhcpd.conf
> /etc/init.d/ltsp-dhcpd:**lockfile=/var/lock/subsys/**ltsp-dhcpd
> /etc/init.d/ltsp-dhcpd:**pidfile=/var/run/ltsp-dhcpd.**pid
> /etc/init.d/ltsp-dhcpd:[ -f /etc/sysconfig/ltsp-dhcpd ] && .
> /etc/sysconfig/ltsp-dhcpd
> /etc/init.d/ltsp-dhcpd:    echo "/etc/ltsp/dhcpd.conf"
> /etc/init.d/ltsp-dhcpd:    echo -n "Starting ltsp-$prog:"
> /etc/init.d/ltsp-dhcpd:    if [ -e /etc/ltsp/DELETE-ME-WHEN-DONE-**need-to-copy-sshkeys
> ]; then
> /etc/init.d/ltsp-dhcpd:        /usr/sbin/ltsp-update-sshkeys
> /etc/init.d/ltsp-dhcpd:        rm -f /etc/ltsp/DELETE-ME-WHEN-DONE-**
> need-to-copy-sshkeys
> /etc/init.d/ltsp-dhcpd:    echo -n "Shutting down ltsp-$prog:"
> /etc/ltsp/kickstart/Fedora/14/**ltsp-i386.ks:# we are going to install
> into a chroot, such as /opt/ltsp/i386
> /etc/ltsp/kickstart/Fedora/14/**ltsp-x86_64.ks:# we are going to install
> into a chroot, such as /opt/ltsp/x86_64
> /etc/ltsp/kickstart/Fedora/**el6/ltsp-i386.ks:# we are going to install
> into a chroot, such as /opt/ltsp/i386
> /etc/ltsp/kickstart/Fedora/**el6/ltsp-x86_64.ks:# we are going to install
> into a chroot, such as /opt/ltsp/x86_64
> /etc/ltsp/kickstart/Fedora/11/**ltsp-i386.ks:# we are going to install
> into a chroot, such as /opt/ltsp/i386
> /etc/ltsp/kickstart/Fedora/**common/common.ks:ltsp-client
> /etc/ltsp/kickstart/Fedora/**common/common.ks:ltspfsd
> /etc/ltsp/kickstart/Fedora/**common/common.ks:
> /usr/sbin/ltsp-rewrap-latest-**kernel
> /etc/ltsp/ltsp-build-client.**conf:# By default ltsp-build-client will
> install a chroot matching your OS into /opt/ltsp/i386.
> /etc/ltsp/ltsp-build-client.**conf:# See /usr/share/ltsp/plugins/ltsp-**build-client
> for more possible options.
> /etc/ltsp/dhcpd.conf:option domain-name            "ltsp";
> /etc/ltsp/dhcpd.conf:        filename      "/ltsp/i386/elf.ltsp";
> /etc/ltsp/dhcpd.conf:        filename "/ltsp/i386/wraplinux-nbi.**ltsp";
> /etc/ltsp/dhcpd.conf:        # NOTE: kernels are specified in
> /tftpboot/ltsp/i386/pxelinux.**cfg/
> /etc/ltsp/dhcpd.conf:        filename "/ltsp/i386/pxelinux.0";
> /etc/ltsp/dhcpd.conf:        filename "/ltsp/i386/wraplinux-nbi.**ltsp";
> /etc/ltsp/dhcpd.conf:        option root-path "172.31.100.254:
> /opt/ltsp/ppc"**;
> /etc/ltsp/dhcpd.conf:        option root-path "172.31.100.254:/opt/ltsp/**
> i386";
> /etc/ltsp/dhcpd.conf:#        filename "/ltsp/vmlinuz.ltsp";
> /etc/ltsp/dhcpd.conf:#        filename "/ltsp/vmlinuz.ltsp";
> /etc/ltsp/dhcpd.conf:#        # kernels are specified in
> /tftpboot/ltsp/i386/pxelinux.**cfg/
> /etc/ltsp/dhcpd.conf:#        filename "/ltsp/i386/pxelinux.0";
> /etc/ltsp/dhcpd.conf:#       option root-path "172.31.100.254:
> /opt/ltsp/ppc"**;
> /etc/ltsp/dracut/sysconfig-**mkinitrd:rootdev="192.168.0.**
> 254:/opt/ltsp/i386"
> /etc/ltsp/dracut/sysconfig-**dracut-skip-first-time:# This file is
> deleted by chroot-creator kickstart prior to ltsp-rewrap-latest-kernel
> /etc/ltsp/dracut/sysconfig-**network:HOSTNAME=ltspclient
> /etc/ltsp/dracut/ltsp-**postinst.d:[ ! -e /etc/ltsp_chroot ] && exit 0
> /etc/ltsp/dracut/ltsp-**postinst.d:  ln -sf elf-$1.img /boot/elf.ltsp
> /etc/ltsp/dracut/ltsp-**postinst.d:  ln -sf wraplinux-nbi-$1.img
> /boot/wraplinux-nbi.ltsp
> /etc/ltsp/dracut/ltsp-**postinst.d:# Symlink vmlinuz.ltsp and initrd.ltsp
> and set permissions for tftp server
> /etc/ltsp/dracut/ltsp-**postinst.d:ln -sf vmlinuz-$1 /boot/vmlinuz.ltsp
> /etc/ltsp/dracut/ltsp-**postinst.d:ln -sf $INITRD /boot/initrd.ltsp
> /etc/ltsp/nbdswapd.conf:**SWAPDIR=/var/lib/ltsp/**swapfiles
> /etc/lvm/archive/vg_ltsp_**00000-998910363.vg:creation_**host = "
> ltsp.MYSERVER.com" # Linux ltsp.MYSERVER.com 2.6.32-279.el6.x86_64 #1 SMP
> Fri Jun 22 12:19:21 UTC 2012 x86_64
> /etc/lvm/archive/vg_ltsp_**00000-998910363.vg:vg_ltsp {
> /etc/lvm/archive/vg_ltsp_**00000-998910363.vg<http://vg_ltsp_00000-998910363.vg>:
> creation_host = "ltsp.MYSERVER.com"
> /etc/lvm/archive/vg_ltsp_**00000-998910363.vg<http://vg_ltsp_00000-998910363.vg>:
> creation_host = "ltsp.MYSERVER.com"
> /etc/lvm/archive/vg_ltsp_**00000-998910363.vg<http://vg_ltsp_00000-998910363.vg>:
> creation_host = "ltsp.MYSERVER.com"
> /etc/lvm/backup/vg_ltsp:**creation_host = "ltsp.MYSERVER.com"     # Linux
> ltsp.MYSERVER.com 2.6.32-279.el6.x86_64 #1 SMP Fri Jun 22 12:19:21 UTC
> 2012 x86_64
> /etc/lvm/backup/vg_ltsp:vg_**ltsp {
> /etc/lvm/backup/vg_ltsp:                        creation_host = "
> ltsp.MYSERVER.com"
> /etc/lvm/backup/vg_ltsp:                        creation_host = "
> ltsp.MYSERVER.com"
> /etc/lvm/backup/vg_ltsp:                        creation_host = "
> ltsp.MYSERVER.com"
> /etc/mtab:/dev/mapper/vg_ltsp-**lv_root / ext4 rw 0 0
> /etc/mtab:/dev/mapper/vg_ltsp-**lv_home /home ext4 rw 0 0
> /etc/printcap:Mustavalkoinen_**[email protected]<printcap%[email protected]>
> |**Mustavalkoinen_uusi:rm=ltsp.**MYSERVER.com:rp=Mustavalkoinen**
> [email protected] <[email protected]>:
> /etc/printcap:CLP-510|Samsung CLP-510:rm=ltsp.MYSERVER.com:r**p=CLP-510:
> /etc/printcap:[email protected].**100.254 <printcap%[email protected]>|Samsung
> CLP-510:rm=ltsp.MYSERVER.com:r**[email protected]:
> /etc/printcap:[email protected].**0.11 <printcap%[email protected]>|Samsung
> CLP-510:rm=ltsp.MYSERVER.com:r**[email protected]:
> /etc/printcap:Colorlaser|**Colorlaser:rm=ltsp.MYSERVER.**
> com:rp=Colorlaser:
> /etc/printcap:Colorlaser@172.**31.100.254<printcap%[email protected]>
> |Colorlaser:rm=ltsp.**MYSERVER.com:rp=Colorlaser@**172.31.100.254<[email protected]>
> :
> /etc/printcap:Colorlaser@192.**168.0.11<printcap%[email protected]>
> |Colorlaser:rm=ltsp.**MYSERVER.com:rp=Colorlaser@**192.168.0.11<[email protected]>
> :
> /etc/printcap:Mustavalkoinen_**uusi|Mustavalkoinen_uusi:rm=**
> ltsp.MYSERVER.com:rp=**Mustavalkoinen_uusi:
> /etc/printcap:Mustavalkoinen_**[email protected]<printcap%[email protected]>
> |**Mustavalkoinen_uusi:rm=ltsp.**MYSERVER.com:rp=Mustavalkoinen**
> [email protected] <[email protected]>:
> /etc/printcap:NewColorLaser|**NewColorLaser:rm=ltsp.**
> MYSERVER.com:rp=NewColorLaser:
> /etc/printcap:NewColorLaser@**172.31.100.254<printcap%[email protected]>
> |NewColorLaser:**rm=ltsp.MYSERVER.com:rp=NewCol**[email protected]<[email protected]>
> :
> /etc/printcap:NewColorLaser@**192.168.0.11<printcap%[email protected]>
> |NewColorLaser:rm=**ltsp.MYSERVER.com:rp=NewColorL**[email protected]<[email protected]>
> :
> /etc/rc0.d/K35ltsp-dhcpd:# Provides: ltsp-dhcpd
> /etc/rc0.d/K35ltsp-dhcpd:# config: /etc/ltsp/dhcpd.conf
> /etc/rc0.d/K35ltsp-dhcpd:**lockfile=/var/lock/subsys/**ltsp-dhcpd
> /etc/rc0.d/K35ltsp-dhcpd:**pidfile=/var/run/ltsp-dhcpd.**pid
> /etc/rc0.d/K35ltsp-dhcpd:[ -f /etc/sysconfig/ltsp-dhcpd ] && .
> /etc/sysconfig/ltsp-dhcpd
> /etc/rc0.d/K35ltsp-dhcpd:    echo "/etc/ltsp/dhcpd.conf"
> /etc/rc0.d/K35ltsp-dhcpd:    echo -n "Starting ltsp-$prog:"
> /etc/rc0.d/K35ltsp-dhcpd:    if [ -e /etc/ltsp/DELETE-ME-WHEN-DONE-**need-to-copy-sshkeys
> ]; then
> /etc/rc0.d/K35ltsp-dhcpd:        /usr/sbin/ltsp-update-sshkeys
> /etc/rc0.d/K35ltsp-dhcpd:        rm -f /etc/ltsp/DELETE-ME-WHEN-DONE-**
> need-to-copy-sshkeys
> /etc/rc0.d/K35ltsp-dhcpd:    echo -n "Shutting down ltsp-$prog:"
>
> Then we get the same over and over again. I left most of the repeating
> lines away.
>
> /etc/rc1.d/K35ltsp-dhcpd:# Provides: ltsp-dhcpd
> /etc/rc2.d/K35ltsp-dhcpd:# Provides: ltsp-dhcpd
> /etc/rc3.d/K35ltsp-dhcpd:# Provides: ltsp-dhcpd
> /etc/rc4.d/K35ltsp-dhcpd:# Provides: ltsp-dhcpd
> /etc/rc5.d/K35ltsp-dhcpd:# Provides: ltsp-dhcpd
> /etc/rc6.d/K35ltsp-dhcpd:# Provides: ltsp-dhcpd
> /etc/rc.d/rc1.d/K35ltsp-dhcpd:**# Provides: ltsp-dhcpd
> /etc/rc.d/rc3.d/K35ltsp-dhcpd:**# Provides: ltsp-dhcpd
> /etc/rc.d/rc6.d/K35ltsp-dhcpd:**# Provides: ltsp-dhcpd
> /etc/rc.d/rc4.d/K35ltsp-dhcpd:**# Provides: ltsp-dhcpd
> /etc/rc.d/rc2.d/K35ltsp-dhcpd:**# Provides: ltsp-dhcpd
> /etc/rc.d/rc5.d/K35ltsp-dhcpd:**# Provides: ltsp-dhcpd
> /etc/rc.d/init.d/ltsp-dhcpd:# Provides: ltsp-dhcpd
> /etc/rc.d/rc0.d/K35ltsp-dhcpd:**# Provides: ltsp-dhcpd
> /etc/rc.d/rc0.d/K35ltsp-dhcpd:**# config: /etc/ltsp/dhcpd.conf
> /etc/rc.d/rc0.d/K35ltsp-dhcpd:**lockfile=/var/lock/subsys/**ltsp-dhcpd
> /etc/rc.d/rc0.d/K35ltsp-dhcpd:**pidfile=/var/run/ltsp-dhcpd.**pid
> /etc/rc.d/rc0.d/K35ltsp-dhcpd:**[ -f /etc/sysconfig/ltsp-dhcpd ] && .
> /etc/sysconfig/ltsp-dhcpd
> /etc/rc.d/rc0.d/K35ltsp-dhcpd:    echo "/etc/ltsp/dhcpd.conf"
> /etc/rc.d/rc0.d/K35ltsp-dhcpd:    echo -n "Starting ltsp-$prog:"
> /etc/rc.d/rc0.d/K35ltsp-dhcpd:    if [ -e /etc/ltsp/DELETE-ME-WHEN-DONE-**need-to-copy-sshkeys
> ]; then
> /etc/rc.d/rc0.d/K35ltsp-dhcpd: /usr/sbin/ltsp-update-sshkeys
> /etc/rc.d/rc0.d/K35ltsp-dhcpd:        rm -f /etc/ltsp/DELETE-ME-WHEN-DONE-
> **need-to-copy-sshkeys
> /etc/rc.d/rc0.d/K35ltsp-dhcpd:    echo -n "Shutting down ltsp-$prog:"
>
> /etc/sysconfig/network-**scripts/ifcfg-ltspbr0:# Put this into
> /etc/sysconfig/network-**scripts/ifcfg-ltspbr0
> /etc/sysconfig/network-**scripts/ifcfg-ltspbr0:# Warning: Deleting
> ifcfg-ltspbr0 alone to disable ltspbr0 will cause you
> /etc/sysconfig/network-**scripts/ifcfg-ltspbr0:# ltsp-server package.
> /etc/sysconfig/network-**scripts/ifcfg-ltspbr0:# Comment out these two
> lines to disable ltspbr0.
> /etc/sysconfig/network-**scripts/ifcfg-ltspbr0:DEVICE=**ltspbr0
> /etc/sysconfig/network-**scripts/ifcfg-eth0:BRIDGE="**ltspbr0"
> Binary file /etc/sysconfig/network-**scripts/k12linux-release-5.2.**17-1.el6.x86_64
> matches
> /etc/sysconfig/network-**scripts/ifcfg-ltspbr0~:# Put this into
> /etc/sysconfig/network-**scripts/ifcfg-ltspbr0
> /etc/sysconfig/network-**scripts/ifcfg-ltspbr0~:# Warning: Deleting
> ifcfg-ltspbr0 alone to disable ltspbr0 will cause you
> /etc/sysconfig/network-**scripts/ifcfg-ltspbr0~:# ltsp-server package.
> /etc/sysconfig/network-**scripts/ifcfg-ltspbr0~:# Comment out these two
> lines to disable ltspbr0.
> /etc/sysconfig/network-**scripts/ifcfg-ltspbr0~:DEVICE=**ltspbr0
> /etc/sysconfig/network-**scripts/ifcfg-ltspbr0.rpmsave:**# Put this into
> /etc/sysconfig/network-**scripts/ifcfg-ltspbr0
> /etc/sysconfig/network-**scripts/ifcfg-ltspbr0.rpmsave:**# Warning:
> Deleting ifcfg-ltspbr0 alone to disable ltspbr0 will cause you
> /etc/sysconfig/network-**scripts/ifcfg-ltspbr0.rpmsave:**# ltsp-server
> package.
> /etc/sysconfig/network-**scripts/ifcfg-ltspbr0.rpmsave:**# Comment out
> these two lines to disable ltspbr0.
> /etc/sysconfig/network-**scripts/ifcfg-ltspbr0.rpmsave:**DEVICE=ltspbr0
> /etc/sysconfig/network-**scripts/ifcfg-eth0~:BRIDGE="**ltspbr0"
> /etc/sysconfig/network:**HOSTNAME=ltsp.MYSERVER.com
> /etc/xinetd.d/nbdrootd: server_args     = /opt/ltsp/images/i386.img
> /etc/xinetd.d/nbdrootd.**rpmsave: server_args     =
> /opt/ltsp/images/i386.img
>
> Looking at these lines I can't see any problems.
>
>
> Kenneth
>
>
>> and see where ltsp is referenced.
>>
>> Also do a
>>
>>
>> and make sure the you get something like:
>> nfsd                  274672  13
>> auth_rpcgss            48594  1 nfsd
>> nfs_acl                12741  1 nfsd
>> lockd                  93540  1 nfsd
>> sunrpc                256499  29 nfsd,auth_rpcgss,lockd,nfs_acl
>>
>>
>> If no nfsd, then BINGO! Just run modprobe nfsd and service nfsd restart
>>
>>
>>
>>
>>
> ______________________________**_________________
> K12OSN mailing list
> [email protected]
> https://www.redhat.com/**mailman/listinfo/k12osn<https://www.redhat.com/mailman/listinfo/k12osn>
> For more info see <http://www.k12os.org>
>



-- 
-- 
James P. Kinney III
*
*Every time you stop a school, you will have to build a jail. What you gain
at one end you lose at the other. It's like feeding a dog on his own tail.
It won't fatten the dog.
- Speech 11/23/1900 Mark Twain
*
http://electjimkinney.org
http://heretothereideas.blogspot.com/
*

_______________________________________________
K12OSN mailing list
[email protected]
https://www.redhat.com/mailman/listinfo/k12osn
For more info see <http://www.k12os.org>