Re: Proxmox and NetApp NFS volumes
tmac <[email protected]> Fri, 7 Nov 2025 22:32:01 -0500
| Newsgroups | gmane.comp.hardware.netapp |
|---|---|
| Message-ID | <CAL9X-_FoxfxGLBc0sv4rvMVN+wmW4tzbAEunky03EDW39ffLfQ@mail.gmail.com> |
--===============5666697357106323445== Content-Type: multipart/alternative; boundary="00000000000096d6ae06430cf12b" --00000000000096d6ae06430cf12b Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable https://docs.netapp.com/us-en/netapp-solutions-virtualization/proxmox/index= .html# Sent from Gmail Mobile. On Fri, Nov 7, 2025 at 7:52=E2=80=AFAM Florian Schmid via toasters < [email protected]> wrote: > > > > ---------- Forwarded message ---------- > From: Florian Schmid <[email protected]> > To: toasters <[email protected]> > Cc: > Bcc: > Date: Fri, 7 Nov 2025 12:52:00 +0000 > Subject: Proxmox and NetApp NFS volumes > Hello, > > we are moving to Proxmox now and I would need some help from you. > > In the past, I have always used NFSv3, because in our KVM environment, we > had issues with NFSv4.1 and head fail-overs -> VMs got paused > I think also VMware had such issues. Problem I think is that NFSv4.1 is > stateful and on a head fail-over, this state got lost. > > I'm on 9.14.1. > > As NFSv3 is quite old and Proxmox is using a newer kernel, I wanted to > ask, if someone of you have experience with Proxmox and NFS volumes from > NetApp. > > Do you use special mount options? > Is NFSv4.2 working fine with head fail-overs -> VMs are not pausing or > don't even notice it? > We have 25 Gbit network interfaces as a bond to our NetApp, are here any > special options to configure? > Are you using on VM disks "cache=3Dnone" or something different? > > Unfortunately, Proxmox has not much experience with NetApp either, so tha= t > I hope someone from you can help me here to create a good, fast and stabl= e > setup. > > This is how a mount point looks like with default options from Proxmox an= d > NFSv3: > *nfs-root-01:/pve_DC_nfs_root_01 /mnt/pve/nfs-v3-root-01 nfs > rw,relatime,vers=3D3,rsize=3D65536,wsize=3D65536,namlen=3D255,hard,proto= =3Dtcp,timeo=3D600,retrans=3D2,sec=3Dsys,mountaddr=3D172.16.4.3,mountvers= =3D3,mountport=3D635,mountproto=3Dudp,local_lock=3Dnone,addr=3D172.16.4.3 > 0 0* > > This is from our old virtualization oVirt: > *nfs-root-01:/oVirt_DC_nfs_root_01 > /rhev/data-center/mnt/nfs-root-01:_oVirt__DC__nfs__root__01 nfs > rw,relatime,vers=3D3,rsize=3D65536,wsize=3D65536,namlen=3D255,soft,nolock= ,nosharecache,proto=3Dtcp,timeo=3D600,retrans=3D6,sec=3Dsys,mountaddr=3D172= .16.4.3,mountvers=3D3,mountport=3D635,mountproto=3Dudp,local_lock=3Dall,add= r=3D172.16.4.3 > 0 0* > > > - oVirt was using soft, but this I think, I shouldn't use on Proxmox > and instead use hard. oVirt had a special watchdog for this. > > > Best regards, > Florian > > > > > ---------- Forwarded message ---------- > From: Florian Schmid via toasters <[email protected]> > To: toasters <[email protected]> > Cc: > Bcc: > Date: Fri, 7 Nov 2025 12:52:00 +0000 > Subject: Proxmox and NetApp NFS volumes > _______________________________________________ > toasters mailing list -- [email protected] > To unsubscribe send an email to [email protected] > --00000000000096d6ae06430cf12b Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable <div><div><a href=3D"https://docs.netapp.com/us-en/netapp-solutions-virtual= ization/proxmox/index.html#">https://docs.netapp.com/us-en/netapp-solutions= -virtualization/proxmox/index.html#</a></div><br clear=3D"all"><br clear=3D= "all"><div><div dir=3D"ltr" class=3D"gmail_signature" data-smartmail=3D"gma= il_signature">Sent from Gmail Mobile.</div></div></div><div><br></div><div>= <br><div class=3D"gmail_quote gmail_quote_container"><div dir=3D"ltr" class= =3D"gmail_attr">On Fri, Nov 7, 2025 at 7:52=E2=80=AFAM Florian Schmid via t= oasters <<a href=3D"mailto:[email protected]">[email protected]= eaparty.net</a>> wrote:<br></div><blockquote class=3D"gmail_quote" style= =3D"margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-style:solid;= padding-left:1ex;border-left-color:rgb(204,204,204)"><br><br><br>----------= Forwarded message ----------<br>From:=C2=A0Florian Schmid <<a href=3D"m= ailto:[email protected]" target=3D"_blank">[email protected]</a>><br>T= o:=C2=A0toasters <<a href=3D"mailto:[email protected]" target=3D"_bl= ank">[email protected]</a>><br>Cc:=C2=A0<br>Bcc:=C2=A0<br>Date:=C2= =A0Fri, 7 Nov 2025 12:52:00 +0000<br>Subject:=C2=A0Proxmox and NetApp NFS v= olumes<br> <div dir=3D"ltr"> <div style=3D"font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Cali= bri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)"> Hello,</div> <div style=3D"font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Cali= bri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)"> <br> </div> <div style=3D"font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Cali= bri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)"> we are moving to Proxmox now and I would need some help from you.</div> <div style=3D"font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Cali= bri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)"> <br> </div> <div style=3D"font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Cali= bri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)"> In the past, I have always used NFSv3, because in our KVM environment, we h= ad issues with NFSv4.1 and head fail-overs -> VMs got paused</div> <div style=3D"font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Cali= bri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)"> I think also VMware had such issues. Problem I think is that NFSv4.1 is sta= teful and on a head fail-over, this state got lost.</div> <div style=3D"font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Cali= bri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)"> <br> </div> <div style=3D"font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Cali= bri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)"> I'm on 9.14.1.</div> <div style=3D"font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Cali= bri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)"> <br> </div> <div style=3D"font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Cali= bri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)"> As NFSv3 is quite old and Proxmox is using a newer kernel, I wanted to ask,= if someone of you have experience with Proxmox and NFS volumes from NetApp= .</div> <div style=3D"font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Cali= bri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)"> <br> </div> <div style=3D"font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Cali= bri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)"> Do you use special mount options?</div> <div style=3D"font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Cali= bri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)"> Is NFSv4.2 working fine with head fail-overs -> VMs are not pausing or d= on't even notice it?</div> <div style=3D"font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Cali= bri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)"> We have 25 Gbit network interfaces as a bond to our NetApp, are here any sp= ecial options to configure?</div> <div style=3D"font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Cali= bri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)"> Are you using on VM disks "cache=3Dnone" or something different?<= /div> <div style=3D"font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Cali= bri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)"> <br> </div> <div style=3D"font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Cali= bri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)"> Unfortunately, Proxmox has not much experience with NetApp either, so that = I hope someone from you can help me here to create a good, fast and stable = setup.</div> <div style=3D"font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Cali= bri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)"> <br> </div> <div style=3D"font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Cali= bri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)"> This is how a mount point looks like with default options from Proxmox and = NFSv3:</div> <div style=3D"font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Cali= bri,Helvetica,sans-serif;color:rgb(0,0,0)"> <span style=3D"font-size:10pt;font-family:Aptos,Aptos_EmbeddedFont,Aptos_MS= FontService,Calibri,Helvetica,sans-serif"><i style=3D"font-family:Aptos,Apt= os_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif">nfs-root-= 01:/pve_DC_nfs_root_01 /mnt/pve/nfs-v3-root-01 nfs rw,relatime,vers=3D3,rsi= ze=3D65536,wsize=3D65536,namlen=3D255,hard,proto=3Dtcp,timeo=3D600,retrans= =3D2,sec=3Dsys,mountaddr=3D172.16.4.3,mountvers=3D3,mountport=3D635,mountpr= oto=3Dudp,local_lock=3Dnone,addr=3D172.16.4.3 0 0</i></span></div> <div style=3D"font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Cali= bri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)"> <br> </div> <div style=3D"font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Cali= bri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)"> This is from our old virtualization oVirt:</div> <div style=3D"font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Cali= bri,Helvetica,sans-serif;color:rgb(0,0,0)"> <span style=3D"font-size:10pt;font-family:Aptos,Aptos_EmbeddedFont,Aptos_MS= FontService,Calibri,Helvetica,sans-serif"><i style=3D"font-family:Aptos,Apt= os_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif">nfs-root-= 01:/oVirt_DC_nfs_root_01 /rhev/data-center/mnt/nfs-root-01:_oVirt__DC__nfs_= _root__01 nfs rw,relatime,vers=3D3,rsize=3D65536,wsize=3D65536,namlen=3D255= ,soft,nolock,nosharecache,proto=3Dtcp,timeo=3D600,retrans=3D6,sec=3Dsys,mou= ntaddr=3D172.16.4.3,mountvers=3D3,mountport=3D635,mountproto=3Dudp,local_lo= ck=3Dall,addr=3D172.16.4.3 0 0</i></span></div> <div style=3D"font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Cali= bri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)"> <br> </div> <ul style=3D"margin-top:0px;margin-bottom:0px"> <li style=3D"font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calib= ri,Helvetica,sans-serif;font-size:12pt;list-style-type:"\002794 "= ;;color:rgb(0,0,0)"> <div role=3D"presentation" style=3D"font-family:Aptos,Aptos_EmbeddedFont,Ap= tos_MSFontService,Calibri,Helvetica,sans-serif">oVirt was using soft, but t= his I think, I shouldn't use on Proxmox and instead use hard. oVirt had= a special watchdog for this.</div> </li></ul> <div style=3D"font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Cali= bri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)"> <br> </div> <div style=3D"font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Cali= bri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)"> Best regards,</div> <div style=3D"font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Cali= bri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)"> Florian</div> <div style=3D"font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Cali= bri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)"> <br> </div> </div> <br><br><br>---------- Forwarded message ----------<br>From:=C2=A0Florian S= chmid via toasters <<a href=3D"mailto:[email protected]" targe= t=3D"_blank">[email protected]</a>><br>To:=C2=A0toasters <<= a href=3D"mailto:[email protected]" target=3D"_blank">toasters@teaparty= .net</a>><br>Cc:=C2=A0<br>Bcc:=C2=A0<br>Date:=C2=A0Fri, 7 Nov 2025 12:52= :00 +0000<br>Subject:=C2=A0Proxmox and NetApp NFS volumes<br>______________= _________________________________<br> toasters mailing list -- <a href=3D"mailto:[email protected]" tar= get=3D"_blank">[email protected]</a><br> To unsubscribe send an email to <a href=3D"mailto:[email protected]= arty.net" target=3D"_blank">[email protected]</a><br> </blockquote></div></div> --00000000000096d6ae06430cf12b-- --===============5666697357106323445== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ toasters mailing list -- [email protected] To unsubscribe send an email to [email protected] --===============5666697357106323445==--