Re: comments on draft-kashyap-ipoib-connected-mode-02.txt

Michael Krause <[email protected]> Fri, 10 Dec 2004 12:54:42 -0800
Newsgroups gmane.ietf.ipoib
Message-ID <[email protected]>
At 09:19 AM 12/10/2004, Margaret Wasserman wrote:

>Hi All,
>
>I also have some comments on draft-kashyap-ipoib-connected-mode-02.txt.
>
>I haven't thoroughly reviewed the document, so I may have some further 
>comments later, but in my initial read, one major concern jumped out at me.
>
>If I understand correctly, the reliable connected mode of IPOIB is 
>TCP/IPv6.  Is that correct?

No.  It uses InfiniBand RC or UC to communicate IP datagrams (v4 / v6) 
between connected endnodes.

>If so, I think that you need to carefully consider the issues associated 
>with tunneling TCP inside of TCP.  In particular, I am concerned about 
>this section:
>
>        The default MTU of the IPoIB-CM interface is 2044 octets i.e.
>         2048 octet IPoIB-link MTU minus the 4 octet encapsulation
>         header.
>
>         The connected modes of InfiniBand allow message sizes up to 2^31
>         octets.  Therefore, IPoIB-CM can use a much larger MTU for
>         unicast communication between any two endpoints. At the same
>         time the maximum and/or optimal payload that can be received or
>         sent over an InfiniBand connection is dependent on the
>         implementation, HCA and the resources configured.
>
>Having a larger MTU at the higher-level TCP layer than at the lower-level 
>TCP layer may lead to situations where the upper and lower layers' 
>retransmit timers will both fire at the same time, causing real problems 
>in the case of congestion.
>
>This may happen because bothTCP layers will use the same algorithm (and 
>maybe the same code) for calculating the retransmission time. When a 
>packet is lost, the lower layer's TCP retransmission timer will fire, 
>causing a retransmission of one lower-layer MTU of data (2048 bytes), AND 
>the upper layer's TCP retransmission timer will also fire, causing a 
>retransmission of one upper-layer MTU of data (up to 2^31 bytes).  The 
>lower layer will not recognize that the upper layer's retransmission is 
>duplicate data, so this will result in the transmission of many 2K packets 
>when a single 2K packet is lost.
>
>We may want to talk to the Transport area to determine if there are other 
>issues associated with tunneling TCP inside of TCP/IP.

Rest is based on a misconception as there is only IB below IP and no 
tunneling of TCP over TCP occurs.

Mike


>Thoughts?
>
>Margaret
>
>
>_______________________________________________
>IPoverIB mailing list
>[email protected]
>https://www1.ietf.org/mailman/listinfo/ipoverib

_______________________________________________
IPoverIB mailing list
[email protected]
https://www1.ietf.org/mailman/listinfo/ipoverib