RE: Connected mode draft and retransmit implosion

Vivek Kashyap <[email protected]> Wed, 25 Aug 2004 13:53:39 -0700
Newsgroups gmane.ietf.ipoib
Message-ID <[email protected]>






At 12:30 AM 8/25/2004, Vivek Kashyap wrote:
      On Mon, 23 Aug 2004, Michael Krause wrote:

      > At 06:25 PM 8/13/2004, Fab Tillier wrote:
      > > > From: bill [mailto:[email protected]]
      > > > Sent: Friday, August 13, 2004 5:59 PM
      > > >
      > > > Yes, that is exactly the problem... Both layers retransmitting
      at the
      > > > same time
      > >
      > >While both layers issue retransmits at the same time, the packets
      on the
      > >wire maintain their order.  The first packet sent will be
      delivered first,
      > >with the second queued up behind.  The data will not get
      interleaved.  There
      > >is no way for the retransmitted packet to get delivered first.
      > >
      > > >
      > > > And possibly not recovering for quite a while
      > >
      > >IB recovery is pretty much binary - if an RC QP exceeds its retry
      limit, it
      > >will transition to the error state.  At that point, all processing
      of the
      > >send queue stops and the consumer gets an error completion and an
      async
      > >error notification for that QP.
      > >
      > >I still don't see the harm in TCP retransmitting while IB is also
      > >retransmitting aside from inefficiencies.
      >
      > Given this is a RC QP, the WR are processed in order and must
      complete in
      > order to make forward progress.  As such, the consumer which is
      posting WR
      > can post new or duplicate packets and the underlying QP will not
      see these
      > until it completes the current WR.  As such, IB retransmission and
      consumer
      > retransmission algorithms are orthogonal to one another in all
      respects
      > sans perhaps doing a poor job configuring the associated IB
      retransmission
      > timers as well as the arbitration policies within the fabric such
      that the
      > consumer falls into its retransmission algorithm too often.
      >
      > Mike

      Yes, TCP will not see out of order packets since the underlying layer
      delivers
      in order, reliable data. Also, TCP timers are likely to be much
      longer than
      the RC timers. Therefore, it is quite likely that RC will retransmit
      multiple
      times and recover by the time TCP timers expire.

      As an aside, IPoIB over connected mode is not limited to RC, it
      includes UC
      too. Also, it is IP (which implies UDP, SCTP etc.) over RC or UC.

Hence why I did not state a particular consumer type only that it is
posting to a connected QP.  Whether RC or UC, the processing order remains
the same.  The only difference is the lack of IB ACK as well as Send Credit
management for UC but for this discussion, they are essentially the same
from the consumer's perspective.

Mike_


<VK>
 True... RC/UC are largely indistinuishable in ipoib context.
Vivek
<VK>


______________________________________________
IPoverIB mailing list
[email protected]
https://www1.ietf.org/mailman/listinfo/ipoverib

_______________________________________________
IPoverIB mailing list
[email protected]
https://www1.ietf.org/mailman/listinfo/ipoverib