Re: ipoib-cm multiple connection model

Vandana Rao <[email protected]> Tue, 25 Oct 2005 11:18:05 -0700
Newsgroups gmane.ietf.ipoib
Message-ID <[email protected]>
Yes, Jerry is right. This does not have to do with how TCP 
connections are mapped to IB connections but whether there is an 
issue with  multiple active-active IB connections between 2 peers. I 
believe there is none.
-Vandana

At 10:40 AM 10/24/2005, H.K. Jerry Chu wrote:
>I think Dror and Vandana are talking about connection "establishment",
>not how to use multiple connections after they have been established.
>It looks like there are some robustness issues wrt the handshake for
>setting up multiple IB connections.
>
>But I may be wrong of course.
>
>Jerry
>
> >At 08:32 PM 10/21/2005, Bill Strahm wrote:
> >>Let me try to understand what you are worried about:
> >>I am assuming that each TCP connection (5-tuple) can be on its own CM
> >>connection, and not multiplex a single TCP connection over multiple CM
> >>connections.
> >>
> >>Is this your understanding ?
> >>
> >>Now if this is what we are talking about - we don't have a problem.  TCP
> >>only guarantees in order delivery to a single connection - if I have
> >>multiple TCP connections to the same hosts, IP packets can be completely
> >>reordered/jumbled by the intermediate network - and all I am guaranteed
> >>is that each TCP stream will have in order delivery relative to itself.
> >>
> >>I am not aware of any applications where in order IP packet delivery is
> >>required between multiple streams.  If this is the case - it has to be
> >>handled above TCP anyway, as TCP does not make this guarantee.
> >
> >>Comments ?
> >
> >Your understanding is correct.   IP packets can arrive in any order on any
> >interface though all implementations prefer them to arrive close to in
> >order and on the same interface (Ethernet aggregation technology attempts
> >to maintain the same interface is used consistently).  Now, having multiple
> >IB connections between endnode pairs is not an issue - does not matter what
> >VL, path, etc. is taken.  However, ideally, the IP datagrams for a given
> >connection are injected for a given tuple on the same path consistently as
> >this leads to optimal performance - it is not a correctness issue though as
> >ordering is the TCP layer's responsibility.
> >
> >Mike
> >
> >>Bill
> >>
> >>Dror Goldenberg wrote:
> >>
> >>>I think that the current model for multiple connections 
> establishment between
> >>>two peers works well for 1 connection but is broken for more than one
> >>>connection.
> >>>Because of cases where CM packets are dropped or travel on different VLs,
> >>>they
> >>>might get reordered on the way and observed in a different order than
> >>>were originally
> >>>sent. This breaks the current model which assumes that the REQs 
> are sent and
> >>>processed in order.
> >>>
> >>>I think that we need to think of a model which is robust to CM packets
> >>>reordering
> >>>which can be one of:
> >>>- Adding a "channel ID" in the private data. The field goes 0,1,2 and on.
> >>>It helps
> >>>    synchronizing both peers on which is the channel at question now. The
> >>> rest
> >>>    of the decision (per channel) of whether to accept or reject can be
> >>> the same
> >>>    as defined in the draft.
> >>>- Not supporting multiple connections between the same peers.
> >>>
> >>>-Dror
> >>>
> >>>------------------------------------------------------------------------
> >>>
> >>>_______________________________________________
> >>>IPoverIB mailing list
> >>>[email protected]
> >>>https://www1.ietf.org/mailman/listinfo/ipoverib
> >>>
> >>
> >>
> >>
> >>_______________________________________________
> >>IPoverIB mailing list
> >>[email protected]
> >>https://www1.ietf.org/mailman/listinfo/ipoverib
> >
>
>
>_______________________________________________
>IPoverIB mailing list
>[email protected]
>https://www1.ietf.org/mailman/listinfo/ipoverib