RE: Please read - proposed WG termination

Michael Krause <[email protected]> Fri, 02 Sep 2005 15:24:11 -0700
Newsgroups gmane.ietf.ipoib
Message-ID <[email protected]>
At 01:18 PM 9/2/2005, Dror Goldenberg wrote:

> > > In the end, IB HCA implementations can adopt the same
> > techniques as Ethernet
> > > and deliver the same performance as a connected model
> > without the overhead /
>
>The features that you mentioned being added to Ethernet sound to me like 
>things that exist in IB for couple of years now.

As one of the architects of IB, I'm well aware of what IB offers as well as 
Ethernet and where there are technology as well as business issues with 
both.  I'm also aware, as are many other people, that technology 
transitions can take much longer than most predict (I'm perhaps a bit more 
realistic in my time lines than other marketroids / analysts) thus 
customers view a technology problem from a different perspective including 
when it will really be a major issue as opposed to a minor 
deficiency.   Just because Ethernet lacks something today does not mean it 
will not have something when it is required.  Similarly, just because IB 
has something today does not mean that it will be a point of 
differentiation in the long-run.  All technologies live in this paradigm in 
the end.

>BTW, fast link rates weaken the QoS argument regarding jumbo frames. 
>Furthermore, in ipoib-cm, jumboframes won't look like 9KB or 64KB frames 
>on the wire. They will look like 2KB or smaller packets interleaved with 
>the rest of the traffic. So, I don't see any QoS problem for ipoib-cm.

If the implementation is brain dead and arbitration is only done at the 
message level rather than the packet level on a given VL, then there is a 
QoS issue.  As I noted before, jumbo frames have micro benchmark or 
selective workload benefits but due to their higher link residency can 
cause QoS concerns.  Large send off-load as well as IB connected do not 
suffer from such issues as they perform SAR at the link level.

>Reusing the existing Ethernet techniques, e.g. LSO and large receive. 
>Maybe possible, but it's going to take way more than just using the 
>existing ipoib-cm mechanisms in a pure software implementation.

Large send can be implemented entirely in software and local to the 
injection point making it rather trivial to accomplish whille reaping the 
performance benefits.  Large receive generally needs some hardware assist 
to work well but given a large percentage of the protocol off-load 
implementations rely upon firmware for various operations, it will vary as 
to whether there is a legitimate execution problem or not.  The same cannot 
be said for the OS infrastructure changes which is what I and a couple of 
others have touched upon.

> > however connected mode is already available to us in all
> > HCAs. Why not use it as it is ?
>
>I strongly agree. Redeveloping HCA silicon takes a long time. Why
>make people wait for that long period of time, if they can have it
>TODAY ?

The existence of a spec does not mean that people can have it today.  They 
might have a first step but that is not a solution that is viable.  It is 
also not clear whether there is more than one OS that really cares about 
this capability as well.  Certainly I/O gateways can effectively use the 
existing specs just fine.  Are there multiple OS that can support IB in 
connected mode that have network stacks that will work in a sufficiently 
general purpose way that will enable iWARP and IB?  Are there even multiple 
OS interested in this capability at all?  People have already noted that 
Linux is not set up to support all of this today.  Is there a time line 
when people could execute the spec in the OS - not just an add-in 
non-kernel.org module - that would demonstrate it delivers superior value 
compared with just using existing technologies?

Mike

_______________________________________________
IPoverIB mailing list
[email protected]
https://www1.ietf.org/mailman/listinfo/ipoverib