[axis2-1.6.1] how to configire JAX-WS MTOM client / service programmatically

Hi Martin é all

 

I have found that a SOAPBinding.java allows i.e.

isMTOMEnabled()  

setMTOMEnabled(true) 

setMTOMThreshold(2048);

 

will check what the threshold value shows on effects and maybe side effects on either side and applications,

 

BUT

Where and how can I select that Transfer-Encoding is changed from chunked to binary for a JAX-WS Annotation based client and for a service by program control.

Doing so a) by configuration or b) programmatic is it guaranteed that only the service doing so is configured.

 

Note: a JAX-WS does not need a service.xml, so configuring the transport on a per-service-base for a given service using service.xml is a no-go

 

So how can I configure my transport used in my JAX-WS client / JAX-WS service programmatically?

 

again:

if each clinet / servide has a Axis2.xml is it by definition assured that such type of "global configuration" are not overriding among already configured clients/service

 

i.e. we have only 1 axis2 engine running; 

setting transfer encoding to chunked for webservice1 will transfer encoding binary for webservice2 also override transfer-encoding chunked for webservice1?

 

are all configurations made in one of the many axis2.xmls influencing all web-services-configurations or only the on for which it is delivered in /WEB-INF/conf ?

 

Josef 

 

 

Von: Martin Gainty [mailto:[email protected]] 
Gesendet: Freitag, 19. April 2013 00:36
An: [email protected]
Betreff: RE: AW: AW: [axis2-1.6.1] java MTOM client very slow compared to .NET WCF client

 

ISO8859-1 is the standard for Latin based languages..AFAIK ISO8859-1 Character Set should *not* have an impact..
I remember the *FUN* we experienced at the bank while  porting our ISO8859-1  based Axis Services and client stubs to 'American' UTF-8

One more thing that (I thought of while reading your response) This *sounds* like you may be using Chunked-encoding  (instead of binary)
The SOAP-Envelope is *supposed* to be reconstructed from the fragments sent to Servlet Connector and handed to the Axis Service *intact*

Turn off chunked-encoding on both sides and set Transfer-Encoding to binary in  .\WEB-INF\conf\Axis2.xml  e.g.

<transportSender name="http" class="org.apache.axis2.transport.http.CommonsHTTPTransportSender">
   ....
   <parameter name="Transfer-Encoding">binary</parameter>
.....
</transportSender>

Martin 
______________________________________________ 
Verzicht und Vertraulichkeitanmerkung

Diese Nachricht ist vertraulich. Sollten Sie nicht der vorgesehene Empfaenger sein, so bitten wir hoeflich um eine Mitteilung. Jede unbefugte Weiterleitung oder Fertigung einer Kopie ist unzulaessig. Diese Nachricht dient lediglich dem Austausch von Informationen und entfaltet keine rechtliche Bindungswirkung. Aufgrund der leichten Manipulierbarkeit von E-Mails koennen wir keine Haftung fuer den Inhalt uebernehmen.

Ce message est confidentiel et peut être privilégié. Si vous n'êtes pas le destinataire prévu, nous te demandons avec bonté que pour satisfaire informez l'expéditeur. N'importe quelle diffusion non autorisée ou la copie de ceci est interdite. Ce message sert à l'information seulement et n'aura pas n'importe quel effet légalement obligatoire. Étant donné que les email peuvent facilement être sujets à la manipulation, nous ne pouvons accepter aucune responsabilité pour le contenu fourni.



 

________________________________

Subject: AW: AW: [axis2-1.6.1] java MTOM client very slow compared to .NET WCF client
Date: Thu, 18 Apr 2013 10:02:22 +0200
From: [email protected]
To: [email protected]

Hi Martin

 

let me ask and comment on your response.

 

Von: Martin Gainty [mailto:[email protected]] 
Gesendet: Donnerstag, 18. April 2013 00:43
An: [email protected]
Betreff: RE: AW: [axis2-1.6.1] java MTOM client very slow compared to .NET WCF client

 

Goddag Josef
 
\r\n is the cuplrit?

++ I can see in my log file (I've sent) that some xml soap records end in [\r][\n]
I can further see that most remaining binary data breaks up the stream at [\n]
I think if the transfer mode is real binary [\r][\n] should never have any impact.

Any chance of doing dos2unix on all the files for your service

what do you mean with that? which files would need treatment?

javac  -Dline.separator='\r' *.java

are you saying with that, that my maven build for my project must include somehow this 
line separator definition when it comes to a maven compile? How do I do that?

jar -Dline.separator='\r' *.aar

are you saying that maven builds must package my are using this line separator; again - how do I do that. 
Isn't this a maven-plugin issue?

redeploy with admin tool

OK

and rerun the container with java -Dline.separator='\r' ContainerBootstrap.jar

Do you refer to the Apache Jakarta Tomcat on OpenVMS here. I have problems with my client code only, kept on NetBeans 7.2.1 in JAVA. There my project, made of a client and a service part is built using maven. 

Is there any negotiation going on between client and server? Does ISO8859-1 somewhere above in the log file generate an indication that \r\n shall be used? But I think that should not lead MTOM to be non binary transparent. again - it cannot be a server/service issue because my .NET WCF 4.0 client runs fine/fast.  But I think it is a question of what binary transparency under MTOM means and how it potentially can be that a sub module makes it no longer binary transparent. MTOM and binary transparency shall never look a t \r \n or just \n as this is just a pattern in a stream which can occur very frequently. As this client was running fine before, there must be a module, a jar coming in from a maven repo which gave me this non binary transparency. Intentionally I was never fiddling around with any such issues as this would not be "binary transparency" unless I run into this performance problems.

and retry..

anyway good hints about a generic problem. 


Viel Gluck!
Martin 

Thanks and regards

Josef


______________________________________________ 

Vertraulichkeit und Datenschutz

 
Diese Nachricht ist vertraulich. Sollten Sie nicht der vorgesehene Empfaenger sein, so bitten wir hoeflich um eine Mitteilung. Jede unbefugte Weiterleitung oder Fertigung einer Kopie ist unzulaessig. Diese Nachricht dient lediglich dem Austausch von Informationen und entfaltet keine rechtliche Bindungswirkung. Aufgrund der leichten Manipulierbarkeit von E-Mails koennen wir keine Haftung fuer den Inhalt uebernehmen.

  

________________________________

Subject: AW: [axis2-1.6.1] java MTOM client very slow compared to .NET WCF client
Date: Wed, 17 Apr 2013 12:21:08 +0200
From: [email protected]
To: [email protected]

Hi Martin,

 

turning on DEBUG logging 

 

#--- logging to CL_FAP

log4j.logger.org.apache.commons.httpclient=DEBUG, CONS, CL_FAP

log4j.additivity.org.apache.commons.httpclient=false

 

log4j.logger.httpclient.wire=DEBUG, CONS, CL_FAP

log4j.additivity.httpclient.wire=false

 

shows that I have in fact a binary encoding for the content 

 

2013-04-17 11:42:30,194

      DEBUG

      httpclient.wire.content

      >> "2364[\r][\n]"

 

2013-04-17 11:42:30,194

      DEBUG

      httpclient.wire.content

      >> "--MIMEBoundary_a4d8953e766f4ad5afd4dbda9ddf2e0e0717f1c793e08ff7[\r][\n]"

 

2013-04-17 11:42:30,194

      DEBUG

      httpclient.wire.content

      >> "Content-Type: application/xop+xml; charset=UTF-8; type="application/soap+xml"[\r][\n]"

 

2013-04-17 11:42:30,194

      DEBUG

      httpclient.wire.content

      >> "Content-Transfer-Encoding: binary[\r][\n]"

 

2013-04-17 11:42:30,194

      DEBUG

      httpclient.wire.content

      >> "Content-ID: <[email protected]>[\r][\n]"

 

2013-04-17 11:42:30,194

      DEBUG

      httpclient.wire.content

      >> "[\r][\n]"

 

2013-04-17 11:42:30,194

      DEBUG

      httpclient.wire.content

      >> "<?xml version='1.0' encoding='UTF-8'?><soapenv:Envelope xmlns:soapenv="http://www.w3.org/2003/05/soap-envelope"><soapenv:Body><sendImage xmlns="http://ch/axa/spezpla/fs1/"><input><imageData><xop:Include xmlns:xop="http://www.w3.org/2004/08/xop/include" href="cid:[email protected]"/></imageData></input></sendImage></soapenv:Body></soapenv:Envelope>[\r][\n]"

 

and it shows octet stream but breaks the stream up into pieces em up at each "\r\n"

 

2013-04-17 11:42:30,194

      DEBUG

      httpclient.wire.content

      >> "--MIMEBoundary_a4d8953e766f4ad5afd4dbda9ddf2e0e0717f1c793e08ff7[\r][\n]"

 

2013-04-17 11:42:30,194

      DEBUG

      httpclient.wire.content

      >> "Content-Type: application/octet-stream[\r][\n]"

 

2013-04-17 11:42:30,194

      DEBUG

      httpclient.wire.content

      >> "Content-Transfer-Encoding: binary[\r][\n]"

but then the content breaks up into pices at each "\n"

 

That is why I get such a lousy performance!


WHY

 

Please remember: some weeks ago, my example was fast running as well under a JAVA Client. 

So I expect a new maven build getting down some to me yet unknown jar makes this happen

at the java client side awhile at the WCF .NET client side all runs at full speed and transfers 25MB 

asci2.zip in 5 to 8 seconds to a remote node.

 

full log (until I stopped the apps) is attached.

 

Josef

 

Von: Martin Gainty [mailto:[email protected]] 
Gesendet: Dienstag, 16. April 2013 11:54
An: [email protected]
Betreff: RE: [axis2-1.6.1] java MTOM client very slow compared to .NET WCF client

 

Goddag Josef

Trying to narrow down the environments in play here
NetBeans
AxisClient/AxisService
Network Path
 
what happens when you run Axis client outside of NB?
If your MTOM client achieves consistent rapid results you know NB plugin is at fault

On the other hand if you port the same Axis Client to another box
clean the arp cache and run the AxisClient repeatedly 
If you achieve consistent rapid results you know your Network path (Arp cache?) is at fault on  box 1

If there is consistent degradation on both boxes over a period of time the problem is with AxisClient
and or Axis Service

Apologies as this is Not an answer but a means to narrow down the culprit

Viel Gluck,
Martin 
______________________________________________ 
Verzicht und Vertraulichkeitanmerkung

Diese Nachricht ist vertraulich. Sollten Sie nicht der vorgesehene Empfaenger sein, so bitten wir hoeflich um eine Mitteilung. Jede unbefugte Weiterleitung oder Fertigung einer Kopie ist unzulaessig. Diese Nachricht dient lediglich dem Austausch von Informationen und entfaltet keine rechtliche Bindungswirkung. Aufgrund der leichten Manipulierbarkeit von E-Mails koennen wir keine Haftung fuer den Inhalt uebernehmen.

  

________________________________

Subject: [axis2-1.6.1] java MTOM client very slow compared to .NET WCF client
Date: Mon, 15 Apr 2013 20:54:30 +0200
From: [email protected]
To: [email protected]

Hi all,

I've developed a MTOM Client server apps sending up- and downloading larger files.

Doing some performance testing 

I toke 25 MB files and did some up and downloads routinely using dispatch and proxy approaches.

The outcome was very nice, 

I had a java client working uploading axis2.zip (25MB) 

to a OpenVMS Java web service server within 5 to 8 seconds.

Generating a stub in Visual Studio delivered me the same. A very performing CL/SV transfer aps, 

and the Vista task Manager showed close to 100% network utilization.

Since a few days however, this is no longer the case for the java client, 

the network utilization has degraded to 1 to 2% and now the same transfer takes 

4 to 5 minutes. Unacceptable.

At the same time absolute no problem and close to 100% network utilization if I run my Visual Studio Test Suite of proxy based up and down load tests.

If I changed something on my client side java code, that would be unintentionally. ! J

But any hint where I can start to hunt this phenomena would be very appreciated?

I am launching my java client within NetBeans 7.2.1 for debugging and testing reasons, 

also it the past it was working so nicely.

There is maybe one point I can make: 

When I used the NB debugger, I could see the

 "MultiThreadedHttpConnectionManager" doing some cleanup 'running' forever.

What makes him running?

Fiddling a bit around within the debug-view, 

I have seen an immediate Network utilization going up to 100% 

when this manager was suspended for a moment.

as I have no clue what has happen then or how to catch it any hints are very welcome.

Any hints welcome.

Regards

Josef


--------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]