Re: Has performance improved?

in my company we have CA-wily which gives huge amount of information which looks a far cry from your situation.

What is CA- wily here?

Regards,

Chandiran

On Dec 3, 2014 1:19 AM, Adil qureshi <[email protected]> wrote:

measuring the improvement in performance is multidimensional

You cannot look at the number of request Grinder is sending and calculate the mean time since grinder will execute all the test that you have asked for unless and until you have put some checks.

in my company we have CA-wily which gives huge amount of information which looks a far cry from your situation.

Few things come to my mind looking in your situation

1) Run your test for fixed amount of time on A & B seprately which same number of threads lets say 15 minutes

Order your scripts component wise eg logon logout ...

2) Check in databse or logs for number of successful logons .they should be same or increased for a than b... similary target each component where code changes have been done for optimization ....

You should know what changes have been done and in which functionality ... i believe they have optimized the business logic and queries

To be noted that sending more number of request to the BE can be counter productive as well since at times tables are not optimized and contention increases .... so a change which dev team thinks is an improvement can be a hassle ....however this is where these kinds of tools help ....

For satisfying the management use this plugin ... http://track.sourceforge.net/ .. to generate fancy reports

On Tue, Dec 2, 2014 at 5:30 PM, Zulu Zulu <[email protected] > wrote:

Hi All,

I spent three months in learning & implementing this wonderful tool in my organization.

I recorded the scripts for two different builds (A and B) using TCPProxy, modified according to my requirements, ran it and collected the two different logs. The dev team has made lots of changes in the application to improve the performance of our application (which is build B). Now, the dev along with the higher management wants to know whether the application performance has actually improved or not. I proposed the following method which got rejected

* Add the average mean time of all requests for each page for both builds A & B and compare them. They rejected this outright saying the builds (A & B) may vary with the number of requests in each page. And since I do a sum of the average mean time of all the requests in a page, the load time will definitely be higher for the page having higher requests. (These requests are actually resource files which in real browser will be loaded in parallel).

I'm now in a position where I really could not explain to them whether the performance has actually improved or not.

Would really appreciate if someone can guide me on this

Regards,

Chandiran

------------------------------------------------------------------------------

Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server

from Actuate! Instantly Supercharge Your Business Reports and Dashboards

with Interactivity, Sharing, Native Excel Exports, App Integration & more

Get technology previously reserved for billion-dollar corporations, FREE

http://pubads.g.doubleclick.net/gampad/clk?id=164703151&iu=/4140/ostg.clktrk
_______________________________________________

grinder-use mailing list

[email protected]

https://lists.sourceforge.net/lists/listinfo/grinder-use

------------------------------------------------------------------------------
Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server
from Actuate! Instantly Supercharge Your Business Reports and Dashboards
with Interactivity, Sharing, Native Excel Exports, App Integration & more
Get technology previously reserved for billion-dollar corporations, FREE
http://pubads.g.doubleclick.net/gampad/clk?id=164703151&iu=/4140/ostg.clktrk

_______________________________________________
grinder-use mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/grinder-use