Re: Has performance improved?

measuring the improvement in performance is multidimensional
You cannot look at the number of request Grinder is sending and calculate
the mean time since grinder will execute all the test that you have asked
for unless and until you have put some checks.

in my company we have CA-wily which gives huge amount of information which
looks a far cry from your situation.

Few things come to my mind looking in your situation

1) Run your test for fixed amount of time on A & B seprately  which same
number of threads lets say 15 minutes
 Order your scripts component wise eg logon logout ...

2) Check in databse or logs for number of successful logons .they should be
same or increased for a than b...  similary target each component where
code changes have been done for optimization ....


You should know what changes have been done and in which functionality ...
i believe they have optimized the business logic and queries

To be noted that sending more number of request to the BE can be counter
productive as well since at times tables are not optimized and contention
increases .... so a change which dev team thinks is an improvement can be a
hassle ....however this is where these kinds of tools help ....

For satisfying the management use this plugin ...
http://track.sourceforge.net/ .. to generate fancy reports

On Tue, Dec 2, 2014 at 5:30 PM, Zulu Zulu <[email protected]> wrote:

> Hi All,
>
> I spent three months in learning & implementing this wonderful tool in my
> organization.
> I recorded the scripts for two different builds (A and B) using TCPProxy,
> modified according to my requirements, ran it and collected the two
> different logs. The dev team has made lots of changes in the application to
> improve the performance of our application (which is build B). Now, the dev
> along with the higher management wants to know whether the application
> performance has actually improved or not. I proposed the following method
> which got rejected
>
>      * Add the average mean time of all requests for each page for both
> builds A & B and compare them. They rejected this outright saying the
> builds (A & B) may vary with the number of requests in each page.  And
> since I do a sum of the average mean time of all the requests in a page,
> the load time will definitely be higher for the page having higher
> requests. (These requests are actually resource files which in real browser
> will be loaded in parallel).
>
> I'm now in a position where I really could not explain to them whether the
> performance has actually improved or not.
>
> Would really appreciate if someone can guide me on this
>
> Regards,
> Chandiran
>
>
> ------------------------------------------------------------------------------
> Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server
> from Actuate! Instantly Supercharge Your Business Reports and Dashboards
> with Interactivity, Sharing, Native Excel Exports, App Integration & more
> Get technology previously reserved for billion-dollar corporations, FREE
>
> http://pubads.g.doubleclick.net/gampad/clk?id=164703151&iu=/4140/ostg.clktrk
> _______________________________________________
> grinder-use mailing list
> [email protected]
> https://lists.sourceforge.net/lists/listinfo/grinder-use
>
>

------------------------------------------------------------------------------
Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server
from Actuate! Instantly Supercharge Your Business Reports and Dashboards
with Interactivity, Sharing, Native Excel Exports, App Integration & more
Get technology previously reserved for billion-dollar corporations, FREE
http://pubads.g.doubleclick.net/gampad/clk?id=164703151&iu=/4140/ostg.clktrk

_______________________________________________
grinder-use mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/grinder-use