Re: Apparent performance regression 8.3@ -> 8.4@r255966?

David Wolfskill <[email protected]> Mon, 7 Oct 2013 10:49:29 -0700
Newsgroups gmane.os.freebsd.performance
Message-ID <[email protected]>
On Mon, Oct 07, 2013 at 10:32:57AM -0700, Adrian Chadd wrote:
> On Oct 7, 2013 1:28 PM, "David Wolfskill" <[email protected]> wrote:
> >
> > At work, we have a bunch of machines that developers use to build some
> > software.  The machines presently run FreeBSD/amd64 8.3-STABLE @rxxxxxx
> > (with a few local patches, which have since been committed to stable/8),
> > and the software is built within a 32-bit jail.
> 
> Well, whats the start commit? Xxxxxx isnt all that helpful. :-)

r238914M -- sorry; I got impatient & sent th emessage off before I went
through & plugged in the stuff I meant to plug in later.... :-(

> Once you can establish that, we xan go over the commit logs to see what
> changed.
> 
> Youre building exactly the same software on both, right?

Yes: I have a script that checks out a "sandbox" from the repo, then
tars it up.  Each test iteration then:

* Ensures there is nothing of an old sandbox (directory) around.

* Unpacks the pristine copy of the sandbox.

* Dives into the sandbox & performs a measured build.

* Exits the sandbox (and removes it).

> ....

Here's the other bit I neglected to include:

dwolf-fbsd(9.2-S)[30] /usr/bin/ministat -s baseline test_env
x baseline
+ test_env
+------------------------------------------------------------------------------+
|   xxxxx xx    xxxxxxxx x  xx      x                     +                    |
|xxxxxxxx xx    xxxxxxxx x  xx xxxx x      x    +x        *+ + ++             x|
|       |___________A____________|                                             |
|                                                     |____A____|              |
+------------------------------------------------------------------------------+
    N           Min           Max        Median           Avg        Stddev
x  75       4.91961       6.16419       5.22432     5.2311616    0.20113192
+   7       5.68327       5.94078       5.86111     5.8563686   0.086090721
Difference at 95.0% confidence
        0.625207 +/- 0.153262
        11.9516% +/- 2.92979%
        (Student's t, pooled s = 0.194874)



Peace,
david
-- 
David H. Wolfskill				[email protected]
Taliban: Evil cowards with guns afraid of truth from a 14-year old girl.

See http://www.catwhisker.org/~david/publickey.gpg for my public key.
signature.asc (application/pgp-signature, 196 B)
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.22 (FreeBSD)

iEYEARECAAYFAlJS9CgACgkQmprOCmdXAD22ugCdGUxYzWW+Q63QrNz1seNgIU8j
anYAn0Q7+0yl9fREXDYPW92y8W2+bh53
=5vEF
-----END PGP SIGNATURE-----