Re: cruisecontrol memory

Hi Mathieu,

I'm in the processes on bringing a Red Hat CruiseControl (version 2.8.4) 
server online.  So far I haven't noticed any problem with memory, however as 
it's a new machine CruiseControl has been stopped and started many time 
while I install various things.

I think the server is ready to be used properly now, so I'll run your 
command below and see what the memory usage is like.  One thing to note, my 
server is only configured to run 4 projects, and only 2 are allowed to run 
at any given time.

Steve

-----Original Message----- 
From: Mathieu Jobin
Sent: Monday, March 19, 2012 2:30 PM
To: [email protected]
Cc: Eric Crepeau
Subject: [Cruisecontrol-user] cruisecontrol memory

Hi !

I've been monitoring memory on the cruisecontrol process for a few months 
already and it grows continuously on every build.

I am basically using a simple ps in a crontab to create a log file with 
memory usage.

( date | tr -d "\n"; ps auxww | grep ^rsoft | grep --color 
cruisecontrol-launcher.*1099$ | awk '{print " -- PID: " $2 ", CPU: " $3 ", 
MEM: " $4}' ) >> $log_file

my log file looks like this...

[rsoft@qcdvbs1050 ~]$ grep "PID" cc_memory.log | head  ; echo ... ; tail 
cc_memory.log
Fri Feb 10 15:25:01 EST 2012 -- PID: 12914, CPU: 1.5, MEM: 3.0
Fri Feb 10 15:26:01 EST 2012 -- PID: 12914, CPU: 1.5, MEM: 3.2
Fri Feb 10 15:27:01 EST 2012 -- PID: 12914, CPU: 1.4, MEM: 3.2
Fri Feb 10 15:28:01 EST 2012 -- PID: 12914, CPU: 1.3, MEM: 3.2
Fri Feb 10 15:29:01 EST 2012 -- PID: 12914, CPU: 1.3, MEM: 3.2
Fri Feb 10 15:30:01 EST 2012 -- PID: 12914, CPU: 1.2, MEM: 3.3
Fri Feb 10 15:31:01 EST 2012 -- PID: 12914, CPU: 1.2, MEM: 3.3
Fri Feb 10 15:32:01 EST 2012 -- PID: 12914, CPU: 1.1, MEM: 3.3
Fri Feb 10 15:33:01 EST 2012 -- PID: 12914, CPU: 1.0, MEM: 3.3
Fri Feb 10 15:34:02 EST 2012 -- PID: 12914, CPU: 1.0, MEM: 3.3
...
Tue Feb 14 15:21:01 EST 2012 -- PID: 12914, CPU: 0.8, MEM: 9.0
Tue Feb 14 15:22:01 EST 2012 -- PID: 12914, CPU: 0.8, MEM: 9.0
Tue Feb 14 15:23:01 EST 2012 -- PID: 12914, CPU: 0.8, MEM: 9.0
Tue Feb 14 15:24:01 EST 2012 -- PID: 12914, CPU: 0.8, MEM: 9.0
Tue Feb 14 15:25:02 EST 2012 -- PID: 12914, CPU: 0.8, MEM: 9.0
Tue Feb 14 15:26:01 EST 2012 -- PID: 12914, CPU: 0.8, MEM: 9.0
Tue Feb 14 15:27:01 EST 2012 -- PID: 12914, CPU: 0.8, MEM: 9.0
Tue Feb 14 15:28:01 EST 2012 -- PID: 12914, CPU: 0.8, MEM: 9.0
Tue Feb 14 15:29:01 EST 2012 -- PID: 12914, CPU: 0.8, MEM: 9.0
Tue Feb 14 15:30:01 EST 2012 -- PID: 12914, CPU: 0.8, MEM: 9.0
[rsoft@qcdvbs1050 ~]$

running a uniq -c on the memory value shows clearly that it stop growing at 
night and then grow of 0.1% every 40-60 builds

you can see it growing every few 40-60 minutes, and it is more stable at 
night as we don't build as much.

[rsoft@qcdvbs1050 ~]$ parse_cc_log
      1 3.0
      4 3.2
     50 3.3
     42 3.4
      2 3.5
      8 3.6
      2 3.8
    112 3.9   # evening
    869 4.0   # night
     45 4.1
     60 4.2
     46 4.3
     60 4.4
     47 4.5
     60 4.6
     46 4.7
     45 4.8
     61 4.9
     46 5.0
    832 5.1  # night
     48 5.2
     60 5.3
     47 5.4
     60 5.5
     46 5.6
     61 5.7
     45 5.8
     61 5.9
     45 6.0
     62 6.1
     45 6.2
     61 6.3
     21 6.4
    733 6.5  # night
     46 6.6
     60 6.7
     46 6.8
     45 6.9
     61 7.0
     47 7.1
     60 7.2
     46 7.3
     61 7.4
     45 7.5
     61 7.6
     46 7.7
     60 7.8
     25 7.9
    731 8.0
     46 8.1
     64 8.2
     51 8.3
     60 8.4
     45 8.5
     61 8.6
     46 8.7
     61 8.8
     45 8.9
     14 9.0
[rsoft@qcdvbs1050 ~]$

this cruisecontrol instance is not a busy one, with only 15 projects in the 
queue...

[rsoft@qcdvbs1050 ~]$ grep project\ name /opt/apps/cruisecontrol/config.xml 
| wc -l
15
[rsoft@qcdvbs1050 ~]$

[rsoft@qcdvbs1050 ~]$ tail cc_memory.log
Mon Mar 19 09:20:01 EDT 2012 -- PID: 12914, CPU: 5.4, MEM: 52.2
Mon Mar 19 09:21:01 EDT 2012 -- PID: 12914, CPU: 5.4, MEM: 52.2
Mon Mar 19 09:22:01 EDT 2012 -- PID: 12914, CPU: 5.4, MEM: 52.2
Mon Mar 19 09:23:01 EDT 2012 -- PID: 12914, CPU: 5.4, MEM: 52.2
Mon Mar 19 09:24:01 EDT 2012 -- PID: 12914, CPU: 5.4, MEM: 52.2
Mon Mar 19 09:25:03 EDT 2012 -- PID: 12914, CPU: 5.4, MEM: 52.2
Mon Mar 19 09:26:01 EDT 2012 -- PID: 12914, CPU: 5.4, MEM: 52.2
Mon Mar 19 09:27:01 EDT 2012 -- PID: 12914, CPU: 5.4, MEM: 52.2
Mon Mar 19 09:28:01 EDT 2012 -- PID: 12914, CPU: 5.4, MEM: 52.2
Mon Mar 19 09:29:01 EDT 2012 -- PID: 12914, CPU: 5.4, MEM: 52.2
[rsoft@qcdvbs1050 ~]$

[rsoft@qcdvbs1050 ~]$ free -m
             total       used       free     shared    buffers     cached
Mem:          3567       3389        178          0        285        434
-/+ buffers/cache:       2668        898
Swap:         1027         26       1001
[rsoft@qcdvbs1050 ~]$

we are still running CruiseControl Version 2.7.3

anyone could confirm if this has been fixed in 2.8.4 ?

thanks

Mathieu



------------------------------------------------------------------------------
This SF email is sponsosred by:
Try Windows Azure free for 90 days Click Here
http://p.sf.net/sfu/sfd2d-msazure
_______________________________________________
Cruisecontrol-user mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/cruisecontrol-user 


------------------------------------------------------------------------------
This SF email is sponsosred by:
Try Windows Azure free for 90 days Click Here 
http://p.sf.net/sfu/sfd2d-msazure