cruisecontrol memory

Hi ! 

I've been monitoring memory on the cruisecontrol process for a few months already and it grows continuously on every build.

I am basically using a simple ps in a crontab to create a log file with memory usage.

( date | tr -d "\n"; ps auxww | grep ^rsoft | grep --color cruisecontrol-launcher.*1099$ | awk '{print " -- PID: " $2 ", CPU: " $3 ", MEM: " $4}' ) >> $log_file

my log file looks like this...

[rsoft@qcdvbs1050 ~]$ grep "PID" cc_memory.log | head  ; echo ... ; tail cc_memory.log 
Fri Feb 10 15:25:01 EST 2012 -- PID: 12914, CPU: 1.5, MEM: 3.0
Fri Feb 10 15:26:01 EST 2012 -- PID: 12914, CPU: 1.5, MEM: 3.2
Fri Feb 10 15:27:01 EST 2012 -- PID: 12914, CPU: 1.4, MEM: 3.2
Fri Feb 10 15:28:01 EST 2012 -- PID: 12914, CPU: 1.3, MEM: 3.2
Fri Feb 10 15:29:01 EST 2012 -- PID: 12914, CPU: 1.3, MEM: 3.2
Fri Feb 10 15:30:01 EST 2012 -- PID: 12914, CPU: 1.2, MEM: 3.3
Fri Feb 10 15:31:01 EST 2012 -- PID: 12914, CPU: 1.2, MEM: 3.3
Fri Feb 10 15:32:01 EST 2012 -- PID: 12914, CPU: 1.1, MEM: 3.3
Fri Feb 10 15:33:01 EST 2012 -- PID: 12914, CPU: 1.0, MEM: 3.3
Fri Feb 10 15:34:02 EST 2012 -- PID: 12914, CPU: 1.0, MEM: 3.3
...
Tue Feb 14 15:21:01 EST 2012 -- PID: 12914, CPU: 0.8, MEM: 9.0
Tue Feb 14 15:22:01 EST 2012 -- PID: 12914, CPU: 0.8, MEM: 9.0
Tue Feb 14 15:23:01 EST 2012 -- PID: 12914, CPU: 0.8, MEM: 9.0
Tue Feb 14 15:24:01 EST 2012 -- PID: 12914, CPU: 0.8, MEM: 9.0
Tue Feb 14 15:25:02 EST 2012 -- PID: 12914, CPU: 0.8, MEM: 9.0
Tue Feb 14 15:26:01 EST 2012 -- PID: 12914, CPU: 0.8, MEM: 9.0
Tue Feb 14 15:27:01 EST 2012 -- PID: 12914, CPU: 0.8, MEM: 9.0
Tue Feb 14 15:28:01 EST 2012 -- PID: 12914, CPU: 0.8, MEM: 9.0
Tue Feb 14 15:29:01 EST 2012 -- PID: 12914, CPU: 0.8, MEM: 9.0
Tue Feb 14 15:30:01 EST 2012 -- PID: 12914, CPU: 0.8, MEM: 9.0
[rsoft@qcdvbs1050 ~]$ 

running a uniq -c on the memory value shows clearly that it stop growing at night and then grow of 0.1% every 40-60 builds

you can see it growing every few 40-60 minutes, and it is more stable at night as we don't build as much.

[rsoft@qcdvbs1050 ~]$ parse_cc_log 
      1 3.0
      4 3.2
     50 3.3
     42 3.4
      2 3.5
      8 3.6
      2 3.8
    112 3.9   # evening
    869 4.0   # night
     45 4.1
     60 4.2
     46 4.3
     60 4.4
     47 4.5
     60 4.6
     46 4.7
     45 4.8
     61 4.9
     46 5.0
    832 5.1  # night
     48 5.2
     60 5.3
     47 5.4
     60 5.5
     46 5.6
     61 5.7
     45 5.8
     61 5.9
     45 6.0
     62 6.1
     45 6.2
     61 6.3
     21 6.4
    733 6.5  # night
     46 6.6
     60 6.7
     46 6.8
     45 6.9
     61 7.0
     47 7.1
     60 7.2
     46 7.3
     61 7.4
     45 7.5
     61 7.6
     46 7.7
     60 7.8
     25 7.9
    731 8.0
     46 8.1
     64 8.2
     51 8.3
     60 8.4
     45 8.5
     61 8.6
     46 8.7
     61 8.8
     45 8.9
     14 9.0
[rsoft@qcdvbs1050 ~]$ 

this cruisecontrol instance is not a busy one, with only 15 projects in the queue...

[rsoft@qcdvbs1050 ~]$ grep project\ name /opt/apps/cruisecontrol/config.xml | wc -l 
15
[rsoft@qcdvbs1050 ~]$ 

[rsoft@qcdvbs1050 ~]$ tail cc_memory.log 
Mon Mar 19 09:20:01 EDT 2012 -- PID: 12914, CPU: 5.4, MEM: 52.2
Mon Mar 19 09:21:01 EDT 2012 -- PID: 12914, CPU: 5.4, MEM: 52.2
Mon Mar 19 09:22:01 EDT 2012 -- PID: 12914, CPU: 5.4, MEM: 52.2
Mon Mar 19 09:23:01 EDT 2012 -- PID: 12914, CPU: 5.4, MEM: 52.2
Mon Mar 19 09:24:01 EDT 2012 -- PID: 12914, CPU: 5.4, MEM: 52.2
Mon Mar 19 09:25:03 EDT 2012 -- PID: 12914, CPU: 5.4, MEM: 52.2
Mon Mar 19 09:26:01 EDT 2012 -- PID: 12914, CPU: 5.4, MEM: 52.2
Mon Mar 19 09:27:01 EDT 2012 -- PID: 12914, CPU: 5.4, MEM: 52.2
Mon Mar 19 09:28:01 EDT 2012 -- PID: 12914, CPU: 5.4, MEM: 52.2
Mon Mar 19 09:29:01 EDT 2012 -- PID: 12914, CPU: 5.4, MEM: 52.2
[rsoft@qcdvbs1050 ~]$ 

[rsoft@qcdvbs1050 ~]$ free -m
             total       used       free     shared    buffers     cached
Mem:          3567       3389        178          0        285        434
-/+ buffers/cache:       2668        898
Swap:         1027         26       1001
[rsoft@qcdvbs1050 ~]$ 

we are still running CruiseControl Version 2.7.3

anyone could confirm if this has been fixed in 2.8.4 ?

thanks

Mathieu



------------------------------------------------------------------------------
This SF email is sponsosred by:
Try Windows Azure free for 90 days Click Here 
http://p.sf.net/sfu/sfd2d-msazure