RE: RTEMS Freezing

Hi John
    I am not looking to push the limits, merely seeing strange behaviour
in the event of a RTEMS failure, and I need to ensure standby RTEMS can
cope with the load until normal service is resumed

________________________________

From: [email protected]
[mailto:[email protected]] On Behalf Of John Alvord
Sent: 05 July 2013 18:03
To: Discussion list for Tivoli product and Tivoli Ready products.
Subject: RE: [TME10] RTEMS Freezing


IBM arrives at that limit by doing serious large scale testing and
validating that the number of agents can be supported stably. When you
surpass those limits you can kind of on your own. I have personally
worked with customers that experienced instability at higher levels. You
can lose a lot of time and money experiencing that instability. So.. you
can make your own choices about that. 

The ulimit -n  [number of file descriptors] is very important. Each TCP
connection requires one such element. We currently recommend that TEMS
and WPAs be set up with ulinit -n 8192. The exact technique depends on
platform.

Regards, 
______________________________________________ 


John Alvord
Advisory Engineer
IBM Tivoli Monitoring 6 Platform
Customer Support 
Office: 1-720-396-2788 
Mobile: none 
jalvord-r/[email protected] <mailto:jalvord-r/[email protected]> 

Cloud & Smarter Infrastructure <http://www.ibm.com/software/tivoli/>
IBM Support Portal <https://www.ibm.com/support/> 
Open a New Service Request
<http://www.ibm.com/support/entry/portal/Open_service_request/> 
Update your PMR via Email
<https://www-304.ibm.com/jct05001c/de/support/ecurep/send_email.html#nam
ing> 
Escalate your PMR
<http://www-304.ibm.com/support/customercare/sas/f/handbook/getsupport.h
tml#9> 
My Blog: Wonderful World of Situations
<https://www.ibm.com/developerworks/mydeveloperworks/blogs/jalvord> 
Secure upload to ECUREP <https://www.ecurep.ibm.com/app/upload>  

<https://www.facebook.com/IBMTivolisupport>
<https://twitter.com/TivoliSupport>
<https://www.ibm.com/developerworks/servicemanagement/index.html> 


<http://www.ibm.com/software/tivoli//> 





From:        <Robin.Smith-U3F5sf8KFGKCmk9zJvdQaQC/[email protected]> 
To:        <[email protected]>, 
Date:        07/05/2013 02:50 AM 
Subject:        RE: [TME10] RTEMS Freezing 
Sent by:        [email protected] 

________________________________




Hi John 
    I'm not sure how IBM arrived at those limits, especially with
Enterprise systems, but I think it's a constraint that can be overridden
by the OS as opposed to one within the application 
  
Think its hitting a limit in Aix, have seen TEC etc start misbehaving
when you have over 2000 concurrent connection 
  
ulimit -a                                    
time(seconds)        unlimited
file(blocks)         unlimited
data(kbytes)         131072
stack(kbytes)        32768
memory(kbytes)       32768
coredump(blocks)     2097151
nofiles(descriptors) 2000 
  
/usr/local/BindView/bvcontrol/AIX/bin/lsof | grep kdsmain | wc -l
   1783 
very close to 2000, think it opens a dev file for every socket 
  



________________________________

From: [email protected]
[mailto:[email protected]
<mailto:[email protected]> ] On Behalf Of John Alvord
Sent: 04 July 2013 19:53
To: Discussion list for Tivoli product and Tivoli Ready products.
Subject: RE: [TME10] RTEMS Freezing

It the Installation and Setup manual - we talk about a TEMS being able
to support up to 1500 agents,  I know cases where the actual limit...
based on workload and communications is more like 800-900. A Hub TEMS
can support 10,000 agents. I know many sites that surpass those limits
but they sometimes experience stability issues - crashes/waits etc. 

I suggest you create some new remote TEMSes, reduce the number of agents
to the documented limits - or below - and then re-evaluate.

Regards, 
______________________________________________ 


John Alvord
Advisory Engineer
IBM Tivoli Monitoring 6 Platform
Customer Support 
Office: 1-720-396-2788 
Mobile: none 
jalvord-r/[email protected] <mailto:jalvord-r/[email protected]> 

Cloud & Smarter Infrastructure <http://www.ibm.com/software/tivoli/>
IBM Support Portal <https://www.ibm.com/support/> 
Open a New Service Request
<http://www.ibm.com/support/entry/portal/Open_service_request/> 
Update your PMR via Email
<https://www-304.ibm.com/jct05001c/de/support/ecurep/send_email.html#nam
ing> 
Escalate your PMR
<http://www-304.ibm.com/support/customercare/sas/f/handbook/getsupport.h
tml#9> 
My Blog: Wonderful World of Situations
<https://www.ibm.com/developerworks/mydeveloperworks/blogs/jalvord> 
Secure upload to ECUREP <https://www.ecurep.ibm.com/app/upload>  

<https://www.facebook.com/IBMTivolisupport>
<https://twitter.com/TivoliSupport>
<https://www.ibm.com/developerworks/servicemanagement/index.html> 

<http://www.ibm.com/software/tivoli//> 






From:        <Robin.Smith-U3F5sf8KFGKCmk9zJvdQaQC/[email protected]> 
To:        <[email protected]>, 
Date:        07/04/2013 08:59 AM 
Subject:        RE: [TME10] RTEMS Freezing 
Sent by:        [email protected] 

________________________________




Hi All 
   RTEMS seems to freeze when the server has over 2000 concurrent
connection, any parameters I can tune under Aix or look at? 


Lloyds TSB Bank plc. Registered Office: 25 Gresham Street, London EC2V
7HN. Registered in England and Wales, number 2065. Telephone: 020 7626
1500.

Bank of Scotland plc. Registered Office: The Mound, Edinburgh EH1 1YZ.
Registered in Scotland, number 327000.  Telephone: 020 7626 1500.

Lloyds TSB Scotland plc. Registered Office: Henry Duncan House, 120
George Street, Edinburgh EH2 4LH. Registered in Scotland, number 95237.
Telephone: 0131 225 4555.

Cheltenham & Gloucester plc. Registered Office: Barnett Way, Gloucester
GL4 3RL. Registered in England and Wales, number 2299428. Telephone:
01452 372372. 

Lloyds TSB Bank plc, Lloyds TSB Scotland plc, Bank of Scotland plc and
Cheltenham & Gloucester plc are authorised and regulated by the
Financial Services Authority.

Halifax is a division of Bank of Scotland plc. Cheltenham & Gloucester
Savings is a division of Lloyds TSB Bank plc. 

HBOS plc. Registered Office: The Mound, Edinburgh EH1 1YZ. Registered in
Scotland, number 218813.  Telephone: 020 7626 1500.

Lloyds Banking Group plc. Registered Office: The Mound, Edinburgh EH1
1YZ. Registered in Scotland, number 95000. Telephone: 0131 225 4555 

This e-mail (including any attachments) is private and confidential and
may contain privileged material. If you have received this e-mail in
error, please notify the sender and delete it  (including any
attachments) immediately. You must not copy, distribute, disclose or use
any of the information in it or any attachments. 

Telephone calls may be monitored or
recorded._______________________________________________
TME10 mailing list
[email protected]
Unsubscribe:[email protected] 


Lloyds TSB Bank plc. Registered Office: 25 Gresham Street, London EC2V
7HN. Registered in England and Wales, number 2065. Telephone: 020 7626
1500.

Bank of Scotland plc. Registered Office: The Mound, Edinburgh EH1 1YZ.
Registered in Scotland, number 327000.  Telephone: 020 7626 1500.

Lloyds TSB Scotland plc. Registered Office: Henry Duncan House, 120
George Street, Edinburgh EH2 4LH. Registered in Scotland, number 95237.
Telephone: 0131 225 4555.

Cheltenham & Gloucester plc. Registered Office: Barnett Way, Gloucester
GL4 3RL. Registered in England and Wales, number 2299428. Telephone:
01452 372372. 

Lloyds TSB Bank plc, Lloyds TSB Scotland plc, Bank of Scotland plc and
Cheltenham & Gloucester plc are authorised and regulated by the
Financial Services Authority.

Halifax is a division of Bank of Scotland plc. Cheltenham & Gloucester
Savings is a division of Lloyds TSB Bank plc. 

HBOS plc. Registered Office: The Mound, Edinburgh EH1 1YZ. Registered in
Scotland, number 218813.  Telephone: 020 7626 1500.

Lloyds Banking Group plc. Registered Office: The Mound, Edinburgh EH1
1YZ. Registered in Scotland, number 95000. Telephone: 0131 225 4555 

This e-mail (including any attachments) is private and confidential and
may contain privileged material. If you have received this e-mail in
error, please notify the sender and delete it  (including any
attachments) immediately. You must not copy, distribute, disclose or use
any of the information in it or any attachments. 

Telephone calls may be monitored or
recorded._______________________________________________
TME10 mailing list
[email protected]
Unsubscribe:[email protected]


Lloyds TSB Bank plc. Registered Office: 25 Gresham Street, London EC2V 7HN. Registered in England and Wales, number 2065. Telephone: 020 7626 1500.

Bank of Scotland plc. Registered Office: The Mound, Edinburgh EH1 1YZ. Registered in Scotland, number 327000.  Telephone: 020 7626 1500.

Lloyds TSB Scotland plc. Registered Office: Henry Duncan House, 120 George Street, Edinburgh EH2 4LH. Registered in Scotland, number 95237. Telephone: 0131 225 4555.

Cheltenham & Gloucester plc. Registered Office: Barnett Way, Gloucester GL4 3RL. Registered in England and Wales, number 2299428. Telephone: 01452 372372.

Lloyds TSB Bank plc, Lloyds TSB Scotland plc, Bank of Scotland plc and Cheltenham & Gloucester plc are authorised and regulated by the Financial Services Authority.

Halifax is a division of Bank of Scotland plc. Cheltenham & Gloucester Savings is a division of Lloyds TSB Bank plc.

HBOS plc. Registered Office: The Mound, Edinburgh EH1 1YZ. Registered in Scotland, number 218813.  Telephone: 020 7626 1500.

Lloyds Banking Group plc. Registered Office: The Mound, Edinburgh EH1 1YZ. Registered in Scotland, number 95000. Telephone: 0131 225 4555

This e-mail (including any attachments) is private and confidential and may contain privileged material. If you have received this e-mail in error, please notify the sender and delete it  (including any attachments) immediately. You must not copy, distribute, disclose or use any of the information in it or any attachments.

Telephone calls may be monitored or recorded.

_______________________________________________
TME10 mailing list
[email protected]
Unsubscribe:[email protected]