Re: Errors in collector

Hello Danilo,

There are a few problems here, let me list them out:

1 - You cannot modify the number of DSs from an existing target that has 
already been created. This will cause a mismatch when cricket tries to 
figure out if the configuration is sane. This is a common mistake by 
cricket administrators and one of the quirks of cricket. It assumes that 
you made a configuration mistake and that you do notreally want to 
delete or add DSs to the rrd database you are trying to update. There 
are tools to add or delete DSs, but nothing easy and automatic ;-)

Complex solution that will keep your target rrd data history:

    * You need to COPY your config-tree configurations related to the
      targets which are problematic to another sub-tree of the
      config-tree. We will now refer to this copy as the historical
      config-tree.
    * Put back in the missing DSs in your targetType definition for the
      historical config-tree.
    * Put in the collect=false tag in the defaults for you historical
      config-tree sub-tree.
    * Then you need to MOVE your config-tree databases to the equivalent
      path as your historical configurations. To keep it nice and
      consistent.
    * Compile and run collection.

Cricket will now create new targets with the correct number of DSs for 
the non-historical config-tree rrd databases.

Simple solution:

Delete your cricket config-tree rrd databases for the targets which have 
an incorrect number of DSs versus the config-tree targetType definitions.

2 - If you get a Fetcher error in your logs. This means that you do not 
have any datasource definitions for the TargetType elements you wish to 
collect or it is invalid/badly formatted/etc. Remember that:

    * The targetType defines the datasources to be collected and how to
      display them
    * The datasource definition tells Cricket how to collect the data
    * The OID is just reference to make the datasources more readable
      and usually has only static data which is not related to specific
      run-time reference data (instance numbers in the case of SNMP)

3 - The collector logging can be a bit daunting, but usually ask 
yourself these questions based on the log data and it should make it clear:

Can you identifiy for which device and which target the problem is 
related to. (You should be able to answer this ;-)
Can the collector reach the device for which a target is defined
What is the collector trying to get
Does the device actually have this information to give it
Does the collector get data back
Does the collector get the correct number of data back
Is the data in the right format
Does the number of datasources collected correspond to the number of 
datasources expected in the rrd database
Could the collector actually write/create the rrd database
Is there any monitoring related to these targets, if yes, you may get 
errors related to this, such as a badly formated monitor definitions, 
invalid actions, datasource errors related to the monitor.

4 - Mixing and matching Default files and targets is a sure way to get 
in trouble if you are not careful.

Using genDevConfig is the cricket administrators best and fastest way to 
get consistent, well presented, well documented and up to date targets. 
Sure it has it's share of problems, but it is easily extensible and 
covers a fairly large swath of device types and features.

In item 1, you can keep your historical values for what you have 
collected and just create a new sub-tree for genDevConfig. You can run 
them in parallel if you have a small number of targets, and eventually 
set collect=false for your historical sub-tree.

Hope this helps you and other cricket admins.

Francois Mikus

Danilo Castro Dy wrote:
> Hi,
>
> Thanks, my Cricket is already in production for many months generating
> report for hundreds of client and major changes may affect historical data
> so I'm not keen in making drastic changes.
>
> I used the Defaults in genRtrConfig it works fine and minimizes the errors
> but I'm not getting the graph for MEMORY though there is summary report.
>
> I fallback to the original Defaults (which have the same OID with
> genRtrConfig). I count the error per switch interface and its 10, it could
> be because of this;
> targetType switch-interface
>         ds      =       "ifInOctets, ifOutOctets,
>                         ifInErrors, ifOutErrors,
>                         ifInUcastPackets, ifOutUcastPackets,
>                         ifInDiscards, ifOutDiscards,
>                         ifInNUcastPackets, ifOutNUcastPackets"
>         view    =       "Octets: ifInOctets ifOutOctets,
>                         InPackets: ifInUcastPackets ifInNUcastPackets
> ifInDiscards,
>                         OutPackets: ifOutUcastPackets ifOutNUcastPackets
> ifOutDiscards,
>                         Errors: ifInErrors ifOutErrors"
>  
> I amend it to this;
> targetType switch-interface
>         ds      =       "ifInOctets, ifOutOctets,
>                         ifInErrors, ifOutErrors,
>                         ifInUcastPackets, ifOutUcastPackets "
>         view    =       "Octets: ifInOctets ifOutOctets,
>                         InPackets: ifInUcastPackets,
>                         OutPackets: ifOutUcastPackets,
>                         Errors: ifInErrors ifOutErrors"
>
> Now I only get 6 errors per interface but it's not updating the database.
> There is an error that says the "database update fails as its expecting 10
> entries but its only receiving 6". I should have amended this before
> production like I did for router and packetshaper, sigh.
>
> Thanks.
>
> -----Original Message-----
> From: [email protected]
> [mailto:[email protected]] On Behalf Of Francois
> Mikus
> Sent: Thursday, February 08, 2007 11:15 AM
> To: [email protected]
> Subject: Re: [cricket-users] Errors in collector
>
> Hello Danilo,
>
> genRtrConfig is an easy introduction in getting your configurations 
> created for you.
>
> Follow the installation instructions.
>
> If you wish to use a further enhanced version of the generator.
>
> genDevConfig is available also, which includes improved device 
> recognition and has lots of features that make it easier to extend. You 
> can get it from the acktomic web site. It is still in beta, but should 
> officially emerge from beta shortly and be included in the cricket 
> distribution itself. For those who wish to use it, ,the latest version 
> is available in the Cricket CVS or for a somewhat up to date package 
> from the acktomic website.
>
> Cheers,
>
> Francois Mikus
>
> Danilo Castro Dy wrote:
>
>   
>> Thanks. So many response from the community :) I can't find the
>> genCatConfig, though I'm able to download genRtrConfig.
>>
>>
>> -----Original Message-----
>> From: [email protected]
>> [mailto:[email protected]] On Behalf Of Marc
>> Powell
>> Sent: Wednesday, February 07, 2007 8:33 PM
>> To: [email protected]
>> Subject: Re: [cricket-users] Errors in collector
>>
>>
>>
>>  
>>
>>     
>>> -----Original Message-----
>>> From: [email protected]
>>>    
>>>
>>>       
>> [mailto:cricket-users-
>>  
>>
>>     
>>> [email protected]] On Behalf Of Danilo Castro Dy
>>> Sent: Wednesday, February 07, 2007 3:35 AM
>>> To: [email protected]
>>> Subject: [cricket-users] Errors in collector
>>>
>>> Hi,
>>>
>>>
>>>
>>> Does anyone have any idea what causes the errors below or any tool to
>>>    
>>>
>>>       
>> find
>>  
>>
>>     
>>> the cause of the errors? I seem to get them only from switch
>>>    
>>>
>>>       
>> interfaces,
>>  
>>
>>     
>>> though I still able to get data it annoy me. Thanks.
>>>    
>>>
>>>       
>> [general errors removed]
>>
>>  
>>
>>     
>>> [07-Feb-2007 17:33:34*] Could not find a fetcher with type  to fetch
>>>    
>>>
>>>       
>> data
>>  
>>
>>     
>>> for fa
>>>
>>> 0_1 (1).
>>>
>>> [07-Feb-2007 17:33:34 ] Retrieved data for fa0_1 (1):
>>> 338617880,2229932395,U,U,U
>>>
>>> ,U,U,U,U,U
>>>
>>> [07-Feb-2007 17:33:34 ] Some data is missing for fa0_1 (1).
>>>
>>>    
>>>
>>>       
>> I can only give you a general pointer. The last 6 data sources for this
>> target type are uncollectible on that switch. Cricket tries, but fails.
>> Verify that the datasources (probably OID's) are valid on that device.
>>
>> If this is a cisco switch I've had great success using genRtrConfig for
>> IOS based switches and genCatConfig for CatOS based switches.
>>
>> --
>> marc
>>
>> -------------------------------------------------------------------------
>> Using Tomcat but need to do more? Need to support web services, security?
>> Get stuff done quickly with pre-integrated technology to make your job
>> easier.
>> Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
>> http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
>> _______________________________________________
>> cricket-users mailing list
>> [email protected]
>> https://lists.sourceforge.net/lists/listinfo/cricket-users
>>
>>
>> -------------------------------------------------------------------------
>> Using Tomcat but need to do more? Need to support web services, security?
>> Get stuff done quickly with pre-integrated technology to make your job
>>     
> easier.
>   
>> Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
>> http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
>> _______________________________________________
>> cricket-users mailing list
>> [email protected]
>> https://lists.sourceforge.net/lists/listinfo/cricket-users
>>  
>>
>>     
>
>
> -------------------------------------------------------------------------
> Using Tomcat but need to do more? Need to support web services, security?
> Get stuff done quickly with pre-integrated technology to make your job
> easier.
> Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
> http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
> _______________________________________________
> cricket-users mailing list
> [email protected]
> https://lists.sourceforge.net/lists/listinfo/cricket-users
>
>   

-------------------------------------------------------------------------
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier.
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642