Archived community.zenoss.org | full text search
Skip navigation
Up to Discussions in zenoss-users
1 2 Previous Next 14362 Views 21 Replies Latest reply: Apr 6, 2012 1:09 PM by chasmosaurus RSS
jwilda Rank: White Belt
jwilda
40 posts since
May 7, 2009
Currently Being Moderated

Sep 24, 2010 10:07 AM

error with zenoss.snmp.NewDeviceMap on 3

Hi,

 

     Since upgrading to version 3 every night our SNMP devices get the below error

 

Problem while executing plugin zenoss.snmp.NewDeviceMap

Traceback (most recent call last):   File "/opt/zenoss/Products/DataCollector/zenmodeler.py", line 611, in processClient     results = plugin.preprocess(results, self.log)   File "/opt/zenoss/Products/DataCollector/plugins/CollectorPlugin.py", line 271, in preprocess     getdata = self.snmpGetMap.mapdata(getdata)   File "/opt/zenoss/Products/DataCollector/plugins/CollectorPlugin.py", line 320, in mapdata     data[self.oidmap[oid]] = value KeyError: (1, 3, 6, 1, 2, 1, 1, 2, 0)

 

Anyone know how to fix this?

 

Thanks,

~Jet

Tags: snmp, plugin, newdevicemap
  • jwilda Rank: White Belt
    jwilda
    40 posts since
    May 7, 2009
    Currently Being Moderated
    1. Sep 27, 2010 10:33 AM (in response to jwilda)
    Re: error with zenoss.snmp.NewDeviceMap on 3

    I was wrong about it happening at night.  It actually happens all through out the day at what seem to be random times.

  • jwilda Rank: White Belt
    jwilda
    40 posts since
    May 7, 2009
    Currently Being Moderated
    2. Oct 5, 2010 11:48 AM (in response to jwilda)
    Re: error with zenoss.snmp.NewDeviceMap on 3

    Am I the only one seeing this issue?

  • hhogan Newbie
    hhogan
    2 posts since
    Feb 28, 2011
    Currently Being Moderated
    3. Feb 28, 2011 8:47 AM (in response to jwilda)
    Re: error with zenoss.snmp.NewDeviceMap on 3

    I'm getting the same issue on 3.1.0, newly upgraded. Is there any fix or work around available?

     

    -H

  • chitambira Rank: Brown Belt
    chitambira
    711 posts since
    Oct 15, 2008
    Currently Being Moderated
    4. Feb 28, 2011 12:05 PM (in response to jwilda)
    Re: error with zenoss.snmp.NewDeviceMap on 3

    probably need to update the catalogue and reindex devices/components

  • hhogan Newbie
    hhogan
    2 posts since
    Feb 28, 2011
    Currently Being Moderated
    5. Mar 1, 2011 2:22 PM (in response to chitambira)
    Re: error with zenoss.snmp.NewDeviceMap on 3

    I've tried that, with no luck. The peculiar thing is that the message does not occur every time for every device, and it simply does not repeat on a manual model run.

  • kotique Rank: White Belt
    kotique
    9 posts since
    Apr 5, 2011
    Currently Being Moderated
    6. Apr 21, 2011 3:53 PM (in response to jwilda)
    Re: error with zenoss.snmp.NewDeviceMap on 3

    Got the same error.

     

    
Message:
 Traceback (most recent call last):
 File "/opt/zenoss/Products/DataCollector/zenmodeler.py", line 611, in processClient
 results = plugin.preprocess(results, self.log)
 File "/opt/zenoss/Products/DataCollector/plugins/CollectorPlugin.py", line 271, in preprocess
 getdata = self.snmpGetMap.mapdata(getdata)
 File "/opt/zenoss/Products/DataCollector/plugins/CollectorPlugin.py", line 320, in mapdata
 data[self.oidmap[oid]] = value
 KeyError: (1, 3, 6, 1, 2, 1, 1, 1, 0)

     

    And another message:

     

    Component: 
 Severity: Error
 Time: 2011/04/20 21:03:26.000
 Message:
 Traceback (most recent call last):
 File "/opt/zenoss/Products/DataCollector/zenmodeler.py", line 613, in processClient
 datamaps = plugin.process(device, results, self.log)
 File "/opt/zenoss/Products/DataCollector/plugins/zenoss/snmp/NewDeviceMap.py", line 81, in process
 if om.snmpOid:
 AttributeError: ObjectMap instance has no attribute 'snmpOid'

     

     

    Probably related to unclean shutdown of modeler (3 of them got stuck for 2 days, kill -9'ed).

     

    Update: reindex()'ed, commit()'ed, still getting occasional errors on modeling:

     

    2011-04-21 14:36:12,696 INFO zen.ZenModeler: No WMI plugins found for xxx
2011-04-21 14:36:12,699 INFO zen.ZenModeler: No Python plugins found for xxx
2011-04-21 14:36:12,703 INFO zen.ZenModeler: No command plugins found for xxx
2011-04-21 14:36:12,707 INFO zen.ZenModeler: SNMP collection device xxx
2011-04-21 14:36:12,707 INFO zen.ZenModeler: plugins: zenoss.snmp.NewDeviceMap, zenoss.snmp.DeviceMap, HPDeviceMap, DellDeviceMap, zenoss.snmp.InterfaceMap, zenoss.snmp.RouteMap, zenoss.snmp.IpServiceMap, ze
noss.snmp.HRFileSystemMap, zenoss.snmp.HRSWRunMap, zenoss.snmp.UCDHardDiskMap, HPCPUMap, DellCPUMap, DellPCIMap
2011-04-21 14:36:12,735 INFO zen.ZenModeler: No portscan plugins found for xxx
2011-04-21 14:36:13,313 INFO zen.SnmpClient: snmp client finished collection for xxx
2011-04-21 14:36:13,314 INFO zen.ZenModeler: Processing zenoss.snmp.NewDeviceMap for device xxx
2011-04-21 14:36:13,314 ERROR zen.ZenModeler: Problem while executing plugin zenoss.snmp.NewDeviceMap
2011-04-21 14:36:13,320 ERROR zen.ZenModeler: Traceback (most recent call last):
  File "/opt/zenoss/Products/DataCollector/zenmodeler.py", line 613, in processClient
    datamaps = plugin.process(device, results, self.log)
  File "/opt/zenoss/Products/DataCollector/plugins/zenoss/snmp/NewDeviceMap.py", line 81, in process
    if om.snmpOid:
AttributeError: ObjectMap instance has no attribute 'snmpOid'

2011-04-21 14:36:13,320 INFO zen.ZenModeler: processing zenoss.snmp.DeviceMap for device xxx
2011-04-21 14:36:13,320 INFO zen.ZenModeler: processing HPDeviceMap for device xxx
2011-04-21 14:36:13,320 INFO zen.ZenModeler: processing DellDeviceMap for device xxx
2011-04-21 14:36:13,321 INFO zen.ZenModeler: Modeler zenoss.snmp.InterfaceMap processing data for device xxx
2011-04-21 14:36:13,322 INFO zen.ZenModeler: processing zenoss.snmp.RouteMap for device xxx
2011-04-21 14:36:13,322 INFO zen.ZenModeler: processing zenoss.snmp.IpServiceMap for device sxxx
2011-04-21 14:36:13,323 INFO zen.ZenModeler: Modeler zenoss.snmp.HRFileSystemMap processing data for device xxx
2011-04-21 14:36:13,324 INFO zen.ZenModeler: Skipping Memory Buffers (other) as it matches zFileSystemMapIgnoreTypes.
2011-04-21 14:36:13,324 INFO zen.ZenModeler: Skipping Swap Space (virtualMemory) as it matches zFileSystemMapIgnoreTypes.
2011-04-21 14:36:13,324 INFO zen.ZenModeler: Skipping Real Memory (ram) as it matches zFileSystemMapIgnoreTypes.
2011-04-21 14:36:13,325 INFO zen.ZenModeler: Processing zenoss.snmp.HRSWRunMap for device xxx
2011-04-21 14:36:13,329 INFO zen.ZenModeler: processing zenoss.snmp.UCDHardDiskMap for device xxx
2011-04-21 14:36:13,330 INFO zen.ZenModeler: processing HPCPUMap for device xxx
2011-04-21 14:36:13,330 INFO zen.ZenModeler: processing DellCPUMap for device xxx
2011-04-21 14:36:13,330 INFO zen.ZenModeler: processing DellPCIMap for device xxx

     

    Developers, where are you?! Thanks.

  • ahnjoan Newbie
    ahnjoan
    1 posts since
    May 27, 2011
    Currently Being Moderated
    7. May 27, 2011 9:04 AM (in response to kotique)
    Re: error with zenoss.snmp.NewDeviceMap on 3

    I'm having the exact same behavior...  I run the the modeling command and get different results.  I have done what I think win index the catalog as suggested in an earlier post.  I'm running 3.1.0 and I'm trying to monitor a Cisco 5520 ASA.

     

    Thanks

    Ahnjoan

     

    This is the command run successfuly before the remaining items in this e-mail.  I'm not sure if this is what folks ment by reindexing catalog.

     

    zencatalog run --createcatalog --forceindex

     

    These commands are run right after each other and get different results

     

    [zenoss@sbuzenoss log]$ zenmodeler run --now --monitor localhost -F -d 10.3.64.1
2011-05-26 22:05:57,190 INFO zen.ZenModeler: Connecting to localhost:8789
2011-05-26 22:05:57,199 INFO zen.ZenModeler: Connected to ZenHub
2011-05-26 22:05:57,262 INFO zen.ZenModeler: Collecting for device 10.3.64.1
2011-05-26 22:05:57,322 INFO zen.ZenModeler: No WMI plugins found for 10.3.64.1
2011-05-26 22:05:57,324 INFO zen.ZenModeler: No Python plugins found for 10.3.64.1
2011-05-26 22:05:57,326 INFO zen.ZenModeler: No command plugins found for 10.3.64.1
2011-05-26 22:05:57,328 INFO zen.ZenModeler: SNMP collection device 10.3.64.1
2011-05-26 22:05:57,328 INFO zen.ZenModeler: plugins: zenoss.snmp.NewDeviceMap, zenoss.snmp.DeviceMap, zenoss.snmp.InterfaceMap, zenoss.snmp.RouteMap
2011-05-26 22:06:01,428 INFO zen.ZenModeler: No portscan plugins found for 10.3.64.1
Traceback (most recent call last):
  File "/opt/zenoss/Products/DataCollector/zenmodeler.py", line 1003, in <module>
    dc.run()
  File "/opt/zenoss/Products/ZenHub/PBDaemon.py", line 272, in run
    reactor.run()
  File "/opt/zenoss/Products/DataCollector/zenmodeler.py", line 912, in reactorLoop
    reactor.runUntilCurrent()
--- <exception caught here> ---
  File "/opt/zenoss/lib/python/twisted/internet/base.py", line 705, in runUntilCurrent
    call.func(*call.args, **call.kw)
  File "/opt/zenoss/lib/python/twisted/internet/defer.py", line 243, in callback
    self._startRunCallbacks(result)
  File "/opt/zenoss/lib/python/twisted/internet/defer.py", line 298, in _startRunCallbacks
    raise AlreadyCalledError
twisted.internet.defer.AlreadyCalledError: 
2011-05-26 22:06:07,490 INFO zen.SnmpClient: snmp client finished collection for 10.3.64.1
2011-05-26 22:06:07,490 INFO zen.ZenModeler: Processing zenoss.snmp.NewDeviceMap for device 10.3.64.1
2011-05-26 22:06:07,490 ERROR zen.ZenModeler: Problem while executing plugin zenoss.snmp.NewDeviceMap
2011-05-26 22:06:07,491 ERROR zen.ZenModeler: Traceback (most recent call last):
  File "/opt/zenoss/Products/DataCollector/zenmodeler.py", line 613, in processClient
    datamaps = plugin.process(device, results, self.log)
  File "/opt/zenoss/Products/DataCollector/plugins/zenoss/snmp/NewDeviceMap.py", line 81, in process
    if om.snmpOid:
AttributeError: ObjectMap instance has no attribute 'snmpOid'

2011-05-26 22:06:07,491 INFO zen.ZenModeler: processing zenoss.snmp.DeviceMap for device 10.3.64.1
2011-05-26 22:06:07,491 INFO zen.ZenModeler: Modeler zenoss.snmp.InterfaceMap processing data for device 10.3.64.1
2011-05-26 22:06:07,493 INFO zen.ZenModeler: processing zenoss.snmp.RouteMap for device 10.3.64.1
2011-05-26 22:06:07,849 INFO zen.ZenModeler: No change in configuration detected
2011-05-26 22:06:08,193 INFO zen.ZenModeler: Scan time: 10.93 seconds
2011-05-26 22:06:08,498 INFO zen.ZenModeler: Daemon ZenModeler shutting down
[zenoss@sbuzenoss log]$ zenmodeler run --now --monitor localhost -F -d 10.3.64.1
2011-05-26 22:06:44,908 INFO zen.ZenModeler: Connecting to localhost:8789
2011-05-26 22:06:44,915 INFO zen.ZenModeler: Connected to ZenHub
2011-05-26 22:06:44,951 INFO zen.ZenModeler: Collecting for device 10.3.64.1
2011-05-26 22:06:45,014 INFO zen.ZenModeler: No WMI plugins found for 10.3.64.1
2011-05-26 22:06:45,016 INFO zen.ZenModeler: No Python plugins found for 10.3.64.1
2011-05-26 22:06:45,017 INFO zen.ZenModeler: No command plugins found for 10.3.64.1
2011-05-26 22:06:45,020 INFO zen.ZenModeler: SNMP collection device 10.3.64.1
2011-05-26 22:06:45,020 INFO zen.ZenModeler: plugins: zenoss.snmp.NewDeviceMap, zenoss.snmp.DeviceMap, zenoss.snmp.InterfaceMap, zenoss.snmp.RouteMap
2011-05-26 22:06:47,118 INFO zen.ZenModeler: No portscan plugins found for 10.3.64.1
Traceback (most recent call last):
  File "/opt/zenoss/Products/DataCollector/zenmodeler.py", line 1003, in <module>
    dc.run()
  File "/opt/zenoss/Products/ZenHub/PBDaemon.py", line 272, in run
    reactor.run()
  File "/opt/zenoss/Products/DataCollector/zenmodeler.py", line 912, in reactorLoop
    reactor.runUntilCurrent()
--- <exception caught here> ---
  File "/opt/zenoss/lib/python/twisted/internet/base.py", line 705, in runUntilCurrent
    call.func(*call.args, **call.kw)
  File "/opt/zenoss/lib/python/twisted/internet/defer.py", line 243, in callback
    self._startRunCallbacks(result)
  File "/opt/zenoss/lib/python/twisted/internet/defer.py", line 298, in _startRunCallbacks
    raise AlreadyCalledError
twisted.internet.defer.AlreadyCalledError: 
2011-05-26 22:06:51,175 INFO zen.SnmpClient: snmp client finished collection for 10.3.64.1
2011-05-26 22:06:51,176 ERROR zen.ZenModeler: Problem while executing plugin zenoss.snmp.NewDeviceMap
2011-05-26 22:06:51,176 ERROR zen.ZenModeler: Traceback (most recent call last):
  File "/opt/zenoss/Products/DataCollector/zenmodeler.py", line 611, in processClient
    results = plugin.preprocess(results, self.log)
  File "/opt/zenoss/Products/DataCollector/plugins/CollectorPlugin.py", line 271, in preprocess
    getdata = self.snmpGetMap.mapdata(getdata)
  File "/opt/zenoss/Products/DataCollector/plugins/CollectorPlugin.py", line 320, in mapdata
    data[self.oidmap[oid]] = value
KeyError: (1, 3, 6, 1, 2, 1, 1, 1, 0)

2011-05-26 22:06:51,176 INFO zen.ZenModeler: processing zenoss.snmp.DeviceMap for device 10.3.64.1
2011-05-26 22:06:51,177 INFO zen.ZenModeler: Modeler zenoss.snmp.InterfaceMap processing data for device 10.3.64.1
2011-05-26 22:06:51,179 INFO zen.ZenModeler: processing zenoss.snmp.RouteMap for device 10.3.64.1
2011-05-26 22:06:51,213 INFO zen.ZenModeler: No change in configuration detected
2011-05-26 22:06:51,261 INFO zen.ZenModeler: Scan time: 6.31 seconds
2011-05-26 22:06:51,272 INFO zen.ZenModeler: Daemon ZenModeler shutting down
  • Jeff Creek Rank: White Belt
    Jeff Creek
    40 posts since
    Nov 21, 2011
    Currently Being Moderated
    8. Nov 28, 2011 1:53 PM (in response to jwilda)
    Re: error with zenoss.snmp.NewDeviceMap on 3

    Bump... me too...

     

    Receiving the same error in 3.2.1 with several Enterasys switches.

     

    "Traceback (most recent call last): File "/usr/local/zenoss/zenoss/Products/DataCollector/zenmodeler.py", line 621, in processClient results = plugin.preprocess(results, self.log) File "/usr/local/zenoss/zenoss/Products/DataCollector/plugins/CollectorPlugin.py", line 271, in preprocess getdata = self.snmpGetMap.mapdata(getdata) File "/usr/local/zenoss/zenoss/Products/DataCollector/plugins/CollectorPlugin.py", line 320, in mapdata data[self.oidmap[oid]] = value KeyError: (1, 3, 6, 1, 2, 1, 1, 2, 0)"

     

    When I perform an snmpget for this MIB, I receive a correct response.

    "SNMPv2-MIB::sysObjectID.0 = OID: SNMPv2-SMI::enterprises.52.3.9.20.1.4"

     

    OR

     

    "Traceback (most recent call last): File "/usr/local/zenoss/zenoss/Products/DataCollector/zenmodeler.py", line 621, in processClient results = plugin.preprocess(results, self.log) File "/usr/local/zenoss/zenoss/Products/DataCollector/plugins/CollectorPlugin.py", line 271, in preprocess getdata = self.snmpGetMap.mapdata(getdata) File "/usr/local/zenoss/zenoss/Products/DataCollector/plugins/CollectorPlugin.py", line 320, in mapdata data[self.oidmap[oid]] = value KeyError: (1, 3, 6, 1, 2, 1, 1, 1, 0)"

     

    snmpget:

    "SNMPv2-MIB::sysDescr.0 = STRING: Enterasys Networks, Inc. G3G124-24 Rev 06.03.05.0004"

     

    on a SuSE Linux server:

    "Traceback (most recent call last): File "/usr/local/zenoss/zenoss/Products/DataCollector/zenmodeler.py", line 621, in processClient results = plugin.preprocess(results, self.log) File "/usr/local/zenoss/zenoss/Products/DataCollector/plugins/CollectorPlugin.py", line 271, in preprocess getdata = self.snmpGetMap.mapdata(getdata) File "/usr/local/zenoss/zenoss/Products/DataCollector/plugins/CollectorPlugin.py", line 320, in mapdata data[self.oidmap[oid]] = value KeyError: (1, 3, 6, 1, 2, 1, 1, 2, 0)"

     

    snmpget:

    "SNMPv2-MIB::sysObjectID.0 = OID: NET-SNMP-MIB::netSnmpAgentOIDs.10"

     

     

    I receive no errors when modeling these devices.

  • kotique Rank: White Belt
    kotique
    9 posts since
    Apr 5, 2011
    Currently Being Moderated
    9. Dec 1, 2011 2:21 PM (in response to jwilda)
    Re: error with zenoss.snmp.NewDeviceMap on 3

    Highly possible that's happening because of duplicate SNMP Engine ID -- in my case that was because of VM cloning. Though I don't remember precisely if that triggered the above behaviour.

  • Gert Burger Newbie
    Gert Burger
    1 posts since
    Dec 2, 2011
    Currently Being Moderated
    10. Dec 5, 2011 2:26 AM (in response to jwilda)
    Re: error with zenoss.snmp.NewDeviceMap on 3

    Hi

     

    We are experiencing the same problem across all our linux machines(VM or real). This seems to happen most often directly after a reboot but does NOT happen on a forced modelling of a device.

     

    Has anyone figured out why this happens?

     

    Running zenoss-stack thats upgrded to 3.2.1

     

    The stack trace we receive is:

    Traceback (most recent call last):

    File "/usr/local/zenoss/zenoss/Products/DataCollector/zenmodeler.py", line 621, in processClient

    results = plugin.preprocess(results, self.log)

    File "/usr/local/zenoss/zenoss/Products/DataCollector/plugins/CollectorPlugin.py", line 271, in preprocess

    getdata = self.snmpGetMap.mapdata(getdata)

    File "/usr/local/zenoss/zenoss/Products/DataCollector/plugins/CollectorPlugin.py", line 320, in mapdata

    data[self.oidmap[oid]] = value

    KeyError: (1, 3, 6, 1, 2, 1, 1, 2, 0)

  • Jeff Creek Rank: White Belt
    Jeff Creek
    40 posts since
    Nov 21, 2011
    Currently Being Moderated
    11. Dec 5, 2011 11:08 AM (in response to kotique)
    Re: error with zenoss.snmp.NewDeviceMap on 3

    So, I need to configure a unique SNMP engine ID on each switch?

  • zenphil ZenossEmployee
    zenphil
    6 posts since
    Jun 20, 2011
    Currently Being Moderated
    12. Dec 8, 2011 12:21 PM (in response to jwilda)
    Re: error with zenoss.snmp.NewDeviceMap on 3

    I've created an internal ticket #29598 to look into this issue. I'm unaware of any plans to create a new 3.x patch so the fix may only be in the  4.x community release.

     

    Regards,

     

    Phil Bowman

    Sr. Software Developer, Zenoss

  • Jeff Creek Rank: White Belt
    Jeff Creek
    40 posts since
    Nov 21, 2011
    Currently Being Moderated
    13. Dec 8, 2011 4:01 PM (in response to zenphil)
    Re: error with zenoss.snmp.NewDeviceMap on 3

    Thank you, Phil!

     

    Jeff

  • chasmosaurus Rank: White Belt
    chasmosaurus
    8 posts since
    Mar 13, 2012
    Currently Being Moderated
    14. Mar 13, 2012 11:24 AM (in response to jwilda)
    Re: error with zenoss.snmp.NewDeviceMap on 3

    i was getting the same thing.  i tracked this down to a problem with twistedsnmp.py.  i am not sure exactly what is happening but it appears to be a race with return_dct and the callback's from netsnmp.  the following patch fixes the problem for me:

     

     
--- ../python/lib/python2.6/site-packages/pynetsnmp/twistedsnmp.py.orig 2012-03-13 11:11:50.752632482 -0400
+++ ../python/lib/python2.6/site-packages/pynetsnmp/twistedsnmp.py      2012-03-12 17:52:00.384273688 -0400
@@ -167,8 +167,9 @@
 
             return
         for oid, value in response:
-            if self.return_dct:
-                oid = asOidStr(oid)
+            oid = asOidStr(oid)
+            #if self.return_dct:
+            #    oid = asOidStr(oid)
             if isinstance(value, tuple):
                 value = asOidStr(value)
             result.append((oid, value))

     

     

    it seems safe to just always stuff the non-tuple version of the oid into the result's array.

1 2 Previous Next

More Like This

  • Retrieving data ...

Legend

  • Correct Answers - 4 points
  • Helpful Answers - 2 points