errors after upgrade to 2.5

Up to Discussions in zenoss-users

76848 Views 9 Replies Latest reply: Apr 13, 2010 12:20 PM by dswope

bobrmr

15 posts since
Oct 22, 2009

Currently Being Moderated

Nov 4, 2009 4:54 PM

I upgraded from 2.4.5 to 2.5, following the upgrade section of the install guide. All services start fine except:

Daemon: zenjmx /opt/zenoss/bin/zenoss: line 105: /opt/zenoss/bin/zenjmx: No such file or directory

When i log into the web interface, the map appears to be working, but I can't pull up and devices or events.

If i try and view an event i simply get "error, server connection error".

I get a list of all my devices but when I try and open a particular one, i get the following error:

Type: KeyError
Value: 'titleOrId'

Traceback (innermost last):

Module ZPublisher.Publish, line 119, in publish
Module ZPublisher.mapply, line 88, in mapply
Module ZPublisher.Publish, line 42, in call_object
Module Products.ZenModel.ZenModelBase, line 65, in __call__
Module Shared.DC.Scripts.Bindings, line 313, in __call__
Module Shared.DC.Scripts.Bindings, line 350, in _bindAndExec
Module Products.CMFCore.FSPageTemplate, line 216, in _exec
Module Products.CMFCore.FSPageTemplate, line 155, in pt_render
Module Products.PageTemplates.PageTemplate, line 98, in pt_render
Module zope.pagetemplate.pagetemplate, line 115, in pt_render
Module zope.tal.talinterpreter, line 271, in __call__
Module zope.tal.talinterpreter, line 346, in interpret
Module zope.tal.talinterpreter, line 891, in do_useMacro
Module zope.tal.talinterpreter, line 346, in interpret
Module zope.tal.talinterpreter, line 536, in do_optTag_tal
Module zope.tal.talinterpreter, line 521, in do_optTag
Module zope.tal.talinterpreter, line 516, in no_tag
Module zope.tal.talinterpreter, line 346, in interpret
Module zope.tal.talinterpreter, line 891, in do_useMacro
Module zope.tal.talinterpreter, line 346, in interpret
Module zope.tal.talinterpreter, line 536, in do_optTag_tal
Module zope.tal.talinterpreter, line 521, in do_optTag
Module zope.tal.talinterpreter, line 516, in no_tag
Module zope.tal.talinterpreter, line 346, in interpret
Module zope.tal.talinterpreter, line 949, in do_defineSlot
Module zope.tal.talinterpreter, line 346, in interpret
Module zope.tal.talinterpreter, line 536, in do_optTag_tal
Module zope.tal.talinterpreter, line 521, in do_optTag
Module zope.tal.talinterpreter, line 516, in no_tag
Module zope.tal.talinterpreter, line 346, in interpret
Module zope.tal.talinterpreter, line 949, in do_defineSlot
Module zope.tal.talinterpreter, line 346, in interpret
Module zope.tal.talinterpreter, line 536, in do_optTag_tal
Module zope.tal.talinterpreter, line 521, in do_optTag
Module zope.tal.talinterpreter, line 516, in no_tag
Module zope.tal.talinterpreter, line 346, in interpret
Module zope.tal.talinterpreter, line 861, in do_defineMacro
Module zope.tal.talinterpreter, line 346, in interpret
Module zope.tal.talinterpreter, line 536, in do_optTag_tal
Module zope.tal.talinterpreter, line 521, in do_optTag
Module zope.tal.talinterpreter, line 516, in no_tag
Module zope.tal.talinterpreter, line 346, in interpret
Module zope.tal.talinterpreter, line 891, in do_useMacro
Module zope.tal.talinterpreter, line 346, in interpret
Module zope.tal.talinterpreter, line 536, in do_optTag_tal
Module zope.tal.talinterpreter, line 521, in do_optTag
Module zope.tal.talinterpreter, line 516, in no_tag
Module zope.tal.talinterpreter, line 346, in interpret
Module zope.tal.talinterpreter, line 949, in do_defineSlot
Module zope.tal.talinterpreter, line 346, in interpret
Module zope.tal.talinterpreter, line 536, in do_optTag_tal
Module zope.tal.talinterpreter, line 521, in do_optTag
Module zope.tal.talinterpreter, line 516, in no_tag
Module zope.tal.talinterpreter, line 346, in interpret
Module zope.tal.talinterpreter, line 981, in do_onError_tal
Module zope.tal.talinterpreter, line 346, in interpret
Module zope.tal.talinterpreter, line 745, in do_insertStructure_tal
Module Products.PageTemplates.Expressions, line 199, in evaluateStructure

Module zope.tales.tales, line 696, in evaluate
URL: file:/opt/zenoss/Products/ZenModel/skins/zenmodel/deviceStatus.pt
Line 43, Column 20
Expression: <PythonExpr here.dmd.error_handler(error)>
Names:

{'container': <ZentinelPortal at /zport>,
 'context': <Device at /zport/dmd/Devices/Network/Router/Cisco/devices/sw-c10a-ca01>,
 'default': <object object at 0xb7f7b538>,
 'here': <Device at /zport/dmd/Devices/Network/Router/Cisco/devices/sw-c10a-ca01>,
 'loop': {},
 'nothing': None,
 'options': {'args': ()},
 'repeat': <Products.PageTemplates.Expressions.SafeMapping object at 0xa9de94c>,
 'request': <HTTPRequest, URL=http://netmonbz01.rightnowtech.com:8080/zport/dmd/Devices/Network/Router/Cisco/devices/sw-c10a-ca01>,
 'root': <Application at >,
 'template': <FSPageTemplate at /zport/deviceStatus used for /zport/dmd/Devices/Network/Router/Cisco/devices/sw-c10a-ca01>,
 'traverse_subpath': [],
 'user': <PropertiedUser 'rrichardson'>}

Module Products.PageTemplates.ZRPythonExpr, line 49, in __call__
__traceback_info__: here.dmd.error_handler(error)
Module PythonExpr, line 1, in <expression>
Module zope.tal.talinterpreter, line 968, in do_onError_tal
Module zope.tal.talinterpreter, line 346, in interpret
Module zope.tal.talinterpreter, line 623, in do_insertText_tal
Module Products.PageTemplates.Expressions, line 206, in evaluateText

Module zope.tales.tales, line 696, in evaluate
URL: file:/opt/zenoss/Products/ZenModel/skins/zenmodel/deviceStatus.pt
Line 43, Column 20
Expression: <PathExpr standard:u'here/availability'>
Names:

{'container': <ZentinelPortal at /zport>,
 'context': <Device at /zport/dmd/Devices/Network/Router/Cisco/devices/sw-c10a-ca01>,
 'default': <object object at 0xb7f7b538>,
 'here': <Device at /zport/dmd/Devices/Network/Router/Cisco/devices/sw-c10a-ca01>,
 'loop': {},
 'nothing': None,
 'options': {'args': ()},
 'repeat': <Products.PageTemplates.Expressions.SafeMapping object at 0xa9de94c>,
 'request': <HTTPRequest, URL=http://netmonbz01.rightnowtech.com:8080/zport/dmd/Devices/Network/Router/Cisco/devices/sw-c10a-ca01>,
 'root': <Application at >,
 'template': <FSPageTemplate at /zport/deviceStatus used for /zport/dmd/Devices/Network/Router/Cisco/devices/sw-c10a-ca01>,
 'traverse_subpath': [],
 'user': <PropertiedUser 'rrichardson'>}

Module zope.tales.expressions, line 217, in __call__
Module Products.PageTemplates.Expressions, line 139, in _eval
Module Products.PageTemplates.Expressions, line 103, in render
Module Products.ZenModel.Device, line 489, in availability
Module Products.ZenEvents.Availability, line 197, in query
Module Products.ZenEvents.Availability, line 166, in run
Module Products.ZenModel.DeviceClass, line 455, in findDevice
Module Products.ZenModel.DeviceClass, line 436, in _findDevice
Module Products.AdvancedQuery.eval, line 40, in eval
Module Products.AdvancedQuery.eval, line 16, in _eval
Module Products.AdvancedQuery.AdvancedQuery, line 235, in _eval
Module Products.AdvancedQuery.AdvancedQuery, line 84, in _eval
Module Products.AdvancedQuery.AdvancedQuery, line 278, in _applyIndex

KeyError: 'titleOrId'

Anyone seen this after an upgrade???

~Robert

Like (0)

Tags: 2.4.5, 2.5, upgrade, titleorid

bobrmr

15 posts since
Oct 22, 2009

Currently Being Moderated

1. Nov 4, 2009 5:49 PM (in response to bobrmr)

Re: errors after upgrade to 2.5

From the cmd line, all services except the above start but from the gui, the following won't start:

zenping

zenactions

zenjmx

Looking at the log for zenping, I see more entries for titleOrId... In the realease notes for 2.5 it mentions using titleOrId for a device instead of just an Id but in reports, not in basic system functions/operations...

Log entry for zenping:

2009-11-04 14:09:53 INFO zen.ZenPing: Deleting PID file /opt/zenoss/var/zenping-localhost.pid ...
2009-11-04 14:09:53 INFO zen.ZenPing: Daemon ZenPing shutting down
2009-11-04 14:09:53 INFO zen.ZenPing: zenping shutting down
2009-11-04 14:17:48,138 INFO zen.ZenPing: started
2009-11-04 14:17:48,140 INFO zen.ZenPing: Connecting to localhost:8789
2009-11-04 14:17:48,158 INFO zen.ZenPing: Connected to ZenHub
2009-11-04 14:17:48,185 INFO zen.ZenPing: fetching monitor properties
2009-11-04 14:17:48,197 INFO zen.ZenPing: fetching default RRDCreateCommand
2009-11-04 14:17:48,200 INFO zen.ZenPing: getting threshold classes
2009-11-04 14:17:48,311 INFO zen.ZenPing: getting collector thresholds
2009-11-04 14:17:48,337 INFO zen.ZenPing: getting ping tree
2009-11-04 14:17:48,353 ERROR zen.ZenPing: Remote exception: exceptions.KeyError: 'titleOrId'Traceback (most recent call last):
  File "/opt/zenoss/Products/ZenHub/PBDaemon.py", line 75, in inner
    return callable(*args, **kw)
  File "/opt/zenoss/Products/ZenHub/services/PingConfig.py", line 23, in remote_getPingTree
    return self.getPingTree(self.dmd, root, fallbackIp)
  File "/opt/zenoss/Products/ZenHub/services/PingConfig.py", line 27, in getPingTree
    me = pm.findDevice(root)
  File "/opt/zenoss/Products/ZenModel/PerformanceConf.py", line 255, in findDevice
    brains = self.dmd.Devices._findDevice(deviceName)
  File "/opt/zenoss/Products/ZenModel/DeviceClass.py", line 436, in _findDevice
    devices = self._getCatalog().evalAdvancedQuery(query, (rankSort,))
  File "/opt/zenoss/lib/python/Products/AdvancedQuery/eval.py", line 40, in eval
    rs = _eval(query, cat)
  File "/opt/zenoss/lib/python/Products/AdvancedQuery/eval.py", line 16, in _eval
    rs = query._eval(_QueryContext(cat))
  File "/opt/zenoss/lib/python/Products/AdvancedQuery/AdvancedQuery.py", line 235, in _eval
    for q in sqs: r = union(r,q._eval(context))
  File "/opt/zenoss/lib/python/Products/AdvancedQuery/AdvancedQuery.py", line 84, in _eval
    return context._applyIndex(self, term)
  File "/opt/zenoss/lib/python/Products/AdvancedQuery/AdvancedQuery.py", line 278, in _applyIndex
    res = cat.indexes[index].__of__(cat)._apply_index(
KeyError: 'titleOrId'
Traceback (most recent call last):
  File "/opt/zenoss/Products/ZenStatus/zenping.py", line 162, in loadConfig
    oldtree, self.pingtree = self.pingtree, driver.next()
  File "/opt/zenoss/Products/ZenUtils/Driver.py", line 64, in result
    raise ex
RemoteException: Remote exception: exceptions.KeyError: 'titleOrId'Traceback (most recent call last):
  File "/opt/zenoss/Products/ZenHub/PBDaemon.py", line 75, in inner
    return callable(*args, **kw)
  File "/opt/zenoss/Products/ZenHub/services/PingConfig.py", line 23, in remote_getPingTree
    return self.getPingTree(self.dmd, root, fallbackIp)
  File "/opt/zenoss/Products/ZenHub/services/PingConfig.py", line 27, in getPingTree
    me = pm.findDevice(root)
  File "/opt/zenoss/Products/ZenModel/PerformanceConf.py", line 255, in findDevice
    brains = self.dmd.Devices._findDevice(deviceName)
  File "/opt/zenoss/Products/ZenModel/DeviceClass.py", line 436, in _findDevice
    devices = self._getCatalog().evalAdvancedQuery(query, (rankSort,))
  File "/opt/zenoss/lib/python/Products/AdvancedQuery/eval.py", line 40, in eval
    rs = _eval(query, cat)
  File "/opt/zenoss/lib/python/Products/AdvancedQuery/eval.py", line 16, in _eval
    rs = query._eval(_QueryContext(cat))
  File "/opt/zenoss/lib/python/Products/AdvancedQuery/AdvancedQuery.py", line 235, in _eval
    for q in sqs: r = union(r,q._eval(context))
  File "/opt/zenoss/lib/python/Products/AdvancedQuery/AdvancedQuery.py", line 84, in _eval
    return context._applyIndex(self, term)
  File "/opt/zenoss/lib/python/Products/AdvancedQuery/AdvancedQuery.py", line 278, in _applyIndex
    res = cat.indexes[index].__of__(cat)._apply_index(
KeyError: 'titleOrId'

Report Abuse
Like (0)

tort
2 posts since
Jun 5, 2009

Currently Being Moderated

2. Nov 4, 2009 10:45 PM (in response to bobrmr)
Re: errors after upgrade to 2.5

Hi there,

I've had (have) the same problem after upgrading from 2.4.5 to 2.5.0 on CentOS 5.3 i386 box...
It would seem that the upgrade does not perform a successful migrate (for whatever reason) and I'm still unable to revive the original zenoss instance that has been running for the past year.

What I manage to do however was this:
- Started a new fresh build of Zenoss 2.4.5 and apply the critical Zenpack (including community ones like the WMIData)
- Added a few devices and confirmed that Data is being logged
- Updated new 2.4.5 installation to v 2.5.0
- Restarted zenoss (service zenoss restart)
* At this stage zenoss was broken like before...
- Installed Zenpack 2.5.0 ( this failed with the usual error = KeyError: 'titleOrId' )
- manually issued a zenmigrate (as user zenoss; i.e su - u zenoss zenmigrate)
* At this stage zenoss went throuh the migration and updated all the indexes etc...
- Did a forced install of the Zenpack core
* Zenoss is now (kind of) working... (Having trouble displaying the new Events console)

It seems that something in the original zenoss setup kept blocking the upgrade...

Hope this helps you and you can fix your problem by doing a zenmigrate, unfortunately I have no solution to fix without losing the data...

Tort

Report Abuse

Like (0)
Paul Theodoropoulos
63 posts since
May 20, 2008

Currently Being Moderated

3. Nov 30, 2009 6:07 PM (in response to bobrmr)
Re: errors after upgrade to 2.5

so, i've just screwed myself with this same issue. i had done an upgrade from 2.4.2 to 2.5 back in early november, everything went to hell with the "Reason: KeyError: 'titleOrId'" failure. i managed to restore from my backup, and get back a running installation, which i then upgraded from 2.4.2 to 2.4.5.

today, i tried again, with 2.5.1. this time i had a brain fart, and did everything *except* perform the zenoss backups before starting. dooooh! and, the installation has suffered the same problem. i can poke around within zenoss - using existing tabs to zenoss that i had in zenoss, i can get to my various servers, view their performance graphs, event page, but can't go to the main 'status' subpage, which generates the aforementioned zenoss error.

i tried the zenmigrated listed in the previous response, but i get this -

[zenoss@zenoss ~]$ zenmigrate
INFO:zen.migrate:Database going to version Zenoss 2.5.1
INFO:zen.migrate:Installing AddConfigTimeDataPoints (2.5.0)
INFO:zen.migrate:Installing AddEventQueueLength (2.5.0)
INFO:zen.migrate:Installing AddFilesystemAndInterfaceDataPointAliases (2.5.0)
Recovering
Traceback (most recent call last):
File "/opt/zenoss/Products/ZenModel/migrate/zenmigrate.py", line 21, in ?
    main()
File "/opt/zenoss/Products/ZenModel/migrate/zenmigrate.py", line 18, in main
    m.main()
File "/opt/zenoss/Products/ZenModel/migrate/Migrate.py", line 425, in main
    self.cutover()
File "/opt/zenoss/Products/ZenModel/migrate/Migrate.py", line 305, in cutover
    self.migrate()
File "/opt/zenoss/Products/ZenModel/migrate/Migrate.py", line 281, in migrate
    m.cutover(self.dmd)
File "/opt/zenoss/Products/ZenModel/migrate/addFilesystemAndInterfaceDataPointAliases.py", line 30, in cutover
    {'ifInOctets' : ('inputOctets__bytes',),
File "/opt/zenoss/Products/ZenModel/migrate/addFilesystemAndInterfaceDataPointAliases.py", line 22, in attachAliases
    dp.addAlias( *aliasMap[dp.id] )
File "/opt/zenoss/Products/ZenModel/RRDDataPoint.py", line 178, in addAlias
    manage_addDataPointAlias( self, id, formula )
File "/opt/zenoss/Products/ZenModel/RRDDataPointAlias.py", line 39, in manage_addDataPointAlias
    context.aliases._setObject( id, alias )
AttributeError: 'function' object has no attribute '_setObject'
[zenoss@zenoss ~]$

and, without backups this time - i'm screwed for getting things working again. i've got about a hundred servers in my zenoss install, and a couple of years of performance data - i don't want to lose it!

i imagine there has to be some way to patch the db or something- there has to be a means of fixing it. right? the thing that's frustrating is that there's really nothing particularly out of the ordinary with my installation. it ran fine forever on the previous version(s). it's all linux servers being monitored. help!

Report Abuse

Like (0)
Paul Theodoropoulos
63 posts since
May 20, 2008

Currently Being Moderated

4. Nov 30, 2009 7:22 PM (in response to Paul Theodoropoulos)
Re: errors after upgrade to 2.5

i found the fix! woot!

i ran zenmigrate --help
saw the --list and --step options
ran that
noticed this:
2.5.0 AddTitleOrIdToCatalogs Not Documented
so, i ran
zenmigrate --step=AddTitleOrIdToCatalogs
and got this output:

INFO:zen.migrate:Database going to version Zenoss 2.5.0
INFO:zen.migrate:Installing AddTitleOrIdToCatalogs (2.5.0)
INFO:zen.migrate:Reindexing devices. This may take a while...
INFO:zen.migrate:committing
INFO:zen.migrate:Migration successful

and now all my devices are visible in the device list, and i can visit all the subpages.

so i guess the apparently failed AddFilesystemAndInterfaceDataPointAliases just stops all migrations, and leaves things inconsistent. i'm now going to manually run the other steps and see what comes up.

man. what a relief.

Report Abuse

Like (0)
Paul Theodoropoulos
63 posts since
May 20, 2008

Currently Being Moderated

5. Nov 30, 2009 7:37 PM (in response to Paul Theodoropoulos)
Re: errors after upgrade to 2.5

so, i ran through all the remaining steps of the migrate, and they all ran successfully. the only one that repeatedly failed was AddFilesystemAndInterfaceDataPointAliases. curiously though, after running through the steps, i ran a plain 'zenmigrate' just for grins, and that gave an output of simply

[zenoss@zenoss ~]$ zenmigrate
INFO:zen.migrate:Installing AddressEncoding (2.5.1)
INFO:zen.migrate:Loading Reports

after that, i ran a force install of the zenpacks, which finally did install correctly.

Report Abuse

Like (0)
nxumdon
65 posts since
Oct 27, 2008

Currently Being Moderated

6. Dec 4, 2009 3:39 PM (in response to Paul Theodoropoulos)
Re: errors after upgrade to 2.5

Woot, saved my hide too! Thanks a ton for this!

Report Abuse

Like (0)
Paul Theodoropoulos
63 posts since
May 20, 2008

Currently Being Moderated

7. Dec 7, 2009 2:29 PM (in response to nxumdon)
Re: errors after upgrade to 2.5

awesome. glad i could help someone else.

Report Abuse

Like (0)
dswope
60 posts since
Jul 10, 2009

Currently Being Moderated

8. Apr 13, 2010 10:43 AM (in response to Paul Theodoropoulos)
Re: errors after upgrade to 2.5

I am attempting to update from 2.4.2 to 2.5.1 (before going to 2.5.2) and am unable to view the event console and of course get the infamous "Server Connection Error" message. Daemons not starting properly

I did a zenmigrate --step=AddTitleOrldToCatalogs and this is the output

zenmigrate --step=AddTitleOrldToCatalogs
INFO:zen.migrate:committing
INFO:zen.migrate:Migration successful

I did a zenmigrate and this is the output, this looks better as it is updating the database to 2.5.1 but it fails at the end

[zenoss@evuszenoss root]$ zenmigrate
INFO:zen.migrate:Database going to version Zenoss 2.5.1
INFO:zen.migrate:Installing AddConfigTimeDataPoints (2.5.0)
INFO:zen.migrate:Installing AddEventQueueLength (2.5.0)
INFO:zen.migrate:Installing AddFilesystemAndInterfaceDataPointAliases (2.5.0)
Recovering
Traceback (most recent call last):
File "/opt/zenoss/Products/ZenModel/migrate/zenmigrate.py", line 21, in ?
    main()
File "/opt/zenoss/Products/ZenModel/migrate/zenmigrate.py", line 18, in main
    m.main()
File "/opt/zenoss/Products/ZenModel/migrate/Migrate.py", line 425, in main
    self.cutover()
File "/opt/zenoss/Products/ZenModel/migrate/Migrate.py", line 305, in cutover
    self.migrate()
File "/opt/zenoss/Products/ZenModel/migrate/Migrate.py", line 281, in migrate
    m.cutover(self.dmd)
File "/opt/zenoss/Products/ZenModel/migrate/addFilesystemAndInterfaceDataPointAliases.py", line 30, in cutover
    {'ifInOctets' : ('inputOctets__bytes',),
File "/opt/zenoss/Products/ZenModel/migrate/addFilesystemAndInterfaceDataPointAliases.py", line 22, in attachAliases
    dp.addAlias( *aliasMap[dp.id] )
File "/opt/zenoss/Products/ZenModel/RRDDataPoint.py", line 178, in addAlias
    manage_addDataPointAlias( self, id, formula )
File "/opt/zenoss/Products/ZenModel/RRDDataPointAlias.py", line 39, in manage_addDataPointAlias
    context.aliases._setObject( id, alias )
AttributeError: 'function' object has no attribute '_setObject'

Report Abuse

Like (0)
dswope
60 posts since
Jul 10, 2009

Currently Being Moderated

9. Apr 13, 2010 12:20 PM (in response to dswope)
Re: errors after upgrade to 2.5

Good lord...I found a mistake in the details.

zenmigrate --step=AddTitleOrldToCatalogs

I put L instead of i

Report Abuse

Like (0)

Go to original post

Legend

Correct Answers - 4 points
Helpful Answers - 2 points

Nov 4, 2009 4:54 PM

errors after upgrade to 2.5

Actions

More Like This

Legend