Post 3.2 Upgrade issues - Open Source Network Monitoring and Systems Management

Up to Discussions in zenoss-users

1 2 3 4 Previous Next 15430 Views 47 Replies Latest reply: Mar 6, 2012 12:24 PM by Shane Scott

Go to original post

jmp242
4,060 posts since
Mar 7, 2007

Currently Being Moderated

15. Sep 12, 2011 10:16 AM (in response to blackice8r)
Re: Post 3.2 Upgrade issues

You should put the python tool somewhere the zenoss user can access it, maybe /tmp. Then login as the zenoss user, and navigate to wherever you put the file.

You should then be able to simply do

python zenfixit.py

and it ought to run.

--
James Pulver
Information Technology Area Supervisor
LEPP Computer Group
Cornell University

Report Abuse

Like (0)
blackice8r
5 posts since
Sep 5, 2011

Currently Being Moderated

16. Sep 13, 2011 11:20 AM (in response to jmp242)
Re: Post 3.2 Upgrade issues

thank you...I tried it but it didn't fix Zenoss

zenoss@xxx:/tmp$ python zenfixit.py
Cleaning up invalid entries from catalogs:
* deviceSearch
* componentSearch
* layer3_catalog
* maintenanceWindowSearch
* zenPackPersistence
    - removing /zport/ethernetCsmacd/datasources/PerfRawData.
    - removing /zport/copy_of_FileSystem/datasources/usedBlocksWMI.
    - removing /zport/FileSystem/datasources/usedBlocks.
    - removing /zport/Device/datasources/PerfOSMemory.
    - removing /zport/Device/datasources/sysUpTime.
    - removing Device/datasources/Processor.
    - removing /zport/ethernetCsmacd/datasources/ifOperStatus.
    - removing /zport/OSProcess/datasources/Process.
    - removing /zport/Win32DiskDrive/datasources/DiskDrive.
    - removing Win32DiskDrive/datasources/DiskDrive.
    - removing /zport/FileSystem/datasources/PerfDisk.
    - removing ethernetCsmacd/datasources/PerfRawData.
    - removing copy_of_FileSystem/datasources/usedBlocksWMI.
    - removing /zport/Device/datasources/Processor.
    - removing Device/datasources/sysUpTime.
    - removing ethernetCsmacd/datasources/ifOperStatus.
    - removing /zport/Win32DiskDrive/datasources/PerfDisk.
    - removing FileSystem/datasources/PerfDisk.
    - removing FileSystem/datasources/usedBlocks.
    - removing Device/datasources/PerfOSMemory.
    - removing OSProcess/datasources/Process.
    - removing Win32DiskDrive/datasources/PerfDisk.

Cleaning up any admin roles associated to invalid users.
Updating component catalog with monitor state from database.
Verifying that all devices have a deviceClass relation.
Removing invalid devices from collectors.
Converting important values from unicode to string.
Unbinding component templates from devices.
Removing IP addresses linked to invalid devices.

I cleared the browser's History and checked Zenoss...no change

zenoss@xxx:/tmp$ zenoss restart
Daemon: zenperfwmi stopping...
Daemon: zeneventlog stopping...
Daemon: zenwin stopping...
Daemon: zenprocess stopping...
Daemon: zencommand stopping...
Daemon: zenperfsnmp stopping...
Daemon: zenmodeler stopping...
Daemon: zentrap stopping...
Daemon: zenactions stopping...
Daemon: zenstatus stopping...
Daemon: zensyslog stopping...
Daemon: zenping stopping...
Daemon: zenjobs stopping...
Daemon: zenhub stopping...
Daemon: zopectl .
daemon process stopped
Daemon: zeoctl .
daemon process stopped
Daemon: zeoctl .
daemon process started, pid=21043
Daemon: zopectl .
daemon process started, pid=21054
Daemon: zenhub starting...
Daemon: zenjobs starting...
Daemon: zenping starting...
Daemon: zensyslog starting...
Daemon: zenstatus starting...
Daemon: zenactions starting...
Daemon: zentrap starting...
Daemon: zenmodeler starting...
Daemon: zenperfsnmp starting...
Daemon: zencommand starting...
Daemon: zenprocess starting...
Daemon: zenwin starting...
Daemon: zeneventlog starting...
Daemon: zenperfwmi starting...

Cleared again the browser's history and checked Zenoss...no joy
Rebooted Ubuntu...no change.

Any other suggestions?

Would I be able to export the current setup, templates etc..remove and re-install Zenoss and import?

My boss spent days tweaking the templates.

Report Abuse

Like (0)
ones_and_zeros
12 posts since
Mar 31, 2010

Currently Being Moderated

17. Sep 13, 2011 1:52 PM (in response to blackice8r)
Re: Post 3.2 Upgrade issues

so exactly what is the issue you're seeing at this point since running zenfixit and restarting?

Report Abuse

Like (0)
Insane_Homer
54 posts since
Nov 21, 2008

Currently Being Moderated

18. Sep 14, 2011 3:22 AM (in response to ones_and_zeros)
Re: Post 3.2 Upgrade issues

python zenfixit.py
Traceback (most recent call last):
File "zenfixit.py", line 3, in <module>
from Products.ZenUtils.ZenScriptBase import ZenScriptBase
ImportError: No module named ZenUtils.ZenScriptBase

resulting in the same error as before on when browsing to the infrastucture page

The server reported the following error:
Unable to connect to the server.

Report Abuse

Like (0)
blackice8r
5 posts since
Sep 5, 2011

Currently Being Moderated

19. Sep 15, 2011 12:08 PM (in response to Insane_Homer)
Re: Post 3.2 Upgrade issues

every single time when I try to view Events, the fallowing errors come up:

2011-09-13T11:40:23 ERROR extdirect 'allowedRolesAndUsers'
Traceback (most recent call last):
File "/usr/local/zenoss/zenoss/Products/ZenUtils/extdirect/router.py", line 128, in _processDirectRequest
    result = _targetfn(**data)
File "/usr/local/zenoss/zenoss/Products/Zuul/routers/device.py", line 175, in getDevices
    devices, details = facade.getDeviceList(uid, start, limit, sort, dir, params)
File "/usr/local/zenoss/zenoss/Products/Zuul/facades/devicefacade.py", line 147, in getDeviceList
    query=query, hashcheck=hashcheck)
File "/usr/local/zenoss/zenoss/Products/Zuul/tree.py", line 286, in search
    queryResults = self._queryCatalog(types, queryOrderby, reverse, paths, depth, query)
File "/usr/local/zenoss/zenoss/Products/Zuul/tree.py", line 378, in _queryCatalog
    result = self.catalog.evalAdvancedQuery(*args)
File "/usr/local/zenoss/python/lib/python2.6/site-packages/Products.AdvancedQuery-3.0-py2.6.egg/Products/AdvancedQuery/eval.py", line 40, in eval
    rs = _eval(query, cat)
File "/usr/local/zenoss/python/lib/python2.6/site-packages/Products.AdvancedQuery-3.0-py2.6.egg/Products/AdvancedQuery/eval.py", line 16, in _eval
    rs = query._eval(_QueryContext(cat))
File "/usr/local/zenoss/python/lib/python2.6/site-packages/Products.AdvancedQuery-3.0-py2.6.egg/Products/AdvancedQuery/AdvancedQuery.py", line 220, in _eval
    for q in nsq: r = intersection(r, q._eval(context))
File "/usr/local/zenoss/python/lib/python2.6/site-packages/Products.AdvancedQuery-3.0-py2.6.egg/Products/AdvancedQuery/AdvancedQuery.py", line 84, in _eval
    return context._applyIndex(self, term)
File "/usr/local/zenoss/python/lib/python2.6/site-packages/Products.AdvancedQuery-3.0-py2.6.egg/Products/AdvancedQuery/AdvancedQuery.py", line 278, in _applyIndex
    res = cat.indexes[index].__of__(cat)._apply_index(
KeyError: 'allowedRolesAndUsers'
------
2011-09-13T11:41:15 ERROR extdirect 'allowedRolesAndUsers'
Traceback (most recent call last):
File "/usr/local/zenoss/zenoss/Products/ZenUtils/extdirect/router.py", line 128, in _processDirectRequest
    result = _targetfn(**data)
File "/usr/local/zenoss/zenoss/Products/Zuul/routers/device.py", line 175, in getDevices
    devices, details = facade.getDeviceList(uid, start, limit, sort, dir, params)
File "/usr/local/zenoss/zenoss/Products/Zuul/facades/devicefacade.py", line 147, in getDeviceList
    query=query, hashcheck=hashcheck)
File "/usr/local/zenoss/zenoss/Products/Zuul/tree.py", line 286, in search
    queryResults = self._queryCatalog(types, queryOrderby, reverse, paths, depth, query)
File "/usr/local/zenoss/zenoss/Products/Zuul/tree.py", line 378, in _queryCatalog
    result = self.catalog.evalAdvancedQuery(*args)
File "/usr/local/zenoss/python/lib/python2.6/site-packages/Products.AdvancedQuery-3.0-py2.6.egg/Products/AdvancedQuery/eval.py", line 40, in eval
    rs = _eval(query, cat)
File "/usr/local/zenoss/python/lib/python2.6/site-packages/Products.AdvancedQuery-3.0-py2.6.egg/Products/AdvancedQuery/eval.py", line 16, in _eval
    rs = query._eval(_QueryContext(cat))
File "/usr/local/zenoss/python/lib/python2.6/site-packages/Products.AdvancedQuery-3.0-py2.6.egg/Products/AdvancedQuery/AdvancedQuery.py", line 220, in _eval
    for q in nsq: r = intersection(r, q._eval(context))
File "/usr/local/zenoss/python/lib/python2.6/site-packages/Products.AdvancedQuery-3.0-py2.6.egg/Products/AdvancedQuery/AdvancedQuery.py", line 84, in _eval
    return context._applyIndex(self, term)
File "/usr/local/zenoss/python/lib/python2.6/site-packages/Products.AdvancedQuery-3.0-py2.6.egg/Products/AdvancedQuery/AdvancedQuery.py", line 278, in _applyIndex
    res = cat.indexes[index].__of__(cat)._apply_index(
KeyError: 'allowedRolesAndUsers'
------
2011-09-13T16:02:03 INFO zen.ZenossInfo Telling zeoctl to stop
------
2011-09-13T16:02:03 INFO zen.ZenossInfo Telling zopectl to stop
------
2011-09-13T16:02:04 INFO zen.ZenossInfo Telling zenhub to stop
------
2011-09-13T16:02:04 INFO ZEO.ClientStorage zeostorage Disconnected from storage: "('localhost', 8100)"
------
2011-09-13T16:02:04 WARNING ZEO.zrpc (15597) CW: error connecting to ('localhost', 8100): ECONNREFUSED
------
2011-09-13T16:02:04 INFO zen.ZenossInfo Telling zenjobs to stop
------
2011-09-13T16:02:04 INFO SignalHandler Caught signal SIGTERM
------
2011-09-13T16:02:04 INFO Z2 Shutting down fast
------
2011-09-13T16:02:04 INFO ZServer closing HTTP to new connections
------
2011-09-13T16:02:57 INFO ZServer HTTP server started at Tue Sep 13 16:02:57 2011
Hostname: 0.0.0.0
Port: 8080
------
2011-09-13T16:02:58 INFO ZEO.ClientStorage zeostorage ClientStorage (pid=19989) created RW/normal for storage: '1'
------
2011-09-13T16:02:58 INFO ZEO.cache created temporary cache file '<fdopen>'
------
2011-09-13T16:02:58 INFO ZEO.ClientStorage zeostorage Testing connection <ManagedClientConnection ('127.0.0.1', 8100)>
------
2011-09-13T16:02:58 INFO ZEO.zrpc.Connection(C) (localhost:8100) received handshake 'Z309'
------
2011-09-13T16:02:59 INFO ZEO.ClientStorage zeostorage Server authentication protocol None
------
2011-09-13T16:02:59 INFO ZEO.ClientStorage zeostorage Connected to storage: ('localhost', 8100)
------
2011-09-13T16:02:59 INFO ZEO.ClientStorage zeostorage No verification necessary -- empty cache
------
2011-09-13T16:03:01 INFO Zope_Hotfix_20110622 Patched traverse method of zope.traversing.namespaces.resource.
------
2011-09-13T16:03:01 INFO Zope_Hotfix_20110622 Disabled acquire traverser.
------
2011-09-13T16:03:01 INFO Zope_Hotfix_20110622 Disabled attr traverser.
------
2011-09-13T16:03:01 INFO Zope_Hotfix_20110622 Disabled item traverser.
------
2011-09-13T16:03:01 INFO Zope_Hotfix_20110622 Disabled lang traverser.
------
2011-09-13T16:03:01 INFO Zope_Hotfix_20110622 Disabled vh traverser.
------
2011-09-13T16:03:01 INFO Zope_Hotfix_20110622 Hotfix installed.
------
2011-09-13T16:03:01 INFO Zope Ready to handle requests

Advanced>Daemons>zopectl

Do you think it's related ?

Report Abuse

Like (0)
blackice8r
5 posts since
Sep 5, 2011

Currently Being Moderated

20. Sep 16, 2011 4:59 AM (in response to blackice8r)
Re: Post 3.2 Upgrade issues

it's fixed now.

My boss updated the zenpacks and run zenmigrate twice...

Job done, zenoss running fine now, I'm going to be looking into regular backups now on...we don't want this happening again...

I hope this helps other people.

Report Abuse

Like (0)
darkis
22 posts since
Nov 12, 2007

Currently Being Moderated

21. Oct 14, 2011 8:50 AM (in response to Insane_Homer)
Re: Post 3.2 Upgrade issues

I have the same errors as described in the post. Both zenmigrate and zenfixit give me this error:

AttributeError: 'HPCPU' object has no attribute 'index_object'

Anyone have any ideas where I should look to fix that error?

Report Abuse

Like (0)
Insane_Homer
54 posts since
Nov 21, 2008

Currently Being Moderated

22. Oct 14, 2011 11:07 AM (in response to darkis)
Re: Post 3.2 Upgrade issues

mmm, that's got me thinking. Looking at some othe Zenpacks. I see ZenPacks.zenoss.HPMonitor-2.1.0-py2.4.egg.zip.

But I see my python version is 2.6 and there's a 2.6 version of this Zenpack from

servlet/JiveServlet/download/3448-7-2902/ZenPacks.zenoss.HPMonitor-2.1.0-py2.6.egg.zip (docs/DOC-3448)

So I guess the Question is how to I replace the 2.4 Zenpack with the 2.6 Zenpack?

I can't seem to remove the 2.4 version via the web interface.

Report Abuse

Like (0)
darkis
22 posts since
Nov 12, 2007

Currently Being Moderated

23. Oct 14, 2011 11:33 AM (in response to Insane_Homer)
Re: Post 3.2 Upgrade issues

I used zenpack --remove=ZenPacks.zenoss.HPMonitor to remove it. Just tried to install the 2.6 version instead. Running a zenmigrate now to see if it works better now. Will return when it's done

Report Abuse

Like (0)
Insane_Homer
54 posts since
Nov 21, 2008

Currently Being Moderated

24. Oct 14, 2011 11:48 AM (in response to darkis)
Re: Post 3.2 Upgrade issues

Downloading the 2.6 version of the Zenpacks from http://dev.zenoss.org/zenpacks/ now - installed them successfully (seem to replace the old but also deleted the old zenpack py2.4 folders) but still get the same errors as before.

Now getting...

zenmigrate
INFO:zen.migrate:Database going to version Zenoss 3.1.70
INFO:zen.migrate:Installing DeviceSearchCatalogUpdate (3.1.1)
INFO:zen.migrate:Installing IpSearchCatalogUpdate (3.1.1)
INFO:zen.migrate:Updating IpAddress Catalog
INFO:zen.migrate:rate=57.49/sec count=200
INFO:zen.migrate:Finished total time=4.08 rate=58.04 count=237
INFO:zen.migrate:Installing RebuildPathIndex (3.1.1)
WARNING:zen.migrate:Recovering
Traceback (most recent call last):
File "/usr/local/zenoss/Products/ZenModel/migrate/zenmigrate.py", line 21, in <module>
    main()
File "/usr/local/zenoss/Products/ZenModel/migrate/zenmigrate.py", line 18, in main
    m.main()
File "/usr/local/zenoss/Products/ZenModel/migrate/Migrate.py", line 417, in main
    self.cutover()
File "/usr/local/zenoss/Products/ZenModel/migrate/Migrate.py", line 304, in cutover
    self.migrate()
File "/usr/local/zenoss/Products/ZenModel/migrate/Migrate.py", line 280, in migrate
    m.cutover(self.dmd)
File "/usr/local/zenoss/Products/ZenModel/migrate/rebuildPathIndex.py", line 41, in cutover
    for x in zport.global_catalog():
TypeError: 'GlobalCatalog' object is not callable

Still get the same errors when trying to view Infrastructure.

Report Abuse

Like (0)
VBinet
5 posts since
Oct 22, 2010

Currently Being Moderated

25. Oct 14, 2011 11:49 AM (in response to Insane_Homer)
Re: Post 3.2 Upgrade issues

If I remember correctly I didn't have to remove zenpacks. They were removed automatically when I installed the new ones.
If I'm wrong, you should find the "delete ZenPack" action in the "Advance -> Settings -> Zenpacks" window (see attached screenshot).

Report Abuse

Like (0)
darkis
22 posts since
Nov 12, 2007

Currently Being Moderated

26. Oct 14, 2011 12:25 PM (in response to Insane_Homer)
Re: Post 3.2 Upgrade issues

I still get the same error in zenmigrate as I did before even with the 2.6 version of HPmonitor

Report Abuse

Like (0)
Shane Scott
1,373 posts since
Jul 6, 2009

Currently Being Moderated

27. Oct 18, 2011 11:16 PM (in response to Insane_Homer)
Re: Post 3.2 Upgrade issues

Insane_Homer:

Sounds like your global catalog is messed up. Have you tried running a `python $ZENHOME/Products/ZenUtils/zencatalog.py --createcatalog --forcereindex` as user zenoss?

Best,
--Shane W. Scott(Hackman238)
ZCA - community/zca/blog

Report Abuse

Like (0)
Insane_Homer
54 posts since
Nov 21, 2008

Currently Being Moderated

28. Oct 19, 2011 7:47 AM (in response to Shane Scott)
Re: Post 3.2 Upgrade issues

Shane,

thanks, I get the following running at command

python zencatalog.py --createcatalog --forcereindex
Traceback (most recent call last):
File "zencatalog.py", line 25, in <module>
from Products.ZenRelations.ToManyContRelationship import ToManyContRelationship
ImportError: No module named ZenRelations.ToManyContRelationship

... and made no difference. Still the same issue.

Report Abuse

Like (0)
Shane Scott
1,373 posts since
Jul 6, 2009

Currently Being Moderated

29. Oct 19, 2011 9:03 AM (in response to Insane_Homer)
Re: Post 3.2 Upgrade issues

Insane_Homer:

Oh yikes. Thats a pretty serious error. Did you run this as user zenoss? Can you post the output of `env` as user zenoss?

Thanks!

Best,
--Shane W. Scott(Hackman238)
ZCA - community/zca/blog

Report Abuse

Like (0)

1 2 3 4 Previous Next

Go to original post

Legend

Correct Answers - 4 points
Helpful Answers - 2 points

Actions

More Like This

Legend