dseagren:
Before you upgrade again I'd try a zenchkrels -x1 -r and zenfixit.py to clear up any half relationships. All processes should be stopped during the upgrade, like the instructions say. If something doesn't die gracefully in 2-3 minutes kill -7 or kill -9 the remaining items.
Best,
--Shane
quick update. Went through the install a couple more times trying different things each time. tried stopping the mysql before upgrading but still not luck. going to try upgrading via the stack installer and see how that goes.
The bin install is a no go since the original install was rpms. I'm going to just have to figure it out. I've looked through the logs after the install and don't see any smoking guns. ideas? to recap: navigating to events or infrastructure after the upgrade yield the unable to connect to server error. all daemons are running.
dseagren:
Have you tried clearing your cookies? I know that sounds silly, but try it.
Can you post the page error?
Best,
--Shane
dseagren:
On the zenoss master, `su zenoss`, `zopectl stop`, `zopectl fg`
Are there any errors in the console?
Navigate to a problem page. Are there any errors in the console?
Thanks!
--Shane
Thanks for this thread.. I've been reading it, like checking of a checklist of my past day or so. (thanks for the tip on clearing the cookies/temp files.. that was driving me nuts) I couldn't figure out why a VMWare rollback to previous snapshot would have problems.. now it seems obvious
I am using the vmware appliance for 3.0, and upgrading to 3.2.1. same exact thing as you saw. Things would kind of load, but not really.. lots of times I would see that error msg. Emails were going out about hosts being down that were up.. No device had any components listed, etc. A bit weird, since its an 'official' zenoss image, with very, very few changes.. ( a few zenpacks, and some custom python scripts).
I will try it again in a few days, but I am having trouble seeing any actual step by step directions on the upgrade process.
running zope in debug I don't get any errors until I click on a problem area which yields:
2011-10-27 08:46:44 ERROR Zope.SiteErrorLog 1319723204.20.924742817039 http://usl-zenoss:8080/zport/dmd/Events/evconsole_router
Traceback (innermost last):
Module ZPublisher.Publish, line 127, in publish
Module ZPublisher.mapply, line 77, in mapply
Module ZPublisher.Publish, line 47, in call_object
Module Products.ZenUtils.extdirect.zope.router, line 24, in __call__
Module Products.ZenUtils.extdirect.router, line 88, in __call__
Module Products.ZenUtils.jsonutils, line 152, in json
Module json, line 230, in dumps
Module json.encoder, line 367, in encode
Module json.encoder, line 309, in _iterencode
Module json.encoder, line 275, in _iterencode_dict
Module json.encoder, line 309, in _iterencode
Module json.encoder, line 275, in _iterencode_dict
Module json.encoder, line 306, in _iterencode
Module json.encoder, line 204, in _iterencode_list
Module json.encoder, line 309, in _iterencode
Module json.encoder, line 275, in _iterencode_dict
Module json.encoder, line 309, in _iterencode
Module json.encoder, line 275, in _iterencode_dict
Module json.encoder, line 317, in _iterencode
Module json.encoder, line 323, in _iterencode_default
Module json.encoder, line 344, in default
TypeError: <bound method DeviceClass.titleOrId of <DeviceClass at /zport/dmd/Devices>> is not JSON serializable
2011-10-27 08:46:44 ERROR Zope.SiteErrorLog 1319723204.920.622257176152 http://usl-zenoss:8080/zport/dmd/Events/evconsole_router
Traceback (innermost last):
Module ZPublisher.Publish, line 127, in publish
Module ZPublisher.mapply, line 77, in mapply
Module ZPublisher.Publish, line 47, in call_object
Module Products.ZenUtils.extdirect.zope.router, line 24, in __call__
Module Products.ZenUtils.extdirect.router, line 88, in __call__
Module Products.ZenUtils.jsonutils, line 152, in json
Module json, line 230, in dumps
Module json.encoder, line 367, in encode
Module json.encoder, line 309, in _iterencode
Module json.encoder, line 275, in _iterencode_dict
Module json.encoder, line 309, in _iterencode
Module json.encoder, line 275, in _iterencode_dict
Module json.encoder, line 306, in _iterencode
Module json.encoder, line 204, in _iterencode_list
Module json.encoder, line 309, in _iterencode
Module json.encoder, line 275, in _iterencode_dict
Module json.encoder, line 309, in _iterencode
Module json.encoder, line 275, in _iterencode_dict
Module json.encoder, line 317, in _iterencode
Module json.encoder, line 323, in _iterencode_default
Module json.encoder, line 344, in default
TypeError: <bound method DeviceClass.titleOrId of <DeviceClass at /zport/dmd/Devices>> is not JSON serializable
2011-10-27 08:47:00 ERROR extdirect 'allowedRolesAndUsers'
Traceback (most recent call last):
File "/opt/zenoss/Products/ZenUtils/extdirect/router.py", line 128, in _processDirectRequest
result = _targetfn(**data)
File "/opt/zenoss/Products/Zuul/routers/device.py", line 181, in getDevices
devices, details = facade.getDeviceList(uid, start, limit, sort, dir, params)
File "/opt/zenoss/Products/Zuul/facades/devicefacade.py", line 147, in getDeviceList
query=query, hashcheck=hashcheck)
File "/opt/zenoss/Products/Zuul/tree.py", line 290, in search
queryResults = self._queryCatalog(types, queryOrderby, reverse, paths, depth, query)
File "/opt/zenoss/Products/Zuul/tree.py", line 382, in _queryCatalog
result = self.catalog.evalAdvancedQuery(*args)
File "/opt/zenoss/lib/python/Products/AdvancedQuery/eval.py", line 40, in eval
rs = _eval(query, cat)
File "/opt/zenoss/lib/python/Products/AdvancedQuery/eval.py", line 16, in _eval
rs = query._eval(_QueryContext(cat))
File "/opt/zenoss/lib/python/Products/AdvancedQuery/AdvancedQuery.py", line 220, in _eval
for q in nsq: r = intersection(r, q._eval(context))
File "/opt/zenoss/lib/python/Products/AdvancedQuery/AdvancedQuery.py", line 84, in _eval
return context._applyIndex(self, term)
File "/opt/zenoss/lib/python/Products/AdvancedQuery/AdvancedQuery.py", line 278, in _applyIndex
res = cat.indexes[index].__of__(cat)._apply_index(
KeyError: 'allowedRolesAndUsers'
2011-10-27 08:47:02 ERROR extdirect 'allowedRolesAndUsers'
Traceback (most recent call last):
File "/opt/zenoss/Products/ZenUtils/extdirect/router.py", line 128, in _processDirectRequest
result = _targetfn(**data)
File "/opt/zenoss/Products/Zuul/routers/device.py", line 181, in getDevices
devices, details = facade.getDeviceList(uid, start, limit, sort, dir, params)
File "/opt/zenoss/Products/Zuul/facades/devicefacade.py", line 147, in getDeviceList
query=query, hashcheck=hashcheck)
File "/opt/zenoss/Products/Zuul/tree.py", line 290, in search
queryResults = self._queryCatalog(types, queryOrderby, reverse, paths, depth, query)
File "/opt/zenoss/Products/Zuul/tree.py", line 382, in _queryCatalog
result = self.catalog.evalAdvancedQuery(*args)
File "/opt/zenoss/lib/python/Products/AdvancedQuery/eval.py", line 40, in eval
rs = _eval(query, cat)
File "/opt/zenoss/lib/python/Products/AdvancedQuery/eval.py", line 16, in _eval
rs = query._eval(_QueryContext(cat))
File "/opt/zenoss/lib/python/Products/AdvancedQuery/AdvancedQuery.py", line 220, in _eval
for q in nsq: r = intersection(r, q._eval(context))
File "/opt/zenoss/lib/python/Products/AdvancedQuery/AdvancedQuery.py", line 84, in _eval
return context._applyIndex(self, term)
File "/opt/zenoss/lib/python/Products/AdvancedQuery/AdvancedQuery.py", line 278, in _applyIndex
res = cat.indexes[index].__of__(cat)._apply_index(
KeyError: 'allowedRolesAndUsers'
One more thing I discovered is when looking at "monitoring templates" by "device class", the only thing that shows up is AWS and HTTP
dseagren:
Yikes! I'm going to get a second opinion on this error.
--Shane
internet explorer has this error when processing the page.
Webpage error details
User Agent: Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; WOW64; Trident/4.0; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Media Center PC 6.0; InfoPath.3)
Timestamp: Thu, 27 Oct 2011 16:44:06 UTC
Message: Expected identifier, string or number
Line: 212
Char: 13
Code: 0
URI: http://usl-zenoss:8080/++resource++deviceadvdetail/deviceAdvDetail.js
dseagren:
Let's try something/
As the zenoss user, `zencatalog run --forceindex --createcatalog`
It could take a while. When done, restart zenoss.
--Shane
dseagren:
Nice. Making progress. Stop zope with zopectl stop and then zopectl fg. Navigate to problem pages and post the trace.
Thanks man!
Best,
--Shane W. Scott(Hackman238)
ZCA - community/zca/blog
I'm working on removing 3rd party zenpacks to see if that helps. here is the zope debug:
[zenoss@usl-zenoss ~]$ zopectl fg
/opt/zenoss/bin/runzope -X debug-mode=on
2011-10-28 14:58:17 INFO ZServer HTTP server started at Fri Oct 28 14:58:17 2011
Hostname: 0.0.0.0
Port: 8080
2011-10-28 14:58:17 INFO ZEO.ClientStorage zeostorage ClientStorage (pid=25052) created RW/normal for storage: '1'
2011-10-28 14:58:17 INFO ZEO.cache created temporary cache file '<fdopen>'
2011-10-28 14:58:17 INFO ZEO.ClientStorage zeostorage Testing connection <ManagedClientConnection ('127.0.0.1', 8100)>
2011-10-28 14:58:17 INFO ZEO.zrpc.Connection(C) (localhost:8100) received handshake 'Z309'
2011-10-28 14:58:18 INFO ZEO.ClientStorage zeostorage Server authentication protocol None
2011-10-28 14:58:18 INFO ZEO.ClientStorage zeostorage Connected to storage: ('localhost.localdomain', 8100)
2011-10-28 14:58:18 INFO ZEO.ClientStorage zeostorage No verification necessary -- empty cache
2011-10-28 14:58:19 INFO Zope_Hotfix_20110622 Patched traverse method of zope.traversing.namespaces.resource.
2011-10-28 14:58:19 INFO Zope_Hotfix_20110622 Disabled acquire traverser.
2011-10-28 14:58:19 INFO Zope_Hotfix_20110622 Disabled attr traverser.
2011-10-28 14:58:19 INFO Zope_Hotfix_20110622 Disabled item traverser.
2011-10-28 14:58:19 INFO Zope_Hotfix_20110622 Disabled lang traverser.
2011-10-28 14:58:19 INFO Zope_Hotfix_20110622 Disabled vh traverser.
2011-10-28 14:58:19 INFO Zope_Hotfix_20110622 Hotfix installed.
2011-10-28 14:58:19 INFO Zope Ready to handle requests
2011-10-28 14:58:33 ERROR Zope.SiteErrorLog 1319831913.230.069971058588 http://usl-zenoss:8080/zport/dmd/evconsole_router
Traceback (innermost last):
Module ZPublisher.Publish, line 127, in publish
Module ZPublisher.mapply, line 77, in mapply
Module ZPublisher.Publish, line 47, in call_object
Module Products.ZenUtils.extdirect.zope.router, line 24, in __call__
Module Products.ZenUtils.extdirect.router, line 88, in __call__
Module Products.ZenUtils.jsonutils, line 152, in json
Module json, line 230, in dumps
Module json.encoder, line 367, in encode
Module json.encoder, line 309, in _iterencode
Module json.encoder, line 275, in _iterencode_dict
Module json.encoder, line 309, in _iterencode
Module json.encoder, line 275, in _iterencode_dict
Module json.encoder, line 306, in _iterencode
Module json.encoder, line 204, in _iterencode_list
Module json.encoder, line 309, in _iterencode
Module json.encoder, line 275, in _iterencode_dict
Module json.encoder, line 309, in _iterencode
Module json.encoder, line 275, in _iterencode_dict
Module json.encoder, line 317, in _iterencode
Module json.encoder, line 323, in _iterencode_default
Module json.encoder, line 344, in default
TypeError: <bound method DeviceClass.titleOrId of <DeviceClass at /zport/dmd/Devices>> is not JSON serializable
2011-10-28 14:58:34 ERROR Zope.SiteErrorLog 1319831914.570.307869588338 http://usl-zenoss:8080/zport/dmd/evconsole_router
Traceback (innermost last):
Module ZPublisher.Publish, line 127, in publish
Module ZPublisher.mapply, line 77, in mapply
Module ZPublisher.Publish, line 47, in call_object
Module Products.ZenUtils.extdirect.zope.router, line 24, in __call__
Module Products.ZenUtils.extdirect.router, line 88, in __call__
Module Products.ZenUtils.jsonutils, line 152, in json
Module json, line 230, in dumps
Module json.encoder, line 367, in encode
Module json.encoder, line 309, in _iterencode
Module json.encoder, line 275, in _iterencode_dict
Module json.encoder, line 309, in _iterencode
Module json.encoder, line 275, in _iterencode_dict
Module json.encoder, line 306, in _iterencode
Module json.encoder, line 204, in _iterencode_list
Module json.encoder, line 309, in _iterencode
Module json.encoder, line 275, in _iterencode_dict
Module json.encoder, line 309, in _iterencode
Module json.encoder, line 275, in _iterencode_dict
Module json.encoder, line 317, in _iterencode
Module json.encoder, line 323, in _iterencode_default
Module json.encoder, line 344, in default
TypeError: <bound method DeviceClass.titleOrId of <DeviceClass at /zport/dmd/Devices>> is not JSON serializable
2011-10-28 14:58:34 ERROR Zope.SiteErrorLog 1319831914.860.201785981288 http://usl-zenoss:8080/zport/dmd/Events/evconsole_router
Traceback (innermost last):
Module ZPublisher.Publish, line 127, in publish
Module ZPublisher.mapply, line 77, in mapply
Module ZPublisher.Publish, line 47, in call_object
Module Products.ZenUtils.extdirect.zope.router, line 24, in __call__
Module Products.ZenUtils.extdirect.router, line 88, in __call__
Module Products.ZenUtils.jsonutils, line 152, in json
Module json, line 230, in dumps
Module json.encoder, line 367, in encode
Module json.encoder, line 309, in _iterencode
Module json.encoder, line 275, in _iterencode_dict
Module json.encoder, line 309, in _iterencode
Module json.encoder, line 275, in _iterencode_dict
Module json.encoder, line 306, in _iterencode
Module json.encoder, line 204, in _iterencode_list
Module json.encoder, line 309, in _iterencode
Module json.encoder, line 275, in _iterencode_dict
Module json.encoder, line 309, in _iterencode
Module json.encoder, line 275, in _iterencode_dict
Module json.encoder, line 317, in _iterencode
Module json.encoder, line 323, in _iterencode_default
Module json.encoder, line 344, in default
TypeError: <bound method DeviceClass.titleOrId of <DeviceClass at /zport/dmd/Devices>> is not JSON serializable
2011-10-28 14:58:35 ERROR Zope.SiteErrorLog 1319831915.520.722446255766 http://usl-zenoss:8080/zport/dmd/Events/evconsole_router
Traceback (innermost last):
Module ZPublisher.Publish, line 127, in publish
Module ZPublisher.mapply, line 77, in mapply
Module ZPublisher.Publish, line 47, in call_object
Module Products.ZenUtils.extdirect.zope.router, line 24, in __call__
Module Products.ZenUtils.extdirect.router, line 88, in __call__
Module Products.ZenUtils.jsonutils, line 152, in json
Module json, line 230, in dumps
Module json.encoder, line 367, in encode
Module json.encoder, line 309, in _iterencode
Module json.encoder, line 275, in _iterencode_dict
Module json.encoder, line 309, in _iterencode
Module json.encoder, line 275, in _iterencode_dict
Module json.encoder, line 306, in _iterencode
Module json.encoder, line 204, in _iterencode_list
Module json.encoder, line 309, in _iterencode
Module json.encoder, line 275, in _iterencode_dict
Module json.encoder, line 309, in _iterencode
Module json.encoder, line 275, in _iterencode_dict
Module json.encoder, line 317, in _iterencode
Module json.encoder, line 323, in _iterencode_default
Module json.encoder, line 344, in default
TypeError: <bound method DeviceClass.titleOrId of <DeviceClass at /zport/dmd/Devices>> is not JSON serializable
2011-10-28 14:58:41 ERROR extdirect 'allowedRolesAndUsers'
Traceback (most recent call last):
File "/opt/zenoss/Products/ZenUtils/extdirect/router.py", line 128, in _processDirectRequest
result = _targetfn(**data)
File "/opt/zenoss/Products/Zuul/routers/device.py", line 181, in getDevices
devices, details = facade.getDeviceList(uid, start, limit, sort, dir, params)
File "/opt/zenoss/Products/Zuul/facades/devicefacade.py", line 147, in getDeviceList
query=query, hashcheck=hashcheck)
File "/opt/zenoss/Products/Zuul/tree.py", line 290, in search
queryResults = self._queryCatalog(types, queryOrderby, reverse, paths, depth, query)
File "/opt/zenoss/Products/Zuul/tree.py", line 382, in _queryCatalog
result = self.catalog.evalAdvancedQuery(*args)
File "/opt/zenoss/lib/python/Products/AdvancedQuery/eval.py", line 40, in eval
rs = _eval(query, cat)
File "/opt/zenoss/lib/python/Products/AdvancedQuery/eval.py", line 16, in _eval
rs = query._eval(_QueryContext(cat))
File "/opt/zenoss/lib/python/Products/AdvancedQuery/AdvancedQuery.py", line 220, in _eval
for q in nsq: r = intersection(r, q._eval(context))
File "/opt/zenoss/lib/python/Products/AdvancedQuery/AdvancedQuery.py", line 84, in _eval
return context._applyIndex(self, term)
File "/opt/zenoss/lib/python/Products/AdvancedQuery/AdvancedQuery.py", line 278, in _applyIndex
res = cat.indexes[index].__of__(cat)._apply_index(
KeyError: 'allowedRolesAndUsers'
2011-10-28 14:58:43 ERROR extdirect 'allowedRolesAndUsers'
Traceback (most recent call last):
File "/opt/zenoss/Products/ZenUtils/extdirect/router.py", line 128, in _processDirectRequest
result = _targetfn(**data)
File "/opt/zenoss/Products/Zuul/routers/device.py", line 181, in getDevices
devices, details = facade.getDeviceList(uid, start, limit, sort, dir, params)
File "/opt/zenoss/Products/Zuul/facades/devicefacade.py", line 147, in getDeviceList
query=query, hashcheck=hashcheck)
File "/opt/zenoss/Products/Zuul/tree.py", line 290, in search
queryResults = self._queryCatalog(types, queryOrderby, reverse, paths, depth, query)
File "/opt/zenoss/Products/Zuul/tree.py", line 382, in _queryCatalog
result = self.catalog.evalAdvancedQuery(*args)
File "/opt/zenoss/lib/python/Products/AdvancedQuery/eval.py", line 40, in eval
rs = _eval(query, cat)
File "/opt/zenoss/lib/python/Products/AdvancedQuery/eval.py", line 16, in _eval
rs = query._eval(_QueryContext(cat))
File "/opt/zenoss/lib/python/Products/AdvancedQuery/AdvancedQuery.py", line 220, in _eval
for q in nsq: r = intersection(r, q._eval(context))
File "/opt/zenoss/lib/python/Products/AdvancedQuery/AdvancedQuery.py", line 84, in _eval
return context._applyIndex(self, term)
File "/opt/zenoss/lib/python/Products/AdvancedQuery/AdvancedQuery.py", line 278, in _applyIndex
res = cat.indexes[index].__of__(cat)._apply_index(
KeyError: 'allowedRolesAndUsers'
Follow Us On Twitter »
|
Latest from the Zenoss Blog » | Community | Products | Services Resources | Customers Partners | About Us | ||
Copyright © 2005-2011 Zenoss, Inc.
|
||||||||