Archived community.zenoss.org | full text search
Skip navigation
Up to Discussions in zenoss-users
2755 Views 11 Replies Latest reply: Oct 18, 2012 12:41 PM by Shane Scott RSS
z3r0day Rank: White Belt
z3r0day
22 posts since
Aug 6, 2012
Currently Being Moderated

Oct 9, 2012 5:14 PM

Event Detail - Server Exception

Hi Guys,

 

 

I've got a few events that won't load event details.  When double clicking on the event, the event details pane slides over from the right, but is blank.  After a couple seconds, I get the error:

 

The server reported the following error:

Unable to connect to the server.

The system has encountered an error. Please reload the page

Reload Page | Dismiss

 

This only happens on a select few events.  Other events from the same device appear just fine.

 

Can anyone help to point me in the right direction with this?

 

I'm running Zenoss Core v3.0.3.

 

 

Thanks,

z3r0day

Tags: server, event, details, exception
  • z3r0day Rank: White Belt
    z3r0day
    22 posts since
    Aug 6, 2012
    Currently Being Moderated
    1. Oct 15, 2012 5:13 PM (in response to z3r0day)
    Re: Event Detail - Server Exception

    I've been doing more research and digging.  I found a similar issue, message/41995#41995, which lead me to this ticket http://dev.zenoss.com/trac/ticket/5883 which ultimate points to this ticket http://dev.zenoss.org/trac/ticket/5795.

     

    It seems that the issue relates to non-standard characters that Zenoss cannot interpret.  I found that all the traps that error out contain the following character: Ð

     

    All of the events that contain this character will not open in event details and will generate the Server Exception error, where the 1 event that doesn't contain this character opens just fine. There are also logged errors in /opt/zenoss/log/error.log that reference the issue; "

    UnicodeDecodeError: 'utf8' codec can't decode bytes in position 1-2: invalid data".

    It seems that in the referenced tickets above, the issue would take down the entire event console, whereas now it is only present when trying to view an event containing the non-standard character.

     

    My only idea at this time is to write a transform for each event oid to get rid of the strange character.  The issue with that is I have never written transforms as of yet, and have no prior python expierence.


    Can anyone assist me with this, and/or offer an alternate solution?

     

     

    Thanks!

    z3r0day

  • jmp242 ZenossMaster
    jmp242
    4,060 posts since
    Mar 7, 2007
    Currently Being Moderated
    2. Oct 16, 2012 8:57 AM (in response to z3r0day)
    Re: Event Detail - Server Exception

    While waiting for my e-mail attempt to show up, I'll just give you what I would do which is indeed a transform.

     

    Try using

    evt.summary = evt.summary.replace('Dthingy','Something else')

     

    Rinse and repeat for evt.whatever fields have the problem character.

     

    --

    James Pulver

    ZCA Member

    LEPP Computer Group

    Cornell University

  • Shane Scott ZenossMaster
    Shane Scott
    1,373 posts since
    Jul 6, 2009
    Currently Being Moderated
    3. Oct 16, 2012 9:49 AM (in response to z3r0day)
    Re: Event Detail - Server Exception

    Brian:

     

    Seems like these events are corrupted. Do other events on the same device exhibit the same problem?

     

    Best,

    --Shane Scott (Hackman238)

  • z3r0day Rank: White Belt
    z3r0day
    22 posts since
    Aug 6, 2012
    Currently Being Moderated
    4. Oct 16, 2012 8:23 PM (in response to z3r0day)
    Re: Event Detail - Server Exception

    Hi Guys,

     

     

    Thanks for your responses!

     

    jmp242 - I tried your suggestion.  I'm still new with the transforms, but this is how I set it up.  The Event Class for these events by default are /unknown.  So, I created an EventClass mapping for the problematic event, such as hnOamContComNotification.  In the transform section of the EventClass mapping, I changed it slightly, as I'm not trying to change the summary field, but the hnEventHistoryTimeValue field (according to the record in the database).  So the I made the transform as:

     

    evt.hnEventHistoryTimeValue = evt.hnEventHistoryTimeValue.replace('Ð','')

     

    Basically, I don't care what the value is, because I don't know what it should be, so I left it blank.  Did I do this wrong, or can I use the "evt." with any valid field?  Anyway, the transform did not work. I checked the database when the event reappeared, and that revealed that the transform did not change the hnEventHistoryTimeValue field value in any way.

     

    Shane - yes, this same device produces other events that also give the error.  However, it does produce events that DON'T give the error.  Looking at the raw event data in the status table, it seems to be the Ð character that is causing the issue.

     

     

    Thanks,

    z3r0day

  • jmp242 ZenossMaster
    jmp242
    4,060 posts since
    Mar 7, 2007
    Currently Being Moderated
    5. Oct 17, 2012 8:27 AM (in response to z3r0day)
    Re: Event Detail - Server Exception

    Is the end event getting mapped to your event class? I'm not sure what you mean by in the transform section of the mapping, but in the event class is where the transform should go. However, I'm not sure if you can access all fields or not in a transform, usually I can access any that show up in event details though, so it seems like it should work, assuming it's actually where Zenoss is going to try and apply a transform.

     

    --

    James Pulver

    ZCA Member

    LEPP Computer Group

    Cornell University

  • Shane Scott ZenossMaster
    Shane Scott
    1,373 posts since
    Jul 6, 2009
    Currently Being Moderated
    6. Oct 17, 2012 9:10 AM (in response to jmp242)
    Re: Event Detail - Server Exception

    z3r0day:

     

    What's your 'default-zpublisher-encoding' set to in $ZENHOME/etc/zope.conf? It should be utf-8.

     

    In a worst case scenario you could drop the events db, update the mysql conf with the following parameters then recreate the events db.

     

    [mysqld]

    default-character-set=utf8

    collation_server=utf8_unicode_ci

     

    Best,

    --Shane Scott (Hackman238)

  • z3r0day Rank: White Belt
    z3r0day
    22 posts since
    Aug 6, 2012
    Currently Being Moderated
    7. Oct 17, 2012 4:52 PM (in response to z3r0day)
    Re: Event Detail - Server Exception

    Hi James, I believe the event is being mapped because when the event is present, it shows an alarm within this class. I've attached a screenshot of what I mean by the "transform within the class". Again, I'm new with this part of zenoss, so I don't have my linguo down very well.

    pic2.bmp

     

    I've attached another screen shot of what the event looks like in the database. Take note of the hnEventHistoryTimeValue field.  The value in this field is what is causing the issue.

    pic1.bmp

     

    Shane, I checked and default-zpublisher-encoding value is indeed utf-8.  After all I went through with my last discussion on cleaning up the events database, particularly the history table, I'd hate to go and just drop the database now...lol.

     

     

    Thanks for everyone's help!

    z3r0day

  • jmp242 ZenossMaster
    jmp242
    4,060 posts since
    Mar 7, 2007
    Currently Being Moderated
    8. Oct 18, 2012 8:11 AM (in response to z3r0day)
    Re: Event Detail - Server Exception

    Your screenshot shows a subclass of /Unknown. That may be the issue, you need to map events *out* of /unknown. /Unknown treats everything a bit weird in my experiance.

     

    So delete that mapping and class. Create a class outside of /Unknown... Then set the transform for that class (like what your screen shot shows) and lets see if that then works.

     

    --

    James Pulver

    ZCA Member

    LEPP Computer Group

    Cornell University

  • z3r0day Rank: White Belt
    z3r0day
    22 posts since
    Aug 6, 2012
    Currently Being Moderated
    9. Oct 18, 2012 11:47 AM (in response to jmp242)
    Re: Event Detail - Server Exception

    Hi James,

     

     

    I've created a class /Overture (they're Overture network devices) and I have moved the subclasses as displayed in the screen shot above to the /Overture class.  I think this is what you advised that I do.

     

    I'll update what happens when the event occurs again today.

     

     

    Thanks!

    z3r0day

  • z3r0day Rank: White Belt
    z3r0day
    22 posts since
    Aug 6, 2012
    Currently Being Moderated
    10. Oct 18, 2012 12:22 PM (in response to jmp242)
    Re: Event Detail - Server Exception

    Hi James,

     

     

    The event occurred again, and it seems it was mapped successfully, as the event class for the event shows /Overture.  However, it doesn't seem that the transform worked, because I get the same error when trying to view the event details.  Looking in the database, it shows the same as in the screenshot above, meaning that strange character wasn't changed.

     

    Any ideas?  Is there a log for attempted transforms anywhere that might give more information?

     

    I appreciate your help!

     

     

    Thanks,

    z3r0day

  • Shane Scott ZenossMaster
    Shane Scott
    1,373 posts since
    Jul 6, 2009
    Currently Being Moderated
    11. Oct 18, 2012 12:41 PM (in response to z3r0day)
    Re: Event Detail - Server Exception

    Brian:

     

    I'm thinking it's too late to do a transform once the event arrives since the character is incompatible with something in the event manager in general. You could dump the db, clear the problem events, drop the db, recreate with those options and then dump it back in. Do a backup first- I dont' know how smooth that will all go. In theory it should work.

     

    Best,
    --Shane Scott (Hackman238)

More Like This

  • Retrieving data ...

Legend

  • Correct Answers - 4 points
  • Helpful Answers - 2 points