Topics: performance troubleshooting and tips, AD auth issues and fixes, 3.2.0 release info, New event architecture in Avalon (ZEP), latest ZCA info

[18-Aug-2011 10:53:01] <rmatte> I just manually zeopack every few months myself

[18-Aug-2011 10:53:04] <JohnnyNOC> nyeates i saw some post about exchange2010 monitoring?

[18-Aug-2011 10:53:07] <JohnnyNOC> few months?!

[18-Aug-2011 10:53:11] * rmatte nods

[18-Aug-2011 10:53:17] <JohnnyNOC> how big is your Data.fs?

[18-Aug-2011 10:53:27] <rmatte> largest one is around 5GB or something

[18-Aug-2011 10:53:30] <rmatte> maybe a bit bigger

[18-Aug-2011 10:53:35] <JohnnyNOC> hrm

[18-Aug-2011 10:53:37] <JohnnyNOC> mine's only 2Gb

[18-Aug-2011 10:53:46] <rmatte> well, that's on a box with almost 500 devices on it

[18-Aug-2011 10:54:06] <JohnnyNOC> i need to look into tuning it..  i used tuned settings from our other primary zenoss server but i think it could be better

[18-Aug-2011 10:54:23] <JohnnyNOC> but is there anything other than the cache-size, pool-size, and python-check-interval i could look into

[18-Aug-2011 10:54:23] <nyeates> JohnnyNOC: Yeah someone noted that there might be a exchange2010 zenpack...I cant find it....am I blind? ...maybe its on github, i havent looked there

[18-Aug-2011 10:54:24] <JohnnyNOC> ?

[18-Aug-2011 10:54:31] <dhopp> rmatte: is that 500 devices on a single box (meaning zope/zenhub/mysql and collector all in one)?

[18-Aug-2011 10:54:36] <JohnnyNOC> nyeates i can't find it either but i am definitely interested

[18-Aug-2011 10:54:41] <JohnnyNOC> rmatte this machine has ~800

[18-Aug-2011 10:54:58] <JohnnyNOC> but it's still pretty fresh..  i haven't done anything with process/service monitoring

[18-Aug-2011 10:55:06] <rmatte> I don't think there's an exchange 2010 pack, not that I've seen anyways... we made our own, but I didn't make it, one of our windows admins is, and it hasn't been okayed for release

[18-Aug-2011 10:55:07] <JohnnyNOC> or our custom command perf templates

[18-Aug-2011 10:55:18] <JohnnyNOC> rmatte will you get that OK'd for me?

[18-Aug-2011 10:55:18] <JohnnyNOC>

[18-Aug-2011 10:55:27] <rmatte> I probably can eventually

[18-Aug-2011 10:55:33] <rmatte> though it's not that hard to just build one

[18-Aug-2011 10:55:50] <JohnnyNOC> that may be true - but for me, it's a mtter of time

[18-Aug-2011 10:55:55] <JohnnyNOC> and lack of experience creating zenpacks

[18-Aug-2011 10:56:18] <rmatte> well, making zenpacks with templates is the most braindead thing

[18-Aug-2011 10:56:21] <rmatte> there's no coding involved

[18-Aug-2011 10:56:27] <JohnnyNOC> *nod*

[18-Aug-2011 10:56:30] <JohnnyNOC> i learned that yesterday

[18-Aug-2011 10:56:30] <JohnnyNOC> heh

[18-Aug-2011 10:56:45] <JohnnyNOC> so give me some templates

[18-Aug-2011 10:57:06] <rmatte> it looks like we actually have it split in to 3 sets of templates, one for cluster resources, one for mailbox servers, and one for HubTransport-CA Servers

[18-Aug-2011 10:57:30] <JohnnyNOC> our windows admins kind of suck

[18-Aug-2011 10:57:37] <JohnnyNOC> fortunately i know they don't come here

[18-Aug-2011 10:57:38] <JohnnyNOC> :X

[18-Aug-2011 10:57:42] <rmatte> lol

[18-Aug-2011 10:57:46] <nyeates> rmatte: might that exchange2010 zp see the light of day?

[18-Aug-2011 10:57:48] <JohnnyNOC> i heard one of them have a 10 min conversation about why he didn't want to add a CNAME for a device

[18-Aug-2011 10:58:00] <JohnnyNOC> like, he needed a good reason

[18-Aug-2011 10:58:00] <rmatte> nyeates: it's possible, I'll have to see if I can get it okayed

[18-Aug-2011 10:59:17] <JohnnyNOC> i'll tell everyone Nova is awesome

[18-Aug-2011 10:59:20] <rmatte> I actually have one ZenPack that has templates for all of the different versions of Exchange in it

[18-Aug-2011 10:59:27] <rmatte> instead of having separate packs for each

[18-Aug-2011 10:59:31] <JohnnyNOC> nice

[18-Aug-2011 10:59:48] <nyeates> meta pack

[18-Aug-2011 11:00:00] <JohnnyNOC> MeGaPaCK

[18-Aug-2011 11:00:11] <rmatte> yeh, the 2003 and 2007 templates are from the community, but we've enhanced them

[18-Aug-2011 11:00:18] <rmatte> and the 2010 ZenPack is all ours

[18-Aug-2011 11:00:44] <nyeates> who else at nova devs zenpacks ryan?

[18-Aug-2011 11:00:58] <dhopp> JohnnyNOC: at a previous job we were on Exchange 2003 and discussing upgrading to 2007 but 2010 was already out and I asked the question of why we don't just upgrade to 2010.  And the Windows admin said..and I quote…"If we upgrade to 2010 now what are we going to do next year?  The way I look at it is if we upgrade to 2007 we will have work to do to upgrade to 2010.  More work the better is the way I look at it"

[18-Aug-2011 11:01:04] <rmatte> just one other person who is also named Ryan

[18-Aug-2011 11:01:10] <dhopp> so I offered he could take some of my work if he needed more

[18-Aug-2011 11:01:18] <rmatte> but he's only done those Exchange templates

[18-Aug-2011 11:01:25] <rmatte> I'm the one who actually Zenpacked them

[18-Aug-2011 11:01:50] <rmatte> He has a lot of WMI knowledge (and hates WMI)

[18-Aug-2011 11:01:51] <rmatte> lol

[18-Aug-2011 11:02:13] <jmp242> WMI always seems incomprehensible to me

[18-Aug-2011 11:02:38] <nyeates> dhopp: sounds like twisted logic

[18-Aug-2011 11:02:43] <JohnnyNOC> dhopp that's ridiculous

[18-Aug-2011 11:02:53] <JohnnyNOC> i think part of our problem is we were a windows shop, becoming a linux shop

[18-Aug-2011 11:02:55] <rmatte> WMI queries are pretty similar to stuff like SQL

[18-Aug-2011 11:02:56] <dhopp> nyeates / JohnnyNOC: and he said with our manager in the room

[18-Aug-2011 11:02:56] <JohnnyNOC> and their roles are being diminished

[18-Aug-2011 11:03:04] <JohnnyNOC> and they spend a lot of time in the datacenters

[18-Aug-2011 11:03:18] <nyeates> Hey we Have Eric Miller here today everyone, say hi

[18-Aug-2011 11:03:25] <JohnnyNOC> i think they see the writing on the wall

[18-Aug-2011 11:03:30] <JohnnyNOC> hello Eric Miller

[18-Aug-2011 11:03:46] <JohnnyNOC> nyeates tell rhoulihan i said thanks for hooking up the IBM guy i'm working with with a Zenoss developer

[18-Aug-2011 11:03:50] <JohnnyNOC> that's super appreciated

[18-Aug-2011 11:04:27] <nyeates> if u all have an dev Qs, or otherwiuse, ask away

[18-Aug-2011 11:04:48] <nyeates> JohnnyNOC: np

[18-Aug-2011 11:07:23] <JohnnyNOC> what can i do to speed zope/zeo up?  besides the cache-size and pool-size settings in zope.conf

[18-Aug-2011 11:07:29] <JohnnyNOC> or put it on a ramdisk

[18-Aug-2011 11:07:39] <dhopp> I'm using 3.1 and when looking at graphs for a device if I zoom in/out or change from the default hourly when Zenoss auto refreshes it goes back to hourly zoom level…anyway to prevent that/

[18-Aug-2011 11:07:40] <dhopp> ?

[18-Aug-2011 11:07:51] <nyeates> the ramdisk solution is hairy.... difficult to do

[18-Aug-2011 11:07:58] <rmatte> well, Hackman has some way of configuring it to run multiple zopes on a single server which apparently really helps with performance

[18-Aug-2011 11:07:59] <dhopp> JohnnyNOC: do you have multiple zopes?

[18-Aug-2011 11:08:04] <rmatte> you can ask him about it next time you see him

[18-Aug-2011 11:08:21] <JohnnyNOC> nyeates i just have this new 3.1.0 setup that isn't doing much and removed some devices from the zmi and it took forever to remove 3

[18-Aug-2011 11:08:32] <JohnnyNOC> or hell, to even add 5 devices it takes what i perceive to be too long

[18-Aug-2011 11:08:34] <nyeates> JohnnyNOC: have you poured over our performance KnowledgeBase article yet?

[18-Aug-2011 11:08:40] <dhopp> JohnnyNOC: docs/DOC-8507

[18-Aug-2011 11:09:09] <JohnnyNOC> hrm

[18-Aug-2011 11:09:17] <JohnnyNOC> nyeates yes and i've tuned it accordingly

[18-Aug-2011 11:09:20] <JohnnyNOC> but it's still too slow for me

[18-Aug-2011 11:09:28] <JohnnyNOC> like, the nagios instance we use here is so freaking fast and snappy

[18-Aug-2011 11:09:41] <JohnnyNOC> zenoss, well, is not

[18-Aug-2011 11:09:42] <JohnnyNOC> :/

[18-Aug-2011 11:10:00] <rmatte> JohnnyNOC: what kind of hardware is it running on?

[18-Aug-2011 11:10:01] <JohnnyNOC> dhopp thanks for the link, i guess i'll have to look into it, but i hate that i have to add complexity for more performance

[18-Aug-2011 11:10:07] <JohnnyNOC> good hw

[18-Aug-2011 11:10:07] <JohnnyNOC> 8cores

[18-Aug-2011 11:10:08] <rmatte> an instance with only a few devices should be fast as all hell

[18-Aug-2011 11:10:10] <JohnnyNOC> 32GB RAM

[18-Aug-2011 11:10:12] <JohnnyNOC> RAID5

[18-Aug-2011 11:10:16] <JohnnyNOC> perf on ssd

[18-Aug-2011 11:10:19] <rmatte> weird

[18-Aug-2011 11:10:19] <rocket> JohnnyNOC: I am sorry but nagios/zenoss is an apples/oranges comparison

[18-Aug-2011 11:10:22] <JohnnyNOC> rmatte it's got about 800

[18-Aug-2011 11:10:23] <dhopp> wait nagios interface is fast and snappy?  are you only monitoring like 3 devices?

[18-Aug-2011 11:10:27] <rmatte> ohhhh

[18-Aug-2011 11:10:30] <nyeates> dhopp: sounds like a bug.... another community member just opened a similar one where the 'printable' version only shows hourly views

[18-Aug-2011 11:10:32] <rmatte> I thought it only had a few

[18-Aug-2011 11:10:33] <JohnnyNOC> rocket i don't disagree there but i'm talking about the user experience at the UI

[18-Aug-2011 11:10:37] <JohnnyNOC> in that respect, it is apples to apples

[18-Aug-2011 11:10:40] <JohnnyNOC> and zenoss is freaking slow

[18-Aug-2011 11:10:44] <nyeates> dhopp: make the bug on trac and send me an email

[18-Aug-2011 11:10:46] <rocket> JohnnyNOC: however we do recognize the speed issues and 3.2 has quite a few fixes there

[18-Aug-2011 11:10:52] <JohnnyNOC> dhopp there are more than 1000 devices

[18-Aug-2011 11:10:56] <JohnnyNOC> with 10s of thousands of datapoints

[18-Aug-2011 11:11:17] <JohnnyNOC> many more than what zenoss is currently monitoring

[18-Aug-2011 11:11:47] <JohnnyNOC> and just to be clear, it's check_mk plugin

[18-Aug-2011 11:11:52] <dhopp> JohnnyNOC: I just had experiences with nagios and when the status file got huge the interface was terrible…although if you are running a custom interface that pipes that status file to a db then it is probably better

[18-Aug-2011 11:12:12] <JohnnyNOC> there is no waiting when i click on links

[18-Aug-2011 11:12:17] <JohnnyNOC> (in nagios/check_mk)

[18-Aug-2011 11:12:29] <JohnnyNOC> and this runs on the same box

[18-Aug-2011 11:12:45] <JohnnyNOC> anyway, i'm just trying to figure out what else i can do to improve my performance.  and i guess i have to look into multiple zopes

[18-Aug-2011 11:13:29] <nyeates> JohnnyNOC: what troubleshooting have you done to determine where the bottleneck lays?

[18-Aug-2011 11:13:47] <JohnnyNOC> nyeates thus far not much..  it's a pretty fresh install, i was going to save the tuning for later

[18-Aug-2011 11:13:57] <JohnnyNOC> but i've done the basics as laid out in the zenoss tuning docs in the forums

[18-Aug-2011 11:14:05] <nyeates> JOhnnyNOC: it could be in perf collection, modeling, zenhub backing up for various reasons, ram limitations, etc..... need to know what it is first in order to remedy

[18-Aug-2011 11:14:15] <dhopp> JohnnyNOC:  you have also tweaked mysql too right?

[18-Aug-2011 11:14:38] <JohnnyNOC> dhopp yes

[18-Aug-2011 11:14:48] <JohnnyNOC> nyeates i've disabled most of my perf daemons

[18-Aug-2011 11:14:50] <JohnnyNOC> there's 32GB ram on this box

[18-Aug-2011 11:14:59] <JohnnyNOC> zeo cache size is 2.5GB

[18-Aug-2011 11:15:02] <JohnnyNOC> my Data.fs is 2GB

[18-Aug-2011 11:15:23] <nyeates> even before tweaking, you need to monitor and look into the guts of zenoss and figure out where it is being slowed down - otherwise you are guessing

[18-Aug-2011 11:15:25] <JohnnyNOC> cache-size is 15000000, i haven't checked how many objects are in zope

[18-Aug-2011 11:15:28] <rocket> JohnnyNOC: if your mysql is not tuned that usually is a big one as zenoss is doing full table scans

[18-Aug-2011 11:15:36] <rocket> JohnnyNOC: wget mysqltuner.pl

[18-Aug-2011 11:15:43] <JohnnyNOC> rocket already done

[18-Aug-2011 11:15:43] <nyeates> can you post your collector graphs? .... like the ones that monitor your zenoss collector?

[18-Aug-2011 11:15:50] <JohnnyNOC> and i've used it's recommendations

[18-Aug-2011 11:16:03] <emillerzenoss> a very tardy hello back to you, Johnny. I am reading through this now, trying to come up with any better suggestions ...

[18-Aug-2011 11:16:06] <JohnnyNOC> nyeates mmm yea i could

[18-Aug-2011 11:16:14] <JohnnyNOC> would take some effort tho, not easy to share stuff out of the firm

[18-Aug-2011 11:16:28] <JohnnyNOC> nyeates how do i look into the guts and figure out where it's being slowed down?

[18-Aug-2011 11:16:34] <JohnnyNOC> i've tuned mysql, i've tuned zope

[18-Aug-2011 11:16:37] <JohnnyNOC> the server is beefy

[18-Aug-2011 11:16:39] <JohnnyNOC> the load is low

[18-Aug-2011 11:16:44] <JohnnyNOC> the UI is a pain to use

[18-Aug-2011 11:16:52] <fragfutter> JohnnyNOC: Disk IO

[18-Aug-2011 11:17:00] <rmatte> yeh, has to be disk IO

[18-Aug-2011 11:17:12] <JohnnyNOC> not really

[18-Aug-2011 11:17:12] <rmatte> even RAID 5 will only cut it for so long

[18-Aug-2011 11:17:24] <dhopp> JohnnyNOC: what does free -m look like?

[18-Aug-2011 11:17:27] <JohnnyNOC> iowait is pretty much 0

[18-Aug-2011 11:17:45] <JohnnyNOC>              total       used       free     shared    buffers     cached

[18-Aug-2011 11:17:45] <JohnnyNOC> Mem:         32240      13876      18364          0        561       7801

[18-Aug-2011 11:17:45] <JohnnyNOC> -/+ buffers/cache:       5513      26727

[18-Aug-2011 11:17:45] <JohnnyNOC> Swap:         2047          5       2042

[18-Aug-2011 11:17:53] <JohnnyNOC> 18G free

[18-Aug-2011 11:18:01] <JohnnyNOC> innodb_buffer_pool_size is set to something like 6GB

[18-Aug-2011 11:18:02] <JohnnyNOC> er

[18-Aug-2011 11:18:04] <JohnnyNOC> 8GB

[18-Aug-2011 11:18:04] <nyeates> I have used the collector graphs to look at cycle times, see if there is aberations, look at various daemon performance like zenactions, zenwinperf, (those are simply examples). I had to compare them to a known good server though, so this may be difficult. But those graphs can give you ideas on where stuff may be getting clogged up. Also watch top and see memory usage. Hit the 'c' key to see which processes take up CPU

[18-Aug-2011 11:18:35] <JohnnyNOC> it's normally zenhub using the most cpu

[18-Aug-2011 11:18:39] <JohnnyNOC> or run_zope

[18-Aug-2011 11:18:41] <rmatte> or use htop and sort by cpu which is a nicer way to visualize

[18-Aug-2011 11:18:47] <JohnnyNOC> yes i use htop

[18-Aug-2011 11:18:51] <nyeates> If there is high wa (wait) cpu being used....disk io is yer problem

[18-Aug-2011 11:19:09] <dhopp> JohnnyNOC: how many cores?  have you increased zenhub workers?

[18-Aug-2011 11:19:19] <emillerzenoss> people/simon/blog/2011/07/01/improve-your-31-ui-today

[18-Aug-2011 11:19:26] <JohnnyNOC> dhopp 8 cores

[18-Aug-2011 11:19:30] <JohnnyNOC> workers is set to 6-7

[18-Aug-2011 11:19:57] <dhopp> you might want to lower that to 4 or 5…and leave some cores for mysql and zope

[18-Aug-2011 11:19:58] <JohnnyNOC> emillerzenoss thanks i'll halve to look into that

[18-Aug-2011 11:20:08] <JohnnyNOC> dhopp *nod*

[18-Aug-2011 11:20:18] <JohnnyNOC> workers 6

[18-Aug-2011 11:20:18] <JohnnyNOC> cachesize 16000

[18-Aug-2011 11:20:18] <JohnnyNOC> pcachesize 4500

[18-Aug-2011 11:20:25] <JohnnyNOC> (i'm not using a persistent cache)

[18-Aug-2011 11:20:29] <JohnnyNOC> so i guess that line can be removed

[18-Aug-2011 11:20:37] <Hackman238> Hi all, sorry I'm late

[18-Aug-2011 11:20:42] <JohnnyNOC> but iw ant to bump up cachesize as much as it makes sense as i have plenty of avail memory

[18-Aug-2011 11:20:46] <emillerzenoss> following that article will buy you most of the improvements that will arrive with 3.2, which will come out very soon, also

[18-Aug-2011 11:20:48] <Hackman238> Was down town working on NPO for ZCA

[18-Aug-2011 11:20:49] * JohnnyNOC slaps Hackman238 around with a large trout

[18-Aug-2011 11:21:02] <Hackman238> JohnnyNOC: Ugh...not even a Bass...

[18-Aug-2011 11:21:17] <JohnnyNOC> hehe

[18-Aug-2011 11:21:20] <JohnnyNOC> we missed you

[18-Aug-2011 11:21:25] <Hackman238> I bed

[18-Aug-2011 11:21:27] <Hackman238> *bet

[18-Aug-2011 11:21:29] <Hackman238> LOL

[18-Aug-2011 11:21:36] <Hackman238> Good news and bad news

[18-Aug-2011 11:21:45] <JohnnyNOC> good

[18-Aug-2011 11:22:07] <Hackman238> Good news is a Non profit for the ZCA to handel money and limit liability is the best option, especially with me being here in super de-regulated Texas

[18-Aug-2011 11:22:24] <Hackman238> Bad news is its more complicated than a regular business...go figure. LOL

[18-Aug-2011 11:22:37] <JohnnyNOC> any recommendations on values for cachesize in zenhub.conf?

[18-Aug-2011 11:22:44] <nyeates> emillerzenoss: you involved in any 3.2 release work? hows it going - still aimed for aug or begining of sept?

[18-Aug-2011 11:22:50] <Hackman238> JohnnyNOC: It depends on the number of devices being configured

[18-Aug-2011 11:22:57] <JohnnyNOC> Hackman238 let's say 1000

[18-Aug-2011 11:23:45] <emillerzenoss> i did some work that went into 3.2 while on a cust. engagement last month. those times sound right to me

[18-Aug-2011 11:23:54] <Hackman238> JohnnyNOC: Well I no sites that small, but ours are set universally to 100000 and pcache 2000

[18-Aug-2011 11:24:08] <JohnnyNOC> Hackman238 are you using a persistent disk cache?

[18-Aug-2011 11:24:11] <JohnnyNOC> i assume that's what pcahce is?

[18-Aug-2011 11:24:50] <JohnnyNOC> we aren't using the persistent disk cache

[18-Aug-2011 11:25:04] <JohnnyNOC> (it's commented in zope.conf) .. should we be?

[18-Aug-2011 11:25:41] <Hackman238> JohnnyNOC: Its my understanding its a persistant cache for the daemon

[18-Aug-2011 11:26:00] <Hackman238> JohnnyNOC: Long as the cache isnt invalidated, it helpd the daemon start back up faster

[18-Aug-2011 11:26:16] <JohnnyNOC> i'm not worried about startup times so much

[18-Aug-2011 11:26:26] <Hackman238> JohnnyNOC: Not 100% sure my understanding is correct, but it sure seems like that's what it is

[18-Aug-2011 11:26:41] <Hackman238> JohnnyNOC: On our smallest DC we have 5K devices

[18-Aug-2011 11:27:06] <Hackman238> JohnnyNOC: Try a cache value of 10000

[18-Aug-2011 11:27:14] <Hackman238> ...or 50000

[18-Aug-2011 11:27:21] <JohnnyNOC> i'm bumping it up to 64000

[18-Aug-2011 11:27:23] <nyeates> JohnnyNOC: do particular ui pages take longer to load? Is it just the ui that is slow, or are you dropping collection or event or other non-ui things?

[18-Aug-2011 11:27:25] <xuru> morning everyone

[18-Aug-2011 11:27:28] <JohnnyNOC> i have plenty of available ram

[18-Aug-2011 11:27:36] <nyeates> hi xuru

[18-Aug-2011 11:27:37] <JohnnyNOC> nyeates i'm only noticing it in the UI at this point

[18-Aug-2011 11:27:44] <Hackman238> Hi xuru

[18-Aug-2011 11:27:51] <JohnnyNOC> i haven't done much otherwise, this is a new install i'm setting up to duplicate an old broke 2.5.2 install

[18-Aug-2011 11:28:02] <emillerzenoss> DISCLAIMER: while the last article about pulling down the Products from trunk was easy and very safe, this next one requires far more care and bravery

[18-Aug-2011 11:28:03] <emillerzenoss> people/simon/blog/2011/03/30/speed-up-your-zenoss-deployment-dramatically

[18-Aug-2011 11:28:15] <nyeates> JohnnyNOC: Certain pages are slower to load? Also.... do the pages wait and wait and then all of a sudden load at once.... or do the ui pages load incrementally?

[18-Aug-2011 11:28:42] <JohnnyNOC> seems to do both..  sometimes all at once, sometimes incrementally

[18-Aug-2011 11:28:53] <JohnnyNOC> but i haven't noticed that it's -certain- pages besides the main infrastructure page

[18-Aug-2011 11:28:53] <emillerzenoss> what browser?

[18-Aug-2011 11:28:55] <JohnnyNOC> devices

[18-Aug-2011 11:28:57] <JohnnyNOC> chrome

[18-Aug-2011 11:29:15] <dhopp> emillerzenoss:  while I was love to take advantage of relstorage..I think I'll stay away from anything that says "may result in data loss" in production :-P

[18-Aug-2011 11:29:26] <nyeates> shouldnt make a diff...but we test on firefox

[18-Aug-2011 11:29:46] <Hackman238> emillerzenoss: I should warn you I've found issues with the currect 3.x relstorage

[18-Aug-2011 11:29:46] <nyeates> JohnnyNOC: Do you have LDAP or AD authentication setup? or maybe sometime in the past?

[18-Aug-2011 11:29:49] <emillerzenoss> chrome is usually the fastest, if also the worst about caching things forever.

[18-Aug-2011 11:29:50] <Hackman238> Do not use it in production

[18-Aug-2011 11:29:58] <Hackman238> *current

[18-Aug-2011 11:29:58] <JohnnyNOC> nyeates yes, AD

[18-Aug-2011 11:30:05] <nyeates> theres yer problem i think

[18-Aug-2011 11:30:30] <dhopp> emillerzenoss:  and chrome has a bug that you can't run commands (you click on the command nothing happens)

[18-Aug-2011 11:30:32] <nyeates> Ive seen it before on enterprise users anyway ...where AD auth is causing UI slowdowns

[18-Aug-2011 11:30:35] <dhopp> I think I opened a trac about it

[18-Aug-2011 11:31:00] <JohnnyNOC> nyeates yes i think i've noticed it there too

[18-Aug-2011 11:31:01] <jong> AD auth definitely has overhead.

[18-Aug-2011 11:31:22] <JohnnyNOC> nyeates just emailed you perf graphs for the only collector

[18-Aug-2011 11:31:51] <nyeates> JohnnyNOC: is this a core or enterprise box

[18-Aug-2011 11:32:02] <JohnnyNOC> core

[18-Aug-2011 11:32:12] <JohnnyNOC> we're too cheap for enterprise

[18-Aug-2011 11:32:33] <dhopp> JohnnyNOC:  or enterprise is too expensive for you ;-)

[18-Aug-2011 11:32:46] <JohnnyNOC> dhopp that would be more accurate

[18-Aug-2011 11:32:58] <JohnnyNOC> we'd rather buy art for the office (apparently)

[18-Aug-2011 11:32:59] <JohnnyNOC> heh

[18-Aug-2011 11:32:59] <nyeates> hmm, i dont have any experience in the community solution for AD - but many fingers are pointing at that being your issue. Might look into it and the various bugs for it out there

[18-Aug-2011 11:33:29] <nyeates> there was one bug where it tried to auth like 5 times for each and every page load

[18-Aug-2011 11:33:37] <dhopp> JohnnyNOC:  did you setup a cache for AD?

[18-Aug-2011 11:33:52] <nyeates> so if the AD server is at all slow or bogged, zenoss waits for 5 AD auths for each page

[18-Aug-2011 11:34:00] <nyeates> dhopp: good point

[18-Aug-2011 11:34:01] <jong> nyeates: I think it was for every request, not just page load. Could be wrong though. It was significant though.

[18-Aug-2011 11:34:09] <JohnnyNOC> dhopp yes, but let me look into that

[18-Aug-2011 11:34:50] <dhopp> nyeates:  you say "was one bug"..does that imply it's fixed?

[18-Aug-2011 11:35:12] <JohnnyNOC> dhopp i am but i'm using default settings

[18-Aug-2011 11:35:22] <JohnnyNOC> wondering if i should bump up everything

[18-Aug-2011 11:35:29] <JohnnyNOC> threshold entries, max age of a cache entry, cleanup interval

[18-Aug-2011 11:35:32] <nyeates> JohnnyNOC: hopefully you guys didnt buy $20-$50k art :-p

[18-Aug-2011 11:35:44] <JohnnyNOC> nyeates apparently we have millions of dollars of art

[18-Aug-2011 11:35:51] <dhopp> nyeates:  that wouldn't buy Zenoss anyway :-P

[18-Aug-2011 11:36:02] <JohnnyNOC> we have tour groups who come to our office to look at the art

[18-Aug-2011 11:36:04] <dhopp> JohnnyNOC:  ok that would buy Zenoss :-P

[18-Aug-2011 11:36:06] <JohnnyNOC> it's ridiculous

[18-Aug-2011 11:36:15] <bender183> hi JohnnyNOC

[18-Aug-2011 11:36:21] <JohnnyNOC> yea, our main floor is like a museum

[18-Aug-2011 11:36:23] <JohnnyNOC> hello bender183

[18-Aug-2011 11:36:39] <nyeates> dhopp: i was implying that the bug is fixed, yes

[18-Aug-2011 11:36:46] <emillerzenoss> the infrastructure page is a great example of a page that will make multiple requests as it loads, so if each request has an unexpectedly costly auth cycle, it'll suck.

[18-Aug-2011 11:36:50] <nyeates> dhopp: chet fixed it i think

[18-Aug-2011 11:37:01] <dhopp> is that fix in 3.1 core?

[18-Aug-2011 11:37:05] <bender183> JohnnyNOC, did you ever get your reporting issues sorted out with zenoss ?

[18-Aug-2011 11:37:14] <nyeates> dhopp: we will have to search around and look later

[18-Aug-2011 11:37:22] <Hackman238> Theres a patch for that problem I think

[18-Aug-2011 11:37:27] <JohnnyNOC> bender183 no not quite yet..  but i'm moving to a 3.1.0 install and will worry about it then

[18-Aug-2011 11:37:37] <JohnnyNOC> right now i'm focused on increasing performance so i don't show my boss and he goes "wtf is it so slow?"

[18-Aug-2011 11:37:53] <nyeates> dhopp: as hackman says, i think it has a public solution

[18-Aug-2011 11:38:24] <JohnnyNOC> so in my ad cache i bumped up the threshold entries from 1000->10000 and increased the cleanup interval from 300->900

[18-Aug-2011 11:38:32] <JohnnyNOC> don't think i need a cleanup interval every 5 min

[18-Aug-2011 11:38:42] <bender183> JohnnyNOC, you gonna run rrdcached ?

[18-Aug-2011 11:38:44] <JohnnyNOC> shit, there's only 5 users in zenoss right now anyway, and i'm the only one logging in

[18-Aug-2011 11:39:06] <JohnnyNOC> bender183 i plan to yes

[18-Aug-2011 11:39:15] <bender183> good luck with that

[18-Aug-2011 11:39:22] <bender183> will def help with perf

[18-Aug-2011 11:39:31] <nyeates> JohnnyNOC: there is a zope ad cache ..... you set it in the ZMI (the /manage interface)

[18-Aug-2011 11:39:39] <JohnnyNOC> but we will be going with distributed collectors in each of our DCs so that in of itself will be  large help

[18-Aug-2011 11:39:47] <JohnnyNOC> nyeates yes, i've just tweaked it

[18-Aug-2011 11:39:49] <nyeates> JohnnyNOC: our official extended monitoring guide doc covers it in the AD auth section

[18-Aug-2011 11:40:00] <nyeates> JohnnyNOC: oh i didnt know you could!

[18-Aug-2011 11:40:15] <JohnnyNOC> there isn't much to tweak

[18-Aug-2011 11:40:25] <nyeates> was thinking those settings you mentioned were some other conf file

[18-Aug-2011 11:40:34] <JohnnyNOC> no sorry, that was all in zmi for my ad cache

[18-Aug-2011 11:40:43] <Hackman238> JohnnyNOC: Did you add a ramcache for the AD plugin?

[18-Aug-2011 11:40:49] <Hackman238> You really need it

[18-Aug-2011 11:40:50] <JohnnyNOC> Hackman238 yes

[18-Aug-2011 11:40:53] <nyeates> JohnnyNOC: this is a 2.5.2 machine

[18-Aug-2011 11:40:54] <nyeates> ?

[18-Aug-2011 11:40:56] <JohnnyNOC> i just tweaked it

[18-Aug-2011 11:40:58] <JohnnyNOC> this one is 3.1

[18-Aug-2011 11:41:15] <Hackman238> Ah, same config on 3.1 as in 2.5.2

[18-Aug-2011 11:42:42] <nyeates> JOhnnyNOC: alot of the AD fixes i think are included in 3.1 .... but i cant be sure, so still look into them.... otherwise, you might try ripping out the AD stuff or temporarily allowing local zenoss users and see if those operate at lightning speed

[18-Aug-2011 11:42:50] <nyeates> this would verify if the slowness is the AD setup

[18-Aug-2011 11:42:54] <JohnnyNOC> *nod*

[18-Aug-2011 11:42:58] <JohnnyNOC> man that would make me excited

[18-Aug-2011 11:43:03] <JohnnyNOC> "operate at lightning speed"

[18-Aug-2011 11:43:07] <JohnnyNOC>

[18-Aug-2011 11:43:53] kocolosk|away is now known as kocolosk

[18-Aug-2011 11:43:55] <xuru> nyeates: this was probably already asked, but what's the ETA on the next release?

[18-Aug-2011 11:44:27] <nyeates> xuru, see emillerzenoss's answer to my question above....ill summarize.... 3.2.0 is coming out end of Aug or begin of Sept

[18-Aug-2011 11:44:33] <emillerzenoss> 3 weeks-ish

[18-Aug-2011 11:44:41] <xuru> sweet, ty

[18-Aug-2011 11:44:56] <nyeates> Also see here for 3.2.0 features blogs/zenossblog/2011/08/04/zenoss-core-320-feature-and-bug-list

[18-Aug-2011 11:45:18] <xuru> even better

[18-Aug-2011 11:45:48] <dhopp> 'Production state' field can now be filtered; remembers filter state - YAY

[18-Aug-2011 11:46:11] <nyeates> there is liek a ton of those little wins in it

[18-Aug-2011 11:46:31] <dhopp> nyeates:  are zenpacks that compatible with 3.1 expected to work without problems in 3.2?

[18-Aug-2011 11:46:56] <nyeates> dhopp: ZenPacks that work in 3.* are expected to work in 3.*

[18-Aug-2011 11:46:57] <rmatte> dhopp: yes, 3.2 is just a bugfix release with a few extra features, absolutely no reason why they wouldn't

[18-Aug-2011 11:47:28] <rmatte> the only reason why 2.5 and 3.x packs are different is because of the major overhaul that happened between those versions

[18-Aug-2011 11:47:49] <dhopp> rmatte:  I was just nervous because : "Pages in UI completely rewritten for significant performance and  functionality - Updated UI code uses new standards, instead of old 2.x  setup"

[18-Aug-2011 11:47:51] <rmatte> mostly related to UI components

[18-Aug-2011 11:48:12] <dhopp> notice "Updated UI code"

[18-Aug-2011 11:48:20] <dhopp> and that was the problem with transitioning to 3.x

[18-Aug-2011 11:48:27] <rmatte> ummm, they go in to more detail than that as I recall

[18-Aug-2011 11:48:34] <rmatte> they are talking about screens like the modeler plugins screen

[18-Aug-2011 11:48:39] <rmatte> specific screens

[18-Aug-2011 11:48:41] <nyeates> Even when we eventually move to avalon code, the only expected ZPs that will break are event-related ones. We shall see though, as there is no testing behind this statement.

[18-Aug-2011 11:48:43] <rmatte> nothing to do with ZenPacks

[18-Aug-2011 11:49:00] <dhopp> rmatte:  gotcha

[18-Aug-2011 11:49:09] <rmatte> nyeates: event related in what sense?

[18-Aug-2011 11:49:21] <rmatte> nyeates: you guys haven't changed the names of the functions for pulling events have you?

[18-Aug-2011 11:49:48] <rmatte> for instance, dmd.ZenEventManager.getEventList()

[18-Aug-2011 11:49:54] <nyeates> This *could* change - Hackman might have experience there

[18-Aug-2011 11:50:10] <rmatte> also, dmd.ZenEventManager.getEventDetailFromStatusOrHistory()

[18-Aug-2011 11:50:11] <nyeates> or jong might know

[18-Aug-2011 11:50:15] <rmatte> I have a daemon that uses those heavily

[18-Aug-2011 11:50:25] <rmatte> I'd have to rewrite it if that's the case

[18-Aug-2011 11:50:32] <xuru> nyeates: what role is Java going to play in the future releases of Zenoss?  And will python stay is that scripting language if it does move more into a java app?

[18-Aug-2011 11:50:45] <rmatte> java is going to power the event engine for better performance

[18-Aug-2011 11:50:51] <emillerzenoss> pretty sure that didn't change, but checking ...

[18-Aug-2011 11:50:59] <rmatte> and python will stay as the scripting language since zope and all of the daemons are python

[18-Aug-2011 11:51:05] <Hackman238> nyeates: Exp with what?

[18-Aug-2011 11:51:15] <emillerzenoss> sorry, my previous comment was in reference to the zeneventmanager methods

[18-Aug-2011 11:51:20] <nyeates> rmattes function calls above to event stuff

[18-Aug-2011 11:51:24] <xuru> only the event engine, or are there plans for more?

[18-Aug-2011 11:51:43] <Hackman238> nyeates:  oh yeah

[18-Aug-2011 11:51:50] <nyeates> rmatte: event architecture in avalon is completely and utterly overhauled

[18-Aug-2011 11:51:51] <rmatte> xuru: so far only the event engine, but apparently someone at Zenoss who is running the dev team is all gung-ho about using java

[18-Aug-2011 11:51:57] <rmatte> so they'll probably use it more and more

[18-Aug-2011 11:52:03] <rmatte> (which I'm not personally a fan of)

[18-Aug-2011 11:52:09] <xuru> me either

[18-Aug-2011 11:52:12] <Hackman238> rmatte: There are ways to optimize those calls

[18-Aug-2011 11:52:31] <jong> We plan on implementing more in Java. What or when this will be is unknown at this time.

[18-Aug-2011 11:52:33] <rmatte> Hackman238: in what sense?

[18-Aug-2011 11:52:34] <xuru> every Java app that I use for System Administration sucks ass

[18-Aug-2011 11:52:45] <JohnnyNOC> ^-- agreed

[18-Aug-2011 11:52:46] <Hackman238> rmatte: any event based ops via dmd result in zope thread lockup

[18-Aug-2011 11:52:49] <rmatte> xuru: same

[18-Aug-2011 11:53:04] <nyeates> jong: do you know if those calls rmatte mentioned above are still usable in ZEP?

[18-Aug-2011 11:53:09] <rmatte> Hackman238: the daemon only scans active events, not history, so it's not bad

[18-Aug-2011 11:53:09] <JohnnyNOC> i saw java and better performance then cringed

[18-Aug-2011 11:53:15] <rmatte> and it only does it on 30 second cycles

[18-Aug-2011 11:53:25] <xuru> JohnnyNOC: lol

[18-Aug-2011 11:53:41] <Hackman238> rmatte: You'll want to create new public dmd methods that you can import in to dmd (import blah from blah) which do not acctually ask zenhub to fetch sql data but instead perform sql ops directly

[18-Aug-2011 11:53:47] <JohnnyNOC> it sucks man, but nearly every java app i use i think sucks

[18-Aug-2011 11:54:02] <Hackman238> JohnnyNOC: Second except ZEP

[18-Aug-2011 11:54:17] <JohnnyNOC> i don't know zep

[18-Aug-2011 11:54:21] <jong> There is no plan to move away from browser front end that I know of. Java as a backend has been fantastic for zeneventserver though.

[18-Aug-2011 11:54:28] <rmatte> Hackman238: honestly, I've noticed zero performance impact by doing it the way that I am

[18-Aug-2011 11:54:28] <Hackman238> JohnnyNOC: Zenoss Event Portal (ZenEventServer)

[18-Aug-2011 11:54:40] <Hackman238> rmatte: Ah thats pretty good.

[18-Aug-2011 11:54:47] <Hackman238> rmatte: Zenhub is easily overwhelmed

[18-Aug-2011 11:55:00] <Hackman238> rmatte: Zenhub is like a single mom with ten kids

[18-Aug-2011 11:55:01] <xuru> It would be better to move some of the more costly cpu intensive algorithms into C/C++ that could be linked in using Cython

[18-Aug-2011 11:55:13] <rmatte> lol

[18-Aug-2011 11:55:15] <Hackman238> rmatte: Gets busy, behind then justs gives up and dies

[18-Aug-2011 11:55:22] <rmatte> those event calls just take seconds to return

[18-Aug-2011 11:55:37] <Hackman238> rmatte: Sounds like your event db is a very manageable size

[18-Aug-2011 11:55:42] <emillerzenoss> the zeneventmanager stuff is still there

[18-Aug-2011 11:55:50] <rmatte> well like I said, it's not going through history, only active events

[18-Aug-2011 11:55:53] <jong> rmatte: Those methods are unfamiliar to me, so I'd say they're gone. Interacting with events in 4.X should be done through routers/facades, not off anything on dmd.

[18-Aug-2011 11:55:53] <rmatte> so it's very quick

[18-Aug-2011 11:56:26] <JohnnyNOC> i thought java was meant for toasters, and coffee makers

[18-Aug-2011 11:56:29] <JohnnyNOC> and fridges

[18-Aug-2011 11:56:29] <rmatte> jong: guess I'll have to look in to it

[18-Aug-2011 11:56:32] <nyeates> "Zenhub is like a single mom with ten kids" I lol'ed on that one

[18-Aug-2011 11:56:38] <emillerzenoss> oh, i thought the question about zeneventmanager was in regards to 3.2

[18-Aug-2011 11:56:50] <xuru> nyeates: hehe

[18-Aug-2011 11:56:52] <rmatte> no, in regards to the new event management system

[18-Aug-2011 11:57:02] <rmatte> regardless of what Zenoss version that'll be implemented in

[18-Aug-2011 11:57:24] <Hackman238> jong: second.

[18-Aug-2011 11:57:32] <Hackman238> jong: ...even though I hate it

[18-Aug-2011 11:57:38] <rmatte> those two functions were the basis for the old event console, and worked perfectly for what I wanted to do

[18-Aug-2011 11:57:44] <nyeates> jong: thanks....this is what I had suspected

[18-Aug-2011 11:58:25] <emillerzenoss> jong is right; completely different

[18-Aug-2011 11:58:32] <rmatte> bleh

[18-Aug-2011 11:58:40] <jong> rmatte: what exactly were you doing? the new event system is pretty powerful.

[18-Aug-2011 11:58:45] <jong> compared to the old.

[18-Aug-2011 11:59:18] <rmatte> I wrote a Zenoss daemon that scans through the event console at a set cycle time and automatically creates tickets in our ticketing system

[18-Aug-2011 11:59:29] <rmatte> and I was using those functions to do so

[18-Aug-2011 11:59:32] <jong> scans through the event console? what does that mean?

[18-Aug-2011 11:59:46] <rmatte> it checks what events are in the active event console

[18-Aug-2011 11:59:48] <rmatte> here...

[18-Aug-2011 11:59:52] <rmatte> http://dmon.org/zenticket.html

[18-Aug-2011 11:59:52] <jong> You can implement tht funcionality with a custom action, very easily.

[18-Aug-2011 11:59:54] <emillerzenoss> polled for events, calling getEventList()

[18-Aug-2011 11:59:54] <rmatte> fully documented

[18-Aug-2011 12:00:01] [disconnected at Thu Aug 18 12:00:01 2011]

[18-Aug-2011 12:00:02] [connected at Thu Aug 18 12:00:02 2011]

[18-Aug-2011 12:00:20] [zenoss-logger (logger bot) has joined #zenoss]

[18-Aug-2011 12:00:58] <rmatte> I'm planning to rewrite it and break it up in to functions anyways, so I guess I can figure out how to update it for the new event system at the same time

[18-Aug-2011 12:01:05] <jong> rmatte: what you really want is a custom action, like email/command/page/webhook/snmp trap/whatever. You can implement the ticket creation in that and then just create a trigger to match events you care about.

[18-Aug-2011 12:01:07] <emillerzenoss> the new event system is quite nice, there are extension points where it would be easy to have those tickets created when the events happen, rather than polling for them later.

[18-Aug-2011 12:01:13] <nyeates> rmatte: there are new concepts in the new event system like triggers and actions that you could set to do this

[18-Aug-2011 12:01:21] <Hackman238> jong: Can you give an example? More people will understand if theres a working example.

[18-Aug-2011 12:01:46] <jong> In 4.X all actions are implemented this way, um, lemme find a link.

[18-Aug-2011 12:01:49] <rmatte> jong: there are a few problems with that... first of, on multi-client Zenoss boxes, I have to create an entire new command for each customer, it's overly tedious.

[18-Aug-2011 12:02:00] <rmatte> jong: also, I want it to trigger when the event count of the event increases as well

[18-Aug-2011 12:02:06] <rmatte> which the current command system doesn't allow for

[18-Aug-2011 12:02:25] <JohnnyNOC> man i just installed 3.x from 2.x and now we're talking 4.x!

[18-Aug-2011 12:02:34] <xuru> rmatte: I like it

[18-Aug-2011 12:02:52] <rmatte> xuru: it serves it's purpose hehe

[18-Aug-2011 12:03:02] <Hackman238> jong: Is it possible to use the new facade/routers for event queries in the same manner in 3.x as in 4.x?

[18-Aug-2011 12:03:11] <jong> Triggers are pretty awesome, they can match almost anything. The command would be implemented as a zenpack, easy to install on multiple instances.

[18-Aug-2011 12:03:21] <jong> Hackman238: No, definitely not.

[18-Aug-2011 12:03:53] <rmatte> jong: yeh, but that doesn't solve the ability to easily configure it for multiple customers... each customer can potentially have a specific queue and customer ID assigned to them

[18-Aug-2011 12:04:10] <rmatte> which is the main reason why the daemon was coded

[18-Aug-2011 12:04:26] <Hackman238> jong: Thats what I figured- is it a full overhaul to reimplement this in 3.2?

[18-Aug-2011 12:04:41] <jong> The command is just an action, you'd implement the command in a notification, which is very easy to configure. You can define a command with content bodies, then you'd be configuring the content bodies for each instance o the notification.

[18-Aug-2011 12:04:44] <Hackman238> jong: Or is it a pipe dream until zeneventserver is backported to 3.x?

[18-Aug-2011 12:04:53] <jong> Actions/Notifications/Triggers/Rules are very different from 3.X.

[18-Aug-2011 12:05:12] <xuru> rmatte: what ticket system do you use?

[18-Aug-2011 12:05:17] <rmatte> OTRS

[18-Aug-2011 12:05:25] <rmatte> a highly customized version of it

[18-Aug-2011 12:05:49] <xuru> ah,ok we've been using GLPI

[18-Aug-2011 12:05:52] <jong> Hackman238: It's a pipedream.

[18-Aug-2011 12:06:00] <Hackman238> jong: Figures.

[18-Aug-2011 12:06:07] <rmatte> never even heard of GLPI

[18-Aug-2011 12:06:22] <rmatte> french project?

[18-Aug-2011 12:06:25] <xuru> http://www.glpi-project.org/spip.php?lang=en

[18-Aug-2011 12:06:27] <xuru> yep

[18-Aug-2011 12:06:29] <emillerzenoss> the 3.2 event system is NOT the dramatic change

[18-Aug-2011 12:06:34] <rmatte> interesting

[18-Aug-2011 12:06:38] <Hackman238> xuru rmatte: have you both beat- we use a ticket system that could drive a saint to madness - http://www.python.org/about/success/rackspace/

[18-Aug-2011 12:06:39] <jong> rmatte: still looking for that link for you

[18-Aug-2011 12:06:44] <xuru> It's pretty decent

[18-Aug-2011 12:06:55] <nyeates> I agree, the trigger functionality in the UI is pretty bad a$$ and links to actions. There are preexisting actions or you can create your own new type of action. This is doc'ed to some begining degree here: servicedynamics/resource_manager_administration/4.0-v01/ch02s06.html

[18-Aug-2011 12:07:11] <Hackman238> emillerzenoss: So is the Ent event system going to be backported to 3.x?

[18-Aug-2011 12:07:45] <xuru> Hackman238: oh

[18-Aug-2011 12:07:46] <rmatte> I look forward to seeing the new event system

[18-Aug-2011 12:07:58] <rmatte> the old one was pretty awesome as it was, so if it's improved then that's really something

[18-Aug-2011 12:08:07] <rmatte> I assume transforms are still fully supported?

[18-Aug-2011 12:08:07] <Hackman238> xuru: Oh no indeed. CORE is.....very fun sometimes.

[18-Aug-2011 12:08:16] <rmatte> also, do the existing event mappings still jive with it?

[18-Aug-2011 12:09:14] <xuru> nyeates: looks very nice

[18-Aug-2011 12:09:53] <jong> rmatte: well I'm a jerk, I can't provide a link. The zenpack I wrote that plugs in web hooks as actions is on the internal repo.

[18-Aug-2011 12:10:17] <jong> rmatte: transforms are, yes

[18-Aug-2011 12:10:24] <rmatte> all good

[18-Aug-2011 12:10:41] <jong> rmatte: event mappings, yes, those did not change at all as far as I know.

[18-Aug-2011 12:10:54] <dhopp> jong: sure you can..just port that bad boy over the the public repo and presto you have a link :-P

[18-Aug-2011 12:10:57] <nyeates> jong: if and when ZEP gets backported, we should look into making it public ;-)

[18-Aug-2011 12:11:21] <Hackman238> nyeates: How likely is this?

[18-Aug-2011 12:11:22] <xuru> hell yeahs

[18-Aug-2011 12:11:39] <nyeates> Hackman238: very hopeful - that is all im saying for now

[18-Aug-2011 12:11:47] <jong> Hackman238: All signs point to 'yes' event system being backported.

[18-Aug-2011 12:12:05] <nyeates> :-)

[18-Aug-2011 12:12:08] <Hackman238> nyeates jong: Nice

[18-Aug-2011 12:12:24] <xuru> nyeates: any news on the pricing for small companies front?

[18-Aug-2011 12:12:26] <Hackman238> nyeates: Not sure if you heard, I was at the court house today setting up a NPO for the ZCA

[18-Aug-2011 12:12:42] <Hackman238> nyeates: We have investors who want to trow money at the project

[18-Aug-2011 12:12:46] <Hackman238> *throw

[18-Aug-2011 12:12:50] <nyeates> On that, we have a company-wide meeting coming up here at Zenoss Inc. So I am going to end the Dev chat now

[18-Aug-2011 12:13:01] <nyeates> Thanks all!

[18-Aug-2011 12:13:08] <xuru> thanks nyeates!

[18-Aug-2011 12:13:15] <Hackman238> Thanks Nick

[18-Aug-2011 12:13:17] <Hackman238> Later!

[18-Aug-2011 12:13:26] <JohnnyNOC> er

[18-Aug-2011 12:13:31] <JohnnyNOC> muchas gracias senor nyeates

[18-Aug-2011 12:14:18] <jong> rmatte: zenpack action summary: It's as easy as registering an adapter and implementing some interfaces.

[18-Aug-2011 12:14:38] <nyeates> xuru: talk to and work with the ZCA on that front.... which I am involved with to a degree. I want to do whatever we can to enable SMBs on zenoss, though little has yet been done on my end.

[18-Aug-2011 12:14:54] <Hackman238> rmatte: Yeah none of that is hard

[18-Aug-2011 12:14:57] <Hackman238> rmatte: Just differnt

[18-Aug-2011 12:15:09] <xuru> nyeates: ok, cool, thanks

[18-Aug-2011 12:15:18] <nyeates> Hackman238: Awesome! should help zca maintain voice

[18-Aug-2011 12:15:26] <Hackman238> xuru: What are you looking for?

[18-Aug-2011 12:15:44] <Hackman238> nyeates: Yeah its all moving along well.

[18-Aug-2011 12:15:51] <xuru> personally, I would like to see an alacart approach

[18-Aug-2011 12:16:00] <Hackman238> nyeates: Google is on the fence since they are tied up with the Moto deal

[18-Aug-2011 12:16:12] <Hackman238> nyeates: I think it comes down to resources

[18-Aug-2011 12:16:23] <Hackman238> nyeates: Human resources...not money

[18-Aug-2011 12:16:24] <xuru> or just better pricing for companies that can't afford it

[18-Aug-2011 12:16:36] <Hackman238> xuru: Ah good idea

[18-Aug-2011 12:16:44] <JohnnyNOC> google on the fence

[18-Aug-2011 12:16:45] <JohnnyNOC> about what

[18-Aug-2011 12:16:48] <nyeates> Hackman238: pertaining to them getting involved? what kinda resources would they need to throw at it?

[18-Aug-2011 12:17:03] <JohnnyNOC> what interest does google have in zenoss?

[18-Aug-2011 12:17:13] <Hackman238> xuru: Can you email me a short description so I can roll it in to the ZCA talks? hackman238@gmail.com

[18-Aug-2011 12:17:30] <Hackman238> JohnnyNOC: They have a Core install that makes Rackspaces Ent install like small

[18-Aug-2011 12:17:30] <xuru> Hackman238: yeah, I'd be glad too

[18-Aug-2011 12:17:32] <nyeates> Hackman238: isnt throwing the google name into the ring and having a guy come to meetings once a month, be enough?

[18-Aug-2011 12:17:55] <JohnnyNOC> Hackman238 interesting, while i was there in hardware operations i never saw/heard of it

[18-Aug-2011 12:18:05] <Hackman238> nyeates: Thats what I asked, but it seems like they really want to  make a huge project out of it

[18-Aug-2011 12:18:21] <JohnnyNOC> i seriously doubt it's used in production, at least, on the prod datacenters

[18-Aug-2011 12:18:28] <Hackman238> nyeates: Sort of on hold due to other stuff

[18-Aug-2011 12:18:36] <dhopp> Hackman238:  do you happen to have any kind of blog or anything from google that describes their use of Zenoss?  I'd love to use that for some firepower :-)

[18-Aug-2011 12:18:49] <nyeates> they wanna make a huge project... yet they dont have the resources??? seems juxtaposed

[18-Aug-2011 12:18:51] <dhopp> not necessiarly the scale..just that they use it

[18-Aug-2011 12:18:52] <nyeates> but whatever heh

[18-Aug-2011 12:18:53] <Hackman238> dhopp: Let me look- not sure if its public

[18-Aug-2011 12:18:57] <Hackman238> Its all in the Labs

[18-Aug-2011 12:19:00] <dhopp> *necessarily

[18-Aug-2011 12:19:28] <Hackman238> nyeates: they do...its manager reprioritization nonsense most likely

[18-Aug-2011 12:19:43] <nyeates> awww Hackman....were u suppsoed to let the google name fly in public? :-p

[18-Aug-2011 12:19:56] <Hackman238> nyeates: They didnt say not to

[18-Aug-2011 12:19:58] <Hackman238> LOL

[18-Aug-2011 12:20:46] <xuru> rmatte: do you remember where that post is on zenoss pricing?

[18-Aug-2011 12:20:47] <Hackman238> Anyway, thats all pending

[18-Aug-2011 12:20:52] <xuru> it's been a while

[18-Aug-2011 12:20:55] <JohnnyNOC> we're talking about a company that builds it's own pretty much everything

[18-Aug-2011 12:21:03] <JohnnyNOC> i'm surprised

[18-Aug-2011 12:21:17] <dhopp> JohnnyNOC: he didn't say it was stock Zenoss core :-P

[18-Aug-2011 12:21:47] <xuru> rmatte: ah, nvm found it...

[18-Aug-2011 12:21:50] <Hackman238> JohnnyNOC: Yeah its modded

[18-Aug-2011 12:22:07] <xuru> Hackman238: here is a posting when we talked about this before:  blogs/zenossblog/2011/02/16/zenoss-support--whats-better-than-fanatical-support#comment-3623

[18-Aug-2011 12:23:11] <Hackman238> nyeates: I'm very suprised Lanham hasnt thrown legal at Zenoss Inc for 'Fanatical Support' use

[18-Aug-2011 12:23:23] <xuru> hehe

[18-Aug-2011 12:23:30] <Hackman238> nyeates: Thats playing with fire less theres some sort of deal worked out

[18-Aug-2011 12:23:31] <nyeates> LANL did a pretty interesting mod of zenoss core for the High Performance Computing (HPC) market: community/developers/hpc

[18-Aug-2011 12:23:47] <Hackman238> nyeates: Yes, very cool roll out

[18-Aug-2011 12:24:01] <Hackman238> xuru: Got it. I'll keep you updated

[18-Aug-2011 12:24:21] <xuru> Hackman238: I'll send you an email too with my ideas

[18-Aug-2011 12:24:55] <Hackman238> xuru: Awesome. Email is always best since I'm short on brainspace and threads

[18-Aug-2011 12:25:02] <xuru>

[18-Aug-2011 12:25:12] <nyeates> ok guys, i gotta de compress before a long meeting - cya

[18-Aug-2011 12:25:20] <Hackman238> nyeates: Later!

[18-Aug-2011 12:25:30] <Hackman238> nyeates: Dont get the bends!

[18-Aug-2011 12:25:35] <Hackman238> (decompression joke)

[18-Aug-2011 12:25:37] <xuru> hehe

[18-Aug-2011 12:25:47] <nyeates> change the topic for me will ya?

[18-Aug-2011 12:26:00] <Hackman238> np