ZenPacks : VMWare Data Source : Comments

RE: VMWare Data Source

community@zenoss.org — Mon, 22 Nov 2010 19:16:02 GMT

I'm getting the error "Warning XML::LibXML complied against libxml2 20706, but runtime is libxml2 20702".

It refuses to run. I installed the Perl DSK from VMWare's site.

My Zenoss host is running Ubuntu 10.04 LTS. An apt-get of libxml2 says that it is the latest.

RE: VMWare Data Source

community@zenoss.org — Mon, 22 Nov 2010 19:38:50 GMT

Are you getting this error when you are running model device. If so could you paste the output from that, I had a tester who was using ubuntu and I set it to just log that warning so that it could still collect the data.

RE: VMWare Data Source

community@zenoss.org — Mon, 22 Nov 2010 19:45:23 GMT

Cmd: /usr/bin/perl /usr/local/zenoss/zenoss/ZenPacks/ZenPacks.community.VMwareDataSource-1.0.egg/ZenPacks/community/VMwareDataSource/libexec/esxi_performance.pl --server 10.1.1.85 --username administrator --password 'password' --options 'hostperf:ESX02' - Code: 1 - Msg: General error

RE: VMWare Data Source

community@zenoss.org — Mon, 22 Nov 2010 20:02:05 GMT

Ok could you run the first command in a terminal as the zenoss user and give the me the output I am expecting something like:

hostperf|sysUpTime=725696100 memSwapused=0 memGranted=48503016 memActive=6020332 diskUsage=78 cpuUsagemhz=3133 cpuUsage=1399 cpuReservedcapacity=1000

which is all on one line, I am suspecting you are getting another line with the warning message on it if that is the case I know how to fix that.

RE: VMWare Data Source

community@zenoss.org — Tue, 23 Nov 2010 17:43:05 GMT

urce-1.0.egg/ZenPacks/community/VMwareDataSource/libexec$ ./esxi_performance.pl --server 10.1.1.85 --username root --password 'password' --options 'guestperf:WSUS'

Warning: XML::LibXML compiled against libxml2 20706, but runtime libxml2 is older 20702

guestperf|memUsage=499 memOverhead=160780 memConsumed=3976084 diskUsage=3 cpuUsageMin=756 cpuUsageMax=756 cpuUsageAvg=756 cpuUsage=302

So, that works fine, even though I get the error message.

I wound up re-building Zenoss 3 on a new Ubuntu 10.10 install.

RE: VMWare Data Source

community@zenoss.org — Tue, 23 Nov 2010 18:31:34 GMT

Hey, ok so this problem is no longer affecting you? I will still work on it, but if it is no longer affecting you it may take a while.

RE: VMWare Data Source

community@zenoss.org — Wed, 08 Dec 2010 17:19:23 GMT

I'm seeing the same error on Ubuntu 10.10 x64.

Here is what happens when I run as the Zenoss user:

zenoss@monitor:~$ /usr/bin/perl /usr/local/zenoss/zenoss/ZenPacks/ZenPacks.community.VMwareDataSource-1.1.egg/ZenPacks/community/VMwareDataSource/libexec/esxi_performance.pl --server 1.2.3.45 --username user --password 'password' --options 'hostperf:1.2.3.45'
Warning: XML::LibXML compiled against libxml2 20706, but runtime libxml2 is older 20702

RE: VMWare Data Source

community@zenoss.org — Fri, 10 Dec 2010 03:30:49 GMT

That warning is because ubuntu server has an older version of libxml, to get around this I only grab the last line of output from my script. So basically this warning is ignored in the newer version's of this zenpack from 1.1 and on.

RE: VMWare Data Source

community@zenoss.org — Fri, 10 Dec 2010 14:12:55 GMT

Shouldn't I see some output when I run the command manually as the Zenoss user? Right now I just get the error.

zenoss@monitor:/$ /usr/bin/perl /usr/local/zenoss/zenoss/ZenPacks/ZenPacks.community.VMwareDataSource-1.1.1.egg/ZenPacks/community/VMwareDataSource/libexec/esxi_performance.pl --server 1.2.3.45 --username root --password 'passwd' --options 'hostperf:1.2.3.45'
Warning: XML::LibXML compiled against libxml2 20706, but runtime libxml2 is older 20702

It does seem to be logging into my ESXi installation at least. If I change the user/pass to something incorrect, I get an error that it cannot complete the login.

RE: VMWare Data Source

community@zenoss.org — Fri, 10 Dec 2010 14:32:45 GMT

The reason you are not getting any output from the command is because you have passed it incorrect parameters. It logs into your ESXi machine fine but for host performance options is 'hostperf:esxi.yourcompany.com'. Because vSphere stores performance data by fully qualified domain names. To test the command for your device you should go the vmware host template and test the one datasource.

RE: VMWare Data Source

community@zenoss.org — Fri, 10 Dec 2010 16:53:44 GMT

That fixed it. Thanks!

RE: VMWare Data Source

community@zenoss.org — Fri, 10 Dec 2010 20:58:31 GMT

I updated this component, and I get:

Preparing Command...

Exception while performing command:

Traceback (most recent call last):
  File "/usr/local/zenoss/zenoss/Products/ZenUI3/browser/command.py", line 120, in stream
    self.reportError)
  File "/usr/local/zenoss/zenoss/ZenPacks/ZenPacks.community.VMwareDataSource-1.1.1.egg/ZenPacks/community/VMwareDataSource/datasources/VMwareDataSource.py", line 200, in testDataSourceAgainstDevice
    command = self.getCommand(device)
  File "/usr/local/zenoss/zenoss/ZenPacks/ZenPacks.community.VMwareDataSource-1.1.1.egg/ZenPacks/community/VMwareDataSource/datasources/VMwareDataSource.py", line 152, in getCommand
    cmd = RRDDataSource.RRDDataSource.getCommand(self, context, cmd)
UnboundLocalError: local variable 'cmd' referenced before assignment

This is when testing the Device Vritual Machine Host/ESXi against the cpuUsage data.

RE: VMWare Data Source

community@zenoss.org — Fri, 10 Dec 2010 21:54:41 GMT

It looks like you have renamed the datasource name it must be the default that is why your are getting this traceback for the host template the datasource name must be "VMwareHost" and the data points must be what is supplied with the template. To get this back to default you would have to do a remove and reinstall.

edit: Actually for the VMwareHost datasource make sure performanc source is set to VMwareHost also, the templates are included in the VMwareESXiMonitor zenpack.

RE: VMWare Data Source

community@zenoss.org — Thu, 30 Dec 2010 21:47:52 GMT

Eric,

Is extending this Zenpack to include other DataSources simply (ha!) a matter of modifying the perl script esxi_performance.pl? I am not a perl programmer (or any type of programmer), but we really need to be able to monitor network and disk, as we are running iSCSI. I understand it is right in the middle of the holidays, but if you have any pointers for modifying this after the new year, that would be great!

Also, this seems to be a much better way to monitor my vSphere instances than using resxtop. I liked resxtop, but was unable to extend it's capabilities to monitor the counters we needed.

Thanks again,

Braynyac

RE: VMWare Data Source

community@zenoss.org — Thu, 30 Dec 2010 22:53:00 GMT

Hey Braynyac,

Extending this ZenPack to include other datasources isn't as simple as that you would need to modify the perl script and also the datasource python file. I actually am working on adding network usage monitoring to this zenpack. Right now there is a disk usage graph, ie read/write activity all in one data point as far as actuall disk percentage used I haven't been able to figure that out.

Eric

RE: VMWare Data Source

community@zenoss.org — Tue, 04 Jan 2011 15:00:38 GMT

Thanks for the update Eric.

If there is anything I can do to help, I would love to, just let me know. As I said, I'm not a programmer, but I'm fairly good at figuring things out (except how to extend the ESXTop ZenPack....).

Braynyac

RE: VMWare Data Source

community@zenoss.org — Fri, 07 Jan 2011 16:17:13 GMT

It looks like VSphere stores the host performance data not only in FQDN, but case-sensitive. So for me:

If VSphere stored the host name as esxi.yourcompany.com, and I was passing it 'hostperf:ESXI.yourcompany.com' it wouldn't work, but changing it so the case matched did.

This may seem self-evident, if so sorry!

RE: VMWare Data Source

community@zenoss.org — Wed, 12 Jan 2011 14:40:22 GMT

HI,

i finally had success in using your http://community.zenoss.org/docs/DOC-10225 zenpack that uses this http://community.zenoss.org/docs/DOC-10242 zenpack.

I'm very interested in future extended funcionalities like VMwareDisk, VMwareHostVolumePartition and VMwareNic, as you stated in your zenpack overview.

So i just wanted to let you know that there is an interest for upgrade and ask for your response on this: can we expect upgrades in the near future?

Thanks

marko

RE: VMWare Data Source

community@zenoss.org — Wed, 12 Jan 2011 17:25:19 GMT

Hey

Yes I have started on an update, I can't really give a deadline as to when I will finish it though unfortunately. I need to figure out my school, work balance. I may be able to implement a few of the features soon, but we'll see what happens.

-Eric

RE: VMWare Data Source

community@zenoss.org — Thu, 13 Jan 2011 07:47:57 GMT

hi Eric

well, knowing at least that you plan to implement further enhancements is good enough for me. i will await your next release as we are really interested in monitoring ESX with your zenpack.

If i may add a suggestion: it would be really helpfull to extend zenpack installation and configuration instructions above. This thread contains several helpfull problems&solutions (like discovering your ESX server using FQDN instead of IP address) you can use to update the instructions.

But of course, if you will have the time to do it.

Also, i personally had problems understanding what kind of users are necessary for this zenpack (or VMware ESXi Monitor zenpack) like zCommand User and vSphere User, what kind of user are those (local on ESX server?, permissions, SSH needed or not, etc.), as i'm not VMware expert at all. I had to learn this technology on the fly...

I had to use a ROOT user on a test ESX to get it working, but i had no luck using any other user (creating somekind of Zenoss dedicated user for this to work) because i couldn't find any info on what this user must be able to do. So i tested with root just to see it working. Of course, in production environment, monitoring an ESX with root is not an option. So it would be helpfull if you could be more specific on the requirements for this kind oof monitoring.

Anyway, great job!

regards

marko

RE: VMWare Data Source

community@zenoss.org — Fri, 28 Jan 2011 04:31:45 GMT

Hey

I modified the instructions on VMware ESXi Monitor to say what type of user is needed, hope that helps.

Eric

RE: VMWare Data Source

community@zenoss.org — Mon, 31 Jan 2011 08:09:32 GMT

That's it.

thanks for the instructions update

Marko

RE: VMWare Data Source

community@zenoss.org — Fri, 11 Mar 2011 12:06:04 GMT

Hi Eric,

as per your instructions above, quote:

"Currently there are only two allowed datasources, VMwareHost and VMwareGuest. There are a few in development, and as I have time I will continue to add more."

I was wondering if there is any progress on other VMware datasources?

We're very interested in this zenpack and anxiously look forward to further zenpack expansions for other VMware performance datasources/graphs.

Regards,

Marko

RE: VMWare Data Source

community@zenoss.org — Fri, 11 Mar 2011 12:36:44 GMT

Hey Marko

Yes I have slowly been working on updates the last time I touched It I had gotten the information on vmware nics but hadn't figured out how to get the performance yet. I will try and push out those changes to github today. I can't remember what my next step is but I do have it jotted down somewhere on paper.

RE: VMWare Data Source

community@zenoss.org — Mon, 14 Mar 2011 08:30:55 GMT

okay, thanks for info,

i guess nic and some more storage-oriented perf info would be nice to have.

I have also forgot what are the "standard" perf profiles available, i think you had them listed in you "zenpack info" above once before you updated the info.

anyway, keep up the good work...

marko

RE: VMWare Data Source

community@zenoss.org — Wed, 23 Mar 2011 09:26:25 GMT

EDIT : Find !

in ZenPacks.community.VMwareDataSource-1.1.2.egg/ZenPacks/community/VMwareDataSource/datasources/VMwareDataSource.py

Hi !

I have the same issue so I would like change the command

--options 'hostperf:1.2.3.45' >> to >> --options 'hostperf:MY_FULLY_QUALIFIED_DOMAINE''

but I don't know where I must change it

Shouldn't I see some output when I run the command manually as the Zenoss user? Right now I just get the error.

zenoss@monitor:/$ /usr/bin/perl /usr/local/zenoss/zenoss/ZenPacks/ZenPacks.community.VMwareDataSource-1.1.1.egg/ZenPacks/community/VMwareDataSource/libexec/esxi_performance.pl --server 1.2.3.45 --username root --password 'passwd' --options 'hostperf:1.2.3.45'
Warning: XML::LibXML compiled against libxml2 20706, but runtime libxml2 is older 20702

It does seem to be logging into my ESXi installation at least. If I change the user/pass to something incorrect, I get an error that it cannot complete the login.

RE: VMWare Data Source

community@zenoss.org — Wed, 23 Mar 2011 09:50:20 GMT

I have an other issue.

This command works /usr/bin/perl /usr/local/zenoss/zenoss/ZenPacks/ZenPacks.community.VMwareDataSource-1.1.2.egg/ZenPacks/community/VMwareDataSource/libexec/esxi_performance.pl --server 10.1.0.248 --username root --password '*****' --options 'hostperf:mycompany.com' | tail -n1 against 10.1.0.248

But the same command with 'guestperf:mycompany.com' doesn't work .....

Thanks

RE: VMWare Data Source

community@zenoss.org — Wed, 23 Mar 2011 12:03:40 GMT

This answer has been posted before, your machine in zenoss must use its fqdn. Your device cannot be named my your ip address. For further explanation read my last post on. http://community.zenoss.org/docs/DOC-10225

RE: VMWare Data Source

community@zenoss.org — Wed, 23 Mar 2011 12:05:39 GMT

Yes that command will work but using 'guestperf:my.company.com' wont. That is because guestperf needs to use a virtual machines name on the device which is returned by the Guest modeler plugin in my VMwareESXiMonitor zenpack.

RE: VMWare Data Source

community@zenoss.org — Tue, 03 May 2011 11:06:02 GMT

Hi Eric

We are anxious to have VMwareCluster, VMwareDisk, VMwareHostVolumePartition and VMwareNic datasources supported

Any progress on that?

We are now using your zenpack to monitor ESX technology on 4 separate environments and we are very satisified with benefits this zenpack gives in performance visibility. We would like to be one step further by gaining performance insight in VMs storage (and optionaly network) performance as well. Storage-related performance per VM being on the top of our wish-list.

Hope to hear good news from you soon

regards

Marko

RE: VMWare Data Source

community@zenoss.org — Wed, 04 May 2011 02:06:22 GMT

Hey Marko,

I haven't touched both of my ESXi zenpacks since around January sometime.

This was because I had a busy term of school and work along with that.

Thanks for your reminder's, I just finished setting up my home zenoss

deveopment environment and went back to work on the VMwareNic feature. I had

left it off in January with a good start but couldn't quite figure out how

to quite get it to receive the nic performance data. While I managed to get

that working just barely today. So I just need to do some finishing touches

and there will be a new realease for the Data source and the monitor.

-Eric

RE: VMWare Data Source

community@zenoss.org — Wed, 04 May 2011 10:44:48 GMT

great

if i can add some feedback. while it is not so hard to make your zenpack scripts to get more metrics, the problem is where to pinpoint the graphs. Since your ESX model consists of only a HOST and a guest VIRTUAL MACHINE(S), i expect you will have to extend/update the model itself.

Let's say we can get i.e. Physical Disk write latency (from a vmware data source somehow), the problem is that we don't have Physical disk as a component (or associated with a VM), so there is no place to attach a performance graph to. Also, passing a "disk" to a script is currently impossible since we don't have it in a model and we can't supply the disk ID to a script to make it dynamic and variabile.

i'm sure you understand what i'm talking about and while i understand the problem, i can't be much of help since i know nothing about modelling.

looking forward to your next release....

marko

RE: VMWare Data Source

community@zenoss.org — Thu, 05 May 2011 12:01:08 GMT

Hey Marko,

Yes the additions have been a problem within my current model. This would be related to me using the ZenPacks.zenoss.ZenossVirtualHostMonitor which I am working on phasing out the dependencie. Once I phase this out I will be able to get guest up/down status via a performance template and create alerts when a guest goes down.

Currently in my development version I have retrieved nic receive/transmit rate as well as up/down status. I just need to put the polishing touches on it and it will be complete. I also have a few memory usage fixes that should decrease the amount of time the plugin and performance sources take (basically request only specific areas of information from the server in each request). As far as I can tell other then guest disk latency I have all the other variable information I can get. Along with these updates I finally plan on adding alerts. So if anybody has any alerts they use that could be added to the template be sure to post them here so I can add them and possibly make them work a little nicer.

RE: VMWare Data Source

community@zenoss.org — Fri, 29 Jul 2011 08:34:12 GMT

Could this ZenPack monitor DataStores on the ESXi Host?

RE: VMWare Data Source

community@zenoss.org — Fri, 19 Aug 2011 09:14:58 GMT

Script Timeout:

It works from the command line but as a script it is timing out. Is there a way to set a variable to allow the script to run longer?

command-line

root@sm007:# ./esxi_performance.pl --server 10.20.1.2 --username zenuser --password '#######' --options 'guestperf:ls001' | tail -n1

guestperf|memUsage=599 memOverhead=117136 memConsumed=1954768 diskUsage=15 cpuUsageMin=950 cpuUsageMax=499 cpuUsageAvg=499 cpuUsage=85

zenoss-script-use

Command timed out on device esxi.domain.com: "/usr/bin/perl /usr/local/zenoss/ZenPacks/ZenPacks.community.VMwareDataSource-1.1.2.egg/ZenPacks/community/VMwareDataSource/libexec/esxi_performance.pl --server 10.20.1.2 --username zenuser --password '######' --options 'guestperf:ls001' | tail -n1"

Any advice or insight would be appreciated?

Thanks in advance.

RE: VMWare Data Source

community@zenoss.org — Mon, 21 Nov 2011 07:38:57 GMT

I get nothing when I ran the command both from GUI and ran manually in zenoss. No graphs info comes yet (their values are nan) but in Componets 'Virtual Machines' item added(thanks God!).

I recheck all dependencies and required packages for installing zenpacks, nothing left and now I dont understand what the problem is, why I cant get any values?

* Im working on zenoss 3.2.1 *

Preparing Command...

Executing command /usr/bin/perl /zenoss/zenoss/ZenPacks/ZenPacks.community.VMwareDataSource-1.1.2.egg/ZenPacks/community/VMwareDataSource/libexec/esxi_performance.pl --server 192.168.10.101 --username root --password 'password' --options 'hostperf:192.168.10.101' | tail -n1 against 192.168.10.101

DONE in 0 seconds

RE: VMWare Data Source

community@zenoss.org — Thu, 29 Dec 2011 19:26:58 GMT

This gatherer works really well. In the future, it would be great if it could also pull the hardware status from the ESXi SDK. With ESXi removing the ability for vendors to add data to the (very limited) ESXi SNMP daemon, it's now no longer possible to externally monitor hardware status through SNMP. However, it may be possible to gather that data through the SDK. In specific, I'd love to gain access to the data normally gathered via SNMP from these ZenPacks:

http://community.zenoss.org/docs/DOC-3410

http://community.zenoss.org/docs/DOC-3394

Consider this a feature request.

RE: VMWare Data Source

community@zenoss.org — Thu, 31 May 2012 03:39:01 GMT

I get this error when running the command. I think it has to do with checking for a valid cert but I cannot figure out how to stop it from checking. I tried adding this line to the perl script but if fails too.

my $ENV{PERL_LWP_SSL_VERIFY_HOSTNAME} = 0;

Preparing Command...

Executing command /usr/bin/perl /usr/local/zenoss/zenoss/ZenPacks/ZenPacks.community.VMwareDataSource-1.1.2.egg/ZenPacks/community/VMwareDataSource/libexec/esxi_performance.pl --server 172.16.12.10 --username root --password 'rootpassword' --options 'hostperf:hostname.testdomain.com' | tail -n1 against hostname.testdomain.com

Warning: XML::LibXML compiled against libxml2 20706, but runtime libxml2 is older 20702

Server version unavailable at 'https://172.16.12.10:443/sdk/vimService.wsdl' at /usr/share/perl/5.10/VMware/VICommon.pm line 545.

DONE in 0 seconds

RE: VMWare Data Source

community@zenoss.org — Mon, 14 Jan 2013 16:39:11 GMT

I am trying to run this on CentOS 6.3, with zenoss 4.2.3. When I try to manually run the script "esxi_performance.pl" to troubleshoot, I am seeing this:

/opt/zenoss/ZenPacks/ZenPacks.community.VMwareDataSource-1.1.2-py2.7.egg/ZenPacks/community/VMwareDataSource/libexec/esxi_performance.pl --server server.example.org --username root --password '**********' --options 'guestperf:ls001'

*******************************************************************

Using the default of SSL_verify_mode of SSL_VERIFY_NONE for client

is depreciated! Please set SSL_verify_mode to SSL_VERIFY_PEER

together with SSL_ca_file|SSL_ca_path for verification.

If you really don't want to verify the certificate and keep the

connection open to Man-In-The-Middle attacks please set

SSL_verify_mode explicitly to SSL_VERIFY_NONE in your application.

*******************************************************************

at /usr/local/share/perl5/LWP/Protocol/http.pm line 31

*******************************************************************

Using the default of SSL_verify_mode of SSL_VERIFY_NONE for client

is depreciated! Please set SSL_verify_mode to SSL_VERIFY_PEER

together with SSL_ca_file|SSL_ca_path for verification.

If you really don't want to verify the certificate and keep the

connection open to Man-In-The-Middle attacks please set

SSL_verify_mode explicitly to SSL_VERIFY_NONE in your application.

*******************************************************************

at /usr/local/share/perl5/LWP/Protocol/http.pm line 31

This error keeps repeating..

I have already tried setting at the top of the file:

$ENV{PERL_LWP_SSL_VERIFY_HOSTNAME} = 0

So far, I have not found any way to monitor VMWare with zenoss 4.2 on Centos 6.x