Zenoss QA Overview

Welcome to the Zenoss Test Case Repository. This page serves as both the high-level summary document for Zenoss QA as well as the repository for the Zenoss Core, Pro, and Enterprise test cases. These test cases can be edited by anyone with the proper Trac access. As a software project with a significant user community, we decided to locate our test cases someplace that the community can execute and update. Please email Brian with any questions or before you make large-scale content revisions. As with all Wikis, this Wiki is a constant work in progress, and we can't finish without your help.

Test Environment

As everyone here knows, the Zenoss product is a powerful tool for monitoring diverse network environments. It is also scalable and customizable, to model greater numbers of more diverse devices as time progresses. As such, any test environment that we maintain will inherently be missing machines that are available "in the wild". Furthermore, there are machines that are esoteric and/or prohibitively expensive, and these are not practical to maintain in a dedicated QA lab.

Zenoss is working to configure a consistent test environment that internal testers can model and use when testing the Zenoss product. This environment will consist of a reasonable and manageable number of devices, currently expected to contain 25 total devices, and would be *the* group of machines that Zenoss models when testing new builds & functionality. It also allows for known monitoring values; for example, that the following services should always be seen via WMI, that the following interfaces should be discovered and modeled, etc.

Click here for more information on the Zenoss Test Environment, for example what devices are and are not included.

Click Here for How to make Vmware boxes for testing and such

Sample Test Case (Stub)

Zenoss will use a standard stub test case for all new test case creation. Please make sure, if you add a test case that doesn't already exist, that you follow our naming convention, TestCase-{Test-Component}. All test cases must be prefaced by the "TestCase-" string. As with all things, note that this Test Case Stub is being constantly updated as we progress with testing; Zenoss QA will update older test cases with any formatting changes as needed.

Click here for the sample test case stub, and copy/paste the pre-formatted section of text into your empty Wiki page.

Zenoss 2.3 Test Execution Document

We are tracking the 2.3 Test Execution on Google Docs at http://spreadsheets.google.com/a/zenossinc.com/ccc?key=pTjLoJ3i0aWLpCpXEZs68RQ&hl=en.

Zenoss TRAC Defect Template

For enhancements being entered in track, feel free to make your recommendations in whatever format you find most effect. However, for defects, please use the following framework (enter all fields if possible):

TRAC Defect Template

Zenoss Test Case Repository

Test cases are organized by basic area; if you are unsure of where a given test case should be located, please contact Brian.

Build Smoke Tests

  1. Zenoss Product Installation
  2. Login/User/Email
  3. Discovery & Modeling
  4. Monitoring, & Performance
  5. Smoke Document by Dahl (integrate)

Automation Tests

  1. Zenoss Selenium Homepage
  2. Core Selenium Suite?
  3. Enterprise Selenium Suite?
  4. Command-line Unit Tests?

Distributed Collector

  1. Distributed Collector Tests

Regression Suite

Discovery and Modeling

Windows Discovery Tests *NIX Discovery Tests? Routers/Appliance Discovery Tests? Unknown Discovery Tests?
SNMP Modeling Tests? Windows (WMI) Modeling Tests SSH/CMD Modeling Tests?
“Add Device” via UI Management

Distributed Collector Discovery and Modeling

Distributed Collector Overview

VMWare

https://dev.zenoss.com/tracint/wiki/VMware1_0TestCaseDiscussion

Monitoring and Alerting

Linux Monitoring Tests? Windows Monitoring Tests? Other Hardware Monitoring Tests?
JMX (Java) Monitoring Tests Performance Monitoring Tests? Health Monitoring Tests?
RRD (Metrics) Monitoring Tests? Email Alerting Tests? Other & Pager Alerting Tests?

User Interface and Displays

Main Views -> Dashboard Main Views -> Event Console? Main Views -> Device List? Main Views -> Network Map?
Classes->Events? Classes->Devices Classes->Services Classes->Processes Classes-> Products
Browse By->Systems? Browse By->Groups? Browse By->Locations? Browse By->Networks? Browse By->Reports?
Management->Add Device? Management->Mibs? Management->Collectors? Management->Settings? Management->Event Manager? 1. Login Testcases

Installation Tests

Source Installation Tests BIN Installation Tests? Appliance/VM Installation Tests? RPM Installation Tests

Upgrades Tests

Source Upgrade Tests? BIN Upgrade Tests? Appliance/VM Upgrade Tests?

ZenPack-Specific Tests


Functional Test Script

The current Google Docs testcase, 51 sections.