SLI Government Solutions delivered an approach to staff each development track with a dedicated Test Lead, and an overall Test Manager to coordinate all the team’s activities with DHHS and the systems integration vendors. It was determined that full-time, on-site support was required, so the SLI Test Management Team was co-located with the development teams at the client’s work location in Raleigh, NC.
The SLI Team provided multiple test management support services including the review and assessment of vendor-led test planning deliverables and test artifacts produced by the vendors for the two sub-projects. SLI monitored vendor-led testing through the analysis of actual test results to determine readiness for production of each release. SLI reviewed and refined defect management procedures to ensure proper defect classification and turnaround.
The State-led testing was managed by SLI through coordination of the agency participants, determination of test cases and data scenarios for User Acceptance Test (UAT), and final evaluation of the system for live production status. SLI Test Management Services included:
- Planning, executing, and reporting of system/user testing, involving both internal and outsourced development
- Coordinating and training of State-controlled resources and schedule for testing
- Providing expertise in the chosen testing software, SilkCentral Test Manager; providing custom reports and analysis of testing velocity
- Interfacing with System Integrators to assist and oversee its testing effort to ensure the success of the State’s testing effort. Interface with DHHS and non-DHHS organizations and individuals, as necessary, to enhance the testing program
- Focusing efforts in a value-added fashion that achieved the best return on investment and overlaps the developers’ efforts only where prudent and necessary
- Participating in project risk management programs to ensure that testing was used as an appropriate identification and management tool; and verification of non-system elements of the overall solution, such as manual processes, as directed by the State
SLI’s role was to act as a testing coach, expert, and quality partner. Throughout the Test Management effort, SLI facilitated the work of the NCTracks Project by developing constructive, collaborative relationships with the State and with the System Integration vendors, with the goal of ensuring comprehensive test coverage to maximize software quality. For example, SLI uncovered an issue with the scope, coverage and organizing model for the MMIS vendor’s automated test suite. This finding enabled the State Team Subject Matter Experts to clarify the coverage ‘holes’ present within the System Integrator’s regression testing approach and correct the gaps before they caused significant delays and rework.