Background:
Often when contemplating a GMP application software project it is desirable to use the software vendor’s protocols to minimize cost. It would be natural to assume that the vendor’s protocols should provide a cost savings, as the vendor’s protocols had previously been executed as part of the testing to release the software for commercial sale. Or, alternatively were used on previous commissioning / validation projects. This was the expectation at one recent project however; the reality of the situation was quite different.
End-user Reality:
On a recent project, testing protocols were purchased from the software vendor for a validation of an application to be used in a GMP environment. These protocols were the vendor’s standard test package for the system. The customer (End-User) executed the protocols; however, they experienced a 100% failure rate. Examples included:
The 100% failure rate created questions in the end-users mind as to the quality of the vendor testing and test protocols. The high failure rate negatively affected both project budget and schedule to launch a validated application for GMP use.
Investigation and Solution:
The Performance Validation CSV team was brought in to assist the end-user in resolving these problems. However, was the issue an application problem or a test protocol problem? Performance Validation executed dry runs of the vendor’s testing protocols and identified that:
The Results & Benefits:
While the use of vendor provided testing protocols may provide an opportunity for considerable cost savings it is important to understand the difference in the intended use and of the rigor required for GMP testing versus product release testing. It is a GMP expectation that testing is repeatable and that testing can provide reproducible results independent of the individual performing the testing (i.e., any qualified individual should be able to complete the test and obtain the same result). Additionally, GMP testing is expected to capture objective evidence required to demonstrate satisfactory completion.
Factors that end-users should consider when contemplating use of Vendor test documents:
The process of identifying and resolving testing errors is a significant cost and risk to any Computer System Validation project. Because of the identified issues, the end user spent time and money dry running, sending comments back to the vendor and waiting for updated protocols to be returned and that could have been avoided. Had the testing been maintained and updated after system updates as well as test setup being detailed enough for a less experienced customer, the test protocol execution would have been much more smooth and efficient.
For more information please contact:
Kevin Marcial
Sr. Validation Engineer
Performance Validation, LLC.
5168 Sprinkle Road
Portage, MI 49002