This presentation covers PwC's AI transformation journey through their Tech Catalyst initiative, focusing on quality engineering and testing practices. James Chorlton, Director of Engineering, introduces how PwC consolidated 1,000 engineering staff into Tech Catalyst and launched their AI First for Innovation Lifecycle (AFIL) project to revolutionize software development using AI tools like GitHub Copilot. Helena Brown, who leads the quality engineering team of 71 engineers across multiple countries, explains their scaling strategies including AI upskilling initiatives, mentoring schemes, and capability development. Swapnil then details the shift from traditional deterministic testing to AI system testing, where outputs are variable and trust becomes the key measure rather than simple functionality. He covers new testing challenges like hallucination, bias, and model drift, introduces PwC's AI red teaming approach for safety testing, and presents their testing lifecycle that includes continuous production monitoring. The presentation emphasizes responsible AI adoption with human oversight, evidence-based validation, and the principle that AI tools augment rather than replace quality engineers. A practical case study demonstrates 50-65% time savings in ServiceNow chatbot testing with an 84.7% evaluation pass rate.
Comments