Advancing Innovation through AI and Test Automation at the HHS Agency

Background

The Health Resources and Services Administration (HRSA), an agency within the U.S. Department of Health and Human Services, plays a crucial role in promoting health equity and enhancing access to care for underserved and vulnerable communities. Central to HRSA’s digital operations is the Electronic Handbooks (EHBs) platform, a complex, enterprise-grade environment supporting program management, grants administration, compliance, and performance monitoring.

Supporting and evolving the EHBs platform involves a vast, distributed network of internal and external stakeholders. HRSA’s enterprise IT operations span dozens of systems, hundreds of modules, and multiple teams working in tandem. This includes parallel efforts across Development, Maintenance, Operations, and Independent Verification and Validation (IV&V) vendors, each using different toolsets, timelines, and goals. The scale and complexity of managing quality assurance and coordination in such a multivendor landscape demanded a shift from traditional, manual approaches to one powered by automation, artificial intelligence (AI), and DevOps integration.

Challenge

HRSA required a scalable, consistent, and independent IV&V capability to support its growing EHBs platform, which includes enterprise modules, microservices, and system-to-system integrations. Manual testing approaches have struggled to keep pace with the continuous delivery models adopted by various teams. Inconsistent validation processes, fragmented reporting, and siloed tools created duplication of effort and risked missed defects in critical releases.

The lack of centralized oversight and intelligent testing made early defect detection, particularly visual regressions and accessibility issues, very difficult. Furthermore, coordinating validation activities across multiple vendors added complexity and delayed alignment on release readiness.

HRSA needed a unified, intelligent testing solution that could scale across systems and teams, enforce standard practices, accelerate defect resolution, and support its vision for agile, automated DevOps delivery.

Solution

ASSYST implemented a centralized, AI-powered Test Harness Platform (THP) purpose-built to meet HRSA’s enterprise validation needs. THP functions as a shared automation and collaboration hub for all development, operations, and IV&V teams. It streamlines test management, execution, monitoring, and reporting through a single, web-based interface.

Key elements of the solution include:

• AI-Driven Regression and UAT Automation: Leveraging AI and machine learning (ML), THP dynamically prioritizes test execution based on historical defect data, risk patterns, and recent system changes. This enables smarter and more efficient validation during every release cycle.
• ML-Based Visual Testing: Traditional scripted tests often overlook nuanced UI issues. ML-powered visual testing algorithms now detect layout shifts, styling anomalies, and other user interface defects across various screen types, roles, and configurations.
• DevOps Integration and Continuous Testing: THP is embedded into HRSA’s DevOps pipelines and CI/CD workflows, enabling continuous testing with tools like Azure DevOps, Jenkins, and Jira. Automated tests run as part of code deployments, and defects are fed back into workflows for immediate triage and resolution.
• Cross-Vendor Collaboration and Transparency: THP serves as a common testing foundation across all vendors, aligning development, operations, and validation teams. It enforces consistent standards, promotes collaboration through shared dashboards, and ensures unified quality metrics across the EHBs ecosystem.
• Reusable and Scalable Automation Frameworks: Built on modular, data-driven principles, THP supports large-scale test execution, parallel runs, and dynamic data generation with tools like Redgate, allowing rapid onboarding of new test scenarios and minimizing rework.
• Automated Accessibility and Compliance Testing: THP includes both automated and manual support for Section 508 validation, ensuring inclusive and accessible digital services across HRSA applications.

Outcomes

HRSA’s investment in centralized, intelligent test automation has transformed its digital validation processes:

• Scalable Automation with AI Optimization: Regression and UAT test cases are now automated, with ML-enhanced prioritization accelerating testing while increasing accuracy and coverage.
• Accelerated DevOps and Release Velocity: With automated testing fully integrated into the CI/CD pipeline, HRSA teams benefit from continuous quality feedback, faster deployments, and improved agility.
• Centralized Oversight Across Vendors: Real-time dashboards, standardized metrics, and centralized execution provide a single source of truth for test results, facilitating better decision-making and reducing validation silos across the enterprise.
• Stronger Quality Assurance at Scale: THP ensures consistent validation across the complex, multivendor EHB environment, improving stakeholder alignment and system readiness for mission-critical public health programs.

Innovation and Future Readiness

ASSYST continues to evolve THP to support HRSA’s modernization roadmap. New capabilities include intelligent validation for microservices, test automation for data migration efforts, and enhanced support for cloud-native architectures.

By combining AI, automation, and DevOps principles, ASSYST ensures that HRSA remains well-positioned to deliver secure, scalable, and user-centered digital services that support public health programs nationwide.