Quality Assurance Tester
AI, Automation and Power Platform
Role Purpose
The Quality Assurance (QA) Tester is responsible for ensuring the quality, stability, reliability, security, and
performance of solutions delivered across the Digitisation & Automation portfolio.
The role covers RPA and Bot solutions, Power Apps, Power Automate workflows, AI Agents and Copilot solutions,
Azure AI Foundry solutions, APIs and system integrations, and end-to-end automated business processes. The role
implements quality engineering, test automation, and continuous testing approaches to support production-ready
solutions that meet business, security, and regulatory requirements.
Key Responsibilities
Test Planning and Quality Engineering
Develop test strategies, test plans, test cases, and test scripts.
Define test coverage and acceptance criteria for AI, automation, and digital solutions.
Implement quality engineering throughout the development lifecycle.
Ensure traceability between requirements, tests, defects, and releases.
Support Agile teams through continuous testing practices.
Automation and Digital Solution Testing
RPA and Intelligent Automation
Test attended and unattended RPA and Bot solutions.
Validate automated workflows and end-to-end process automation.
Power Platform Solutions
Test Power Apps, Power Automate flows, Power Pages, custom connectors, and Dataverse integrations.
AI and Copilot Solutions
Test Microsoft Copilot Studio, AI Agents, Azure AI Foundry, conversational AI, and Generative AI-enabled applications.
API and Integration Testing
Validate APIs, web services, enterprise integrations, data flows, authentication, and security controls.
AI Quality Assurance Responsibilities
Validate AI responses for accuracy, relevance, consistency, usability, and correct execution of prompts and instructions.
Test guardrails, safety controls, response boundaries, escalation mechanisms, and responsible AI controls.
Identify hallucinations, incorrect outputs, edge cases, and exception scenarios.
Assess response reliability, repeatability, and compliance with business rules.
CIB Digital Office | Digitization & Automation
Perform regression testing after prompt, model, configuration, or release changes.
Confirm solution stability and verify that existing functionality has not degraded.
Test Automation and Continuous Quality Engineering
Design, develop, and maintain automated test suites and regression packs.
Implement continuous testing practices and support CI/CD quality gates.
Drive shift-left testing and automated quality controls across solutions.
Build reusable test assets, scripts, and frameworks.
Quality Management
Log, track, and manage defects throughout the development lifecycle.
Support root-cause analysis and defect resolution.
Monitor quality metrics and report testing progress.
Participate in release readiness and go-live assessments.
Security, Performance and Non-Functional Testing
Perform security and role-based access testing.
Conduct performance, load, stress, and resilience testing where applicable.
Validate data privacy, security controls, and business continuity requirements.
Technical Skills
Essential
Software testing, quality assurance, and test automation frameworks.
Functional, regression, integration, API, and end-to-end process testing.
Power Platform, RPA, AI Agent, and Copilot testing concepts.
Defect management, Agile delivery methodologies, and continuous quality engineering.
Advantageous
Microsoft Copilot Studio, Azure AI Foundry, Power Platform, Power Automate, UiPath, or Automation Anywhere.
Azure DevOps, PowerShell, SQL, REST APIs, performance testing, security testing, and CI/CD pipelines.
Experience
3-5 years of experience testing enterprise solutions.
Experience testing automation, workflow, Power Platform, APIs, and integrations.
Experience working in Agile delivery teams and with test automation frameworks.
Exposure to AI-enabled solutions, Generative AI agents, chatbots, or Copilot solutions is advantageous.
Qualifications
Degree or diploma in Information Technology, Computer Science, Software Engineering, Information Systems, or a related technical discipline.
Certifications
Mandatory
ISTQB Foundation Certification.
Preferred
Microsoft Power Platform Certification: PL-100 and/or PL-200.
Microsoft Certified: Azure AI Engineer Associate (AI-102) or equivalent.
Test automation-related certification.
Microsoft Azure Fundamentals (AZ-900).
Microsoft Azure AI Fundamentals (AI-900).
Competencies
Technical
Quality engineering, test automation, API testing, AI testing, Power Platform testing, RPA testing, integration testing, defect management, root-cause analysis, security testing, and performance testing.
Behavioural
Attention to detail, critical thinking, analytical problem solving, collaboration, continuous improvement, accountability, customer focus, and adaptability.
Success Measures
Defect detection effectiveness and test coverage achieved.
Automated test coverage and regression testing effectiveness.
Quality and stability of production releases.
Reduction in production defects.
Effectiveness of AI response, guardrail, security control, and regression validation.
Contribution to quality engineering maturity and stakeholder satisfaction.
Ideal Candidate Summary
A quality assurance professional with expertise in testing intelligent automation, Power Platform, integrations, and AI enabled solutions. The individual combines traditional testing skills with modern quality engineering practices and can validate AI agents, Copilot solutions, bots, workflows, APIs, and enterprise automation platforms to ensure theyare secure, reliable, scalable, and fit for purpose.
You have successfully created your alert.
You will receive an email when a new job matching your criteria is posted.
Please check your email. It looks like you haven't verified your account yet. Here's what you're missing out on:
Didn't receive the link? Resend Verification Link