Systems Testing/QA Specialist

Project Overview

This project involves end-to-end testing including manual system/QA testing, integration testing, AODA, performance testing, test automation, and testing Microsoft Dynamics CRM and PowerBI solutions to support Bill 5 related initiatives. The resource may be assigned to Bill 5 related projects under the Protect Ontario by Unleashing Our Economy Act 2025.

Key Responsibilities

• Provides advice on the testing strategy, test plans, the selection of testing tools, and the identification of resources required for testing
• Plans and organizes testing efforts for large systems in Graphical User Interface (GUI) and non-Graphical User Interface (GUI) environments, including the execution of systems integration tests, specialized tests, and user acceptance testing (e.g., stress tests)
• Develops test plans, test scripts and test cases and executes these against the various components, working with the IT lead and project team members in analysis, design, development, implementation and ongoing support
• Performs quality assurance and testing activities for various types of testing such as system testing, Web-based UI testing, integration testing for both systems and applications, functional and non functional testing, regression testing, unit testing, post-release / post-implementation testing, load testing, smoke, performance testing and accessibility & AODA testing
• Creates testing artifacts (e.g. test plan, test cases, test data, test results, defects with detail info and screenshots, test reports/matrix) and manages testing life cycles in Azure DevOps
• Creates/prepares test data to cover all scenarios for a given test case with wide range of existing data based on business scenarios
• Performs data analysis and data validation for end-to-end ETL processing testing, including data completeness, data accuracy, data integrity, data redundancy, data format, functional scenarios, and integration workflows
• Performs a complete data comparison between source and target by writing program/SQL or using tools
• Communicates test results regularly through automated reports that summarize test completion and defects found
• Provides testing and defect status updates in daily scrum stand-ups, team meetings as required
• Supports clients with user acceptance testing (UAT) activities
• Actively participates in elicitation and business requirement workshop sessions, sprint reviews and/or walkthrough meetings
• Works with cross-functional teams to ensure quality throughout the agile / iterative solution development lifecycle
• Investigates problems/defects, works with developers and BA to find root causes and resolution solutions
• Provides daily report confirming status of assigned tasks
• Completes work and achieves milestones within the assigned deadlines
• Complies with the Ontario Government I&IT Directive, standards, operational policy, security procedures and practices, and other applicable Guidelines, Standards and Procedures
• Complies with the Ontario Government and the Cluster/Ministry Conflict of Interest and Confidentiality Guidelines

Qualifications & Requirements

REQUIRED

• Must be able to work 5 days onsite per week at the identified OPS office location.
• 3+ years of hands on experience of Microsoft Dynamics CRM solution testing experience
• 5+ years of hands on experience of BI product and end to end ETL testing experience
• 8+ years web-based system testing and QA experience for following type of testing: Integration testing for both system and applications, Unit testing, Regression testing, Functional testing, Accessibility testing, Non-functional testing, Web-based applications, Smoke testing, Performance and stress testing
• Experience in planning, organizing and implementing testing efforts at the specified experience level
• Knowledge of structured methodologies for the development, design, implementation and maintenance of applications
• Knowledge and experience in the use of Computer Aided Software Engineering (CASE) tools and data query tools to aid in the development of test cases
• Knowledge and experience in the use of automated test tools and version control systems on one or more platforms
• Experience executing functional tests, non-functional tests and systems level integration tests
• Experience supporting user acceptance testing and participating in UAT activities
• Experience with quality assurance principles, practices, tools and structured methodologies
• Experience creating testing strategy documentation, test plans, test cases and test data for various types and phases of testing, including technical and business functional validation
• Experience in quality assurance and testing, including unit testing, integration testing, load testing, performance testing, etc.
• Knowledge and experience in all phases of the Systems Development Life Cycle
• Excellent analytical, problem-solving and decision-making skills; organizational, creativity and perseverance skills; verbal and written communication skills; and interpersonal skills
• A team player with a track record for meeting deadlines
• Knowledge of one or more automated testing tools

NICE TO HAVE

• Knowledge and experience in at least one programming language
• Experience in the use of information retrieval packages
• Knowledge and understanding of testing methods in an object-oriented environment
• Knowledge and understanding of Information Management principles, concepts, policies and practices.
• Knowledge and understanding of Accessibility for Ontarians with Disability Act (AODA) and related regulations and standards
• Experience planning and organizing testing efforts for both large and small systems
• Experience coding automated test scripts to produce sets of automated test cases
• Experience testing Commercial Off-the Shelf Applications (COTS).
• Experience in DevOPs methodology is an asset
• Experience on data analysis and data verification for testing ETL, PowerBI products, web-based applications
• Experience in testing COTS CRM type of solution, e.g., Ms Dynamics.
• Experience identifying and documenting bugs and quality issues in development, service or business processes.
• Experience installing applications and databases relevant to automation
• Experience collaborating with stakeholders to understand how automation can improve workflow and creating documentation
• Experience gathering and documenting requirements from end-users to develop the best automation solutions

EVALUATION CRITERIA

Manual Testing & QA Skills & Experience - 65%

• 3+ years of hands on experience of Microsoft Dynamics CRM solution testing experience
• 8+ years experience developing testing strategies / plans, comprehensive test cases, scenarios/scripts for manual testing
• 8+ years experience prepares and create test data that covers all the test scenarios
• 8+ years experience testing non-functional requirements (e.g. fail-over, component response times, data integrity, security)

• 8+ years web-based system testing and QA experience for following type of testing but not limited to:
  • Integration testing for both system and applications
  • Unit testing
  • Regression testing
  • Functional testing
  • Accessibility testing
  • Non-functional testing
  • Web-based applications
  • Smoke testing
  • Performance and stress testing

BI & Dashboard & ETL testing Skills & Experience - 25%

• 5+ years of hands on experience of BI product and end to end ETL testing experience
• 3+ years of hands on experience on data analysis, date validation, data comparation for data completeness, data accuracy, functional scenarios, and integration workflows for BI product between source and target
• Demonstrated knowledge and skills of testing methods for end to end ETL processing and BI product

Agile Delivery and General Skills - 10%

• Experience with agile methodology and Azure DevOps tools for testing artefacts and testing life cycle management
• Experience with the software development life cycle (SDLC) and Agile methodology
• Excellent analytical, problem solving and decision-making skills
• Excellent communication skills, both written and verbal
• Excellent skills to collaborate with team and understanding requirement precisely
• Excellent meeting facilitation skills to gather requirements
• Experience reporting progress on deliverables to team, deliveries in strict timeline, and team players
• Good research skills and quick learner

Key Skills & Competencies

Microsoft Dynamics CRM, PowerBI, ETL, SQL, Azure DevOps, Automated Testing, CASE Tools, Data Query Tools, Version Control, GUI Testing, Integration Testing, Unit Testing, Regression Testing, Functional Testing, Accessibility Testing, Non-Functional Testing, Performance Testing, Load Testing, Smoke Testing, Stress Testing, Test Automation, Agile, SDLC, Data Analysis, Data Validation, Data Comparison, Defect Tracking, COTS, Programming, Object-Oriented, DevOPs, Information Retrieval, Web-Based Testing, Test Planning, Test Case Design, Requirements Analysis, AODA