Systems Testing/QA Specialist

Project Overview

Health Card Linguistic Identifier Project (HCLIP) will deliver a secure, standalone digital portal enabling Ontario residents to update their Official Language of Preference (OLP), with updates written directly to the Registered Persons Database (RPDB). The initiative addresses current gaps where OLP updates are manual and inconsistent, resulting in underreporting and limited ability to support French-language service delivery. This initiative aligns with the HSC operational plan and Ministry priorities for improving service accessibility, data accuracy, and compliance with the French Language Services Act (FLSA).

Key Responsibilities

• Provides advice on the testing strategy, test plans, the selection of testing tools, and the identification of resources required for testing.
• Plans and organizes testing efforts for large systems in Graphical User Interface (GUI) and non-Graphical User Interface (GUI) environments, including the execution of systems integration tests, specialized tests, and user acceptance testing (e.g., stress tests).
• The Quality Assurance Specialist is responsible for the development of test plans, test scripts and test cases and executing these against the various components. The tester will work with the testing lead and IT lead of each project as well as the project team members in the analysis, design, development, implementation and ongoing support of the required systems.
• Executes functional, integration, system, and regression tests.
• Validates that the system behaves as expected under various conditions.
• Identifies, document, and track software defects using tools like ALM, JIRA, Bugzilla, and Azure DevOps.
• Works closely with developers to reproduce and resolve issues.
• Develops and maintains automated test scripts using tools like Micro Focus, OpenText™ UFT, Selenium, TestComplete, or Postman.
• Integrate automated tests into CI/CD pipelines.
• Conduct performance, stress, and load testing to ensure the system can handle expected user traffic and data volumes.
• Knowledge and understanding of Accessibility for Ontarians with Disability Act (AODA) and related regulations and standards.
• Collaborate with developers, business analysts, and project managers to clarify requirements and ensure quality.
• Participate in Agile ceremonies like sprint planning, daily stand-ups, and retrospectives.
• Maintain detailed documentation of test results, test coverage, and quality metrics.
• Provide input for user manuals and release notes.
• Ensure testing processes comply with industry standards and regulatory requirements.

Qualifications & Requirements

REQUIRED

• Must be able to work 5 days onsite per week in Toronto or Kingston
• Experience in planning, organizing and implementing testing efforts at the specified experience level
• Knowledge of structured methodologies for the development, design, implementation and maintenance of applications
• Knowledge and experience in the use of Computer Aided Software Engineering (CASE) tools and data query tools to aid in the development of test cases
• Knowledge and experience in the use of automated test tools and version control systems on one or more platforms
• Experience executing functional tests, non-functional tests and systems level integration tests
• Experience supporting user acceptance testing and participating in UAT activities
• Experience with quality assurance principles, practices, tools and structured methodologies
• Experience creating testing strategy documentation, test plans, test cases and test data for various types and phases of testing, including technical and business functional validation
• Experience in quality assurance and testing, including unit testing, integration testing, load testing, performance testing, etc.
• Knowledge and experience in all phases of the Systems Development Life Cycle
• Excellent analytical, problem-solving and decision-making skills; organizational, creativity and perseverance skills; verbal and written communication skills; and interpersonal skills
• A team player with a track record for meeting deadlines
• Knowledge of one or more automated testing tools
• Knowledge of system, integration, regression, and acceptance testing.
• Familiarity with Agile, Scrum, and Waterfall methodologies.
• Demonstrated ability to write clear, comprehensive test cases and execute them effectively.
• Experience with tools like ALM, JIRA, Bugzilla, TestRail, Zephyr, etc.
• Familiarity with tools like Selenium, Cypress, or Postman for API testing.
• Understanding of scripting languages (e.g., Python, JavaScript, Bash) for automation or test data setup.
• Demonstrated ability to write queries to validate data and perform backend testing.
• Clear grasp of the software development and testing life cycles.
• Experience conducting basic security testing and collaborating with security specialists for deeper penetration testing.
• Experience developing and managing robust test data strategies, including generating realistic and sufficient test data, ensuring data privacy, and managing test data environments.
• Validates data integrity, consistency, and accuracy across various system components and databases, performing data migration and transformation testing as needed.
• Experience developing and executing performance test scripts using tools like JMeter or LoadRunner, and analyzing performance bottlenecks and system scalability.

NICE TO HAVE

• Knowledge and experience in at least one programming language
• Experience in the use of information retrieval packages
• Knowledge and understanding of testing methods in an object-oriented environment
• Knowledge and understanding of Information Management principles, concepts, policies and practices.
• Knowledge and understanding of Accessibility for Ontarians with Disability Act (AODA) and related regulations and standards
• Experience planning and organizing testing efforts for both large and small systems
• Experience coding automated test scripts to produce sets of automated test cases
• Experience testing Commercial Off-the Shelf Applications (COTS)

EVALUATION CRITERIA

Public Sector Experience - 5%

• Experience working with federal/provincial/broader public-sector healthcare providers
• Knowledge of the provincial immunization system and Public Sector large complex IT Health related projects or equivalent
• Experience with integration of Clinical IT Systems such as Client and Provider Registries
• Knowledge of Public Sector Enterprise Architecture artifacts (or similar), processes and practices, and ability to produce technical documentation that comply with industry standard practices
• Knowledge of adopting and adhering to Public Sector Unified I&IT Project Methodology, Public Sector Enterprise Architecture and Public Sector Gating process, and Public Sector Standard Systems Development Methodologies.

Testing Experience - 35%

• 5+ years in implementing and executing comprehensive test strategies for web applications within Agile and DevOps frameworks (managing the backlog, preparing, and supporting the scrum master, sprint planning, creating user stories etc.) Excellent knowledge of system testing methodology, execute system and user acceptance tests.
• Ability to understand and analyze business requirements, and systems response documents, to design and execute test plans to ensure the system functions and meets the business requirements.
• Verify actual results meet expected results. Examine test databases using SQL and JCL. Analyze and log test results. Document and monitor resolution of system variances using an automated problem management system (e.g., Clear Quest).
• Expertise in writing and executing test cases, scenarios, and scripts for web applications, covering functional, regression, performance, and security testing requirements.
• Skilled in utilizing version control systems, such as Git, and CI/CD tools, like MS Azure DevOps, IBM CLI, Git to automate testing workflows and ensure continuous integration of code changes.
• Proficient in defect tracking and management tools, such as Jira, IBM ClearQuest, MS Azure DevOps, to identify, report, and prioritize issues, facilitating timely resolution and maintaining the quality of web applications throughout the development lifecycle.
• Ability to write test plans and test cases that are well-structured, easy to maintain, and easily understood by both developers and business analysts and clients.

Knowledge of Agile Methodology - 35%

• +5 years in Agile/DevOps development
• Providing detailed testing cases, plans and strategies for an Agile/DevOps product delivery methodology.
• Strong understanding of Agile methodologies, including Scrum and Kanban, to effectively collaborate with cross-functional teams and prioritize testing tasks in iterative development cycles.
• Proven and demonstrable troubleshooting and analytical experience.
• Demonstrated excellent problem solving and decision-making skills.
• Experience analyzing business requirements documentation including Use Cases, User Stories, User Map Journeys, and non-functional requirements.
• Experience analyzing test data requirements and create appropriate test data to support the test strategy

Communication Skills - 10%

• Strong verbal and written communications skills
• Strong Interpersonal and negotiation skills
• Strong consulting skills to engage with all stakeholders.
• A demonstrated team player with a track record for meeting deadline
• Demonstrated success in working productively with business clients, developers, and technical specialists such as DBAs

Automated scripting and Testing tools - 15%

• Extensive experience in automated testing tools and frameworks, such as Selenium or SOAP UI, to streamline testing processes and improve efficiency in an Agile environment.
• Demonstrated proficiency in translating testing strategies and plans into automated test scripts using tools such as Selenium or equivalent, ensuring efficient and effective test automation coverage for web applications in Agile/DevOps environments.

Key Skills & Competencies

Accessibility Testing, Agile, ALM, Automated Testing, Azure DevOps, Backend Testing, Bash, Bugzilla, CASE Tools, CI/CD, ClearQuest, COTS, Cypress, Data Migration Testing, Data Query Tools, Functional Testing, Git, IBM CLI, Information Retrieval, Integration Testing, JavaScript, JCL, JMeter, JIRA, Kanban, Load Testing, LoadRunner, Micro Focus, Non-Functional Testing, Object-Oriented Testing, Penetration Testing, Performance Testing, Postman, Python, QA, Regression Testing, Scrum, Security Testing, Selenium, SOAP UI, SQL, Stress Testing, System Testing, TestComplete, Test Data Management, TestRail, UAT, UFT, UML, Unit Testing, Version Control, Waterfall, Zephyr