Manual Quality Engineer - TestRail
Job Description - Manual Quality Engineer Project: TestRail Gen AI Tech level: Middle+/Senior This position will report to: Quality Engineer Manager Key responsibilities: Perform manual testing of web applications to identify bugs, glitches, and inconsistencies. Develop, maintain, and execute detailed manual test cases based on product requirements and specifications. Perform thorough cross-browser UI testing to ensure consistent behavior across Chrome, Firefox, Safari, Edge, etc. Validate AI-generated test cases, summaries, and recommendations produced by integrated LLMs to ensure accuracy, completeness, and alignment with project requirements. Design and execute test scenarios to verify AI behavior, including promptresponse consistency, contextual relevance, and deterministic vs. non-deterministic outputs. Evaluate AI model quality using defined acceptance metrics (precision, recall, hallucination rate, duplication rate). Conduct manual API testing to validate request/response accuracy, error handling, and integration. Use TestRail to create, manage, and track test plans, test cases, and test execution results. Use Jenkis CI/CD pipelines for automated testing and deployment processes. Execute automated test scripts using Phyton based framework Contribute to the existing automation framework by automating priority test cases for new functionality Report and document defects clearly using bug tracking system (JIRA) Participate in daily stand-ups, sprint planning, and other Agile team meetings. Review user stories and acceptance criteria to understand the scope of testing. Estimate own tasks, report on risks to the team lead. Collaborate with developers and other QA team members to reproduce issues and verify fixes. Maintain and update test documentation as needed. Hard Skill requirements: Basic understanding of methodologies and SDLC and STLC (Software Development and Testing Life Cycle) models. Knowledge of Testing and Quality Assurance Processes. Strong experience with Test Design activities to cover a set of product requirements. Knowledge of Test Design techniques. Knowledge of testing methodologies Defect analysis skills and the ability to write detailed and useful defect reports with expected defect-fixing outcomes. Experience with Postman (API testing) and Browser developer tools. Experience with UI testing. Understanding of LLM evaluation principles, including prompt engineering, output validation, and model fine-tuning cycles. Familiarity with AI/ML concepts, APIs, and frameworks (e.g., OpenAI API, Azure OpenAI, LangChain) Knowledge of data protection and compliance standards for AI systems (GDPR, zero-data retention, PII anonymization). Experience with TestRail as a Test Management system ( as a user, test execution is required) Basic understanding of CI/CD process Experience with SSO testing is a plus. Experience in Performance or Load testing is a plus, but not required. Desired knowledge and Soft skills: English an Intermediate, higher knowledge level is an advantage. Effective communication skills capable of clearly articulating issues, test results, and suggestions to both technical and non-technical team members. Ability to prioritize tasks and manage time efficiently. Time management and organization able to handle multiple tasks, meet deadlines, and manage test deliverables within the sprint. Readiness to work with distributed teams, high-load and multicultural projects. Adaptability and flexibility comfortable adjusting to changing priorities, new tools, and evolving project requirements. A proactive mindset with a focus on product quality. Willingness to learn new tools and technologies.
An Equal Opportunity Employer - All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran. By submitting your application, you acknowledge that Sembi, Inc. will process and retain your resume and related personal information solely for recruitment and hiring purposes. Resumes of unsuccessful candidates will be securely deleted within twelve (12) months of the hiring decision, unless a longer period is required by law or you provide explicit consent for continued retention (e.g., for consideration for future opportunities).
In compliance with applicable privacy laws, including the EU General Data Protection Regulation (GDPR), you have the right to request access to, correction of, or deletion of your personal information at any time by contacting compliance@sembi.com. Sembi, Inc. does not sell candidate data and will ensure that all personal information is processed securely and in accordance with relevant data protection regulations.
Manual Quality Engineer - TestRail
Job Description - Manual Quality Engineer Project: TestRail Gen AI Tech level: Middle+/Senior This position will report to: Quality Engineer Manager Key responsibilities: Perform manual testing of web applications to identify bugs, glitches, and inconsistencies. Develop, maintain, and execute detailed manual test cases based on product requirements and specifications. Perform thorough cross-browser UI testing to ensure consistent behavior across Chrome, Firefox, Safari, Edge, etc. Validate AI-generated test cases, summaries, and recommendations produced by integrated LLMs to ensure accuracy, completeness, and alignment with project requirements. Design and execute test scenarios to verify AI behavior, including promptresponse consistency, contextual relevance, and deterministic vs. non-deterministic outputs. Evaluate AI model quality using defined acceptance metrics (precision, recall, hallucination rate, duplication rate). Conduct manual API testing to validate request/response accuracy, error handling, and integration. Use TestRail to create, manage, and track test plans, test cases, and test execution results. Use Jenkis CI/CD pipelines for automated testing and deployment processes. Execute automated test scripts using Phyton based framework Contribute to the existing automation framework by automating priority test cases for new functionality Report and document defects clearly using bug tracking system (JIRA) Participate in daily stand-ups, sprint planning, and other Agile team meetings. Review user stories and acceptance criteria to understand the scope of testing. Estimate own tasks, report on risks to the team lead. Collaborate with developers and other QA team members to reproduce issues and verify fixes. Maintain and update test documentation as needed. Hard Skill requirements: Basic understanding of methodologies and SDLC and STLC (Software Development and Testing Life Cycle) models. Knowledge of Testing and Quality Assurance Processes. Strong experience with Test Design activities to cover a set of product requirements. Knowledge of Test Design techniques. Knowledge of testing methodologies Defect analysis skills and the ability to write detailed and useful defect reports with expected defect-fixing outcomes. Experience with Postman (API testing) and Browser developer tools. Experience with UI testing. Understanding of LLM evaluation principles, including prompt engineering, output validation, and model fine-tuning cycles. Familiarity with AI/ML concepts, APIs, and frameworks (e.g., OpenAI API, Azure OpenAI, LangChain) Knowledge of data protection and compliance standards for AI systems (GDPR, zero-data retention, PII anonymization). Experience with TestRail as a Test Management system ( as a user, test execution is required) Basic understanding of CI/CD process Experience with SSO testing is a plus. Experience in Performance or Load testing is a plus, but not required. Desired knowledge and Soft skills: English an Intermediate, higher knowledge level is an advantage. Effective communication skills capable of clearly articulating issues, test results, and suggestions to both technical and non-technical team members. Ability to prioritize tasks and manage time efficiently. Time management and organization able to handle multiple tasks, meet deadlines, and manage test deliverables within the sprint. Readiness to work with distributed teams, high-load and multicultural projects. Adaptability and flexibility comfortable adjusting to changing priorities, new tools, and evolving project requirements. A proactive mindset with a focus on product quality. Willingness to learn new tools and technologies.
An Equal Opportunity Employer - All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran. By submitting your application, you acknowledge that Sembi, Inc. will process and retain your resume and related personal information solely for recruitment and hiring purposes. Resumes of unsuccessful candidates will be securely deleted within twelve (12) months of the hiring decision, unless a longer period is required by law or you provide explicit consent for continued retention (e.g., for consideration for future opportunities).
In compliance with applicable privacy laws, including the EU General Data Protection Regulation (GDPR), you have the right to request access to, correction of, or deletion of your personal information at any time by contacting compliance@sembi.com. Sembi, Inc. does not sell candidate data and will ensure that all personal information is processed securely and in accordance with relevant data protection regulations.