Job description
Summary
Join a focused GenAI team building AI-powered clinical trial and operational solutions. In this Test Engineer / SDET role, you will design and maintain automated testing frameworks to ensure the quality, reliability, and performance of LLM and AI-powered applications—supporting high-confidence releases across models, APIs, and cloud services.
Requirements
- Bachelor's degree in Computer Science, Engineering, or related field
- Proven experience in software development and test automation, strongly with Python
- Experience testing GenAI features and APIs in cloud-based environments
- Strong understanding of CI/CD pipelines (GitLab CI/CD experience is a plus)
- Strong problem-solving skills with ability to diagnose and resolve root causes of failures
- Experience with performance, scalability, and security testing of cloud applications
- Familiarity with DevOps practices and continuous improvement in testing strategies
- Excellent communication and collaboration skills across cross-functional teams
- Ability to stay current with advancements in GenAI/LLMs and AWS cloud technologies
Responsibilities
- Design, develop, and maintain automated test frameworks for LLM and AI-powered applications (primarily Python)
- Collaborate with DevOps, AI engineers, and developers to understand model requirements, data pipelines, and application workflows
- Create and execute test plans and test cases for GenAI features, APIs, and cloud-based services
- Implement automated testing for model evaluation, data validation, and API endpoints using modern tools (e.g., Pytest, Robot Framework)
- Integrate automated tests into CI/CD pipelines in GitLab
- Monitor, analyze, and report test results; identify root causes and partner with the team to remediate issues
- Ensure AI model and cloud application security, scalability, and performance through appropriate testing coverage
- Drive best practices in test automation, code quality, and DevOps within the GenAI team
- Lead the development of testing strategies and frameworks aligned to organizational goals
- Mentor junior team members and help build a culture of continuous learning and improvement
- Explore and implement new tools/methodologies to advance test automation capabilities
- Participate in strategic planning sessions to align testing objectives with business goals
Benefits
- Opportunity to work directly with a cutting-edge GenAI team
- Focus on AI and clinical trial technology
- Small, highly visible team (~10 people)
- Ability to influence testing strategy and quality processes
- Work on real-world AI products deployed in production
- Potential for contract extension beyond the initial term
- Estimated contract length: 3–6+ months (may extend based on project needs and budget)
- Pay Location: 100% Remote