Staff Applied AI Product Engineer

About Carrum

Carrum is a health tech company transforming healthcare payment, delivery, and experience. We aim to eliminate surprise bills, poor quality, and high prices through an entrepreneurial, cutting-edge approach. Founded in 2014, Carrum reinvented the Centers of Excellence (COE) category in digital health. Our COEs are accessible to 95% of the US population and our providers are top-ranked nationally. We have secured over $96M in funding from investors like OMERS, Tiger Global Management, and Wildcat Ventures. Our impact is validated by a 2021 RAND Corporation study and a Harvard Business School (HBS) case study.

Staff Applied AI Product Engineer

This role bridges cutting-edge AI capabilities with real-world patient needs. You will lead the architecture and integration of LLM-driven features into our core platform, evolving our Ruby on Rails (SOA) and React stack to support AI-native workflows and build agents for business initiatives like improving care navigation.

Key Responsibilities:

• Collaborate with Data and Product teams to identify LLM use cases, build RAG pipelines, select foundation models, and iterate on prompts.
• Design the integration of AI intelligence into reliable product features.
• Partner with DevOps to deploy AI services on AWS/Azure, ensuring performance and resilience.
• Implement comprehensive monitoring and observability for AI services.
• Work with clinical experts to validate model outputs for safety and accuracy in healthcare.
• Own the AI engineering strategy, moving from demos to scalable, production-ready systems.
• Establish patterns for building "smart products," model evaluation, latency optimization, and cost management.
• Ensure strict data privacy and HIPAA compliance.
• Champion Responsible AI by operationalizing fairness checks, bias detection, and safety guardrails.
• Mentor engineers on AI-native development practices and identify high-leverage AI opportunities.
• Partner with leadership to align delivery teams and define project timelines.

What You'll Do:

• Define the Gen AI technical roadmap: Build the foundation of Applied AI at Carrum, impacting how Generative AI automates healthcare coordination and improves patient outcomes.
• Build "magic" features: Rapidly prototype, iterate, and ship AI-powered experiences like instant answer bots or automated appointment logistics.
• Architect for the future: Integrate vector databases, orchestration frameworks (e.g., LangChain), and LLM APIs into our Service-Oriented Architecture.
• Bridge the gap: Translate between AI models and software engineering for reliability and trust.
• Lead without ego: Mentor full-stack engineers on AI tool integration, elevating the team's technical capabilities.
• Own the outcome: Manage the full lifecycle of AI features, from prompt iteration to production monitoring.
• Solve meaningful problems: Collaborate cross-functionally to address patient pain points.
• Prioritize quality: Ensure excellent documentation alongside functionality.

What We're Looking For:

• Strong engineering roots: 10+ years of software development experience, with experience as a senior engineer leading teams. Proven ability to build robust, scalable, high-availability systems.
• Expert AI practitioner: 2+ years of professional experience architecting production-grade LLM applications (OpenAI, Anthropic, Llama). Deep expertise in RAG pipelines, vector databases (e.g., pgvector, Pinecone), and solving for latency, hallucination, and retrieval accuracy at scale.
• Advanced AI/API knowledge: Ability to discern when to use prebuilt solutions versus custom LLM integrations, and apply fine-tuning and model optimization techniques.
• Technical stack proficiency: Experience with web application environments (Ruby on Rails, Python), system design, and exposing AI logic via performant APIs for frontend clients (React).
• Infrastructure awareness: Comfort designing and configuring Terraform for AI infrastructure with DevOps.
• Tech Lead capabilities: Ability to drive execution, elevate teams through code reviews, architectural design docs (RFCs), and teaching. Project management skills for cross-functional initiatives.
• AI-native workflow: Daily use of AI developer productivity tools (e.g., Cursor, GitHub Copilot) and ability to mentor others.
• Focus on "The Last Mile": Understanding the importance of latency, error handling, monitoring, and user experience in AI product wrapping.
• Data-pragmatic approach: Comfort with SQL and data modeling, recognizing the need for good data infrastructure for AI.
• Entrepreneurial spirit: Ability to go from 0 to 1, creatively using AI for rapid product launches and impact with limited resources.
• Complexity management: Experience handling deadlines and prioritizing in a fast-paced environment.
• Valuable human skills: Strong interpersonal, empathetic, courteous, and friendly communication.

Why You'll Love Working With Us:

• Impactful Mission: Join a dedicated team solving critical healthcare problems. Work with experienced professionals from top tech and healthcare companies.
• Esteemed Partnerships: Collaborate with renowned institutions like Johns Hopkins, Mayo Clinic, Stanford Health Care, and major employers like US Foods and United Airlines.
• Empowerment & Collaboration: Enjoy autonomy within a supportive, collaborative environment that encourages authentic self-expression and mutual support.
• Work-Life Balance: Benefit from flexible working hours, generous time off, paid parental leave, and opportunities for virtual and in-person connection in our remote-first company.
• Diversity & Inclusion: Be part of a company that values diversity of thought, experience, and interests, with active DEIJ initiatives and employee resource groups (ERGs).
• Meaningful Work: Contribute to work that directly and positively impacts people's lives.

Other Benefits:

• Stock option plan
• Flexible schedules and remote work
• Chicago and San Francisco office options
• Self-managed vacation days
• Paid parental leave
• Comprehensive health, vision, and dental insurance
• 401K retirement plan

About Carrum Health:

Carrum Health is a health tech company dedicated to bringing value-based care to the masses. We empower employers to deliver exceptional patient experiences, reduce healthcare costs, and improve outcomes through technology and human-centered design. Since 2014, we've partnered with Fortune 500 employers and leading hospitals nationwide. Recognized by Harvard Business School and featured in major publications, we are poised for significant growth and seek talented individuals to join us.

Carrum Health is an equal opportunity employer, encouraging applications from all backgrounds and life experiences.

Salary Range: $190,000 - $260,000 (depending on experience and location)