Lead Data Engineer - Clinical AI
Posted on February 21, 2026 (3 months ago)
This job post is archived - the company is no longer hiring for this position.
Check out other job posts of this company here!Lead Data Engineer - Clinical AI
Transform healthcare with us.
Qualified Health is redefining what’s possible with Generative AI in healthcare. Our infrastructure provides the guardrails for safe AI governance, healthcare-specific agent creation, and real-time algorithm monitoring—working alongside leading health systems to drive real change.
This is an opportunity to build the future of AI in healthcare, solve complex challenges, and make a lasting impact on patient care. We are seeking a Principal (Lead) Data Engineer to lead the development of our clinical intelligence layer and build production-grade systems that convert raw clinical data into AI-ready features.
Key Responsibilities
Clinical Data Transformation (60%)
- Design and build clinical annotation pipelines that extract conditions, medications, and procedures from unstructured clinical notes
- Implement negation and temporal detection to distinguish current conditions from historical findings
- Build business rules engines that classify medications, calculate risk scores, and apply clinical logic at scale
- Integrate clinical reference data (drug databases, terminology mappings) into transformation pipelines
- Optimize data structures to reduce LLM processing time and improve downstream AI performance
Platform Engineering (30%)
- Build production-grade pipelines using PySpark and Databricks for large-scale clinical data processing
- Implement data quality frameworks to validate clinical transformations and catch issues before they reach AI workflows
- Design feature stores that serve pre-computed clinical features to ML models and LLM applications
- Maintain pipeline observability with monitoring, alerting, and performance tracking
Collaboration (10%)
- Partner with clinical SMEs to translate medical knowledge into data transformation logic
- Define data contracts with the AI team to ensure feature outputs meet LLM workflow requirements
- Contribute to technical standards and best practices for clinical data engineering
Required Qualifications
- 8+ years of data engineering experience with demonstrated expertise building production data pipelines
- 5+ years on Databricks, including PySpark, Delta Lake, and Unity Catalog
- Healthcare data experience: prior work with FHIR APIs, EHR databases, or claims data
- Clinical text processing experience: built pipelines that extract entities from unstructured clinical notes using tools like spaCy, medspaCy, or cloud NLP services
- Feature engineering for ML/AI: experience preparing data for machine learning models or LLM consumption
- Data quality mindset: track record implementing validation frameworks and monitoring for data pipelines
- Healthcare terminology familiarity: ICD-10, RxNorm, SNOMED CT, LOINC
- Epic Clarity experience: direct work with Epic's relational database structure
Desirable Skills
- Azure cloud platform: hands-on with Azure Databricks, Data Lake Storage, Service Bus
- Clinical NLP tools: experience with Azure Text Analytics for Health, Amazon Comprehend Medical, or similar
- RAG architecture patterns: understanding of vector databases and retrieval-augmented generation
Why Join Qualified Health?
This is an opportunity to join a fast-growing, mission-driven company building a category-defining product. Qualified Health offers competitive salaries with equity packages, robust medical/dental/vision insurance, flexible working hours, hybrid work options, and an inclusive environment that fosters creativity and innovation.
Our Commitment to Diversity: Qualified Health is an equal opportunity employer. We encourage applications from all qualified individuals regardless of race, color, religion, gender, sexual orientation, gender identity or expression, age, national origin, marital status, disability, or veteran status.
Pay & Benefits: The pay range for this role is between $160,000 and $210,000, and will depend on skills, qualifications, experience, and location. This role is also eligible for equity and benefits.
How to Apply
To apply, please submit your resume through the application form on this job posting.
Applicants may use the provided online form to attach a resume/CV and optional cover letter. Accepted file types include pdf, doc, docx, txt, and rtf.
Application Notes
Qualified Health requests that candidates provide accurate contact information. The position is located in Palo Alto, CA and offers hybrid work options.
If you have questions about the role or application process, use the application form on this page to get in touch.