Lead ML/AI Solution Engineer with Databricks

We are looking for an experienced Lead ML/AI Solution Engineer to design, build, and deploy a personalization platform that serves recommendation and ranking models through a scalable API layer. The solution consists of a Python FastAPI service exposed through AWS API Gateway and Lambda, which integrates with Databricks Model Serving endpoints.

The engineer will work closely with Data Scientists to operationalize personalization models, ensure production-grade reliability, and validate performance through testing and monitoring.

Responsibilities

• Collaborate with Data Scientists to adapt, package, and deploy personalization models (recommendation and ranking models) to Databricks Model Serving using MLflow
• Build and maintain a FastAPI service that invokes one or more model serving endpoints
• Implement production-grade engineering practices, including caching, connection pooling, request timeouts, and fail-open fallback