Job Description
Databricks seeks an AI Engineer to develop GenAI applications using tools like HuggingFace and LangChain, deploying production solutions for customer problems in domains ranging from finance to healthcare. This role produces rollouts of AI systems, advising on deployments that incorporate techniques like RAG and multi-agent setups, impacting organizations by accelerating AI adoption.
Databricks powers over 10,000 organizations with its data intelligence platform, including 50% of the Fortune 500, headquartered in San Francisco with Apache Spark origins, unifying data, analytics, and AI for global enterprise use.
Engineers build GenAI solutions with PyTorch and scikit-learn, own production deployments on AWS or GCP, present at Data + AI Summit, and collaborate with product teams for roadmap input. They use Databricks platform for large-scale datasets, interacting with customers and SME teams virtually or on-site in D.C., Maryland, or Virginia. One challenge is obtaining Top Secret clearance, requiring U.S. citizenship to handle government contracts and classified data securely.
Compensation ranges from $161,280 to $225,792 USD in Zone 2 or 3, offered in remote or hybrid roles in Washington D.C., Maryland, or Virginia areas with on-site collaboration. Schedules accommodate flexible hours, including conferences. Benefits include annual performance bonus, equity, comprehensive health plans, retirement options, and diversity-focused practices for inclusive hiring across protected characteristics.
Responsibilities
- Develop cutting-edge GenAI solutions, incorporating the latest techniques from our Mosaic AI Research to solve customer problems
- Own production rollouts of consumer and internally facing GenAI applications
- Serve as a trusted technical advisor to customers across a variety of domains
- Present at conferences such as Data + AI Summit, recognized as a thought leader internally and externally
- Collaborate cross-functionally with the product and engineering teams to influence priorities and shape the product roadmap
Requirements
- Eligibility to work in the United States and the ability to obtain and maintain a U.S. government security clearance at the Top Secret level or higher
- U.S. citizenship is required
- Experience building GenAI applications, including RAG, multi-agent systems, Text2SQL, fine-tuning, etc., with tools such as HuggingFace, LangChain, and DSPy
- Expertise in deploying production-grade GenAI applications, including evaluation and optimizations
- Extensive years of hands-on industry data science experience, leveraging common machine learning and data science tools (i.e., pandas, scikit-learn, PyTorch, etc.)
- Experience building production-grade machine learning deployments on AWS, Azure, or GCP
- Graduate degree in a quantitative discipline (Computer Science, Engineering, Statistics, Operations Research, etc.) or equivalent practical experience
- Experience communicating and/or teaching technical concepts to non-technical and technical audiences alike
- Passion for collaboration, life-long learning, and driving business value through AI
- [Preferred] Experience using the Databricks Intelligence Platform and Apache Spark to process large-scale distributed datasets