Databricks Machinel Learning

Job Title: Databricks ML Engineer
Location: New York, NY
Employment Type: Full-Time

About Us:
DMV IT Service LLC is a trusted IT consulting firm, established in 2020. We specialize in optimizing IT infrastructure, providing expert guidance, and supporting workforce needs with top-tier staffing services. Our expertise spans system administration, cybersecurity, networking, and IT operations. We empower our clients to achieve their technology goals with a client-focused approach that includes online training and job placements, fostering long-term IT success.

Job Overview:
We are seeking an experienced Databricks ML Engineer to design, develop, and deploy machine learning models using Azure Databricks. The ideal candidate will have a strong background in PySpark, Python, and SQL, with at least 7 years of experience in machine learning model deployment.

Requirements

• Design, develop, and deploy machine learning models using Azure Databricks.
• Implement and manage Azure Databricks ML Flow for tracking and managing ML experiments.
• Apply ML Ops best practices to ensure robust and scalable model deployment.
• Deploy and manage Large Language Models (LLMs) and Generative AI (GenAI) models on Databricks.
• Collaborate with data scientists and engineers to integrate ML models into production environments.
• Optimize and maintain existing ML models for high performance and scalability.
• Utilize PySpark, Python, and SQL for data processing and analysis.
• Conduct statistical analysis to support data-driven decision-making.
• Troubleshoot and resolve issues related to ML model deployment and performance.

Required Skills & Experience:

• 7+ years of experience in ML model deployment using Azure Databricks.
• Proficient in PySpark, Python, and SQL.
• Experience with Azure Databricks ML Flow and ML Ops best practices.
• Experience with deploying and managing LLMs and GenAI models on Databricks.
• Strong problem-solving skills and attention to detail.

Preferred Qualifications:

• Master’s degree in Computer Science, Data Science, or a related field.
• Experience with statistical analysis.
• Certifications such as Azure Databricks Data Engineer Professional Certification and Azure Databricks Machine Learning Professional Certificate.