Databricks Senior Data & AI Engineer
Tasks
- Apply MLflow for experiment tracking
- Build RAG pipelines
- Build data pipelines
- Conduct knowledge transfer
- Configure row level and column level security
- Deploy model serving endpoints
- Design Lakehouse architecture
- Design data models for reporting
- Develop AI agents
- Implement Databricks SQL analytics
- Implement Delta Sharing
- Implement data governance with Unity Catalog
- Implement medallion architecture
- Integrate business intelligence dashboards
- Integrate external model APIs
- Lead code reviews
- Manage compute cost governance
- Optimize Databricks performance tuning
- Optimize data pipelines
- Support scoping and solutioning
- Use feature engineering in Unity Catalog
Perks/Benefits
- N/A
Skills/Tech-stack
AI Agent framework | AI BI | AI BI Genie | AWS | Agent Framework | Anthropic | Apache Airflow | Apache Spark | Azure | Column-Level Security | DBT | DLT | Data Governance | Data cloud | Databricks | Databricks Apps | Databricks SQL | Delta Lake | Delta Live Tables | Delta Live) | Delta Sharing | Feature Engineering | GCP | Gemini | LLM integration | Lakehouse Architecture | Looker | MLflow | Medallion Architecture | Model Serving | Mosaic AI | Mosaic AI Agent Framework | Mosaic Vector Search | OpenAI | Power BI | RAG | Row Level Security | Salesforce Data Cloud | Salesforce data | Snowflake | Tableau | Unity Catalog | Vector Search
Education
N/A
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R3d ago
-
Data Analyst - Forecasting and Optimization USD 124K-187KBacktesting | Deep learning | Feature Engineering | Gurobi | HiGHS401k matching | Disability insurance | Health insurance | Life insurance | Medical savings accountMid-level Full TimePhiladelphia, PA, United States10h ago
-
AWS Glue | AWS Lambda | AWS S3 | Access Control | Data GovernanceCareer growth opportunities | Collaborative and inclusive work environment | Diverse and inclusive culture | Flexible work arrangements | Permanent remote working modelSenior-level Full TimeCanada R10h ago
-
Data Modeling | Data analytics | Language Models | Large Language Models | Machine LearningCoaching | Hybrid work model | Mental health counseling | Mentorship | Paid volunteer timeMid-level Full TimeRaleigh, US, North Carolina11h ago
-
AI Engineer USD 200K-250KAWS | Automated testing | CI/CD | Deployment Pipelines | Embedding Models401k match | Frequent In Person Collaboration | Generous benefitsSenior-level Full TimeNew York1d ago
-
Senior AI Engineer USD 153K-259KAgent Frameworks | Embeddings | Evaluation | Graph Databases | Human-in-the-loop401k plan | Flexible vacation policy | Flexible work policy | Health and wellness benefits | Paid HolidaysSenior-level Full TimeRemote - US R1d ago
-
Senior-level Full TimeMountain View, CA1d ago
-
DAX | Data Governance | Data Modeling | Data Visualization | Data Warehousing401k match | Dental insurance | Disability insurance | Life insurance | Medical insuranceSenior-level Full TimeCincinnati, Ohio, United States1d ago
-
AWS | Application Security | Artificial Intelligence | Azure | Cloud SecurityConference speaking opportunities | Flexible schedule | Health Premium Plan Option | Mentorship | Paid trainingSenior-level Full TimeLos Angeles, California, United States R1d ago
-
Staff AI engineer USD 170K-254KAI Evaluation | AWS | Agent Orchestration | Caching | Data PipelinesFlexible working hours | Hybrid work culture | Unlimited time offSenior-level Full TimeSan Francisco1d ago
-
Data Engineer USD 120K-175KAPIs | AWS | Apache Spark | Data Pipelines | Data Processing401k plan | Dental insurance | Disability insurance | Employee assistance program | HolidaysMid-level Full TimeSunnyvale, CA1d ago
-
Lead Azure Data Engineer USD 139K-264KAzure SQL | CDC | DBT | Data Governance | Data LakehouseDental insurance | Flexible work policy | LTD insurance | Life insurance | Medical insuranceSenior-level Full TimeCanada1d ago
-
Machine Learning Engineer V USD 231K-382KAWS | Agent Orchestration | Automated testing | Azure | CI/CDBonus eligibility | Disability insurance | Life insurance | Paid parental leave | Paid time offSenior-level Full TimeRemote, United States R1d ago
-
SAP Analytics & Reporting SME — Alteryx USD 101K-142KABAP CDS | Alteryx Designer | Alteryx Server | Analytics Cloud | Analytics documentationDoD clearance eligibility | Training and enablement supportMid-level Full TimeScott Air Force Base, United States2d ago
-
Analytics & Insights Engineer II (Healthcare EDI) USD 97K-171KData Governance | Data Quality | Data integration | Data interchange | ETLMid-level Full TimeNashville, Tennessee, United States2d ago
-
Databricks Engineer USD 97K-162KAPI | Cloud Data | Cloud Data Platforms | Data Governance | Data ModelingMid-level Full TimeArlington/Rosslyn, Virginia, United States; Baltimore, Maryland, …2d ago
-
Databricks Engineer USD 126K-171KAPIs | Agile | Apache Spark | Data Governance | Data ModelingTravel 10 to 15 percentMid-level Full TimeGilbert, Arizona, United States; Lake Mary, …2d ago
-
Forward Deployed Engineer, GenAI, YouTube GTM Operations USD 128K-185KAgentic Workflows | Cloud Computing | Containerization | DevOps | EmbeddingsEquity | Health insurance | Paid time off | Retirement planMid-level Full TimeNew York, NY, USA; Mountain View, …2d ago
-
AI Research Lead USD 96K-104KAPIs | AWS | Cloud infrastructure | Code review | Copyright ProtectionCompany paid life insurance | Medical, dental & vision coverage | Mental well-being resources | Paid parental leave | Paid sick daysSenior-level Full TimeNew York, NY, US, 102812d ago
-
Analytics Engineer USD 100K-160KAWS | Analytics engineering | Cohorting | DBT | Data ClassificationFlexible time off | Medical, dental, vision benefits | Paid Holidays | Paid parental leaveMid-level Full TimeUSA2d ago
-
Supply Chain Master Data Analyst USD 129K-171KData Analysis | Data Auditing | Data Dictionary | Data Governance | Data ManagementMid-level Full TimeCosta Mesa, California, United States2d ago
-
AI Engineer USD 149K-184KAPI Integration | EHR Integration | Evaluation | Language Models | Large Language ModelsSenior-level Full TimeNew York, NY2d ago
-
Senior AI Engineer USD 182K-220KAgent workflows | Arize Phoenix | Compliance | Cost Optimization | EmbeddingsSenior-level Full TimeNew York, NY2d ago
-
AI Engineer USD 78K-82KAPI Integration | CI/CD | Containerization | Csharp | Function Calling401k match | Flexible spending account | Health savings account | Legal ID Shield | Life insuranceEntry-level Full TimeTroy, MI, US2d ago
-
AWS | Alerting | Black box monitoring | Black-box | CI/CDBackup childcare | Financial coaching | Mental health support | Mentoring | Onsite health and wellness centersSenior-level Full TimeJersey City, NJ, United States2d ago