Databricks Senior Data & AI Engineer
Tasks
- Apply MLflow for experiment tracking
- Build RAG pipelines
- Build data pipelines
- Conduct knowledge transfer
- Configure row level and column level security
- Deploy model serving endpoints
- Design Lakehouse architecture
- Design data models for reporting
- Develop AI agents
- Implement Databricks SQL analytics
- Implement Delta Sharing
- Implement data governance with Unity Catalog
- Implement medallion architecture
- Integrate business intelligence dashboards
- Integrate external model APIs
- Lead code reviews
- Manage compute cost governance
- Optimize Databricks performance tuning
- Optimize data pipelines
- Support scoping and solutioning
- Use feature engineering in Unity Catalog
Perks/Benefits
- N/A
Skills/Tech-stack
AI Agent framework | AI BI | AI BI Genie | AWS | Agent Framework | Anthropic | Apache Airflow | Apache Spark | Azure | Column-Level Security | DBT | DLT | Data Governance | Data cloud | Databricks | Databricks Apps | Databricks SQL | Delta Lake | Delta Live Tables | Delta Live) | Delta Sharing | Feature Engineering | GCP | Gemini | LLM integration | Lakehouse Architecture | Looker | MLflow | Medallion Architecture | Model Serving | Mosaic AI | Mosaic AI Agent Framework | Mosaic Vector Search | OpenAI | Power BI | RAG | Row Level Security | Salesforce Data Cloud | Salesforce data | Snowflake | Tableau | Unity Catalog | Vector Search
Education
N/A
Related jobs
-
Featured Feat. Applied AI Engineer - Bay Area USD 211K-263KArtificial Intelligence | C plus plus | C# | Embeddings | Feature Engineering401k | Comprehensive health and wellness benefits | Learning and development opportunities | Unlimited time offMid-level Full TimeHQ (San Francisco)23d ago
-
Senior-level Full TimeHerdon, VA, US6h ago
-
Data Engineer – Senior USD 140K-180KABAC | AWS | AWS Glue | AWS IAM | AWS Lake FormationActive MBI required | IRS contract experience preferred | U.S. citizenship requiredSenior-level Full TimeHyattsville, MD, US6h ago
-
AI/ML Engineer II USD 93K-179KAmazon EC2 | Amazon S3 | Apache Airflow | CI/CD | CSS401k | Adoption Assistance | Career path planning | Continuing education | Employee referral programMid-level Full TimePhoenix Campus (Main), United States19h ago
-
MES Software Engineer/Data Analyst USD 109K-175K.NET | AWS | Artificial Intelligence | Azure | Cloud Platforms401k match | Employee assistance program | Employee stock purchase program | Medical/Dental/Vision | Paid HolidaysSenior-level Full TimeUSA-Pennsylvania-Breinigsville-9999 Hamilton Blvd, United States19h ago
-
Director, Precision Medicine Data Science & AI USD 194K-361KAWS | Apache Spark | Azure | CPT | Claims data401-k match | Comprehensive benefits package | Hybrid work | Paid time off | Travel 10 percentExecutive-level Full TimeEast Hanover, United States19h ago
-
Senior Data Engineer USD 105K-149KAWS | AWS Lambda | Agile | Amazon Redshift | CI/CD401k matching | Dental insurance | Family and Medical Leave FMLA | Life insurance | Medical insuranceSenior-level Full TimeKS Overland Park, United States19h ago
-
Azure Data | Azure Data Factory | Azure DevOps | CI/CD | Data Factory401k match | Disability insurance | Education benefit | Employee stock purchase plan | Life insuranceSenior-level Full TimePrudential Tower, 655 Broad Street, Newark, … R19h ago
-
Quantitative Developer USD 140K-155KAPIs | Agentic AI | Batch Processing | CI/CD | ContainerizationSenior-level Full TimeBoston, United States19h ago
-
Apache Arrow | Backtesting | Cost modeling | Cross-validation | Data QualityMid-level Full TimeNew York, New York, United States …19h ago
-
Senior-level Full TimeAlpharetta, GA1d ago
-
Apache Airflow | DBT | Data Modeling | ETL | Embedded Analytics401k matchSenior-level Full TimeOrlando, Florida, United States - Remote R1d ago
-
Apache Spark | Distributed Computing | Language Models | Language Processing | Large Language ModelsHybrid work | On-site customer support | Travel opportunityMid-level Full TimeConnecticut, Connecticut, United States1d ago
-
Apache Spark | Data Processing | Distributed Computing | Large Scale Data | Large-scaleHybrid work | Travel opportunityMid-level Full TimeMassachusetts, Massachusetts, United States1d ago
-
AWS | Artificial Intelligence | Asynchronous programming | Context engineering | Distributed Systems401k matching | Dental insurance | Health insurance | Learning opportunities | Relocation assistanceSenior-level Full TimeSan Antonio, Texas, United States1d ago
-
Machine Learning Engineer USD 140K-220KApache Spark | Azure | Azure Machine Learning | CI/CD | Cloud StorageCareer development opportunities | High responsibilitySenior-level Full TimeUnited States - Remote R1d ago
-
API Integration | AWS | Automation | Business Intelligence | Cloud ArchitectureMid-level Full TimeSan Mateo, California, United States1d ago
-
Quantum Software Engineer USD 120K-150KAWS | Access Control | C++ | CI/CD | Cirq401k match | Employee assistance program | Employer paid medical/dental/vision | Flexible savings account | Health savings accountMid-level Full TimeChicago, Illinois, United States1d ago
-
Agile | Azure | Azure DevOps | C plus plus | DAQ401k matching | Dental insurance | Employee assistance program | HSA option | Health insuranceSenior-level Full TimeAustin, TX, United States1d ago
-
Data Engineer USD 179K-273KAmazon Kinesis | Apache Airflow | Apache Kafka | Apache Spark | Data ModelingMid-level Full TimeFoster City, CA1d ago
-
ML Infrastructure Engineer USD 120K-190KAirflow | Amazon SageMaker | Apache Spark | Argo | DatabricksEntry-level Full TimeOakland, CA1d ago
-
Staff Data Engineer USD 192K-250KAWS RDS | Airflow | Amazon Aurora | Amazon Kinesis | Apache KafkaCatered lunches | Co-working travel perk | Commuter benefit | Disability insurance | Equipment allowanceSenior-level Full TimeSan Francisco, CA1d ago
-
Senior AI Engineer USD 140K-180KAI Foundry | AI Platform | AI Services | Azure AI | Azure AI FoundrySenior-level Full TimeChicago, Illinois1d ago
-
Senior AI Engineer USD 140K-180KAI Foundry | AI Services | Azure AI | Azure AI Foundry | Azure AI ServicesClient facing consulting opportunities | Cross-functional collaboration | Work on enterprise AI deploymentsSenior-level Full TimeAtlanta, GA | Kansas City, MO …1d ago
-
Senior Data Engineer USD 150K-220KAWS | Anomaly Detection | DBT | Data Observability | Data QualityFully remoteSenior-level Full TimeRemote (U.S. based) R1d ago