Senior Platform Engineer - Databricks Integration
Falls Church, VA, United States
USD 180K-247K (estimate) Senior-level Full Time
Tasks
- Assess emerging technologies
- Design distributed data pipelines
- Enable cross domain data movement
- Implement MLOps workflows
- Integrate Databricks with platform components
- Lead Databricks integration
- Optimize Databricks cluster performance
- Produce architecture documentation
- Provide engineering mentorship
Perks/Benefits
- N/A
Skills/Tech-stack
API Integration | AWS GovCloud | Agile Development | Auto Scaling | CI/CD | Capacity Planning | Cluster performance | Cluster performance tuning | Cross domain | Cross-domain data | Cross-domain data movement | Data Governance | Data Movement | Data Pipelines | Data Security | Databricks | Databricks Workflows | Delta Lake | DevSecOps | Distributed data | Distributed data pipelines | Feature Store | Infrastructure as Code | Job Scheduling | MLOps | Model Registry | Performance Tuning | Predictive Capacity Planning | Unity Catalog | Workload monitoring | “as-code”
Education
N/A
Related jobs
-
Analytics Engineer USD 120K-175KData Cataloging | Data Governance | Data Pipelines | Data Quality | Data Quality ManagementHybrid work schedule | Mentorship and training | Professional office environmentSenior-level Full TimeMilwaukee, WI, United States4h ago
-
Entry-level Full TimeCary, NC, United States4h ago
-
Apache Spark | Clustering | Data Ingestion | Data Ingestion Pipelines | Data ModelingSenior-level ContractLos Angeles, United States5h ago
-
AI Engineer (Latam, Remote) USD 70K-110KAPI Integration | Authentication | Claude | Database Management | LLM integrationCollaboration with U S based teams | Fully remote | High ownership and autonomy | Part-time flexibilitySenior-level Part TimeFlorida, Aventura, United States of America R5h ago
-
Cloud Computing | Data Pipelines | Experimental Design | Java | Machine LearningCommunity volunteering | Internal mobility | Learning opportunities | Mentorship programs | Recognition programsMid-level Full TimeAustin, TX, United States5h ago
-
Senior-level Full TimeAustin, TX, United States5h ago
-
Availability Engineering | Canary Deployment | Capacity Planning | Cause analysis | Change ManagementSenior-level Full TimeSeattle, Washington, United States6h ago
-
AI Solutions Expert USD 137K-236KArtificial Intelligence | Cybersecurity | Data Pipelines | Decision support | EWSenior-level Full TimeUSA-VA-Stafford6h ago
-
Automation | Canary Deployment | Capacity Planning | Cause analysis | Change ManagementSenior-level Full TimeSeattle, Washington, United States7h ago
-
Apache Spark | Computer Vision | Data Curation | Data Pipelines | GroundingSenior-level Full TimeSunnyvale, CA | Bellevue, WA | …7h ago
-
Systems Development Engineer, Quantum AI USD 138K-198KAutomation | CI/CD | Cloud APIs | Cloud infrastructure | Configuration ManagementMid-level Full TimeGoleta, CA, USA8h ago
-
Senior-level Full TimeUnited States10h ago
-
AI/ML Engineer USD 117K-171KA/B | A/B Testing | API Development | AWS | B testingDental insurance | Health insurance | Paid time off | Retirement plan | Sick leaveSenior-level Full TimeResidence Based, Residence Based, US10h ago
-
Cloud Data Engineer USD 92K-113KAgile | Apache Airflow | Beam | BigQuery | Cloud ComposerOnsite workMid-level Full TimeAda, MI, United States, 4935512h ago
-
AWS | Azure | Cloud platform | Data Pipelines | Demand forecastingOnsite collaborationSenior-level Full TimeLewisville, TX, US15h ago
-
Sr. Staff Software Engineer - Managed Tables USD 228K-314KAlgorithms | Automation | Capacity Planning | Data Structures | Database systemsSenior-level Full TimeMountain View, California17h ago
-
Senior ML Engineer, Fauna USD 184K-250KComputer Vision | Data Quality | Distributed Training | Edge Deployment | Evaluation PipelinesSenior-level Full TimeNew York, New York, USA19h ago
-
Forward Deployment Engineer - Gen AI USD 162K-224KAWS Bedrock | AWS SageMaker | Autogen | Azure OpenAI | ChromaCareer development opportunities | Individual responsibility | Travel to client sitesMid-level Full TimeNew York, New York, United States19h ago
-
Computer Vision | Experiment design | Experiment tracking | Generative AI | Image ProcessingSenior-level Full TimeAEP Headquarters, United States19h ago
-
Senior Software Engineer - Platform & MLOps USD 152K-230KAWS | Azure | CI/CD | Datadog | DockerDiscretionary incentive plan | Flexible work policy | Learning and development access | Medical benefitsSenior-level Full TimeSeattle, Washington, United States - Remote R19h ago
-
Data Engineer USD 84K-101KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageCharity donation matching | Digital course library | Employee assistance program | Mindfulness program | Volunteer hours matching programMid-level Full TimeIndia Pune (Mississippi Building)19h ago
-
Staff Data Eng, Data Systems, TCGplayer USD 136K-228KData Architecture | Data Governance | Data Lifecycle Management | Data lifecycle | Event Driven401k eligibility | Medical benefits | Paid time off | Parental leaveSenior-level Full TimeRemote North Carolina, United States R19h ago
-
Data Engineer (Remote) USD 97K-130KAWS | Agile | Azure | Azure DevOps | CI/CDOff hours production support rotation | Remote workSenior-level Full Time1 First American Way, Santa Ana, … R19h ago
-
Senior-level Full TimeRoyal Lane Office, United States19h ago
-
MLOps Engineer USD 113K-188KAWS GovCloud | Apache Spark | Artifact management | Auditability | Azure401k | Adoption Assistance | Disability insurance | Emergency back-up childcare program | Employee referral programMid-level Full TimeGH Office: Tysons Corner, VA (Headquarters), …19h ago