Senior Platform Engineer - Databricks Integration
Falls Church, VA, United States
USD 180K-247K (estimate) Senior-level Full Time
Tasks
- Assess emerging technologies
- Design distributed data pipelines
- Enable cross domain data movement
- Implement MLOps workflows
- Integrate Databricks with platform components
- Lead Databricks integration
- Optimize Databricks cluster performance
- Produce architecture documentation
- Provide engineering mentorship
Perks/Benefits
- N/A
Skills/Tech-stack
API Integration | AWS GovCloud | Agile Development | Auto Scaling | CI/CD | Capacity Planning | Cluster performance | Cluster performance tuning | Cross domain | Cross-domain data | Cross-domain data movement | Data Governance | Data Movement | Data Pipelines | Data Security | Databricks | Databricks Workflows | Delta Lake | DevSecOps | Distributed data | Distributed data pipelines | Feature Store | Infrastructure as Code | Job Scheduling | MLOps | Model Registry | Performance Tuning | Predictive Capacity Planning | Unity Catalog | Workload monitoring | “as-code”
Education
N/A
Related jobs
-
API Testing | Cypher | Data Quality | DataOps | DevOpsBenefits | Competitive pay | Growth opportunity | Remote work | Travel requiredSenior-level Full TimeReston, VA, United States R10h ago
-
Principal Engineer - Data Platform USD 221K-387KAWS | Airflow | Apache Hive | Apache Iceberg | Apache ImpalaRemote workSenior-level Full TimeSanta Clara, California, United States R10h ago
-
Agile | Automated testing | CI/CD | Cloud Computing | CrewAIDental insurance | Health insurance | Vision insuranceMid-level Full TimeAshburn, VA, United States12h ago
-
AI Machine Learning Skill 2-FFPP-8904 USD 78K-250KC# | Data Governance | Data Modeling | Data pipeline | Java401k plan with company match | Dental insurance | Diverse inclusive workplace | Employee referral programs | Flexible spending accountsMid-level Full TimeHanover, MD13h ago
-
AWS | AWS SageMaker | Azure | Cloud Pak for Data | Cloud infrastructureAccess to national security mission work | Hybrid work | Travel opportunitiesSenior-level Full TimeUSA-VA-Herndon14h ago
-
Analytics Engineer USD 115K-150KAgile | Azure DevOps | CI/CD | DBT | Data GovernanceAdoption Assistance | Dental insurance | Disability insurance | Educational assistance | Flexible spending accountMid-level Full TimeHouston, Texas | Tulsa, Oklahoma | …14h ago
-
AI Engineer USD 180KAgent Orchestration | Cost Management | Data Pipelines | Distributed Systems | LLM401k | Commuter benefits | Dental insurance | Flexible spending | Health insuranceMid-level Full TimeNew York, New York, United States …14h ago
-
Data & Analytics Specialist USD 87K-135KAPI Integration | Alteryx | DAX | JavaScript | Power AppsAdoption Assistance | Educational assistance | Flexible spending account | Health savings account | Life insuranceMid-level Full TimeWichita, Kansas15h ago
-
Data Platform & Engineering Specialist USD 100K-130KAWS | Amazon Kinesis | Azure | Azure Event | Azure Event HubsDental insurance | Educational assistance | Flexible spending accounts | Health insurance | Health savings accountsMid-level Full TimeLincoln, Nebraska15h ago
-
AI Architect USD 134K-237KAI Search | AI Security | API Gateway | API Integration | AWS BedrockAdoption Assistance | Dental insurance | Disability insurance | Educational assistance | Flexible spending accountsSenior-level Full TimeHouston, Texas | Tulsa, Oklahoma | …15h ago
-
Machine Learning Engineer USD 120K-140KAI Pipelines | AI Workbench | AI endpoints | Apache Kafka | Automated testingEntry-level Full TimeDenver, Colorado, United States19h ago
-
AWS Glue | AWS Lambda | AWS S3 | Access Control | Data GovernanceCareer growth opportunities | Collaborative and inclusive work environment | Diverse and inclusive culture | Flexible work arrangements | Permanent remote working modelSenior-level Full TimeCanada R23h ago
-
Principal AI Architect Engineer USD 118K-195KAWS | AWS Lambda | Amazon Bedrock | Amazon EC2 | Amazon EKSSenior-level Full TimeNew York, United States1d ago
-
Senior Software Engineer (AI/ML) - Vice President USD 150K-210KAPI Security | Algorithms | Cloud Platforms | Data Structures | DatabricksSenior-level Full Time1 New York Plaza, United States1d ago
-
AI Developer USD 77K-176KAWS | Agentic Workflows | Asynchronous Messaging | Audit Logging | Automated testingDependent care | Disability insurance | Financial benefits | Health insurance | Life insuranceMid-level Full TimeUSA, VA, Arlington (1550 Crystal Dr …1d ago
-
AI Developer USD 77K-176KAWS | Agentic Workflows | Asynchronous Messaging | Audit Logging | Automated testingDependent care | Disability insurance | Health insurance | Life insurance | Paid leaveMid-level Full TimeUSA, OH, Beavercreek (3800 Pentagon Blvd), …1d ago
-
AI Developer USD 77K-176KAWS | Asynchronous Messaging | Audit Logging | Automated testing | CI/CDDependent care | Disability insurance | Health benefits | Life insurance | Paid leaveMid-level Full TimeUSA, VA, Arlington (1550 Crystal Dr …1d ago
-
AVP, Business Insights and Analytics USD 169K-175KAlteryx | Change Management | Data Dictionary | Data Governance | Data Lineage401k | Dental insurance | Incentive Award Eligible | Life insurance | Medical insuranceExecutive-level Full TimeBuilding 400-Whippany Campus, Jefferson Park, United …1d ago
-
Hadoop Big Data Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache SparkRemote workSenior-level Full TimeUnited States - Remote R1d ago
-
Hadoop Big Data Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HiveRemote workSenior-level Full TimeUnited States - Remote R1d ago
-
AI Data Engineer USD 100K-150KActive Learning | Apache Beam | CI/CD | Caching | Code review100 percent remote | Career growth | Full-time employment | H1B transfer support | W2 employmentMid-level Full TimeUnited States - Remote R1d ago
-
Senior Data Engineer USD 120K-224KAb Initio | Agile | DB2 | Datamover | Foundation ServerHybrid work scheduleSenior-level Full Time111432-TX-Las Colinas Bldg A, Irving Campus, …1d ago
-
Data Engineer III USD 74K-84KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data WarehouseAdoption Assistance | Behavioral health solutions | Employee resource groups | Mentorship programs | Paid caregiver leaveSenior-level Full TimeUSA - TX - Carrollton - …1d ago
-
AI Data Engineer USD 100K-150KApache Beam | CI/CD | Code review | Data Lineage | Data Modeling100 percent remote | Career growthMid-level Full TimeUnited States - Remote R1d ago
-
Senior Software Engineer - Data Platform USD 106K-147KAzure | Change Management | Cloud Cost Optimization | Cost Optimization | DSCSA401k retirement savings plan | Career development | Dental benefits | Life insurance | Long-term disabilitySenior-level Full TimeWaterside Bldg, United States1d ago