Senior Data Engineer - Databricks
Tasks
- Apply CI CD best practices to pipeline delivery
- Apply multi tenant data isolation
- Automate ETL ELT pipeline transitions
- Design Delta Lake architecture
- Enforce data security and access control
- Implement data quality monitoring and observability
- Integrate pipelines with product ecosystem
- Maintain SLA performance metrics
- Maintain technical documentation and runbooks
- Migrate legacy ETL to Databricks
- Monitor pipelines and respond to incidents
- Onboard customers by provisioning tenant data pipelines
- Optimize Databricks compute costs and throughput
- Own Databricks production support
- Participate in on-call incident response
Perks/Benefits
- 401k match
- Career development program
- Corporate Benefit Program
- Educational resources
- Employee Referral Bonus Program
- Financial planning services
- Health and wellness reimbursement
- Healthcare package
- Legal services online
- Paid parental leave
- Pet insurance discount
- Travel discounts
- Unlimited paid time off
Skills/Tech-stack
AWS | Access Control | Apache Spark | Azure | CI/CD | Data Governance | Data Quality | Data Security | Data quality monitoring | Databricks | Delta Lake | Incremental processing | Informatica | Multi-tenant | Multi-tenant architecture | Observability | PostgreSQL | PySpark | Python | Quality monitoring | Role-Based Access | Role-Based Access Control | SQL | SSIS | Secrets management | Streaming processing | Tenant architecture
Education
N/A
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R26d ago
-
Access Control | Azure | Azure Backup | Azure CLI | Azure DataMentorship | Remote workSenior-level ContractSaint Paul, United States R3h ago
-
Edge Computing AI Engineer USD 100K-105KC++ | DSP | Edge inference | Embedded Systems | Federated LearningCareer growth | Remote workMid-level Full TimeUnited States - Remote R17h ago
-
Hadoop Big Data Developer USD 100K-150KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HudiCareer growth | Direct W2 employment | Remote workSenior-level Full TimeUnited States - Remote R17h ago
-
Machine Learning Data Engineer USD 80K-100KApache Beam | CI/CD | Data Lineage | Data Modeling | Data QualityDirect W2 employment | Remote workSenior-level Full TimeUnited States - Remote R17h ago
-
Data Platform Engineer USD 100K-150KAutoscaling | C++ | Capacity Planning | Distributed Systems | FinOpsRemote workSenior-level Full TimeUnited States - Remote R17h ago
-
Robot Application Developer USD 100K-150KC++ | Computer Vision | Control Systems | Gazebo | IMUCareer growth | Remote workSenior-level Full TimeUnited States - Remote R17h ago
-
Kafka Platform Engineer USD 130K-180KAWS MSK | Access Control | Access Control Lists | Access Control Lists ACLs | AnsibleSenior-level Full TimeUnited States - Remote R17h ago
-
AWS | Azure | Cloud platform | Direct Preference Optimization | Fine TuningComprehensive benefits package | Remote work | Travel to enterprise customers | Visa sponsorship possibleMid-level Full TimeSan Mateo R20h ago
-
Lead AI Engineer- GTM Systems USD 131K-176KAWS Bedrock | AWS Lambda | Agent coordination | Async event-driven architecture | Async/event-drivenNo relocation assistance not provided | Remote workSenior-level Full TimeRemote - US R20h ago
-
Lead AI Engineer USD 198K-261KAgentic Frameworks | CI/CD | Cloud Computing | Containers | Fine TuningSenior-level Full TimeUSA, USA R20h ago
-
A/B | A/B Testing | AWS | AWS SageMaker | Apache Spark401k employer match | Commuter benefit | Dental insurance | Dependent Care Flexible Spending Account FSA | Flexible time offSenior-level Full TimeLos Angeles, California, United States; San … R21h ago
-
Senior Data Scientist, Applied ML USD 154K-200KAWS | Airflow | Apache Spark | DVC | Data Transformation401k employer contribution | Employer-paid life insurance | Flexible Remote Friendly Work Options | Generous paid holidays | Health Savings Account employer contributionSenior-level Full TimeAustin, Texas | Remote R22h ago
-
Staff Engineer Tech Lead Manager, ML Acceleration USD 172K-229KAWS | Azure | C++ | Cloud Computing | Distributed Systems401k match | Dental insurance | Health savings account | Life insurance | Medical insuranceSenior-level Full TimeRemote U.S. R23h ago
-
Sr Machine Learning Engineer I USD 150K-241KAutomated retraining | Bayesian Filter | CI/CD | Data Association | Extended KalmanDiscretionary paid time off | Emotional and mental wellness support | Employee resource groups | Fitness programs | Learning and development programsSenior-level Full TimeSeattle, Washington, United States R1d ago
-
AWS | Apache Kafka | Apache Spark | Azure | Cloud platformSenior-level Full TimeFlorida; Remote - Massachusetts; Remote - … R1d ago
-
Amazon Web Services | Apache Hadoop | Apache Kafka | Apache Spark | Big DataRemote work | Travel opportunitiesSenior-level Full TimeFlorida; Remote - Illinois; Remote - … R1d ago
-
AI Engineer II ( AI Platform) USD 104K-177K.NET | AWS Bedrock | Asynchronous processing | Audit trails | Azure OpenAIMentorship | Remote work | Soft skill sessions | TrainingMid-level Full TimeUS Remote R1d ago
-
Analytics Engineer USD 100K-126KAPIs | Data Governance | Data Marts | Data Modeling | Data Pipelines401k match | Dental insurance | Disability insurance | Employee assistance program | FSA plansSenior-level Full TimeVirtual Office, United States R1d ago
-
Analytic Server Modeler USD 150K-170KAzure | Big Data | C# | C++ | DDL401k | Medical/Dental/Vision insurance | Paid time offEntry-level Full TimeRemote, United States R1d ago
-
Principal AI Engineer USD 130K-197KAI monitoring | Cloud Computing | Deep learning | Fine Tuning | Language Processing401k match | Employee awards | Hybrid work | Industry certifications | MentorshipSenior-level Full TimeUnited States R1d ago
-
Senior Software Engineer (Storage) - remote in the US USD 100K-155KArgoCD | CSI | Cluster API | Flux | GPU DirectConference attendance | Professional development and trainingSenior-level Full TimeRemote, USA, United States R1d ago
-
Data Engineer - AWS/Databricks USD 122K-210KACID | AWS Glue | AWS S3 | Adaptive Query | Adaptive query executionComprehensive benefits | Mentorship | Training budget | Work-life balanceEntry-level Full TimeReston, VA, United States R1d ago
-
Data Engineer USD 133K-159KAWS Glue | AWS Lambda | Amazon Redshift | Amazon S3 | Amazon SNS401k match | Casual dress code | Company paid life insurance | Dental insurance | Health insuranceMid-level Full TimeLehi, UT, US R1d ago
-
SkillBridge – US 2026 Active Duty US Military ONLY USD 110K-176KApplication development | Data Visualization | Databases | Databricks | Machine LearningRemote workEntry-level Full TimeAtlanta, GA - Remote R1d ago