Lead Data Engineer - Databricks
Tasks
- Collaborate with analytics teams
- Collaborate with architecture teams
- Design scalable data pipelines
- Develop ETL/ELT pipelines
- Enable data products
- Establish engineering standards
- Implement data ingestion frameworks
- Implement data transformation frameworks
- Mentor engineers
- Optimize Spark workloads for performance
Perks/Benefits
- Dental insurance
- Disability insurance
- Life insurance
- Medical insurance
- PTO
- Retirement savings
- Vision insurance
Skills/Tech-stack
Apache Spark | Data Ingestion | Data Transformation | Databricks | Distributed Processing | ELT | ETL | PySpark | Python | SQL
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Machine Learning Engineer USD 130K-194KAI machine learning | AWS AI | AWS AI Machine Learning | Amazon DynamoDB | Amazon EC2Professional development | Work from homeMid-level Full TimeRemote, NY, US R6h ago
-
Data Scientist, Analytics (Technical Leadership) USD 160K-190KAI Workflow Optimization | AI workflow | Agent Orchestration | Bias Mitigation | Causal InferenceCareer development | World class analytics communitySenior-level Full TimeRemote, US | Bellevue, WA | … R7h ago
-
Adaptive Control | Apache Spark | Azure DevOps | C++ | CI/CDFlexible hybrid work model | Flexible vacation policy | Paid Holidays | Paid time off | Personal and family careSenior-level Full TimeNew York, NY, US, 10001-8604 R16h ago
-
Adaptive Control | Agile | Audio Processing | Azure DevOps | C++Flexible vacation policy | Hybrid work model | Paid Holidays | Travel opportunitiesMid-level Full TimeNew York, NY, US, 10001-8604 R16h ago
-
AWS | Benchmarking | Code Quality | Code review | Data Pipelines401k matching | Dining | Flexible spending accounts | Healthcare | Onsite gymSenior-level Full TimeRemote - US R18h ago
-
Software Engineer III (AI/ML) USD 113K-169KAPI Design | AWS | CrewAI | Docker | DynamoDBCompany sponsored retirement plan | Flexible work environment | Health and wellness benefits | Hybrid work options | In person orientation processSenior-level Full TimeRemote (USA), United States R18h ago
-
Dashboard Development | Data Analysis | Data Modeling | Data Querying | Data VisualizationCareer development opportunities | Education assistance program | Flexible work options | Generous leave accruals | Health benefitsSenior-level Full TimeAlvarado Square, United States R18h ago
-
Staff Applied AI Engineer USD 180K-273KAWS SageMaker | Agentic AI | Amazon Bedrock | CI/CD | Caching401k match | Dental insurance | Fertility assistance | Flexible paid time off | Health insuranceSenior-level Full TimeRemote - US & Canada R19h ago
-
Applied AI Engineer II USD 100K-295KAI Agents | AWS | Azure | CI/CD | Docker401k matching | Dental insurance | Disability insurance | Employee assistance program | Flexible spending accountSenior-level Full TimeAddison, TX (Hybrid); Durham, NC (Hybrid) R20h ago
-
Senior Software Engineer, Data Platform USD 163K-247KAWS | Amazon EMR | Amazon Kinesis | Amazon MSK | Amazon Redshift401k match | Equity RSUs | Health insurance | Paid time offSenior-level Full TimeDenver, CO;San Francisco, CA;New York, NY;Los … R20h ago
-
Agile | Algorithms | Analytics | C plus plus | CI/CD401k | Accident insurance | Dental insurance | FSA | HSASenior-level Full TimeAustin, Texas or Remote R20h ago
-
Data Solutions Engineer USD 119K-164KAlerting | Azure | Azure Data | Azure Data Factory | Azure Databricks401k match | Dental insurance | Employee referral program | Health insurance | Life insuranceEntry-level Full TimeRemote, United States R21h ago
-
Machine Learning Engineer, Data Mining USD 144K-192KActive Learning | Batch inference | CI/CD | Contrastive Learning | Data Augmentation401k match | Dental insurance | Health insurance | Health savings account | Life insuranceSenior-level Full TimeRemote U.S. R22h ago
-
Data Engineer (Remote) USD 123K-178KAlerting | Batch Processing | CI/CD | Cloud platform | ClusteringFully remote | W2 Candidates OnlyMid-level Full TimeRochester, MN R23h ago
-
Staff Data Analyst USD 122K-165KB2B SaaS | Behavioral segmentation | Cohort Analysis | Dashboarding | Data Instrumentation401k match | Dental insurance | Family planning resources | Flexible vacation policy | Fully remoteSenior-level Full TimeRemote - USA R23h ago
-
Data Engineer II-AWS USD 90K-100KAWS Glue | AWS Lambda | Amazon Athena | Amazon DynamoDB | Amazon EMRFully remote workMid-level Full TimeOrlando, FL, United States R1d ago
-
AI-Native Data Platform Engineer USD 165K-225KAWS Glue | AWS Lambda | AWS S3 | Access Control | Amazon OpenSearch401k matching | Book clubs | Health benefits | Roth IRA options | SeminarsSenior-level Full TimeHybrid - New York, NY R1d ago
-
Senior Full Stack AI Developer USD 145K-180KArtificial Intelligence | Cloud Computing | Continuous Delivery | Continuous integration | Language ModelsRemote workSenior-level Full TimeWork from home, VA, United States R1d ago
-
Analytics Lead, Market Insights USD 118K-147KAnalytics | Data Visualization | Economics | Excel | Google Sheets401k match | Child care benefits | Commuter benefits | Dental insurance | Family building benefitsSenior-level Full TimeSan Francisco, CA R1d ago
-
Senior Solution Engineer USD 165K-216KAnalytics | Artificial Intelligence | Cloud Computing | Data Science | Data WarehousingSenior-level Full TimeUS-CA-Bay Area-Remote R1d ago
-
Senior Data Engineer USD 130K-175K.Net Core | .Net Framework | Apache Airflow | Azure | Azure Data401k match | Career growth opportunities | Dental insurance | Employee resource groups | Life insuranceSenior-level Full TimeRemote, United States R1d ago
-
Data Solutions Engineer USD 123K-178KAWS | AWS Glue | AWS Lambda | AWS Step Functions | Amazon S3401k match | Flexible spending account | Growth opportunities | Health benefits | Long-term disabilityMid-level Full TimeUS-Remote R1d ago
-
Data Analytics Team Lead USD 130K-170KAI visuals | APIs | Azure Data | Azure Data Factory | Azure Data Lake401k matching | Dental insurance | Life insurance | Medical insurance | Paid time off (PTO)Senior-level Full TimeRemote, US R1d ago
-
Senior Data Platform Engineer USD 166K-230KAWS | Apache Airflow | Apache Kafka | Apache Spark | Data Catalog401k plan | Employee assistance program | Health insurance | Paid parental leave | Paid time offSenior-level Full TimeUnited States | Remote R1d ago
-
AWS S3 | Amazon Redshift | Apache Airflow | Azure Storage | Cloud PlatformsSenior-level ContractLincoln, United States R1d ago