Senior Data Engineer
Tasks
- Build Databricks solutions with Delta Lake
- Build lakehouse data layers
- Create semantic models and curated data products
- Design scalable Spark ETL and ELT pipelines
- Develop dimensional and data vault models
- Develop medallion architecture data products
- Drive engineering best practices
- Enable lineage governance and traceability
- Implement CI/CD deployment pipelines
- Implement data quality validations
- Implement metadata driven data engineering frameworks
- Mentor junior engineers
- Optimize cluster performance and workload efficiency
- Optimize distributed data processing workloads
- Participate in architecture and code reviews
- Support Master Data Management initiatives
Perks/Benefits
- Dental insurance
- Disability insurance
- Life insurance
- Medical insurance
- PTO
- Retirement savings
- Vision insurance
Skills/Tech-stack
Apache Spark | Azure | Azure DevOps | CI/CD | DBT | Data Governance | Data Lineage | Data Management | Data Quality | Data Vault | Data Vault 2 | Data Vault 2 0 | Databricks | Delta Lake | Delta Live Tables | Delta Live) | Dimensional Modeling | ELT | ETL | Git | Lakehouse Architecture | Master Data | Master Data Management | Medallion Architecture | Metadata | PySpark | SQL | Semantic Modeling | Terraform | Unity Catalog
Education
Roles
Related jobs
-
Algorithm Engineer USD 150K-170KCI/CD | Code review | Data labeling | Deep learning | Digital SignalIn person office hubs | Remote work flexibilityMid-level Full TimeBoston, MA / Remote R1d ago
-
Analytics Engineer USD 130K-170KCI/CD | DBT | Data Modeling | Data Quality | Data Quality Testing401k match | Flexible time off | Health benefits day one | Paid caregiver leave | Paid parental leaveSenior-level Full TimeUnited States (Remote) R1d ago
-
Senior Principal Software Engineer, Machine Learning USD 222K-453KA/B | A/B Testing | B testing | Canary Deployment | Capacity PlanningHybrid work model | MentorshipSenior-level Full TimeRemote, US R1d ago
-
CI/CD | Fastlane | Git | Multithreading | SOLIDAsynchronous culture | Bonus | Learning support resources | Remote work | Stock optionsSenior-level Full TimeKansas City, MO, USA R1d ago
-
Data Engineer USD 81K-105KAPIs | AWS | Azure | Cloud Data | Cloud Data Platforms401k match | Full-flex work week | Health and wellness benefits | Hybrid work schedule | Life insuranceMid-level Full TimeUSA VA Falls Church - 3150 … R1d ago
-
Analytics Engineer USD 84K-105KAWS | Azure | Cloud Computing | Data Modeling | Data ValidationEmployee assistance program | Health insurance | Paid time off | Retirement plan 401kMid-level Full TimeNew York, NY ( 200 Park … R1d ago
-
API Integration | Agent Orchestration | Authentication | CI/CD | Code assistantsHealth benefits | Mentorship | Remote work | Training and supportSenior-level Full TimeRemote - USA, United States R1d ago
-
Senior Software Engineer, Training & Experimentation USD 180K-250KAPI Development | AWS | Asynchronous processing | Automated testing | Azure401k matching | Company holidays | Company winter break | Dental coverage | Flexible scheduleSenior-level Full TimeLondon, England, United Kingdom; New York, … R2d ago
-
Predictive Analytics Consultant USD 69K-101KAWS IAM | AWS Lambda | AWS SageMaker | AWS Step Functions | Amazon CloudWatchSenior-level Full TimeUS Remote R2d ago
-
AI Engineer I USD 90K-119KAPI Integration | Azure | CI/CD | Chroma | Docker401k match | Dental insurance | Holidays | Medical insurance | Personal Time OffEntry-level Full TimeRemote, CA, USA R2d ago
-
Senior Software Engineer - Machine Learning USD 183K-223KApache Flink | Apache Spark | Apache Storm | Data Modeling | Deep learning401k match | Dental insurance | Health insurance | Life insurance | Long-term disabilitySenior-level Full TimeSan Francisco, CA 94158, United States R2d ago
-
Sr. Software Engineer, Data Products USD 105K-175KAPI Design | Apache Airflow | Asynchronous processing | Backend Development | Backward Compatibility401k retirement savings plan | Adoption Assistance | Charitable gift program | Company holidays | Dental insuranceSenior-level Full TimeChicago, Illinois, United States R2d ago
-
Software Engineer, Machine Learning Platform USD 200K-330KAlerting | CI/CD | Cloud Computing | Distributed Systems | Docker401k match | Health, dental, vision insurance | Paid time off | Professional development | Work-life balanceMid-level Full TimeEmeryville, California, United States; Hybrid (2-3 … R2d ago
-
Data Scientist USD 121K-202KBI tools | DBT | Data Lake | Data Pipelines | Databricks401k | Dental insurance | Health insurance | Paid time off | Short Term Incentive ProgramSenior-level Full TimeWorcester, MA, United States R2d ago
-
Data Engineer III/Senior (Analytics) USD 130K-170KCI/CD | DORA Metrics | Data Governance | Data Modeling | Data Privacy401k retirement savings plan | Dental insurance | Employee stock purchase plan | Health insurance | Life insuranceSenior-level Full TimeEdison, NJ, United States R2d ago
-
Data Engineer III/Senior (Analytics) USD 130K-170KAnalytics engineering | Azure | CCPA | CI/CD | DORA Metrics401k retirement plan | Dental insurance | Employee stock purchase plan | Health insurance | Life insuranceSenior-level Full TimeIrving, TX, United States R2d ago
-
Data Engineer III/Senior (Analytics) USD 130K-170KAutomation | Azure | CI/CD | DORA Metrics | Data Governance401k retirement plan | Dental insurance | Employee stock purchase plan | Health insurance | Life insuranceSenior-level Full TimeEllenwood, GA, United States R2d ago
-
Data Engineer III/Senior (Analytics) USD 130K-170KAnalytics engineering | Azure | CCPA | CI/CD | DORA Metrics401k matching | Dental insurance | Employee stock purchase plan | Health insurance | Life insuranceSenior-level Full TimeRomulus, MI, United States R2d ago
-
Data Platforms Software Engineer USD 99K-155KAWS | Apache Airflow | CI/CD | Cloud Foundry | DBTEmployee resource groups | Hybrid work schedule | Professional development | Remote work flexibilityMid-level Full TimePortsmouth, New Hampshire, United States R2d ago
-
AI Search | AI Security | AWS | AWS Bedrock | Agent memoryHybrid work | In-person interviewSenior-level Contract Full TimeJersey City, NJ, United States R2d ago
-
Agile | Data Governance | Data Management | Data Modeling | Data TransformationHybrid schedule | Occasional travel | Professional development | Remote workSenior-level Full TimeRemote, Remote, United States R2d ago
-
Staff Engineer - Experimentation Platform USD 231K-318KA/B | A/B Testing | AWS | Airflow | Apache SparkComprehensive benefits | Equity | Hybrid work flexibilitySenior-level Full TimeSan Francisco, CA R2d ago
-
Fullstack Engineer, Embedded Wallet USD 177K-230KAPI Design | Backward Compatibility | Blockchain Signing | Blockchain Transactions | Blockchain integrationDistributed team collaboration | Flexible, distributed work environment | Remote work optionSenior-level Full TimeUnited States R2d ago
-
Data Engineer eCommerce Customer Experience USD 110K-178KAWS | Azure | Data Modeling | Data Transformation | Data WarehousingMid-level Full TimeRemote, United States R2d ago
-
Analytics Engineer USD 100K-140KAzure Data | Azure Data Factory | Azure SQL | Common table expressions | DAXSenior-level Full TimeHouston, TX, US R2d ago