Senior/Lead Data Engineer – AI-Native Aftermarket Platform
Tasks
- Author and deploy Databricks Asset Bundles jobs
- Build and test dbt models and tests
- Deploy securely using service principals
- Design and build data pipelines end to end
- Implement data quality checks
- Lead architecture standards and data strategy
- Maintain data governance with dbt documentation and tests
- Model dimensional schemas for data marts
- Participate in hiring panels
- Run exposure checks before merging changes
- Unblock team and lead code reviews
- Write production Python modules with unit tests
Perks/Benefits
Skills/Tech-stack
Asset bundles | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Key Vault | Checkpointing | DBT | Data Factory | Data Governance | Data Lake Storage | Data Quality | Data Quality Checks | Databricks | Databricks (asset) | Databricks Asset Bundles | Dbt exposures | Delta Lake | Dimensional Modeling | Elementary | Elementary Observability | Elementary dbt Exposures | Git | GitHub Actions | GitHub Environment Secrets | Grain Management | Incremental loading | Key Vault | Medallion Architecture | Merge | Optimize | PII masking | PySpark | Pytest | Python | Quality checks | ReplaceWhere | Ruff | SCD Type-2 | SQL | Secret management | Service principals | Spark | Spark UI | Time Travel | Type 2) | Type Hints | Unity Catalog | Z-Order
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer | Senior Data Engineer
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R6d ago
-
Principal Software Engineer USD 105K-159KAWS | Agile | Azure | Bitbucket | CI/CDFlexible hybrid work model | Health and life insurance | Paid time off | Pension/retirement benefits | Personal/Family Care leavesSenior-level Full TimeTampa, FL, United States R12h ago
-
Principal AI Engineering Architect USD 224K-308KAWS | Data Processing | Docker | Google Cloud | High AvailabilityAdoption and surrogacy reimbursement | Cancer Care Program | Employee Assistance Program (EAP) | Fertility coverage | Flexible time offSenior-level Full TimeUnited States - Remote R21h ago
-
Staff Data Analytics Engineer USD 159K-220KApache Airflow | Apache Spark | BigQuery | DBT | Data ContractsFlexible working hours | Remote work flexibilitySenior-level Full TimeAmericas - Remote, US - Remote, … R1d ago
-
Data Engineer USD 120K-150KAWS Glue | Amazon Redshift | Apache Airflow | Apache Spark | Azure Data100 percent remote | Hardware setup for home office | Paid time off | Training allowanceSenior-level Full TimeLatam R1d ago
-
Analytics Engineer USD 86K-165KAPI | Agile | Data Cleansing | Data Modeling | Data orchestration401k match | Dental insurance | Flexible work schedules | Life insurance | Medical insuranceSenior-level Full TimeUS-FL-REMOTE, United States R1d ago
-
Entry-level Full TimeOntario,Canada Offsite R1d ago
-
Data Scientist Lead Consultant - Remote USD 90K-153KAWS | Azure | Machine Learning | Predictive Modeling | PythonConnectivity reimbursement | Equipment provided | Remote workSenior-level Full TimeUSA - NJ (Remote), United States R1d ago
-
Principal Data Engineering - Hybrid USD 112K-193KAPI Design | Apache Spark | Artifactory | Azure | Azure Databricks401k contribution | Career development opportunities | Comprehensive benefits package | Hybrid work schedule | Incentive and recognition programsSenior-level Full TimePrimary location: Eden Prairie, Minnesota R1d ago
-
Technical Director - ML & Algorithms USD 161K-225KAnomaly Detection | Apache Flink | Apache Spark | Auditability | Classification401k matching | Certificate reimbursement | Disability coverage | Health and wellness coverage | Leadership trainingExecutive-level Full TimeUnited States, Remote, United States R1d ago
-
Senior Data Engineer (Exadata) USD 91K-163KAnsible | Automation | Backup infrastructure | Capacity Planning | Cloud Service401k contribution | Career development | Comprehensive benefits | Equity stock purchase | Incentive and recognition programsSenior-level Full TimeEden Prairie, Minnesota, UNITED STATES; REMOTE R1d ago
-
Software Engineer - Drive OS USD 124K-195KAgent Orchestration | Bazel | C++ | CI/CD | CMakeEquity | Health benefits | Paid time offSenior-level Full TimeUS, CA, Santa Clara R1d ago
-
Conversational AI Engineer USD 100K-150KAgent systems | Agentic Workflows | Embeddings | Evaluation | IndexingMid-level Full TimeUnited States - Remote R1d ago
-
Mid-level Full TimeUnited States - Remote R1d ago
-
Applied AI Engineer USD 100K-150KAccelerator hardware | Agentic Systems | Computer Vision | Data Quality | Data quality monitoringRemote workMid-level Full TimeUnited States - Remote R1d ago
-
Big Data Application Developer USD 100K-150KAWS EMR | Airflow | Apache Flink | Apache Hive | Apache HudiSenior-level Full TimeUnited States - Remote R1d ago
-
ML Data Engineer USD 100K-150KApache Beam | CI/CD | Data Deduplication | Data Lineage | Data ModelingBenefits | Remote workMid-level Full TimeUnited States - Remote R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Robotics Software Engineer USD 100K-150KBehavior Trees | C++ | Concurrent programming | Control Systems | Embedded SystemsMid-level Full TimeUnited States - Remote R1d ago
-
Senior-level Full TimeRemote, Canada R1d ago
-
Senior Data Engineer USD 147K-190KAWS Lambda | Agile | Airflow | Amazon Redshift | Amazon SNS401k matching | Casual work environment | Dental insurance | Fitness reimbursement | Flexible paid time offSenior-level Full TimeRemote - US R1d ago
-
Data Visualization Engineer USD 90K-112KArcGIS | Cartography | D3 | Data Visualization | GDALCommuter benefits | Employee assistance program | Health savings account | Home office reimbursement | LinkedIn Learning accessMid-level Full TimeSan Francisco, CA R1d ago
-
Lead Data Engineer USD 160K-193KAmazon Redshift | CI/CD | DBT | ELT | ETL401k match | Adoption benefits | Employee resource groups | Flexible time off | Health insuranceSenior-level Full TimeDeerfield, IL, United States R1d ago
-
Marketing Analytics Lead USD 200K-230KA/B | A/B Testing | App Messaging | Attribution Modeling | B testing401-k match | Benefits effective on day one | Flexible time off | Paid caregiver leave | Paid parental leaveSenior-level Full TimeUnited States (Remote) R1d ago
-
Lead Data Scientist USD 130K-200KA/B | A/B Testing | Agents | B testing | Evaluation Frameworks401k | Dental insurance | Medical insurance | Vision insuranceSenior-level Full TimeNew York City, NY (Hybrid); San … R1d ago