Senior/Lead Data Engineer – AI-Native Aftermarket Platform
Tasks
- Author and deploy Databricks Asset Bundles jobs
- Build and test dbt models and tests
- Deploy securely using service principals
- Design and build data pipelines end to end
- Implement data quality checks
- Lead architecture standards and data strategy
- Maintain data governance with dbt documentation and tests
- Model dimensional schemas for data marts
- Participate in hiring panels
- Run exposure checks before merging changes
- Unblock team and lead code reviews
- Write production Python modules with unit tests
Perks/Benefits
Skills/Tech-stack
Asset bundles | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Key Vault | Checkpointing | DBT | Data Factory | Data Governance | Data Lake Storage | Data Quality | Data Quality Checks | Databricks | Databricks (asset) | Databricks Asset Bundles | Dbt exposures | Delta Lake | Dimensional Modeling | Elementary | Elementary Observability | Elementary dbt Exposures | Git | GitHub Actions | GitHub Environment Secrets | Grain Management | Incremental loading | Key Vault | Medallion Architecture | Merge | Optimize | PII masking | PySpark | Pytest | Python | Quality checks | ReplaceWhere | Ruff | SCD Type-2 | SQL | Secret management | Service principals | Spark | Spark UI | Time Travel | Type 2) | Type Hints | Unity Catalog | Z-Order
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer | Senior Data Engineer
Related jobs
-
AI Agents | AWS | Amazon Bedrock | Autogen | CI/CDEnglish communication environment | Flexible contractor schedule | International team collaboration | Remote workMid-level Contract Full TimeBrazil R13h ago
-
Applied AI Engineer - AI Solutions USD 172K-300KAgentic Workflows | Airflow | Apache Spark | Chroma | CrewAIAnnual travel up to 25% | Employee stock options | Hybrid work | Professional developmentMid-level Full TimeNew York City, NY (Hybrid); Redwood … R13h ago
-
Senior Data engineer USD 120K-160KAWS | Anomaly Detection | Aurora | Cause analysis | Code reviewDental insurance | Education reimbursement | Flex work | Life insurance | Medical insuranceSenior-level Full TimeHeredia, Heredia, Costa Rica R18h ago
-
Product Analytics Engineer USD 130K-140KA/B | A/B Testing | Airflow | B testing | DBT401k retirement savings plan | Employer-sponsored healthcare | Flexible spending account | Health savings account | Paid parental leaveSenior-level Full TimeRemote, USA R18h ago
-
Sr. Data Engineer (Remote) USD 163K-192KAccess Control | Amazon Web Services | Apache Iceberg | Apache Kafka | Apache Spark401k plan | Dental insurance | Disability insurance | Employee assistance program | FSA/HSASenior-level Full TimeRemote - United States R20h ago
-
AWS | Agent Orchestration | CI/CD | Cloud platform | Databricks401k match | Counseling membership | Employer subsidized medical dental and vision | Flexible time away program | Life insuranceMid-level Full Time-REMOTE, USA- R20h ago
-
APIs | Agile | Cloud Computing | Data Visualization | Databricks401k program | Flexible spending account | Medical, dental & vision coverage | Paid time off | Parental leaveEntry-level Full TimeCamp Springs, MD R21h ago
-
APIs | Agile | Application development | Cloud Computing | Data Lakes401k program | Dental insurance | Flexible PTO | Flexible spending account | Medical insuranceEntry-level Full TimeCamp Springs, MD R21h ago
-
AI Engineer, Ecosystem USD 171K-240KAPI Integration | Access Management | Audit Logging | Authentication | AuthorizationHybrid work | Remote work up to 4 weeks per yearMid-level Full TimeSan Francisco, California, United States R21h ago
-
Forward Deployed AI Solutions Engineer USD 95K-145KAPIs | Agentic Workflows | Audit Logging | Cloud Computing | Command Line401k benefits | Commuter benefits | Employee referral program | Fertility care benefits | Free testingMid-level Full TimeUS Remote R21h ago
-
Staff Analytics Engineer USD 159K-187KClaude | Claude Code | DBT | Data Contracts | Data Modeling401k company match | Accident insurance | Company funded HSA contributions | Critical illness insurance | Health, dental, vision coverageSenior-level Full TimeRemote (United States) R21h ago
-
AI Engineer, Product USD 171K-240KA/B | A/B Testing | API Design | B testing | Data ModelingHybrid work | Remote work up to four weeks per yearMid-level Full TimeSan Francisco, California, United States R21h ago
-
Senior Machine Learning Engineer, Shield USD 211K-263KAnomaly Detection | Apache Spark | Behavior analytics | BigQuery | Cloud DataflowSenior-level Full TimeRedwood City, CA, United States R22h ago
-
Senior Data Engineer USD 150K-175KAPI Development | AWS | Agile | Apache Airflow | Apache SparkHybrid/Remote flexibilitySenior-level Full TimeHerndon, VA R22h ago
-
Lead Data Scientist CAD 150K-241KAccountability | CI/CD | Computer Vision | Data Mining | Data PreprocessingSenior-level Full TimeLima, Peru R22h ago
-
Lead Data Scientist CAD 150K-241KAI ethics | CI/CD | Computer Vision | Data Mining | Data PreprocessingSenior-level Full TimeQuito, Ecuador R22h ago
-
Staff AI Engineer - Grafana AI/ML | USA | Remote CAD 186K-230KAWS | Agent Frameworks | Agent workflows | Alerting | AzureCompany funded AI coding assistant budget | Global annual leave policy | Remote workSenior-level Full TimeCanada (Remote) R23h ago
-
Staff AI Engineer - Grafana AI/ML | USA | Remote USD 174K-220KAWS | Azure | Cloud platform | Docker | Generative AIAnnual leave | Bonus | Equity | RSUs | Remote workSenior-level Full TimeUnited States (Remote) R23h ago
-
Senior AI Engineer - Grafana AI/ML | USA | Remote CAD 129K-217KAWS | Azure | Docker | GCP | GenAIAnnual leave policy | Company funded AI usage budget | Developer productivity support | Global culture | In-person onboardingSenior-level Full TimeCanada (Remote) R23h ago
-
Senior AI Engineer - Grafana AI/ML | USA | Remote USD 127K-203KAWS | Agent Frameworks | Agent workflows | Cloud Computing | Cloud platformBonus | Equity | Global annual leave policy | Remote workSenior-level Full TimeUnited States (Remote) R23h ago
-
Analytics Engineer USD 152K-179KAutomation | DBT | Data Contracts | Data Modeling | Data PipelinesQuarterly in person surges | Remote-firstMid-level Full TimeRemote - USA R23h ago
-
AI-ML Engineer - Finance-Hybrid USD 130K-210KCI/CD | Cloud infrastructure | Computer Vision | Data Engineering | Data ScienceContinuing education | FSA | HSA | Health, dental, vision insurance | Hybrid workSenior-level Full TimeRochester, MN, United States R23h ago
-
Staff Forward Deployed AI Solutions Engineer USD 136K-209KAPI | Access Control | Authentication | Automation | CLI401k benefits | Baby bonding leave | Commuter benefits | Employee referral program | Fertility care benefitsSenior-level Full TimeUS Remote R1d ago
-
Sr. Data Engineer USD 100K-150KAirflow | Amazon QuickSight | Apache Flink | Apache Iceberg | Apache Spark401k match | Dental insurance | Flex remote days | Health insurance | Life insuranceSenior-level Full TimeChicago or Remote* R1d ago
-
Data Engineer 1 USD 107K-150KApache Beam | Apache Kafka | Cloud platform | Dataflow | GeminiExpensed lunches | Gym reimbursement | Learning and development opportunities | Virtual events | Wellness perksSenior-level Full TimeRemote in the United States R1d ago