Lead Data Engineer
USD 150K-191K (estimate) Senior-level Full Time
Tasks
- Conduct code reviews
- Create operational standards
- Define technical direction
- Design data models
- Develop data transformations
- Enforce data testing standards
- Ensure data accuracy and accessibility
- Lead data engineering teams
- Maintain runbooks and on call practices
- Manage Databricks Workflows
- Manage incident resolution
- Meet SLAs
- Mentor engineers
- Monitor data pipelines
- Orchestrate data jobs
- Partner with business stakeholders
- Perform root cause analysis
Perks/Benefits
Skills/Tech-stack
Access Control | Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Event | Azure Event Hubs | Data Factory | Data Governance | Data Lake Storage Gen2 | Data Lineage | Data Modeling | Data Pipeline Monitoring | Data pipeline | Databricks | Delta Lake | ETL | Event Hubs | Lakehouse Architecture | Medallion Architecture | Pipeline monitoring | Python | Query Optimization | SQL | Schema Design | Unity Catalog
Education
N/A
Roles
Data Engineer | Data Engineering | Data Engineering Manager | Engineer | Engineering Manager | Lead | Lead Data | Lead Data Engineer | Manager
Related jobs
-
ML Engineer Summer Intern (Remote & Paid) USD 40K-42KArtificial Intelligence | Classification | Data Visualization | Data Wrangling | Generative AI401k participation | Flexible work schedule | Remote work | Volunteer time offEntry-level InternshipUnited States, United States R13h ago
-
Executive Director, Data Governance Lead USD 120K-173KCompliance | Data Governance | Data Lineage | Data Management | Data PrivacyFlexible hybrid work model | Health and life insurance | Paid time off | Pension/retirement benefits | Personal/Family Care leavesSenior-level Full TimeJersey City, NJ, United States R19h ago
-
Agile | Algorithms | CI/CD | Data Engineering | Data Structures401k plan | Accident insurance | Dependent care FSA plan | HSA and FSA | Hospital indemnity insuranceSenior-level Full TimeAustin, Texas or Remote R1d ago
-
Pre-Sales Data Scientist USD 70K-90KAPIs | AUC | Credibility Testing | Cross-validation | Data AnalysisCompany sponsored volunteering days | Discounted private health insurance | Extra paid time off | Fully remote within continental United States | Generous parental leaveMid-level Full TimeCarlsbad, CA, United States R1d ago
-
Group Leader - Senior Director, Quantitative Pharmacology and Pharmacometrics (Hybrid or Remote) USD 210K-331KADME | Biologics | Biopharmaceutics | Clinical Development | Clinical Pharmacology401k | Annual bonus | Compassionate days | Dental insurance | Hybrid workSenior-level Full TimeUSA - Pennsylvania - West Point, … R1d ago
-
Senior Manager, HRIS & People Analytics USD 111K-162KAdvanced Compensation | BIRT | Business Intelligence | Business Intelligence Reporting | Business Intelligence Reporting ToolsSenior-level Full TimeUSA - NC - Remote, United … R1d ago
-
Senior Data Engineer USD 162K-242KCloud Platforms | Data Lakes | Data Modeling | Data Pipelines | Data Transformation401k match | Company holidays | Dental insurance | Life insurance | Long-term disabilitySenior-level Full TimeUSA - MA - Cambridge, United … R1d ago
-
Senior Applied ML Engineer USD 180K-200KAWS | Amazon Web Services | Computer Vision | Distributed Systems | Docker401k match | Disability Leave | Family building benefits | Health benefits | Life insuranceSenior-level Full Time06083 GameChanger, United States R1d ago
-
Data Engineer I USD 30K-36KACID | Apache Spark | Azure | Azure DevOps | Batch Data Processing401k match | Community giveback paid time off | Employee assistance program | Employee discounts | FSAEntry-level Full TimeUnited States - Remote R1d ago
-
Assistant Data Science Engineer USD 78K-110KAWS | Access | Computational Finance | Decision Trees | DynamoDBEntry-level Full TimeRemote, Pennsylvania, United States of America R1d ago
-
AI Solution Engineer – Platform USD 89K-175KAmazon Neptune | Automated testing | CI/CD | CloudFormation | Containerization401k match | Certification programs | Childcare option | Comprehensive medical, dental and vision plans | Flexible spending accountMid-level Full TimeRemote - Alabama, United States R1d ago
-
AI Solution Engineer - Operations and Implementation USD 89K-175K800-171 | AWS | Airflow | Azure | CUI401k match | Certification programs | Childcare option | Flexible spending account | Flexible work scheduleMid-level Full TimeRemote - Alabama, United States R1d ago
-
Principal AI Infrastructure Engineer USD 200K-275KAWS | Accelerator resource management | Apache Spark | Azure | Compliance401k | Dental coverage | Holidays | Medical coverage | Paid vacationSenior-level Full TimeUS, MA, Wilmington, United States R1d ago
-
Senior Platform Data Engineer USD 180K-248KAccess Control | Apache Kafka | BM25 | Batch ETL | Data GovernanceCollaborative work environment | Dental insurance | Health insurance | Paid time off | Vision insuranceSenior-level Full TimeWork from home (Pennsylvania), United States R1d ago
-
Freelance Creative Technologist, Applied AI USD 150K-190KAPI | Agentic Workflows | ComfyUI | ControlNet | Embeddings401k match | Dental | Healthcare | Paid Holidays | Paid time offMid-level FreelanceUnited States R1d ago
-
Data Governance and Management Lead USD 144K-205KAccess Control | Business Intelligence | Data Classification | Data Governance | Data LineageSenior-level Full TimeUnited States R1d ago
-
Senior AI/ML Engineer USD 192K-240KAWS | Agentic Orchestration | Automated Labeling | Automated Labeling Pipelines | AzureHybrid work scheduleSenior-level Full TimeRedwood City, CA (Hybrid); San Francisco, … R1d ago
-
Senior Software Engineer, Data Platform USD 146K-230KAPI Gateway | API Versioning | AWS Lambda | AWS RDS | AWS S3401k match | Catered lunch | Commuter benefit | Dental insurance | Fully paid parental leaveSenior-level Full TimeNew York, New York, United States R1d ago
-
Senior Forward Deployed AI Engineer USD 160K-226KData Pipelines | DevOps | Distributed Systems | Edge Computing | JAX401k match | Continuing education support | Function health subscription | Health & wellness stipend | Health, dental, vision benefitsSenior-level Full TimeAustin, TX R1d ago
-
Forward Deployed Engineering Manager USD 180K-220KAWS | Automated testing | CI/CD | Containerization | DebuggingCareer growth tied to impact | Health and wellness benefits | Hybrid workMid-level Full TimeSan Francisco Bay Area R1d ago
-
Manager - Data Engineering USD 134K-150KApache Airflow | Automated testing | CRM | Campaign analytics | Clickstream401(k) retirement benefits | Casual dress code | Employee discount | Employee stock purchase program | Health care benefitsMid-level Full TimePittsburgh, PA, United States R1d ago
-
Machine Learning Engineer – Search & Retrieval Systems USD 225K-280KA/B | A/B Testing | ANN indexing | B testing | CTR401k plan | Company holidays | Equity stock options | Flexible PTO | Fully remote United StatesSenior-level Full TimeRemote - USA R1d ago
-
Data Engineer USD 150K-200KAWS | Apollo | ClickHouse | Data Pipelines | Data Warehousing401k | Dental insurance | Equity compensation | FSA | HSAMid-level Full TimeRemote - US R1d ago
-
Data Scientist III - AI & Machine Learning USD 126K-149KAI Pipelines | Airflow | Apache Spark | Bayesian Inference | Bias Variance401k matching | Equity options grant | Flexible time off | Get Out Get Active funds | Health benefitsSenior-level Full TimeMissoula, Montana, United States R1d ago
-
Director, Data Engineering, ML & AI USD 166K-215KAnomaly Detection | Apache Airflow | Apache Kafka | Apache Spark | Artificial Intelligence401k matching | Bonus potential | Flexible PTO | Flexible work hours | Fully remoteExecutive-level Full TimeRemote (United States) R1d ago