Lead Data Engineer
USD 130K-180K (estimate) Senior-level Full Time
Tasks
- Build data models
- Create runbooks
- Define operational standards
- Develop data transformations
- Drive operational excellence
- Ensure SLAs
- Implement data testing
- Lead data engineering teams
- Maintain on call practices
- Manage Databricks Workflows
- Manage incident resolution
- Mentor engineers
- Orchestrate data jobs
- Partner with analysts and stakeholders
- Perform code review
- Perform root cause analysis
- Set technical direction
- Validate data accuracy and accessibility
Perks/Benefits
Skills/Tech-stack
Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Event | Azure Event Hubs | Data Factory | Data Governance | Data Lake Storage Gen2 | Data Lineage | Data Modeling | Data Pipelines | Data Processing | Data Quality | Databricks | Delta Lake | Distributed data | Distributed data processing | ETL | Event Hubs | Lakehouse | Medallion Architecture | Python | Query Optimization | SQL | Schema Design | Unity Catalog
Education
N/A
Roles
Data Engineer | Data Engineering | Data Engineering Manager | Engineer | Engineering Manager | Lead | Lead Data | Lead Data Engineer | Manager
Related jobs
-
Sr Technical Program Manager USD 170K-185KAWS | Agile | Azure | Cloud Data | Cloud Data PlatformsRemote work | Security clearance supportSenior-level Full TimeWork from home, VA, United States R6h ago
-
API Integration | AWS ACM | Agile | Alerting | AnsibleCross-functional workshops | Hybrid work | Professional mentorship | Remote work flexibilitySenior-level ContractPittsburgh, United States R10h ago
-
Associate Director, Biostatistics & AI USD 173K-217K21 CFR | 21 CFR Part 11 | ADaM | Adaptive Design | Annex 11401k employer match | Company provided life and disability | Comprehensive health care | Employee stock purchase program | Flex Spending AccountsMid-level Full TimeRemote - USA R22h ago
-
Senior Computational Fluid Dynamics Engineer USD 100K-190KANSYS-FLUENT | Computational Fluid Dynamics | Data Preprocessing | Data postprocessing | Fluid Dynamics401k | Bonuses | Equity | FSA | Flexible time offSenior-level Full TimeSanta Clara, CA or Remote R23h ago
-
Lead Data Scientist - GenAI USD 112K-188KAgentic AI | Azure OpenAI | Bedrock | CI/CD | Deep learningCareer development opportunities | Equal employment opportunitySenior-level Full TimeNew Jersey, United States - Remote R23h ago
-
Data Analysis | Deep learning | GenAI | Langchain | Language ModelsFreelance project-based work | Part-time hours | Project-based compensationMid-level FreelanceUnited States - Remote R23h ago
-
Freelance Machine Learning Engineer USD 180KLLMs | Langchain | MLOps | Machine Learning | NumPyFreelance engagement | Part-time project-based workMid-level FreelanceUnited States - Remote R23h ago
-
Database operations | LLMs | Langchain | MLOps | Machine LearningPaid per project | Part-time flexible schedule | Project based workMid-level FreelanceNew York, United States - Remote R23h ago
-
Langchain | Language Models | Large Language Models | MLOps | NumPyEnglish proficiency support | Flexible workload during active phases | Part-time schedule | Project based workMid-level FreelanceTexas, United States - Remote R23h ago
-
Freelance Machine Learning Engineer USD 180KLangchain | Language Models | Large Language Models | MLOps | Machine LearningFlexible weekly hours during active phases | Part-time availability | Project based workMid-level FreelanceNew York, United States - Remote R23h ago
-
Freelance Machine Learning Engineer USD 180KLangchain | MLOps | Machine Learning | NumPy | PandasProject based workMid-level FreelanceTexas, United States - Remote R23h ago
-
Senior-level Full TimeSan Jose, United States R23h ago
-
Lead Analytics Engineer (REMOTE) USD 83K-138KBigQuery | Business Intelligence | CI/CD | Cloud Data | Cloud data warehousingInclusive culture | Remote workSenior-level Full TimeCustomer Support Center, United States R23h ago
-
Data Engineer, Go To Market (Remote) USD 100K-155KAmazon Redshift | Apache Airflow | Automated Workflows | CI/CD | DBTCompetitive vacation and holidays | Comprehensive wellness programs | Employee networks | Great Place to Work certified | Paid adoption leaveMid-level Full TimeUSA CA Remote, United States R23h ago
-
Staff AI Engineer, Internal Automation USD 62K-70KAlerting | CI/CD | Docker | FastAPI | HubSpot401k match | Dental insurance | Flexible PTO | Health insurance | Paid HolidaysEntry-level Full TimeRemote (United States) R23h ago
-
Associate, Member and Provider Optimization USD 87K-114KChange Management | Data Analysis | Data Visualization | Excel | Health insurance401k plan | Annual performance bonuses | Dental insurance | Disability insurance | Health insurance benefitsMid-level Full TimeAtlanta, Georgia, United States R1d ago
-
Principal AI Engineer (Remote) USD 280K-330KAWS | Agentic loops | Anthropic API | Data Pipelines | Distributed Systems401k plan | Employee assistance program | Health benefits | Home office stipend | Paid parental leaveSenior-level Full TimeRemote - United States R1d ago
-
Lead Software Engineer - Data Platform USD 150K-175KAPIs | AWS | CI/CD | Data Governance | Data Modeling401k match | Company holidays | Dental insurance | Disability insurance | Employee assistance programSenior-level Full TimeUnited States R1d ago
-
Mid-level Full TimeAliso Viejo, CA R1d ago
-
Sr. Full Stack Engineer (Python, AWS & GenAI) USD 106K-221KAPI Design | AWS | Agentic AI | Cloud Computing | GenAISenior-level Full TimeWashington, DC R1d ago
-
Data Analytics - Associate USD 110K-150KA/B | A/B Testing | B testing | DBT | Data ModelingEmployer-Matched Retirement Plan | Paid dental vision telemedicine | Parental leave | Remote work Friday flexibility | Subsidized healthcareSenior-level Full TimeNew York, New York, United States R1d ago
-
Data Engineer USD 122K-180KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOps401k with company match | Collaborative and independent work mix | Community outreach opportunities | Company paid disability and life insurance | Comprehensive medical, dental and vision coverageMid-level Full TimeRemote-US R1d ago
-
Benefits Administration | Business Intelligence | Compensation Management | Compliance reporting | Data GovernanceInclusion and Belonging Culture | Remote work flexibility | Training and documentation supportMid-level Full TimeRemote, United States R1d ago
-
Senior Manager, Machine Learning USD 220K-330KData Analysis | Decision engine | Experimentation | Feature Store | Forecasting401k match | Dental insurance | Disability insurance | Health insurance | Life insuranceSenior-level Full TimeUnited States | Remote R1d ago
-
Director of Data Platform & Engineering USD 185K-235KAPI Integration | Access Control | Azure Data | Azure Data Factory | Azure Data LakeDental insurance | Employee assistance program | Health insurance | Mental health benefits | Paid HolidaysExecutive-level Full TimeManhattan, New York R1d ago