Lead Data Engineer
Tasks
- Alert on data issues
- Build data pipelines
- Conduct code reviews
- Create reusable patterns
- Design data models
- Design data solutions
- Gather requirements
- Handle data ingestion and transformation
- Implement CDC
- Maintain project documentation
- Monitor data quality
- Monitor pipeline operations
- Optimize queries
- Orchestrate data workflows
- Perform incremental loads
- Provide technical mentorship
- Troubleshoot production workloads
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache Airflow | CDC | Cloud platform | Cron | Data Engineering | Data Modeling | Data Quality | Data Warehousing | Data pipeline | Data pipeline orchestration | Data quality monitoring | Databricks | Dimensional Modeling | ELT | ETL | Google Cloud | Google Cloud Platform | HBase | Hadoop | Hive | Lakehouse | Medallion Architecture | Microsoft Azure | Performance Tuning | Pig | Pipeline Orchestration | Power BI | PySpark | Python | Quality monitoring | Query Optimization | SQL | Spark | Tableau
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Data Engineer | Data Engineering | Data Engineering Manager | Engineer | Engineering Manager | Lead | Lead Data | Lead Data Engineer | Manager
Related jobs
-
Staff Data Platform Software Engineer, Graph — Veza USD 176K-308KAWS | Azure | Caching | Cloud platform | Data Management401k match | ESPP | Family leave programs | Flexible time away | Health plansSenior-level Full TimeSanta Clara, CALIFORNIA, United States9h ago
-
Analytics Engineer USD 147K-225KApache Airflow | BigQuery | DBT | Data Modeling | Data Visualization401k | Comprehensive benefits | Equity | Flexible time offSenior-level Full TimeUS Remote, Los Angeles, CA; San … R11h ago
-
Staff Software Engineer, AI/ML USD 186K-233KApache Iceberg | Capacity Planning | Cloud services | Competitive Analysis | Data ArchitectureConference reimbursement | Education reimbursement | Employee assistance program | Employee stock purchase program | Flexible time offSenior-level Full TimeSeattle12h ago
-
Autonomy | C++ | CPU GPU | CPU GPU Debugging | Critical Systems401k | Health insurance | Paid Company Holidays | Paid time off | Phone stipendSenior-level Full TimeSan Carlos - Hybrid R13h ago
-
Autonomy | C++ | Data Ingestion | Data Ingestion Pipelines | Deployment401k | Health insurance | Paid Holidays | Paid time off | Phone stipendMid-level Full TimeSan Carlos - Hybrid R13h ago
-
Agent Orchestration | Airflow | Argo Workflows | Artifact versioning | Autonomous workflowsRemote work flexibilitySenior-level Full TimeRemote - United States R13h ago
-
Senior Databricks Engineer USD 180K-247KAWS | Autoscaling | Azure | CI/CD | CachingVisa sponsorshipSenior-level Full TimeCanada R14h ago
-
Product Manager - Data & Analytics USD 110K-145KAgile | Amazon Web Services | Cloud Computing | Cloud platform | Data Architecture401k | Dental insurance | Discounts | Medical insurance | Paid leaveMid-level Full TimeUniversal City, CALIFORNIA, United States R14h ago
-
Staff Applied Scientist USD 244K-320KAgentic Systems | Artificial Intelligence | Benchmarking | CI/CD | Computer VisionEmployee communities | Experience bonus | Hybrid work model | Wellness reimbursementSenior-level Full TimeSeattle, Washington, United States14h ago
-
Senior-level Full TimeCanada R14h ago
-
Capacity Analysis | Cloud Computing | Continuous Improvement | Data Visualization | Data Warehousing401k | Dental insurance | Discounts | Health insurance | Paid leaveMid-level Full TimeUniversal City, CALIFORNIA, United States14h ago
-
AI Research Engineer USD 190K-280KDeep learning | Generative AI | Language Models | Language Processing | Large Language ModelsCareer development | Diversity and inclusion | Flexible work environmentMid-level Full TimeSeattle, Washington, United States; South San …15h ago
-
Sr. AI Engineer (Applied AI & ML Systems) USD 132K-165KAgentic AI | Context engineering | Continuous Improvement | Data Engineering | Data PipelinesE learning license | Hackathons | Healthcare benefits | Home office setup allowance | Identity theft protectionSenior-level Full TimeUnited States R15h ago
-
Machine Learning Engineer USD 159K-216KC++ | Computer Vision | ITK | Image analytics | Image registrationEntry-level Full TimeSunnyvale, CA, United States16h ago
-
Data Engineer USD 95K-140KApache Spark | Automated testing | Azure Databricks | CI/CD | Data ModelingMid-level Full TimeUS Remote R16h ago
-
Senior Applied AI Engineer CAD 144K-165KAI SDK | AWS ECS | AWS ECS Fargate | AWS Key Management Service | AWS LambdaSenior-level Full TimeCanada16h ago
-
Analytics Engineer USD 150K-190KDBT | Data Governance | Data Modeling | Data Monitoring | Data Pipelines401k | Catered lunches | Dental insurance | Equity | Free coffee snacksMid-level Full TimeNYC Office17h ago
-
Manager, Analytics USD 85K-100KAmazon Ads | Attribution | Business Intelligence | DV360 | ExcelCaregiver parental leave | Employer-sponsored 401k match | Health and wellness benefits | Medical, dental, and vision coverage | Unlimited PTOMid-level Full TimeUnited States- Los Angeles, CA17h ago
-
Sr. Software Engineer - Analytics USD 160K-215KAPI Design | Computational Linguistics | Data Modeling | Elasticsearch | Java401k match | Dental insurance | Disability insurance | Health insurance | Life insuranceSenior-level Full TimeSomerville, MA17h ago
-
Bioinformatics Engineer USD 125K-150KBAM | BED | BWA | Batch | Bismark401k match | Dependent care assistance | Educational benefits | Employee referral bonus | Flexible spending accountMid-level Full TimeRockville, MD17h ago
-
A/B | A/B Testing | AWS | Airflow | Amazon Redshift401k matching | Employee assistance program | Flexible time off | Flexible work arrangement | Paid HolidaysMid-level Full TimeRemote, US R18h ago
-
Senior Manager, Marketing Analytics & Operations USD 145K-155KA/B | A/B Testing | Ad Spend | Ads API | Airbyte11 paid holidays | 401(k) plan match | Employee assistance program | Employee discounts | Employee ownership programSenior-level Full TimeRemote United States R18h ago
-
Data Scientist I (Prescriptive AI) USD 99K-135KCPLEX | DB2 | Data Warehousing | Discrete Event Simulation | Discrete eventCross training | Onsite Work Authorization SupportMid-level Full TimeLittle Rock, AR18h ago
-
Practice Manager - AI & Data USD 160K-190KAWS | Agent systems | Amazon SageMaker | Apache Spark | AzureCareer growth opportunities | Comprehensive benefits | MentorshipSenior-level Full TimeBroomfield, CO. Greensboro, NC. Troy, Michigan19h ago
-
Software Engineer - Medical Applications & Algorithms USD 130K-150KAWS CodeBuild | AWS CodePipeline | Agile | Amazon Web Services | C++Cross-functional team collaboration | Hybrid work environment | Medical device industry domainMid-level Full TimeSan Francisco, California, United States19h ago