Lead Data Engineer
Tasks
- Design data pipelines
- Develop data pipelines
- Ensure data quality, availability, and integrity
- Evaluate emerging tools and architectures
- Implement data governance and security
- Ingest transform and deliver datasets
- Integrate internal and external sources
- Maintain data pipelines
- Mentor junior engineers
- Monitor data flows
- Optimize data workflows
- Perform query tuning and optimization
- Provide technical leadership
- Troubleshoot data issues
- Write Python for data processing
- Write SQL for data processing
Perks/Benefits
- 401k match
- Commuter benefits
- FSA
- HSA
- Paid Holidays
- Paid Time Off for Community Give Back
- Paid parental leave
- Paid sick time
- Paid vacation
- Pet insurance
- Professional Certification Reimbursement
- Tuition assistance program
Skills/Tech-stack
Apache Iceberg | Automation | CI/CD | Cloud Platforms | Columnar Storage | Data Catalog | Data Governance | Data Modeling | Data Pipelines | Data Processing | Data Quality | Data Security | Data integration | Data orchestration | Delta Lake | Distributed data | Distributed data processing | ELT | ETL | Metadata Management | PII | Parquet | Performance optimization | Python | Query Tuning | SQL | Version control
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Data Engineer Associate USD 75K-85KAWS | Azure | Cloud platform | DevOps | Docker401k match | Dental insurance | Flexible spending account | Health insurance | Health savings accountEntry-level Full TimeRoseville, CA, United States11h ago
-
AI Expert USD 148K-175KAWS | Agile | Batch Processing | Data Mapping | Data ModelingHybrid work | Public Trust Clearance | Remote workSenior-level Full TimeMemphis, TN, United States R13h ago
-
Staff Machine Learning Engineer, Agentic App Platform USD 123K-216KAPI Design | Distributed Systems | Generative AI | LLM integration | Language ModelsCareer development | Health benefits | Remote work flexibilitySenior-level Full TimeMountain View, CALIFORNIA, United States13h ago
-
API Design | Debugging | Distributed Systems | Generative AI | Language ProcessingSenior-level Full TimeMountain View, CALIFORNIA, United States13h ago
-
Machine Learning Engineer, Agentic Product - Moveworks USD 116K-192KAPI Design | Data collection | Debugging | Distributed Systems | Generative AIFlexible work arrangements | Remote or in-office optionsEntry-level Full TimeMountain View, CALIFORNIA, United States13h ago
-
Software Engineer (Computer Science) USD 73K-128KAPI | Agile methodology | Algorithms | Alignment | BEDMid-level Full TimeBaltimore, MD, United States14h ago
-
AI Engineer USD 152K-200KAPI Development | Bias Mitigation | Cloud Computing | Data Pipelines | Data PreparationSenior-level Full TimeLincoln, NE, US14h ago
-
AI Agents | AWS | Alerting | Athena | Data LineageRemote workSenior-level Contract Full TimeReston, VA, United States15h ago
-
AWS Cloud | AWS Cloud Architecture | AWS Glue | AWS IAM | AWS Lambda100 percent onsite | Onsite in McLean VASenior-level ContractMc Lean, United States15h ago
-
Senior-level ContractEast Lansing, United States15h ago
-
Engineer - Technology (AI/ML) USD 60K-75KAPIs | AWS Bedrock | Adapters | Apache Airflow | Apache SparkMid-level Full TimeUS-TX-Dallas16h ago
-
Senior-level Full TimeUS-NJ-Jersey City16h ago
-
Sr . SAP Datasphere + Databricks Engineer - Hybrid USD 180K-248KAPI | Access Control | CI/CD | Data Classification | Data GovernanceHybrid workSenior-level ContractDurham or Philadelphia, United States R16h ago
-
Robotics/UAS Engineer II/III USD 89K-176KArduPilot | Autopilot systems | C++ | CAD | Embedded SystemsCareer development and training | Education assistance | Fitness reimbursement | Flexible work schedules | Paid parental leaveSenior-level Full TimeUS-Massachusetts-Wilmington17h ago
-
Data Engineer III USD 134K-161KAnalytics Cloud | Data Governance | Data Marts | Data Quality | Data Security401k | Adoption Assistance | Dental insurance | Education reimbursement | FSASenior-level Full TimeIrvine, CA17h ago
-
Sr. Data Scientist USD 113K-188KData Visualization | Machine Learning | Python | R | SQLHybrid work schedule | Mentorship opportunities | Professional development | Reasonable accommodationsSenior-level Full TimeRaleigh, North Carolina, United States17h ago
-
Databricks Data Engineering Manager USD 151K-252KBusiness Intelligence | Data Engineering | Data Governance | Databricks | MLOpsTravel up to 25 percentMid-level Full TimeArlington/Rosslyn, Virginia, United States; Sacramento, California, …17h ago
-
Checkpointing | Data-Driven Optimization | Data-driven | Distributed Training | Fault ToleranceMid-level Full TimeSan Jose, California, United States17h ago
-
Data Engineer, Product Analytics USD 184K-235KAI workflow | AI workflow automation | C# | C++ | DashboardsCareer growth | Skill developmentSenior-level Full TimeBellevue, WA | Menlo Park, CA …18h ago
-
Automation | Distributed Systems | Enterprise Architecture | Event Log analysis | Event logSenior-level Full TimeSan Jose, CA, USA; Austin, TX, …18h ago
-
Artificial Intelligence | C++ | CSS | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSunnyvale, CA, USA18h ago
-
Software Engineer, Data, Global Sustainability USD 147K-211KAlgorithms | Data Marts | Data Modeling | Data Structures | Data WarehousingMid-level Full TimeSan Francisco, CA, USA; Boulder, CO, …18h ago
-
Senior Software Engineer, Google Cloud Storage USD 174K-253KC# | C++ | Cloud Computing | Compute Technologies | Data StructuresSenior-level Full TimeNew York, NY, USA18h ago
-
Cloud Engineer/ Architect- Generative AI Integration USD 170K-190KAPIs | AWS | Access Management | Angular | Azure401-K matching | Dental insurance | Flexible spending accounts | Health insurance | Hybrid work availableSenior-level Full TimeWashington, DC, US20h ago
-
Data Engineer - Python USD 120K-160KAgile | Apache Airflow | Kubernetes | Pandas | Polars24/7 GP service | Flexible working | Healthcare cover | Mental health helpline | Regular social eventsSenior-level Full TimeNew York, NY, United States21h ago