Lead Data Engineer
Tasks
- Architect implement ETL ELT and streaming data ingestion delivery
- Collaborate with data science for generative AI RAG and LLM data layers
- Define implement data engineering standards for version control testing secure CI CD
- Design build operationalize production data engineering solutions
- Develop maintain containerize Python data applications and scripts
- Ensure schema evolution guidelines for downstream integrity
- Implement data governance security and RBAC
- Improve data ingestion architecture for quality cost performance maintainability
- Instrument platforms with metrics alerting monitoring and SLAs SLOs
- Integrate disparate production data systems for end to end data products
Perks/Benefits
- 401k match
- Adoption Assistance
- Education assistance
- Holiday pay
- Home purchase discounts
- Paid parental leave
- Paid vacation
- Personal days
- Referral bonus
- Sick leave
Skills/Tech-stack
API communication | AWS | AWS CloudTrail | AWS ECR | AWS ECS | AWS IAM | AWS Lambda | Amazon CloudWatch | Amazon EC2 | Amazon S3 | Apache Airflow | Automated testing | CI/CD | Change Data Capture | Cloud infrastructure | Containerization | DBT | Data Capture | Data Compliance | Data Governance | Data Lakes | Data Modeling | Data Observability | Data Quality | Data Sharing | Data Warehousing | Docker | ELT | ETL | Git | Incremental loading | Prefect | Python | Qlik Replicate | RBAC | REST APIs | Snowflake | Streaming Data | Time Travel | Version control | Zero copy | Zero-Copy Cloning
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R4d ago
-
Data Engineer USD 110K-178KAWS Glue | Amazon Redshift | Data Modeling | Data Quality | Data WarehousingMid-level Full TimeCenter, Center District, IL7h ago
-
GCP/Linux Data Engineer (Remote) USD 95K-170KAPIs | Agile | CI/CD | Cloud automation | Cloud platformFully remote | W2 Candidates OnlyMid-level Full TimeRochester, MN R8h ago
-
API Development | Agile | Azure | CI/CD | Data IngestionHybrid option | Onsite 4 days a week | Remote optionSenior-level Full TimeCalabasas, United States9h ago
-
A/B | A/B Testing | AI Model Deployment | AI model | App ServiceRemote workMid-level ContractHartford, United States R9h ago
-
Data and AI Solution Engineer USD 128K-214KAWS | AWS Bedrock | Agentic AI | Azure | Cloud ComputingSenior-level Full TimeUSA-VA-Herndon10h ago
-
Delivery Senior Consultant, Software Engineering Solutions, Identity & Gen AI Engineer USD 155K-265KAI Agents | AWS | Access Management | Ansible | AuthenticationHybrid work model | Onsite up to 5 days per week | Professional training and development | Travel opportunitiesSenior-level Full TimeAtlanta, Georgia, United States; Charlotte, North …10h ago
-
AI Agents | AI Risk Management Framework | Access Management | Amazon Web Services | AnsibleSenior-level Full TimeArlington/Rosslyn, Virginia, United States; Baltimore, Maryland, …10h ago
-
AWS Data Engineer - Consultant USD 93K-170KAWS Glue | AWS Lambda | Amazon S3 | Cloud Engineering | Data ArchitectureMentorship | Professional developmentMid-level Full TimeHouston, Texas, United States10h ago
-
Senior BI & Data engineer Developer USD 120K-150KAWS DMS | AWS Glue | Amazon QuickSight | Amazon Redshift | Amazon S3Senior-level Full TimeCenter, Center District, IL10h ago
-
Data Engineer, Product Analytics USD 185K-204KAI workflows | C# | C++ | Data Compliance | Data ModelingCareer growthMid-level Full TimeLos Angeles, CA | Burlingame, CA11h ago
-
Business Support Engineer USD 159K-223KAPI Development | AWS | Agent Orchestration | Azure | Bias Mitigation24 7 Oncall RotationMid-level Full TimeMenlo Park, CA11h ago
-
Business Support Engineer USD 147K-203KAPI troubleshooting | AWS | Azure | Data Analysis | Debugging24 7 Oncall RotationMid-level Full TimeMenlo Park, CA11h ago
-
Business Support Engineer USD 141K-197KAI Agents | API troubleshooting | AWS | Agent Orchestration | Azure24 7 Oncall Rotation | Cross-functional collaborationSenior-level Full TimeMenlo Park, CA11h ago
-
Software Engineer, Machine Learning RecSys USD 170K-240KAgent Orchestration | BERT | Bias Mitigation | C++ | Code ReviewsSenior-level Full TimeSunnyvale, CA11h ago
-
Senior Software Engineer, Sensor AI/ML, Watch Software USD 174K-253KC# | C++ | Data Processing | Debugging | Deep learningSenior-level Full TimeMountain View, CA, USA11h ago
-
Staff Software Engineer, Cooling Optimization USD 207K-301KC++ | Control Theory | Data Structures | Data center | Data center architectureSenior-level Full TimeSunnyvale, CA, USA11h ago
-
AI Application Engineer USD 144K-209KAI Agents | API Development | Artificial Intelligence | Data Pipelines | Data QualityBonus | Employee benefits | Equity | Health insurance | Paid time offSenior-level Full TimeAustin, TX, USA11h ago
-
Staff Software Engineer, AI/ML, Search Ads USD 207K-301KC++ | Data Processing | Data Quality | Debugging | Distributed ComputingBonuses | Comprehensive health insurance | Equity | Paid time off | Retirement planSenior-level Full TimeMountain View, CA, USA11h ago
-
Software Engineer III, Generative AI, Search Health USD 147K-211KA/B | A/B Testing | B testing | Benchmarking | Computer VisionSenior-level Full TimeMountain View, CA, USA11h ago
-
Senior Developer Relations Engineer, AI Infrastructure USD 163K-237KC++ | Deep learning | Developer Content | GPU | Google KubernetesSenior-level Full TimeSunnyvale, CA, USA; Cambridge, MA, USA11h ago
-
Retail Actuarial Data Engineer USD 85K-110KAI | Data Engineering | Data Governance | Data Modeling | Data QualityMid-level Full TimeHartford, CT, 06103, USA13h ago
-
Senior Data Engineer USD 90K-110KAgile | Amazon Web Services | Apache NiFi | Data Modeling | Data WarehousingAutonomy | Employee assistance program | Flexible working hours | Inclusive community | Online training videosSenior-level Full TimeNew York, United States R14h ago
-
Lead Data Scientist USD 140K-175KArtifactory | CI/CD | Data Analysis | Deep learning | Experimental DesignDental insurance | Health care | Paid time off | Retirement plan | Sick leaveSenior-level Full TimeSt. Louis, Missouri, US R14h ago
-
Associate Director, AI Enablement & Machine Learning USD 212K-318KCloud Computing | Data Engineering | Data Governance | Deep learning | Generative AIAnnual incentive program | Healthcare coverage | Retirement benefitsMid-level Full TimeCambridge, MA16h ago