Lead Data Engineer
O'Fallon, Missouri (Main Campus), United States
R
USD 140K-231K Senior-level Full Time
Tasks
- Architect scalable ETL ELT frameworks
- Build governed reusable data products
- Define engineering standards best practices
- Design data platforms and pipelines
- Enable observability and monitoring
- Ensure security privacy regulatory compliance
- Implement data quality lineage metadata governance
- Integrate streaming data pipelines
- Lead technical design reviews
- Lead technical initiatives from strategy to execution
- Mentor and coach engineers
- Modernize cloud data lakehouse architecture
- Optimize data workloads for performance reliability scalability
Perks/Benefits
Skills/Tech-stack
AWS | Apache Airflow | Apache Spark | Automated testing | Avro | Azure | CI/CD | Cloud platform | Data Architecture | Data Governance | Data Lakehouse | Data Lineage | Data Modeling | Data Quality | Databricks | Delta Lake | DevOps | ELT | ETL | Event Streaming | Git | GitHub | Google Cloud | Google Cloud Platform | Hadoop | Infrastructure as Code | Kafka | Metadata Management | Monitoring | ORC | Observability | Parquet | Privacy | PySpark | Python | SQL | Security Compliance | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer | Senior Data Engineer
Related jobs
-
Data Platform Software Engineer USD 125K-194KCI/CD | Cloud Computing | Data Lakes | Data Modeling | Data Structures401k match | ESPP | Family leave programs | Flexible time off | Health plansEntry-level Full TimeSan Diego, CALIFORNIA, United States R4h ago
-
Data Engineer USD 150K-160KApache Iceberg | Cloud Data | Cloud Data Warehouses | Data Lakes | Data Warehouses401k | Employee assistance program | Health spending account | Life insurance | Long-term disabilityMid-level ContractSunnyvale, California, USA R5h ago
-
Apache Iceberg | Apache Spark | Avro | Concurrency | Data Ingestion401k matching | ESPP | Family leave programs | Flexible spending accounts | Flexible time awaySenior-level Full TimeSan Diego, CALIFORNIA, United States R6h ago
-
API | AWS | Automated testing | Cloud Computing | Code generation401k | Dental insurance | Discounts and perks | Fully remote | Medical insuranceSenior-level Full TimeUniversal City, CALIFORNIA, United States R7h ago
-
Lead GenAI Engineer USD 150K-170KAgile | Azure | Cloud platform | Containerization | Cybersecurity401k | Employee assistance program | Health savings account | Life insurance | Long-term disabilitySenior-level ContractMinneapolis, Minnesota, USA R8h ago
-
Software Engineer Level 2 -FFPP-8911 USD 78K-250KAccumulo | BSON | Bigtable | HBase | HDFS401k match | Bonus opportunities | Dental insurance | Diverse Inclusive Workplace Culture | Employee referral programSenior-level Full TimeHanover, MD; Information Technology; Hanover, MD; … R12h ago
-
Senior-level Full TimeRemote, USA, United States R12h ago
-
Enterprise - Software Engineer - Python, PySpark, AWS USD 185K-200KAWS Glue | AWS Lambda | Amazon DynamoDB | Amazon Web Services | PySparkBirthday off | Company events | Dental coverage | Flexible work schedule | Group life insuranceSenior-level Full TimeAnnapolis Junction, MD R12h ago
-
Agent systems | Agentic Workflows | Amazon Web Services | Azure | C#Customer site travel | Remote workSenior-level Contract Full TimeJersey City, NJ, United States R13h ago
-
Agile | Angular | Azure DevOps | CSS | Cloud DataHybrid RemoteMid-level Full TimeTampa R14h ago
-
AWS Glue | Amazon RDS | Amazon Redshift | Amazon S3 | Artificial Intelligence401k matching | Certification programs | Disability insurance | Employee resource groups | Fertility coverageEntry-level Full TimeRichmond, VA, United States R16h ago
-
Senior Full Stack & AI Engineer USD 100K-135K.NET | AI Foundry | Agile | Angular | Azure AIContinuous learning | Flexible schedule | Hybrid work modelSenior-level Full TimeMadrid, MD, Spain R18h ago
-
AWS Bedrock | AWS EC2 | AWS ECS | AWS EKS | AWS LambdaOn-site or hybrid work | Sabbaticals | Shared parental leave | Study assistance | Work-life balance initiativesSenior-level Full TimeUSA - Raleigh, NC (RDU), United … R1d ago
-
Senior Software Engineer, Decision Intelligence Platform USD 180K-225KCloud Computing | Data Modeling | Data Pipelines | Data Quality | Distributed SystemsEquity compensation | Hybrid work option | Medical benefits | Onsite collaboration daysSenior-level Full TimeSeattle, Washington United States, United States R1d ago
-
PAHO Consultant - Data, Analytics, and AI (ITS) USD 53K-53KActive Directory | Azure Active Directory | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeOff Site, United States R1d ago
-
Senior Staff Engineer – AI Engineering USD 113K-188KGit | Hugging Face | Language Models | Language Processing | Large Language ModelsAdoption Assistance | Disability benefits | Employee assistance program | Health Coach access | Life insuranceSenior-level Full TimeNiskayuna, United States R1d ago
-
Senior Marketing Data & Analytics Lead USD 202K-304KAdvertising analytics | Attribution Modeling | Business Intelligence | CRM | DashboardsHybrid work | Remote work flexibilitySenior-level Full TimeUS - SF Bay Area - … R1d ago
-
Data Quality and Solutions Lead Developer (Hybrid) USD 86K-165KChange Management | Dashboards | Data Catalog | Data Cleansing | Data Flow401k match | Adoption Assistance | Child and elder care services | Dental insurance | Disability coverageSenior-level Full TimeUS-TX-RICHARDSON-461 ~ 3200 E Renner Rd … R1d ago
-
ADA | ARINC 429 | Agile | C++ | Confluence401k matching | Counseling sessions | Dental insurance | Disability coverage | Employee assistance programMid-level Full TimeUS-PR-AGUADILLA-110 ~ Rd 110 N Km … R1d ago
-
AI / LLM Platform Engineer USD 108K-149KAPI Development | AWS | Azure | CICD | CMMC401k match | Dental insurance | Health insurance | Hybrid work option | Life insuranceMid-level Full TimeEnglewood, CO - CO RMN, United … R1d ago
-
Staff Software Engineer-AI Solutions USD 131K-210KAJAX | Agentic AI | Artificial Intelligence | Business Rules | CMDB401k | Dental insurance | FSA/HSA | Hybrid work | Life insuranceSenior-level Full TimeAshburn, VA, United States R1d ago
-
Staff Software Test Engineer, Embedded Systems USD 140K-160KAgile | Automated testing | CI/CD | Embedded Systems | GitHub Actions401k plan | Dental insurance | Disability insurance | Employee assistance program | Employee stock purchase planSenior-level Full TimeUS - Work From Home, United … R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Big Data Engineer USD 90K-110KAWS EMR | Airflow | Apache Atlas | Apache Hudi | Apache IcebergRemote workSenior-level Full TimeUnited States - Remote R1d ago
-
Hadoop Big Data Developer USD 86K-103KAWS EMR | Airflow | Apache Atlas | Apache Flink | Apache HBaseCareer growth potential | Direct W2 employment | Remote workSenior-level Full TimeUnited States - Remote R1d ago