Lead Data Engineer
Alpharetta, GA, United States
USD 125K-156K (estimate) Senior-level Full Time
Tasks
- Build secure ingestion pipelines
- Classify PII at landing
- Define and enforce data contracts and quality thresholds
- Design Lakehouse architecture
- Develop in bank collector pattern
- Document data lineage transformation logic and access controls
- Handle batch and SFTP ingestion
- Implement log based CDC
- Make pipelines observable and recoverable
- Manage schema drift and data quality
- Own data modeling for semantic and metric layer
- Reconcile source data
- Set up alerting for pipeline failures
Perks/Benefits
Skills/Tech-stack
Amazon S3 | Apache Airflow | Apache Iceberg | CDC | DBT | Dagster | Data Contracts | Data Governance | Data Lineage | Data Modeling | Data Quality | Data Reconciliation | Debezium | Delta Lake | DuckDB | Kafka | Lakehouse | Least Privilege | Least-privilege access | Minio | PII Classification | PostgreSQL | Presto | Privilege Access | Python | Redpanda | SQL | SQL Server | Trino
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
AC DC Sizing | AC/DC | Arc Flash | Artificial Intelligence | AutomationMultiple project extensions | Paid on time | Remote work optionSenior-level Full TimeJuno Beach, FL R5h ago
-
API Integration | AWS Bedrock | Auditing | Authentication | AuthorizationMentoring | MentorshipMid-level Full TimeMenlo Park, CA, United States6h ago
-
Senior Software Engineer (Java Full Stack) - Hybrid USD 138K-183KAgile | C plus plus | Concurrency | Data Structures | Embedded SystemsHybrid work | Remote work possibleSenior-level ContractBoston, United States8h ago
-
Lead Palantir AI and Data Science Engineer II USD 159K-265KAI workflows | Analytics | Cloud Computing | Dashboards | Data GovernanceProfessional development | Travel opportunitiesSenior-level Full TimeRosslyn, Virginia, United States9h ago
-
Analytics and Insights Engineer III USD 131K-218KApache Spark | Data Governance | Data Modeling | Data Pipelines | Data QualitySenior-level Full TimeRichmond, Virginia, United States9h ago
-
3D Rendering | A/B | A/B Testing | Agentic AI | AlgorithmsSenior-level Full TimeSan Jose, California, United States10h ago
-
Senior Software Engineer, Google Cloud Dataproc USD 174K-252KApache Hive | Apache Spark | C++ | Data Warehouse | Data Warehouse InternalsSenior-level Full TimeSunnyvale, CA, USA11h ago
-
Agentic Orchestration | C++ | Data Onboarding | Data Pipeline Engineering | Data pipelineSenior-level Full TimeSan Jose, CA, USA11h ago
-
Senior Software Engineer, AI/ML, Core USD 174K-252KC++ | Data Processing | Data Structures | Data Structures and Algorithms | DebuggingSenior-level Full TimeMountain View, CA, USA11h ago
-
Analytics Data Engineer USD 94K-130KAzure Data | Azure Data Factory | CI/CD | Data Analysis | Data FactoryRemote workMid-level Full TimeFlagstaff, AZ, US17h ago
-
AI Application & Cloud Operations Engineer (Mid level) USD 108K-117KAWS | AWS Bedrock | AWS CloudTrail | AWS CloudWatch | AWS PrivateLinkMid-level Contract Full TimePlano, TX, United States17h ago
-
Software Engineer, Applied AI USD 173K-250KABAC | Agentic Frameworks | Apache Airflow | Audit trails | BIMDental insurance | Generous PTO | Health insurance | Retirement or Pension Plan | Vision insuranceMid-level Full TimeSan Francisco, CA17h ago
-
Apple Neural Engine | C++ | CPU | Compilers | Computer ArchitectureMid-level Full TimeSeattle20h ago
-
Apple Neural Engine | C plus plus | CPU performance | Compilers | Computer ArchitectureMid-level Full TimeCupertino21h ago
-
AI Developer - Model Creation & Full Stack USD 130K-145KAWS | Aiohttp | Angular | Asyncio | Azure DatabricksRemote work | USPS Public Trust Clearance supportMid-level Full TimeWork from home, VA, United States21h ago
-
GTM Data Analytics Engineer USD 120K-150KAmplitude | DBT | Hex | Metabase | PythonHealth insurance | Startup equityMid-level Full TimeSan Francisco21h ago
-
Senior Machine Learning Engineer USD 160K-200KAWS | CI/CD | Computer Vision | Data Processing | DockerCommuter benefits | Dental insurance | Employee assistance program | Equity | Health insuranceSenior-level Full TimeArlington, VA R22h ago
-
Senior Computer Vision & Machine Learning Engineer USD 140K-206KAblation Studies | CI/CD | Data Pipelines | Docker | Error AnalysisAutonomy | Client project impact | Support for professional growthSenior-level Full TimeRemote, US R22h ago
-
Computer Vision & Machine Learning Engineer USD 150K-200KAblation Studies | CI/CD | Computer Vision | Data Pipelines | DockerEntry-level Full TimeRemote, US R22h ago
-
C# | C++ | Fine Tuning | Foundation | ICUMid-level Full TimeCupertino22h ago
-
Sr AI Engineer II - Agentic AI USD 123K-215KAWS | Agent Orchestration | Evaluation and monitoring | Event Driven | Event-driven architectureSenior-level Full TimePhoenix, AZ, United States23h ago
-
Sr Staff AI Engineer - Veza USD 190K-334KAgent Orchestration | Algorithms | C++ | Data Structures | Distributed Systems401k plan with match | ESPP | Family leave programs | Flexible time away | Health plansSenior-level Full TimeMinneapolis, Minnesota, United States R23h ago
-
AI Engineer USD 143K-210KAPI Integration | Audit trails | Authentication | CI/CD | Cost Optimization401k match | Casual work environment | Catered lunch | Comprehensive health insurance | Disability insuranceMid-level Full TimeLivingston, NJ / New York, NY …23h ago
-
AI/ML Engineer USD 152K-220K3D Reconstruction | 3D Scene | 3D Scene Understanding | AI Agents | Cloud ComputingAgile team collaboration | Fully remote | Production monitoring ownershipMid-level Full TimeSan Francisco, CA (Hybrid) or United … R23h ago
-
Data Engineer USD 150K-250KAWS | Business Intelligence | DBT | Data Governance | Data LineageGrowth opportunities | Ownership | Startup environmentMid-level Full TimeSan Francisco23h ago