Lead Data Engineer
Columbus, GA, United States
USD 133K-174K (estimate) Senior-level Full Time
Tasks
- Automate remediation for recurring issues
- Build monitoring and alerting for data ingestion
- Create and maintain data documentation
- Create architecture and design artifacts
- Design and implement scalable data frameworks
- Develop and maintain CI/CD pipelines for automated testing and deployment
- Develop production data pipelines and code
- Ensure data governance standards
- Implement ER models with fact and dimension tables
- Implement data quality checks and validation processes
- Lead vendor evaluation sessions
- Maintain source control practices using Git
- Provide ongoing support and enhancements
- Review debug data pipelines
- Translate business requirements into technical specifications and data models
Perks/Benefits
Skills/Tech-stack
Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure Databricks Pipelines | Azure DevOps | CI/CD | Data Aggregation | Data Governance | Data Integrity | Data Lake Storage | Data Modeling | Data Quality | Data Transformation | Databricks | Databricks Pipelines | Dimension tables | ER Modeling | Fact tables | Git | Machine Learning | Monitoring and Alerting | SQL
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Data Visualization Engineer USD 130K-140KAWS | Agile | Amazon QuickSight | Azure | DAXPublic trust clearance support | Remote workMid-level Full TimeWork from home, VA, United States R10h ago
-
Customer Analytics | Customer decisioning | Data Engineering | Data Modeling | Data Standardization401k | Accident insurance | Dental insurance | Disability insurance | Health insuranceSenior-level ContractVienna, United States13h ago
-
Senior Insurance Data Science Consultant USD 180K-204KActuarial modeling | Data Validation | Decisioning Platforms | Insurance analytics | Machine LearningSenior-level Full TimeBoston, MA, US13h ago
-
AI Architect USD 130K-230KAgentic AI | Amazon Web Services | Azure | Bagging | CI/CDMentorship opportunities | Remote work environmentSenior-level Full TimeUnited States13h ago
-
SYSTEM ENGINEER - AI/ML - 15+ yrs of Experience - TS/SCI w/Poly clearance is required - ES A USD 205K-211KAgile Development | Artificial Intelligence | Confluence | Jira | Language Models401k retirement plan | Dental plan | Life insurance | Medical insurance | Paid time offMid-level Full TimeFort George G Meade, United States13h ago
-
Machine Learning Engineer Graduate (TikTok-Data-Search-Basic Ranking) - 2026 Start (BS/MS) USD 116K-177KComputer Vision | Deep learning | Language Models | Language Processing | Large Language ModelsEntry-level Full TimeSan Jose, California, United States15h ago
-
Behavior Modeling | CTR Prediction | CVR Prediction | Information Retrieval | Machine LearningSenior-level Full TimeSeattle, Washington, United States15h ago
-
Machine Learning Engineer, Search - Local Services Team USD 194K-355KClick Through Rate | Click Through Rate Prediction | Conversion Rate | Conversion Rate Prediction | Feature EngineeringEntry-level Full TimeSeattle, Washington, United States15h ago
-
Senior Software Engineer, ML Infrastructure, Core Infra USD 174K-252KC++ | Data Processing | Data Storage | Debugging | Distributed ComputingSenior-level Full TimeSunnyvale, CA, USA16h ago
-
Artificial Intelligence | Data Analysis | Experimentation | Information Retrieval | Language ModelsSenior-level Full TimeMountain View, CA, USA16h ago
-
Technical Lead Manager, ML and GenAI, Ads Safety USD 207K-300KData Processing | Distributed Computing | Embedding | Generative AI | Information RetrievalSenior-level Full TimeMountain View, CA, USA; New York, …16h ago
-
Senior Software Engineer, AI/ML, Youtube Ads USD 174K-252KData Processing | Data Storage | Data Structures | Data Structures and Algorithms | DebuggingSenior-level Full TimeMountain View, CA, USA16h ago
-
Automated Monitoring | C++ | Cloud platform | Dashboards | Data ModelingEntry-level Full TimeSunnyvale, CA, USA16h ago
-
Senior Staff Software Engineer, Applied AI USD 262K-365KAlgorithms | Artificial Intelligence | Data Processing | Data Structures | Distributed ComputingSenior-level Full TimeMountain View, CA, USA16h ago
-
Data Engineer, AI Solutions, Global Affairs USD 130K-187KData Modeling | Data Pipelines | ETL | LLM APIs | PythonMid-level Full TimeNew York, NY, USA; Chicago, IL, …16h ago
-
ATA | C# | C++ | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSunnyvale, CA, USA16h ago
-
AI Research Engineer – Agentic AI USD 165K-180KAblation Studies | Agentic AI | Edge Computing | Evaluation | Experiment design401k matching | Health coverage | Paid time off | Parental leaveMid-level Full TimeSunnyvale, CA, United States21h ago
-
Senior Staff Machine Learning Engineer, Infrastructure USD 248K-310KA/B | A/B Testing | Agentic AI | Apache Airflow | Apache KafkaDisability accommodation support | Employee travel credits | Inclusion focused hiring | Remote eligibleSenior-level Full TimeUnited States21h ago
-
Software Engineer, Robotics & Autonomous Systems USD 180K-225K3D data | 3D data processing | AWS | Airflow | C++Commuter stipend | Comprehensive health, dental and vision coverage | Generous PTO | Learning and development stipend | Retirement benefitsMid-level Full TimeSan Francisco, CA23h ago
-
Senior Software Engineer (AI/ML) USD 150K-222KAPI Gateway | API Management | Cloud Native | Containers | Data Warehousing401k match | Dental insurance | Federal Holidays | Flexible PTO | Flexible spending accountSenior-level Full TimePatrick SFB, FL1d ago
-
Anomaly Detection | Automated testing | Benchmarking | Computer Vision | Data Preparation401k | Education reimbursement program | Flexible schedules | Hybrid schedule | Relocation assistanceSenior-level Full TimeLivermore, CA, United States R1d ago
-
Senior Data Analyst USD 150K-175KAWS S3 | Amazon Athena | Amazon Aurora | Anomaly Detection | CTEDental insurance | Flexible PTO | Health insurance | Professional development budget | Vision insuranceSenior-level Full TimeUnited States1d ago
-
Senior Data Engineer USD 150K-175KAWS Glue | Airflow | Amazon Athena | Amazon Redshift | Amazon S3Continuing education support | Dental insurance | Flexible PTO | Health insurance | Professional development budgetSenior-level Full TimeUnited States1d ago
-
Design Optimization Engineer - Postdoctoral Researcher USD 122K-143KAdjoint method | C# | C++ | CUDA | Data Science401k | Education reimbursement program | Flexible schedule | Hybrid work schedule | Relocation assistanceEntry-level Full TimeLivermore, CA, United States R1d ago
-
Full Stack AI Software Engineer USD 216K-283KAPI contracts | AWS | Azure | Classification | Data PipelinesAdoption leave | Commuter benefits | Dental insurance | Disability insurance | ESPPExecutive-level Full TimeSan Mateo, CA, United States1d ago