Lead Data Engineer
Columbus, GA, United States
USD 133K-174K (estimate) Senior-level Full Time
Tasks
- Automate remediation for recurring issues
- Build monitoring and alerting for data ingestion
- Create and maintain data documentation
- Create architecture and design artifacts
- Design and implement scalable data frameworks
- Develop and maintain CI/CD pipelines for automated testing and deployment
- Develop production data pipelines and code
- Ensure data governance standards
- Implement ER models with fact and dimension tables
- Implement data quality checks and validation processes
- Lead vendor evaluation sessions
- Maintain source control practices using Git
- Provide ongoing support and enhancements
- Review debug data pipelines
- Translate business requirements into technical specifications and data models
Perks/Benefits
Skills/Tech-stack
Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure Databricks Pipelines | Azure DevOps | CI/CD | Data Aggregation | Data Governance | Data Integrity | Data Lake Storage | Data Modeling | Data Quality | Data Transformation | Databricks | Databricks Pipelines | Dimension tables | ER Modeling | Fact tables | Git | Machine Learning | Monitoring and Alerting | SQL
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Data Platform/Infrastructure Engineer USD 135K-180KAPI Gateway | AWS GovCloud | Access Control | Access Management | AirflowSecurity clearance processing supportSenior-level Full TimeFAIRFAX, VA, United States8h ago
-
AI Expert USD 148K-175KAWS | Agile | Batch Processing | Data Mapping | Data ModelingHybrid work | Public Trust Clearance | Remote workSenior-level Full TimeMemphis, TN, United States R8h ago
-
Software Engineer (Computer Science) USD 73K-128KAPI | Agile methodology | Algorithms | Alignment | BEDMid-level Full TimeBaltimore, MD, United States10h ago
-
AI Engineer USD 152K-200KAPI Development | Bias Mitigation | Cloud Computing | Data Pipelines | Data PreparationSenior-level Full TimeLincoln, NE, US10h ago
-
AWS Cloud | AWS Cloud Architecture | AWS Glue | AWS IAM | AWS Lambda100 percent onsite | Onsite in McLean VASenior-level ContractMc Lean, United States11h ago
-
Senior-level ContractEast Lansing, United States11h ago
-
Engineer - Technology (AI/ML) USD 60K-75KAPIs | AWS Bedrock | Adapters | Apache Airflow | Apache SparkMid-level Full TimeUS-TX-Dallas12h ago
-
Sr . SAP Datasphere + Databricks Engineer - Hybrid USD 180K-248KAPI | Access Control | CI/CD | Data Classification | Data GovernanceHybrid workSenior-level ContractDurham or Philadelphia, United States R12h ago
-
Data Engineer III USD 134K-161KAnalytics Cloud | Data Governance | Data Marts | Data Quality | Data Security401k | Adoption Assistance | Dental insurance | Education reimbursement | FSASenior-level Full TimeIrvine, CA12h ago
-
Sr. Data Scientist USD 113K-188KData Visualization | Machine Learning | Python | R | SQLHybrid work schedule | Mentorship opportunities | Professional development | Reasonable accommodationsSenior-level Full TimeRaleigh, North Carolina, United States12h ago
-
Databricks Data Engineering Manager USD 151K-252KBusiness Intelligence | Data Engineering | Data Governance | Databricks | MLOpsTravel up to 25 percentMid-level Full TimeArlington/Rosslyn, Virginia, United States; Sacramento, California, …12h ago
-
Data Engineer, Product Analytics USD 184K-235KAI workflow | AI workflow automation | C# | C++ | DashboardsCareer growth | Skill developmentSenior-level Full TimeBellevue, WA | Menlo Park, CA …13h ago
-
Software Engineer, Computer Vision - Video AI USD 147K-246KAV1 | AV2 | Audio/Video | Audio/video synchronization | BenchmarkingMid-level Full TimeBellevue, WA | Menlo Park, CA …13h ago
-
Software Engineer, Data, Global Sustainability USD 147K-211KAlgorithms | Data Marts | Data Modeling | Data Structures | Data WarehousingMid-level Full TimeSan Francisco, CA, USA; Boulder, CO, …14h ago
-
Cloud Engineer/ Architect- Generative AI Integration USD 170K-190KAPIs | AWS | Access Management | Angular | Azure401-K matching | Dental insurance | Flexible spending accounts | Health insurance | Hybrid work availableSenior-level Full TimeWashington, DC, US16h ago
-
Data and Analytics - AI Engineer II USD 97K-134KAI Foundry | AIOps | APIs | Azure | C#Collaborative environment | Continuous learning | Hybrid work | On site collaboration as needed | Professional growthMid-level Full TimeOmaha, NE, 68102, USA17h ago
-
Forward Deployed AI Engineer, Aviation Regulatory USD 112K-300KAirspace Tracking | Analytics | C++ | Data Pipelines | Data ProcessingSenior-level Full TimeSouth San Francisco, California, USA19h ago
-
Forward Deployed AI Engineer, Expansion USD 112K-300KAnalytics | C++ | Data Pipelines | Decision Support Systems | Decision supportDental insurance | Equity compensation | Medical insurance | Overtime pay | Paid time offSenior-level Full TimeSouth San Francisco, California, USA19h ago
-
Forward Deployed AI Engineer, Community Engagement USD 112K-300KC++ | Data Pipelines | Evaluation | Issue Tracking | JavaSenior-level Full TimeSouth San Francisco, California, USA19h ago
-
Analytics | C++ | Data Pipelines | Document Intelligence | EvaluationDental insurance | Health insurance | Paid time off | Travel up to 25% | Vision insuranceSenior-level Full TimeSouth San Francisco, California, USA19h ago
-
Analytics | C++ | Data Pipelines | Evaluation | JavaDental insurance | Health insurance | Paid time off | Travel opportunities | Vision insuranceSenior-level Full TimeSouth San Francisco, California, USA19h ago
-
Forward Deployed AI Engineer, Legal Real Estate USD 112K-300KAnalytics | Approval Routing | C++ | Contract automation | Data PipelinesDental insurance | Equity compensation | Medical insurance | Paid time off | Performance bonusesSenior-level Full TimeSouth San Francisco, California, USA19h ago
-
Forward Deployed AI Engineer, Operations USD 112K-300KAnalytics | C++ | Data Processing | Data Processing Pipelines | GenAIDental insurance | Equity compensation | Medical insurance | Overtime pay | Paid time offSenior-level Full TimeSouth San Francisco, California, USA19h ago
-
Forward Deployed AI Engineer, People USD 112K-300KAnalytics | C++ | Data Pipelines | Data Processing | GenAIDental insurance | Medical insurance | Paid time off | Travel opportunities | Vision insuranceSenior-level Full TimeSouth San Francisco, California, USA19h ago
-
Analytics | C++ | Data Pipelines | Data Processing | GeospatialDental insurance | Medical insurance | Paid time off | Travel opportunity | Vision insuranceSenior-level Full TimeSouth San Francisco, California, USA19h ago