Director - Data Pipeline Engineering
AT8 - 725 Ponce de Leon Ave NE, Atlanta, United States
R
USD 162K-215K (estimate) Executive-level Full Time
Tasks
- Architect and implement scalable reliable pipeline solutions
- Ensure code quality and testing standards
- Establish enforce pipeline development best practices
- Implement CI/CD procedures
- Manage mentor and grow alternative data pipeline engineering team
- Manage outsourcing contingent workers and budget oversight
- Optimize pipeline performance, reliability, and scalability
- Prioritize engineering development backlog
- Provide level 3 support for pipeline operational issues
- Research and evaluate data engineering technologies
- Transform legacy processes to enterprise data platform
- Triage complex operational and performance problems
- Troubleshoot legacy pipeline issues
Perks/Benefits
Skills/Tech-stack
AWS | Agile | Airflow | Azure | CI/CD | DBT | Data Modeling | Data Pipeline Architecture | Data pipeline | DataOps | ELT | ETL | Elasticsearch | GCP | Git | Hadoop | Kafka | Perl | Pipeline architecture | Python | Relational databases | Release Management | SQL | Snowflake | Spark
Education
Related jobs
-
Associate Director, Biostatistics & AI USD 173K-217K21 CFR | 21 CFR Part 11 | ADaM | Adaptive Design | Annex 11401k employer match | Company provided life and disability | Comprehensive health care | Employee stock purchase program | Flex Spending AccountsMid-level Full TimeRemote - USA R21h ago
-
Director, AI Engineering USD 130K-272KAI Governance | AI Services | Agentic AI | Azure AI | Azure AI ServicesCareer development | Learning opportunities | Work from anywhere remoteExecutive-level Full TimeUnited States R1d ago
-
Data Engineering Manager USD 150K-185KAccess Control | Batch Processing | CI/CD | Data Governance | Data Lineage401k match | Company funded HSA | Dental insurance | Flexible PTO | Health insuranceSenior-level Full TimeRemote (United States) R1d ago
-
Senior Engineering Manager, Enterprise AI USD 184K-213KAWS | Apache Airflow | Apache Hive | Apache Impala | Apache SparkCareer development | Employee resource groups | Flexible WFH | Generous PTO | Paid volunteer timeSenior-level Full TimeUS-Connecticut-Remote, United States R1d ago
-
Lead Data Engineer USD 130K-180KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageOn-call rotation | Remote work optionSenior-level Full TimeUnited States, United States R1d ago
-
Director, Forward Deployed AI Engineering USD 186K-233KAPIs | Access Control | Agent Development | Agent Orchestration | Auditability401k | Commuter benefits | Employee referral program | Fertility care benefits | Free testingExecutive-level Full TimeUS Remote R2d ago
-
Director of Engineering – AI/ML - CDH - Remote USD 176K-250KAI Platform | AWS | AWS SageMaker | Agile | AzureAdvancement opportunities | Comprehensive benefits plans | Continuing education | Dental insurance | FSAExecutive-level Full TimeRochester, MN, United States R2d ago
-
Agile | Apache Spark | Azure | Azure Cloud | Azure Cloud Architecture401k match | Dental insurance | Health insurance | Health savings account | Life insuranceSenior-level Full TimeNashville, Tennessee, United States R2d ago
-
Director, Data Analytics & Business Intelligence USD 180K-231KAI machine learning | BI | DBT | Dashboarding | Data GovernanceExecutive-level Full TimeUnited States - Remote R2d ago
-
Engineering Manager, Fulfillment USD 130K-218KContinuous integration | DevOps | Elasticsearch | Go | GraphQLAnnual bonus | Equity grants | Health and wellness benefitsMid-level Full TimeRemote, USA R2d ago
-
Azure Data | Azure Data Factory | Azure DevOps | CI/CD | Data FactorySenior-level Full TimeUS - Remote, United States R2d ago
-
Data Engineering Analyst Lead/Scientist - Remote USD 90K-150KAWS | Data Compliance | Data Engineering | Data Privacy | PythonSenior-level Full TimeUnited States, UNITED STATES, United States R3d ago
-
AI tools | Automation | C++ | Cloud Computing | ETLCollaborative work environment | Flexible working hours | Health and wellness benefits | Professional development | Remote workMid-level Full TimeMinnesota R3d ago
-
Automation | C plus plus | C++ | Cloud infrastructure | ETLCollaborative inclusive work environment | Flexible working hours | Health and wellness benefits | Professional development training | Remote workMid-level Full TimeIllinois R3d ago
-
Automation | Cloud infrastructure | ETL | Golang | Incident ResponseCollaborative inclusive work environment | Flexible working hours | Fully remote work | Health and wellness benefits | Professional development and trainingMid-level Full TimeFlorida R3d ago
-
ABAC | AWS | Audit Logging | Azure | CI/CDSenior-level Full TimeChicago - 550 Van Buren, United … R3d ago
-
Senior Manager - AI Engineering USD 159K-207KAI Foundry | Agent workflows | Agentic AI | Artificial Intelligence | AzureSenior-level Full TimeRemote - PA, United States R3d ago
-
Principal Data Engineer USD 152K-190KApache Spark | Artificial Intelligence | CI/CD | Cloud Platforms | Code Coverage401k company match | Dental insurance | Flexible paid time off | Life insurance | Long-term disabilitySenior-level Full TimeDallas, TX - Hybrid (3x in … R4d ago
-
Director, Finance Analytics & Reporting USD 160K-213KAccess Management | Analytics | Business Intelligence | Change Management | Data Modeling401k matching | Dental insurance | Employee stock purchase program | Flexible time off | Health insuranceExecutive-level Full TimeUSA Remote, United States R4d ago
-
Senior-level Full TimeBethesda, MD R4d ago
-
Director, Analytics & Insights - Programmatic USD 120K-130KAnalytics testing | Data Visualization | Excel | PowerPoint | Presentation storytellingDental insurance | Employee discounts | Employee equity | Health insurance | Pet insuranceExecutive-level Full TimeRemote - Fort Lauderdale, FL R6d ago
-
Engineering Manager, Machine Learning USD 145K-180KData Pipelines | Data Science | Experimentation | Geospatial Data | Machine LearningCoworking stipend | Education budget | Flexible schedule | Home office stipend | Remote workMid-level Full TimeRemote: United States | Canada | … R7d ago
-
Director, B2B Data Strategy & Revenue Analytics USD 140K-160K6sense | Attribution | CRM Data Sync | CRM data | Campaign Taxonomy401k matching | Extended holiday break | Flexible schedules | Life insurance | Medical/Dental/Vision insuranceExecutive-level Full TimeRemote, United States R7d ago
-
Manager, Data Engineering - Hybrid Schedule USD 75K-94KAWS | Agile | Apache Airflow | CI/CD | Data Architecture401k match | Company holidays | Discounts with preferred vendors | Employee assistance program | FSAMid-level Full TimeCharlotte, NC, US R7d ago
-
Senior-level Full TimeUnited States - Remote R7d ago