Lead Data Engineer
USA - NC - Durham - 10 Moore Drive, United States
USD 100K-170K (estimate) Senior-level Full Time
Tasks
- Apply ETL design patterns and development standards
- Assist data integration design for data architecture security and governance
- Assist release deployments and change management
- Build and support data pipelines for analytics and reporting
- Create and maintain technical documentation for jobs and workflows
- Design develop maintain IBM DataStage jobs and sequences
- Participate in incident response and escalation for critical batch processes
- Perform code reviews and incorporate feedback
- Perform performance tuning for partitioning job parallelism and batch window optimization
- Support production ETL environments and perform root cause analysis
- Translate business requirements into ETL solutions
- Troubleshoot ETL failures data issues and performance problems
Perks/Benefits
- 401k
- Dental insurance
- Employee stock purchase plan
- Flexible time off
- Hybrid work schedule
- Life insurance
- Medical insurance
- Paid time off
- Tuition reimbursement
- Vision insurance
Skills/Tech-stack
AWS | Azure | Batch Processing | Cloud platform | Data Warehousing | Dimensional Modeling | ETL | Google Cloud | Google Cloud Platform | IBM DataStage | MetaData Workbench | Monitoring | Parallel Edition | Partitioning | Performance Tuning | QualityStage | SQL | Shell Scripting | Unix/Linux
Regions
Countries
States
Cities
Related jobs
-
Mid-level Full TimeFAIRFAX, VA, United States6h ago
-
Deloitte Technology-US Associate GenAI Engineer USD 70K-86K.Net Core | AWS | Agile | Algorithms | AngularMid-level Full TimeHermitage, Tennessee, United States11h ago
-
Databricks Engineering Consultant USD 93K-155KAmazon Web Services | Apache Spark | Auto Loader | Cloud platform | Data ModelingMentorship | Professional development | Travel opportunitiesMid-level Full TimeArlington/Rosslyn, Virginia, United States; Sacramento, California, …11h ago
-
Consultant - Data Science / Data Lake USD 107K-188KAmazon Web Services | Apache Hadoop | Apache Kafka | Apache Spark | Apache StormEntry-level Full TimeChicago, Illinois, United States11h ago
-
Agile | Amazon Web Services | Cloud Platforms | Cloud platform | Data EngineeringMentorship | Professional development | Travel opportunitiesSenior-level Full TimeAtlanta, Georgia, United States; Charlotte, North …11h ago
-
Java Full Stack Developer-Software Engineer II USD 93K-155KAPI Design | AWS | Ansible | Benchmarking | Best practicesMid-level Full TimeDallas, Texas, United States11h ago
-
Anthropic Forward Deployed Engineer - GPS USD 97K-171KAPI Integration | AWS | Airflow | Anthropic Claude | Anthropic Claude APIMentorship | Professional development opportunities | Reasonable accommodations | Travel 50% | US government security clearance supportMid-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …11h ago
-
Lead Forward Deployed Engineer - AWS USD 189K-372KAPI Integration | AWS | Airflow | Amazon Bedrock | Bedrock AgentsMentorship | Professional developmentSenior-level Full TimeSan Jose, California, United States11h ago
-
Cloud Engineer - Project Delivery Senior Analyst USD 103K-173KAWS CloudFormation | AWS CloudWatch | AWS Lambda | Amazon EKS | Amazon Web ServicesSenior-level Full TimeDallas, Texas, United States11h ago
-
Software engineer - AI Agent Infra USD 212K-450KAI Agent | AI Agent Frameworks | API Development | Access Control | Agent FrameworksEntry-level Full TimeSan Jose, California, United States11h ago
-
API Development | AWS | CI/CD | Distributed Systems | Docker401k match | Dental insurance | Life insurance | Medical insurance | Paid time offSenior-level Full TimeNew York11h ago
-
Senior Software Engineer, Generative AI, Core ML USD 174K-252KAgentic Applications | Automated testing | Computer Vision | Data Processing | DebuggingSenior-level Full TimeMountain View, CA, USA12h ago
-
APIs | Agent systems | Cloud platform | Cost Per Request | CrewAIEmployee discounts | Health insurance | Paid time off | Retirement plansMid-level Full TimeSan Francisco, CA, USA; Atlanta, GA, …12h ago
-
Forward Deployed Engineer III, Google Cloud, Applied AI USD 174K-252KAPIs | Agent systems | Cloud platform | Conversational AI | DebuggingTravel opportunitiesSenior-level Full TimeSan Francisco, CA, USA; Atlanta, GA, …12h ago
-
Mechanical Engineer, Data Center Technology Systems USD 171K-248KASME B31 | C++ | Fire Protection | Fuel Systems | HVACSenior-level Full TimeSunnyvale, CA, USA12h ago
-
Software Engineer III, Infrastructure/Cloud Storage USD 147K-211KC++ | Cloud Computing | Code review | Debugging | Distributed SystemsSenior-level Full TimeSeattle, WA, USA12h ago
-
Forward Deployed Engineer II, Applied AI, Google Cloud USD 147K-211KAPI Integration | APIs | Agent systems | Cloud platform | Evaluation PipelinesTravel opportunitiesMid-level Full TimeSan Francisco, CA, USA; Atlanta, GA, …12h ago
-
Senior Software Engineer, BigQuery Managed Storage USD 174K-252KBigQuery | C++ | Change Data Capture | Cloud platform | Data CaptureSenior-level Full TimeKirkland, WA, USA12h ago
-
Senior Data Platform Engineer, Remote USD 135K-180KAWS | AWS Lambda | Access Control | Amazon Aurora | Amazon CloudWatchSenior-level Full TimeUnited States, UNITED STATES, United States R18h ago
-
AI Software Engineer USD 181K-270KAWS | CI/CD | Docker | Edge Functions | GitHub CopilotComprehensive benefits | Equity | Learning stipend | Remote-first cultureSenior-level Full TimeUnited States or Canada R22h ago
-
Senior-level Full TimeLos Angeles, CA22h ago
-
Machine Learning Intern USD 80K-90KAWS | Apache Hive | Apache Spark | C++ | Cloud platformFinal evaluation | Mentorship | Performance feedbackEntry-level InternshipMountain View, USA22h ago
-
AWS | Data Governance | Data Lineage | Data Modeling | Data PipelinesMid-level Full TimeHawthorne, California, USA23h ago
-
Senior Data Engineer - Remote - Multiple Levels USD 85K-141KAWS Data | AWS Data Migration | AWS Data Migration Service | AWS Lambda | Airflow401k retirement plan | Dental insurance | Health insurance | Paid Holidays | Parental leaveSenior-level Full TimeHome Office: Tysons, VA, United States R23h ago
-
Mid-level Full TimeInnovation Point, United States23h ago