Senior Data Engineer
100 New Millennium Way, Bldg 1, Durham NC, United States
USD 107K-185K (estimate) Senior-level Full Time
Tasks
- Automate data processing with Unix shell scripts
- Build modernize maintain data solutions
- Collaborate with cross-functional teams
- Design, develop, & maintain data pipelines
- Develop and optimize ETL processes
- Document data engineering processes
- Ensure data quality, integrity, and security
- Implement CI/CD pipelines
- Implement data integration solutions
- Schedule and execute ETL jobs with AWS Batch
- Troubleshoot data pipeline issues
Perks/Benefits
Skills/Tech-stack
AWS Batch | AWS EC2 | AWS EMR | AWS S3 | Apache Hadoop | Apache Spark | Artifactory | CI/CD | Data Architecture | Data Governance | Data Modeling | Data Quality | Data Warehousing | ETL | Git | Informatica | Jenkins | Oracle | Power BI | Python | SQL | Shell Scripting | Snowflake | Tableau | Unix
Education
N/A
Roles
Regions
Countries
States
Cities
Related jobs
-
Data Engineer- Consumer/Small Business USD 76K-125KAWS | AWS EC2 | AWS Glue | Adobe Analytics | Amazon AthenaMid-level Full TimeMiami Lakes, FL, United States4h ago
-
Lead CyberSecurity Engineer USD 119K-258KAlation | BigID | Cloud apps | Data Classification | Data GovernanceHybrid work | In-person collaboration | Work-life balanceSenior-level Full TimeAlpharetta, GA, United States4h ago
-
Senior Data Engineer USD 119K-180KANSI SQL | AWS S3 | Amazon Redshift | Azure Container | Azure Container AppsSenior-level Full TimeOrlando, FL, United States4h ago
-
API Integration | Asynchronous processing | Containerization | Data Pipelines | Deep learningSenior-level ContractAnnapolis, United States R7h ago
-
Data Engineer, Analytics USD 205K-235KData Governance | Data Modeling | Data Quality | Data Security | Data VisualizationSenior-level Full TimeBellevue, WA9h ago
-
AI Agents | C++ | Data Structures | Data Structures and Algorithms | Generative AISenior-level Full TimeNew York, NY, USA9h ago
-
ML Engineer, Query Understanding, Search Ads USD 174K-252KC++ | Data Processing | Data Storage | Debugging | Deep learningMid-level Full TimeMountain View, CA, USA9h ago
-
Customer Engineer, Data Analytics, Financial Services USD 153K-222KApache Spark | Batch Processing | Big Data | Cloud Computing | Cloud platformSenior-level Full TimeNew York, NY, USA; Atlanta, GA, …9h ago
-
BigQuery | Cloud platform | Data Processing | Deep learning | Distributed SystemsMid-level Full TimeKirkland, WA, USA9h ago
-
Software Engineer III, AI/ML, Google Play USD 147K-211KC++ | Data Processing | Data Structures | Data Structures and Algorithms | DebuggingSenior-level Full TimeMountain View, CA, USA9h ago
-
Senior Software Engineer, AI/ML, Payments Platform USD 174K-252KC++ | Data Processing | Data Structures | Data Structures and Algorithms | DebuggingSenior-level Full TimeMountain View, CA, USA9h ago
-
Staff Software Engineer, AI/ML Machine Repairs USD 207K-300KArtificial Intelligence | C++ | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSunnyvale, CA, USA9h ago
-
Senior ML/AI Software Engineer, Chrome AI USD 174K-252KAgent Orchestration | Algorithms | Automated testing | C++ | Computer VisionSenior-level Full TimeMountain View, CA, USA9h ago
-
Staff Software Engineer, AI/ML, Agent Assist USD 207K-300KAgentic AI | Cloud Computing | Data Processing | Debugging | Deep learningSenior-level Full TimeSunnyvale, CA, USA9h ago
-
Mid-level Full TimeIndianapolis, IN, 46254, USA11h ago
-
Sr. Data Engineer USD 131K-164KAgentic AI | DBT | Data Governance | Data Quality | Data SecurityConvenient location | Group insurance | Hospitalization insurance | Meal vouchers | Open company cultureSenior-level Full TimeUnited States, FL, US, 56007614h ago
-
Embedded Systems Engineer USD 100K-200KC# | C++ | CAN | Circuit design | Debugging Tools401k | Dental insurance | Disability insurance | Employee stock ownership plan | Employer paid medical insuranceSenior-level Full TimeGoleta, CA, US15h ago
-
Senior AI Engineer USD 170K-200KAWS | Agentic Workflows | Airflow | Data Pipelines | Data TransformationOnsite collaborationSenior-level Full TimeSeattle, Washington, United States18h ago
-
Senior AI Engineer USD 170K-200KAWS | Airflow | Anthropic | Datadog | EmbeddingsOnsite 4 days per weekSenior-level Full TimeLos Angeles, California, United States18h ago
-
Senior AI Engineer USD 170K-200KAWS | Agentic Workflows | Airflow | Anthropic | Data Pipelines401k plan | Bonus plans | Disability coverage | Healthcare benefits | Life insuranceSenior-level Full TimeNew York, New York, United States18h ago
-
Machine Learning Engineer, API Multicloud USD 295K-445KAWS | Data Pipelines | Data Structures | Data structures algorithms | Deep learningSenior-level Full TimeSan Francisco19h ago
-
Agentic AI | Agile | Cloud Computing | Container Orchestration | Distributed SystemsSenior-level Full TimeUnited States19h ago
-
Tech Lead, Robotic AI Model USD 150K-180KAction Chunking | Action Tokenization | Behavior Cloning | DPO | DeepSpeedSenior-level Full TimeEl Segundo, California, United States19h ago
-
ML Engineer, Post-Training and Evaluation USD 175K-270KData Pipelines | Data Quality | Data quality analysis | Dataset Preparation | Evaluation methodologyDental insurance | Disability insurance | Health insurance | Life insurance | Paid time offMid-level Full TimeSan Francisco21h ago
-
Cloud Data Engineer USD 75K-135KAPI Gateway | AWS | AWS Glue | Amazon EC2 | Amazon EKS401k | Life insurance | Medical, dental, and vision | Paid leaveMid-level Full TimeBuilding 400-Whippany Campus, Jefferson Park, United …21h ago