Data Engineer, AWS Glue
Tasks
- Apply development and promotion procedures across Dev QA and Production
- Build ETL jobs with AWS Glue
- Design S3 landing and raw zone layouts
- Design ingestion pipelines
- Embed data quality controls in pipelines
- Implement full incremental and CDC loads
- Maintain data lake medallion architecture layers
- Move relational file API and streaming data to Amazon S3
- Orchestrate multi step workflows with Glue Workflows Step Functions and EventBridge
- Register and maintain datasets in Glue Data Catalog
- Support production pipelines with incident analysis and backfills
- Tune job performance and reduce processing cost
Perks/Benefits
Skills/Tech-stack
AWS Glue | AWS Glue Data Catalog | AWS Lake | AWS Lake Formation | AWS Step Functions | Amazon Athena | Amazon DMS | Amazon EventBridge | Amazon Redshift | Amazon S3 | Apache Spark | CDC | Data Catalog | Data Partitioning | Data Quality | Data Reconciliation | ETL | Glue Data Catalog | Lake Formation | PySpark | Python | SQL | Step Functions
Education
N/A
Roles
Related jobs
-
Automation | C# | C++ | CPU Utilization | Capacity PlanningDevelopment workshops | Hands-on learning opportunities | Industry exposure | Mentorship | Social eventsEntry-level InternshipSan Jose, California, United States3h ago
-
Machine Learning Engineer Graduate (E-Commerce Supply Chain & Logistics - LLM/Agent) - 2027 Start (PhD) USD 137K-246KAgents | Benchmarking | C++ | Deep learning | EvaluationEntry-level Full TimeSan Jose, California, United States3h ago
-
Machine Learning Engineer Graduate (E-Commerce Supply Chain & Logistics - LLM/Agent) - 2027 Start (PhD) USD 137K-246KAI Feedback | Agents | Benchmarking | C++ | DPOEntry-level Full TimeSeattle, Washington, United States3h ago
-
Agent evaluation | Classification | Clustering | Data Mining | Deep learningEntry-level Full TimeSeattle, Washington, United States3h ago
-
Apache Flink | Apache Hive | Apache Spark | Batch Processing | C++Entry-level Full TimeSan Jose, California, United States3h ago
-
Classification | Clustering | Data Mining | Deep learning | E-commerceEntry-level Full TimeSan Jose, California, United States3h ago
-
AI Workflow Orchestration | AI workflow | CD pipeline | CI Pipeline | CI/CDMid-level Full TimeSeattle, Washington, United States3h ago
-
Machine Learning Engineer (Technical Leadership) USD 213K-251KAB Testing | C plus plus | Data Mining | Data Pipelines | Deep learningSenior-level Full TimeMenlo Park, CA | New York, …3h ago
-
Software Developer, Scaled Ops AI Acceleration Team USD 170K-209KAgent Orchestration | Artificial Intelligence | Backend Development | Bug tracking | ComplianceSenior-level Full TimeAustin, TX | Menlo Park, CA …3h ago
-
Research Engineer, Machine Perception (Project Aria) USD 141K-208K3D Computer Vision | C++ | Computer Vision | Data Pipelines | Deep learningOnsite work | Work authorization supportMid-level Full TimeRedmond, WA3h ago
-
Software Engineer, Managed Service for Apache Spark USD 147K-210KApache Hadoop | Apache Spark | Apache YARN | BigQuery | Cloud platformMid-level Full TimeKirkland, WA, USA4h ago
-
Algorithms | Android | Android AppCompat | C# | C++Mid-level Full TimeWaterloo, ON, Canada; San Jose, CA, …4h ago
-
Staff Software Engineer, Applied AI, Model Quality USD 207K-300KData Processing | Data Storage | Data Structures | Data Structures and Algorithms | DebuggingSenior-level Full TimeNew York, NY, USA4h ago
-
Software Engineer III, AI/ML GenAI, Search USD 147K-210KC++ | Data Processing | Debugging | Information Retrieval | LLMSenior-level Full TimeNew York, NY, USA4h ago
-
C++ | Cloud Computing | Data Processing | Debugging | Distributed ComputingSenior-level Full TimeMountain View, CA, USA4h ago
-
Application Modernization | C++ | Cloud Architecture | Conversational AI | Document AITravel opportunitiesMid-level Full TimeSão Paulo, State of São Paulo, …4h ago
-
AI Inference | Benchmarking | C++ | Collective communication | Distributed SystemsSenior-level Full TimeMountain View, CA, USA4h ago
-
Customer Engineer III, Data Analytics, Google Cloud USD 152K-221KApache Spark | Architecture Design | Batch Processing | Big Data | Cloud NativeEquity compensation | Health insurance | Paid time off | Retirement benefitsSenior-level Full TimeNew York, NY, USA; Chicago, IL, …4h ago
-
Staff Software Engineer, Pixel Storage Architecture USD 207K-300KAOSP | Android | Block layer | DDR initialization | DRAMSenior-level Full TimeMountain View, CA, USA4h ago
-
Sr Data Engineer_ITDE1I USD 102K-170KAPI Integration | AWS | Automation | Azure | CI/CD401k match | Dental insurance | Disability insurance | Hybrid work policy | Life insuranceSenior-level Full TimeHOUSTON, US, 77056 R6h ago
-
Sr. Automation Engineer Robotics Software USD 115K-144KAutomation | Computer Vision | Databases | FastAPI | HMIDental insurance | Health insurance | Paid time off | Retirement plan | Sick leaveSenior-level Full TimeAnkeny, Iowa, US R6h ago
-
Machine Learning Engineer, Memory BRL 179K-209KAgile | Foundation Models | Language Processing | Machine Learning | Natural LanguageCommuter benefits | Dental insurance | Life insurance | Meal vouchers | Medical insuranceMid-level Full TimePorto Alegre,Rio Grande do Sul,Brazil9h ago
-
Machine Learning Programmer, Memory CAD 122K-175KContext modeling | Foundation Models | Information Retrieval | Language Processing | Long ContextCritical illness insurance | Dental insurance | Employee assistance program | Health insurance | Life and accidental death and dismemberment insuranceMid-level Full TimeMontreal,Quebec,Canada9h ago
-
Machine Learning Engineer, Memory USD 125K-194KAgile | Computer Vision | Foundation Models | Horizon Modeling | Language Processing401k match | Coaching | Dental insurance | Life insurance | Long-term disabilityMid-level Full TimeCary,North Carolina,United States9h ago
-
A/AI Machine Learning Engineering Stf - E4 USD 135K-251KAI | AI RMF | Adversarial Machine Learning | Automation Testing | C#401k match | Dental insurance | EAP | Education assistance | Employee assistance programSenior-level Full TimeShelton, CT, US10h ago