Data Engineer, AWS Glue
Tasks
- Apply development and promotion procedures across Dev QA and Production
- Build ETL jobs with AWS Glue
- Design S3 landing and raw zone layouts
- Design ingestion pipelines
- Embed data quality controls in pipelines
- Implement full incremental and CDC loads
- Maintain data lake medallion architecture layers
- Move relational file API and streaming data to Amazon S3
- Orchestrate multi step workflows with Glue Workflows Step Functions and EventBridge
- Register and maintain datasets in Glue Data Catalog
- Support production pipelines with incident analysis and backfills
- Tune job performance and reduce processing cost
Perks/Benefits
Skills/Tech-stack
AWS Glue | AWS Glue Data Catalog | AWS Lake | AWS Lake Formation | AWS Step Functions | Amazon Athena | Amazon DMS | Amazon EventBridge | Amazon Redshift | Amazon S3 | Apache Spark | CDC | Data Catalog | Data Partitioning | Data Quality | Data Reconciliation | ETL | Glue Data Catalog | Lake Formation | PySpark | Python | SQL | Step Functions
Education
N/A
Roles
Related jobs
-
Senior AI Engineer ID80138 BRL 319K-412KAnthropic | CI/CD | DNS | Firewalls | GitAnnual learning budget | Flexible hours | Mentorship | Performance reviews | Remote workSenior-level Full TimeSão Bernardo do Campo, Brazil2h ago
-
Senior AI Engineer ID80138 BRL 319K-412KAnthropic | CI/CD | DNS | Git | GrafanaFlexible hours | Learning budget | Mentorship | Remote work | Well-being programsSenior-level Full TimeRio de Janeiro, Brazil2h ago
-
Senior AI Engineer ID80138 BRL 319K-412KAnthropic | Automated testing | CI/CD | DNS | FirewallCollaborative culture | Flexible hours | Learning budget | Mentorship | People focused supportSenior-level Full TimeSorocaba, Brazil2h ago
-
Senior AI Engineer ID80138 BRL 319K-412KAnthropic | Automated testing | CI/CD | DNS | GitAnnual learning budget | Flexible hours | Mentorship | Remote work | Support programsSenior-level Full TimeBelo Horizonte, Brazil2h ago
-
Senior AI Engineer ID80138 BRL 319K-412KAnthropic | Automated testing | CI/CD | DNS | FirewallFlexible hours | Learning budget | Mentorship | Remote work | Support programsSenior-level Full TimeSão Paulo, Brazil2h ago
-
Senior AI Engineer ID80138 USD 172K-270KAnthropic | Automated testing | CD pipelines | CI/CD | CI/CD pipelinesCollaborative culture | Flexible hours | Internal tech talks | Learning budget | MentorshipSenior-level Full TimeMAR DEL PLATA, Argentina2h ago
-
Senior AI Engineer ID80138 BRL 319K-412KAnthropic | Automated testing | CI/CD | DNS | FirewallsAnnual TechTalks | Flexible hours | Learning budget | Mentorship | Remote workSenior-level Full TimeBrasília, Brazil2h ago
-
Senior AI Engineer ID80138 USD 172K-270KAnthropic | CI/CD | DNS | Docker | GitFlexible hours | Learning budget | Mentorship | Remote work | Support programsSenior-level Full TimeSANTIAGO DEL ESTERO, Argentina2h ago
-
Senior AI Engineer ID80138 BRL 319K-412KAnthropic | Authentication | CI/CD | Code Quality | DNSAnnual learning budget | Collaborative culture | Flexible hours | Internal TechTalks | MentorshipSenior-level Full TimePorto Alegre, Brazil2h ago
-
Senior AI Engineer ID80138 USD 172K-270KAnthropic | CI/CD | DNS | Docker | FirewallsAnnual learning budget | Flexible hours | Mentorship | Remote work | Well-being programsSenior-level Full TimeCORDOBA, Argentina2h ago
-
Senior AI Engineer ID80138 BRL 319K-412KAnthropic | CI/CD | CMDB | DNS | GitFlexible hours | Learning budget | Mentorship | Remote work | Supportive collaborative cultureSenior-level Full TimeSalvador, Brazil2h ago
-
Senior AI Engineer ID80138 BRL 319K-412KAnthropic | Automated testing | CI/CD | DNS | Data ProcessingAnnual learning budget | Flexible hours | Mentorship | Remote work | Well-being programsSenior-level Full TimeFlorianópolis, Brazil2h ago
-
Senior AI Engineer ID80138 USD 172K-270KAnthropic | Automated testing | CI/CD | Cause analysis | DNSAnnual learning budget | Collaborative culture | Flexible hours | Learning budget | MentorshipSenior-level Full TimeBUENOS AIRES, Argentina2h ago
-
Senior AI Engineer ID80138 USD 172K-270KAnthropic | Automated testing | CI/CD | DNS | FirewallsAnnual learning budget | Collaborative culture | Flexible hours | Mentorship | Remote workSenior-level Full TimeTUCUMAN, Argentina2h ago
-
Senior AI Engineer ID80138 USD 172K-270KAnthropic API | CI/CD | DNS | Firewalls | GitCollaborative culture | Flexible hours | Internal tech talks | Learning budget | MentorshipSenior-level Full TimeROSARIO, Argentina2h ago
-
Data Engineer II USD 84K-140KAgile | Amazon Redshift | Apache Airflow | CI/CD | Cloud ComputingMentorship | Professional developmentMid-level Full TimeBaltimore, Maryland, United States; McLean, Virginia, …2h ago
-
Senior AI Engineer ID80138 BRL 319K-412KAnthropic API | Automated testing | CI Pipeline | CI/CD | DNSFlexible hours | Learning budget | Mentorship | Remote work | Well-being programsSenior-level Full TimeRecife, Brazil2h ago
-
Senior AI Engineer ID80138 USD 172K-270KAnomaly Detection | Anthropic API | Automated testing | CI/CD | Cause analysisFlexible hours | Learning budget | Mentorship | People focused support | Performance reviewsSenior-level Full TimeBARILOCHE, Argentina2h ago
-
Databricks Senior Consultant USD 124K-207KBusiness Intelligence | Data Governance | Data Ingestion | Data Quality | Data TransformationMentorship | Professional development | TravelSenior-level Full TimeRosslyn, Virginia, United States; Washington, District …2h ago
-
Databricks Engineering Consultant USD 97K-162KApache Spark | Data Governance | Data Lineage | Databricks | ELTMentorship programs | Professional development | Travel opportunitiesMid-level Full TimeRosslyn, Virginia, United States; Washington, District …2h ago
-
Senior Data Engineer ID71671 BRL 305K-390KAWS Kinesis | Apache Airflow | Apache Kafka | CI/CD | DagsterFlexible hours | Learning budget | Mentorship | Remote work | Well-being programsSenior-level Full TimeSão Paulo, Brazil2h ago
-
Senior AI Engineer ID80138 USD 172K-270KAnthropic | Automated testing | CI/CD | Code Quality | DNSFlexible hours | Learning budget | Mentorship | Performance reviews | Remote workSenior-level Full TimeMENDOZA, Argentina2h ago
-
Senior AI Engineer ID80138 BRL 319K-412KAnthropic API | CI/CD | DNS | Firewall | GitAnnual learning budget | Flexible hours | Mentorship | Remote work | Well-being programsSenior-level Full TimeCuritiba, Brazil2h ago
-
Senior AI Engineer ID80138 BRL 319K-412KAnthropic | Automated testing | CI Pipeline | CI/CD | DNSFlexible hours | Learning budget | Mentorship | Performance reviews | Remote workSenior-level Full TimeCampinas, Brazil2h ago
-
Senior LLM Engineer USD 195K-255KAI Foundry | AI Search | Azure AI | Azure AI Foundry | Azure AI SearchSenior-level Full TimeAustin, Texas | Fremont, California | …2h ago