Lead AWS Data Engineer
São Paulo JK, SP, BR, 04543-011
BRL 20K-31K (estimate) Senior-level Full Time
Tasks
- Build and evolve corporate data lakes using medallion architecture
- Collaborate with architects DevOps infrastructure and business stakeholders
- Define data engineering standards governance and observability
- Design develop and maintain scalable resilient data pipelines
- Design for scalability security performance and cost
- Develop Airflow DAGs for orchestrating complex pipelines
- Develop and optimize ETL ELT processes with Python and PySpark
- Ensure compliance with regulatory audit and corporate governance
- Ensure data security using IAM KMS encryption and access control
- Implement data solutions with AWS Glue Amazon S3 MWAA Step Functions CloudWatch
- Implement infrastructure as code with Terraform
- Lead data engineering initiatives in AWS
- Migrate data platforms from on premises to AWS
- Perform troubleshooting root cause analysis and production support
- Provide technical mentorship and code reviews
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS Glue | AWS KMS | AWS Step Functions | Amazon CloudWatch | Amazon S3 | Apache Airflow | Apache Iceberg | CI/CD | Cloud Security | Data Engineering | Data Governance | Data Lake | Data integration | Data pipeline | ELT | ETL | IAM | Infrastructure as Code | MWAA | Medallion Architecture | Observability | Oracle | Oracle Data | Oracle Data Integration | PySpark | Python | Relational databases | Step Functions | Terraform | “as-code”
Education
Roles
AWS Data Engineer | Data Engineer | Engineer | Lead | Lead AWS Data Engineer
Related jobs
-
Business Intelligence | Cloud platform | Dashboards | Data Compliance | Data EngineeringChildcare assistance | Dental assistance | Employee stock purchase plan | Extended maternity and paternity leave | Global career opportunitiesSenior-level Full TimeBrazil8h ago
-
AI Developer | Asset Servicing - Innovation BRL 14K-18KAPI Gateway | AWS Lambda | Agent Orchestration | Agile | Amazon APIChildcare allowance | Dental insurance | Employee assistance program | Extended maternity leave | Extended paternity leaveMid-level Full TimeSão Paulo / Rio de Janeiro13h ago
-
Coordenador de PD&I - Machine Learning BRL 20K-31KAutomation | Data Architecture | Data Drift | Data Drift Detection | Data EngineeringChildcare support | Day off on birthday | Dental insurance | Extended parental leave | Free parkingSenior-level Full TimeCampinas, São Paulo, Brasil17h ago
-
AWS | AWS QuickSight | Data Governance | Data Modeling | ELTBirthday day off | Culture initiatives | Flexible schedule | Fully remote | High-impact projectsMid-level Full TimeBrazil R20h ago
-
[Job-29213] Senior Data Engineer, Brazil BRL 212K-270KAzure | Data Governance | Data Ingestion | Data Lake | Data integrationChildcare assistance | Continuous learning platform | Dental insurance | Discount club | Extended paternity leaveSenior-level Full TimeBrazil21h ago
-
Azure | Azure DevOps | CI/CD | DBT | DatabricksBirthday day off | Career growth program | Dental insurance | Employee referral bonus | Flexible benefits allowanceSenior-level Full TimeBrazil R22h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Distributed work | Friendly work environmentMid-level Full TimeCuritiba, Brazil23h ago
-
Benchmarking | CUDA | Docker | Inference Optimization | KubernetesAutonomy | Collaborative international team | Continuous learning | Flexible location options | Fully remoteMid-level Full TimeBrazil R1d ago
-
AWS | Apache Airflow | Azure | CI/CD | Data EngineeringCareer growth opportunities | Continuous learning | Flexible working hours | Fully remote | Home office setup supportSenior-level Full TimeBrazil R1d ago
-
API Design | AWS | Apache Spark | CI/CD | CrossplaneCareer development | Dental insurance | Flexible schedule | Health insurance | Home office supportSenior-level Full TimeBrazil1d ago
-
Data Engineer (GTM) BRL 150K-230KAirflow | Apache Beam | Batch Ingestion | BigQuery | Clay401k retirement plan | Fully funded travel after four years | Gympass membership | Language learning opportunities | Medical, dental, and vision coverageMid-level Full TimeSão Paulo, SP1d ago
-
APIs | Apache Airflow | Azure Data | Azure Data Factory | Data FactoryDental insurance | Gym membership support | Health insurance | Life insurance | Meal or food allowanceMid-level Full TimeBrazil1d ago
-
Cloud Computing | Data Pipelines | ETL | Google Colab | Information RetrievalCareer growth | Continuous learning culture | Coworking access | Flexible schedule | Fully remote workMid-level Full TimeBrazil R1d ago
-
Senior Specialist - Data Engineering BRL 180K-252KApache Spark | Data Cataloging | Data Governance | Data Modeling | Data QualityHybrid workSenior-level Full TimeBarueri, SP, BR1d ago
-
APIs | BigQuery | Copilot Studio | Data Governance | GeminiChildcare support | Dental insurance | Food Voucher | Gym pass | Health insuranceEntry-level Full TimeSão Paulo, Brazil1d ago
-
AI Agents | APIs | Automation | BI | BigQueryChildcare assistance | Dental insurance | Food Voucher | Gym membership | Health insuranceEntry-level Full TimeSão Paulo, Brazil1d ago
-
API Management | APIs | ArgoCD | Azure DevOps | CI/CDChildcare allowance | Company civic leave program | Dental insurance | Employee Assistance Program (EAP) | Extended maternity leaveSenior-level Full TimeSão Paulo1d ago
-
Engenheiro de Software Senior (.NET) | BTG Empresas BRL 119K-119K.NET | AWS | Azure | C# | CI/CDChildcare allowance | Dental insurance | Employee assistance program | Extended maternity leave | Extended paternity leaveSenior-level Full TimeSão Paulo1d ago
-
.NET | AWS | Azure | C# | CI/CDChildcare allowance | Dental insurance | EAP | Extended maternity leave | Extended paternity leaveSenior-level Full TimeSão Paulo1d ago
-
.NET | API Design | AWS | Asynchronous programming | C#Childcare assistance | Dental insurance | EAP | Employee assistance program | Extended parental leaveSenior-level Full TimeSão Paulo1d ago
-
.NET | Agile | Amazon Web Services | C# | CI/CDChildcare support | Dental insurance | Employee assistance program | Extended parental leave | Food allowanceSenior-level Full TimeSão Paulo1d ago
-
.NET | .Net Core | API Gateway | AWS | AgileChildcare support | Dental insurance | EAP | Gym membership | Life insuranceSenior-level Full TimeSão Paulo1d ago
-
Engenheiro de Software .NET Pleno | BTG Empresas BRL 80K-80K.NET | .Net Core | AWS | Agile | Amazon SNSChildcare support | Dental insurance | Employee Assistance Program (EAP) | Extended maternity leave | Extended paternity leaveSenior-level Full TimeSão Paulo1d ago
-
AWS | Agile | Azure DevOps | CI/CD | Cloud ArchitectureChildcare assistance | Dental insurance | Employee assistance program | Gym membership | Health insuranceEntry-level Full TimeSão Paulo1d ago
-
Accessibility | CI/CD | CSS3 | Cypress | DatadogChildcare assistance | Dental insurance | Employee assistance program | Extended maternity leave | Extended paternity leaveSenior-level Full TimeSão Paulo1d ago