Engenheiro de Dados Sênior / Especialista - AWS / Snowflake / Iceberg
Tasks
- Automate Iceberg table maintenance
- Build data transformation pipelines
- Control data governance and security
- Design data ingestion pipelines
- Develop PySpark and Spark distributed processing jobs
- Implement CI CD data testing and lineage
- Implement incremental loads and upserts
- Maintain Apache Iceberg tables on Amazon S3
- Manage Git version control and code reviews
- Mentor team through code reviews and documentation
- Monitor and optimize AWS and Snowflake performance
- Optimize Snowflake data models and queries
- Perform MERGE operations
- Synchronize Snowflake with Iceberg lakehouse metadata
Perks/Benefits
- Continuous professional development
- Fully remote within Brazil
- Technical mentorship
- Technical ownership
Skills/Tech-stack
AWS Glue | AWS Glue Data Catalog | AWS Lake | AWS Lake Formation | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon EMR | Amazon S3 | Amazon Web Services | Apache Airflow | Apache Iceberg | Apache Spark | CI/CD | DBT | Data Catalog | Data Governance | Data Lake | Data Lakehouse | Data Lineage | Data Modeling | Data Security | Data Testing | Data Warehouse | Git | Glue Data Catalog | Lake Formation | PySpark | Python | Query Optimization | SQL | Snowflake | Snowflake RBAC | Step Functions | Terraform | Warehouse Management | Web Services
Education
N/A
Roles
Related jobs
-
AI Model Evaluation | AI model | AWS | Azure | Azure DataChildcare assistance | Continuous learning platform | Dental insurance | Discount club | Extended parental leaveSenior-level Full TimeBrazil R10h ago
-
Azure | CI/CD | Databricks | Git | GitHub100 percent remote | Childcare assistance | Continuous learning platform | Dedicated language learning platform | Dental insuranceMid-level Full TimeBrazil R10h ago
-
Engenheiro de Dados SR BRL 60K-72KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Senior-level Full TimeSão Paulo, Brasil R23h ago
-
Azure | Azure Blob | Azure Blob Storage | Azure Data | Azure Data FactoryConference talk sponsorship | Employee leave policies | Home office fund | Learning and development budget | Medical insuranceMid-level Full TimeBrazil R1d ago
-
AI Evaluation Engineer (QA) BRL 319K-390KAWS | Azure | CI/CD | CloudFormation | Data ModelingAccess to cutting edge AI platforms | Collaborative work environment | Diverse and inclusive culture | Growth opportunities | Hybrid working modelSenior-level Full TimeSão Paulo R1d ago
-
API Development | Airflow | Amazon Redshift | ClickHouse | DBTDental insurance | Education and courses stipend | Health plan | Paid annual leave | Sports incentiveEntry-level Full TimeSão Paulo, SP R1d ago
-
Senior Data Engineer BRL 234K-295KAWS Data | AWS Glue | AWS data platform | Amazon Web Services | Apache FlinkSenior-level Full TimeSao Paulo, SP, Brazil R2d ago
-
AWS Glue | AWS IAM | AWS Lambda | AWS S3 | AWS Step FunctionsAutonomy | Continuous learning | Fully remote | MentorshipSenior-level Full TimeBrazil R2d ago
-
Analista Machine Learning/Python BRL 30K-30KData Analysis | Machine Learning | Python | SQL | StatisticsChildcare assistance | Course discounts | Dental assistance | Meal allowance | Medical assistanceEntry-level Full TimeBrasil R2d ago
-
Apache Spark | Big Data | Data Mining | Data Modeling | Data PipelinesBonus Salaries | Childcare assistance | Dental insurance | Extended parental leave | Flexible working hoursSenior-level Full TimeBrasil R2d ago
-
Mid-level Full TimeRemote - Brazil R2d ago
-
Anthropic Claude | Application Insights | Asynchronous systems | Azure Application Insights | Azure OpenAIB2B contract arrangement | Flexible work environment | Long-term engagement | Remote workSenior-level Contract Full TimeBrazil R4d ago
-
AWS | AWS Cost Explorer | Cloud billing | Cost Explorer | Cost ManagementRemote workEntry-level Full TimeRemote (Brazil) R4d ago
-
CAS | Engenharia de Dados - Foco em Seguros BRL 18K-18KApache Spark | Data Engineering | Data Lake | Data Modeling | DataOpsChildcare support | Dental insurance | Extended parental leave | Food allowance | GympassSenior-level Full TimeBrasil R5d ago
-
Senior Data Engineer - Databricks BRL 319K-455KAWS | Apache Spark | Automation Scripting | CI/CD | Cloud SecurityEquipment and office stipend | Flexible PTO | Learning and development stipend | Paid exams and certifications | Professional development planSenior-level Full TimeBRAZIL R5d ago
-
Automation | Azure Data | Azure Data Explorer | CSV | Cloud SecurityCollaborative global working environment | Cross-functional collaboration | Exposure to large scale telemetry | Professional growth | Remote work opportunityMid-level Full TimeBrazil R5d ago
-
Forward Deployed Engineer – Agentic AI BRL 319K-412KAI Services | API Design | API Integration | Agentic AI | Artificial IntelligenceSenior-level Full TimeBrazil R5d ago
-
Data Analytics Lead - Veeva Ostro BRL 305K-390KAI readiness | Data Architecture | Data Modeling | Data integration | Data setsLeadership opportunities | Team mentorship | Work from home flexibilitySenior-level Full TimeBrazil - São Paulo R5d ago
-
API Integration | Alerting | Apache Airflow | Authentication | BackfillAccess to company products | Career growth | Company off-sites | Family benefits | Fully remoteMid-level Full TimeBrazil R6d ago
-
Senior Embedded Software Engineer BRL 160K-240KAnalytics | C# | C++ | CI/CD | Code AnalysisExtended paternity leave | Flexible work hours | Hybrid work environment | Insurance policy plan | Learning opportunitiesSenior-level Full TimeBR-CWB-002, Brazil R6d ago
-
Power BI | Python | SQL | TableauChildcare support | Day off | Dental insurance | Food card | Life insuranceEntry-level Full TimeSão Paulo, Brasil R6d ago
-
Senior Clinical Data Engineer (LATAM) MXN 990K-1300K21 CFR Part 11 | Audit trails | CDISC | CFR Part 11 | Clinical trialsCareer development | Mentorship | Remote workSenior-level Full TimeRemote, Argentina; Remote, Brazil; Remote, Chile; … R6d ago
-
Senior Clinical Data Engineer (LATAM) MXN 950K-1300K21 CFR Part 11 | Audit trails | Automation | CDISC | CFR Part 11Senior-level Full TimeRemote, Argentina; Remote, Brazil; Remote, Chile; … R6d ago
-
Senior-level Full TimeBrasil R7d ago
-
AI Governance | Axon | Business glossary | CRM | Cloud Data Governance and CatalogCompetitive compensation | Inclusive workplace | Professional growth | Remote workMid-level Full TimeBrazil R7d ago