Engenharia de Dados | Remota - 134797
Alphaville - Barueri, BR, 06.454-000
BRL 119K-119K (estimate) Mid-level Full Time
Tasks
- Apply CDC and batch ingestion patterns
- Document migrated business rules and technical details
- Implement Bronze Silver Gold medallion layers
- Implement business rules and transformations with automated testing
- Optimize pipeline performance and costs with partitioning OPTIMIZE ZORDER and workload sizing
- Perform parity reconciliation between legacy and lakehouse datasets
- Reconstruct data warehouse pipelines in Databricks using PySpark and Spark SQL
- Run domain reconstruction waves with legacy coexistence
- Support migration wave planning and execution
Perks/Benefits
- N/A
Skills/Tech-stack
AWS DMS | AWS Glue | AWS Lambda | AWS S3 | AWS Step Functions | Amazon Athena | Amazon EMR | Azure | Azure Synapse | CDC | CI/CD | Data Modeling | Data Quality | Databricks | Delta Lake | Delta Live Tables | Delta Live) | Dimensional Modeling | ETL | Git | PySpark | Python | Relational Data | Relational Data Modeling | SQL | Spark SQL | Step Functions | Unit Catalog
Education
N/A
Roles
Related jobs
-
Analista de Dados BRL 14K-18KAPI | AWS S3 | Apache Airflow | Apache NiFi | Azure DataDental insurance | Gympass | Health insurance | Life insurance | Meal allowanceMid-level Full TimeBrasília, Brazil2h ago
-
Senior-level Full TimeBrasília, DF, Brazil19h ago
-
Cientista de dados III - Home BRL 78K-129KBig Data | Data Manipulation | Feature Engineering | Feature Learning | Machine LearningSenior-level Full TimeSão Paulo, Brazil20h ago
-
AI Deployment Engineer, Enterprise BRL 300K-360KCost Optimization | Data Governance | Debugging | Evaluation | GovernanceSenior-level Full TimeSão Paulo22h ago
-
Data Engineer Pleno BRL 120K-120KAmazon Web Services | Apache Airflow | Configuration Management | DBT | DatahubRemote work | Work from BrazilMid-level Full TimeBrasil R23h ago
-
Data Engineer Sr BRL 119K-119KAmazon Web Services | Apache Airflow | DBT | Datahub | DockerRemote workSenior-level Full TimeBrasil R23h ago
-
API Development | Artificial Intelligence | Automation | BigQuery | Data ModelingSenior-level Full TimeSudeste,Brazil23h ago
-
[GenAI] Sênior Software Engineer - híbrido Florianópolis MXN 101K-101KAWS | Azure | CD | CI | CI/CDChildcare assistance | Dental insurance | Education benefit | Emotional support | Fuel allowanceMid-level Full TimeFlorianopolis, Santa Catarina, Brasil R1d ago
-
AI Assisted Development | Claude Code | Code review | Cursor | JavaScriptFlexible hours | Ongoing project based workSenior-level Full TimeMiami1d ago
-
Artificial Intelligence | Classification | Credit Scoring | Data Management | DatabricksCorporate university | Dental insurance | Fitness program | Health insurance | Life insuranceMid-level Full TimeIndaiatuba,Sao Paulo,Brazil1d ago
-
AWS Lambda | Amazon S3 | Amazon SQS | Azure DevOps | BDDChildcare support | Dental insurance | Extended parental leave | Gym membership discount | Health insuranceSenior-level Full TimeBrazil1d ago
-
API Development | Autogen | CrewAI | Data Ingestion | Data ModelingEquipment support | Flexible working hours | Gifts and rewards | Lunch allowance | No dress codeSenior-level Full TimeBrazil R1d ago
-
AMP | Asynchronous programming | CI/CD | Claude Code | Cloudflare VectorizeHybrid work | Medical healthcare | Ongoing learning reimbursement | Recognition program | Referral bonusesSenior-level Full TimeBrazil1d ago
-
CI/CD | Data Governance | Data Lineage | Data Modeling | Data ObservabilityFully remote workSenior-level Full TimeBrazil R1d ago
-
Senior Data Engineer BRL 70K-88KAgile | Artificial Intelligence | BigQuery | Cloud Computing | Computer VisionFlexible work arrangements | Generous paid time off program | Hybrid work environment | Opportunity to progressSenior-level Full TimeSao Paulo, SP, BR, 05423-0101d ago
-
Azure | Data Governance | Data Modeling | Data Pipelines | Data QualityChildcare assistance | Coding Sessions | Continuous learning | Dental insurance | Flexible benefits cardMid-level Full TimeBrazil1d ago
-
Consultor(a) Data Engineer BRL 48K-48KCI/CD | Data Engineering | Data Lake | Data Modeling | Data integrationBirthday off | Career mentoring | Childcare assistance | Company profit sharing | Corporate vehicle for managerial rolesMid-level Full TimeSao Paulo, Torre Paineira, Brazil1d ago
-
Data Engineering | Data Modeling | Data Pipelines | Databricks | ELTChildcare assistance | Corporate university | Dental insurance | Educational partnerships | Gym membershipEntry-level Full TimeOSASCO, Brazil; OSASCO, SP, Brazil; OSASCO1d ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Azure Synapse | Azure Synapse AnalyticsChildcare support | Corporate university | Dental insurance | Educational partnerships | Gym membership discountEntry-level Full TimeOSASCO, Brazil; OSASCO, SP, Brazil; OSASCO1d ago
-
Data Scientist III BRL 18K-18KCredit Risk | Databricks | Generative AI | Machine Learning | Model ValidationChildcare assistance | Dental insurance | Gym membership | Health insurance | Life insuranceSenior-level Full TimeOSASCO, Brazil; OSASCO, SP, Brazil; OSASCO1d ago
-
Engenheiro/Engenheira de Dados Pleno BRL 20K-31KAWS | Apache Kafka | Apache Spark | Azure | CI/CDDental insurance | Health insurance | Home-office allowance | Life insurance | Paid family leaveMid-level Full TimeBarueri, BR1d ago
-
Analista de Dados BRL 13K-18KAI Foundry | Automl | Azure AI | Azure AI Foundry | Azure Machine LearningFamily care program | Flexible work model | Gym and wellness benefits | Hybrid work | Life insuranceMid-level Full TimeBarueri, BR1d ago
-
Engenheiro/Engenheira de Dados BRL 20K-31KAWS | Agile | Apache Spark | Azure | Data GovernanceCorporate university access | Dental insurance | Discount benefits club | Family care program | Flexible work modelMid-level Full TimeBarueri, BR1d ago
-
Sr Specialist, AI Platform Engineering BRL 235K-390KAWS | Airflow | CI/CD | Distributed Systems | DockerLife insurance | Meal vouchers | Medical and dental assistance | Others | Private pensionSenior-level Full TimeJundiai, SP, BR1d ago
-
Sr Specialist, AI Platform Engineering BRL 235K-390KAirflow | Amazon Web Services | CI/CD | Cloud platform | Distributed SystemsDental insurance | Life insurance | Meal vouchers | Medical insurance | Private pensionSenior-level Full TimeJundiai, SP, BR1d ago