Senior Data Engineer (Databricks, Spark)
Tasks
- Build analytical datasets and metrics
- Collaborate with stakeholders to deliver data solutions
- Create technical documentation
- Design data transformation pipelines
- Develop scalable data pipelines
- Ensure data quality validation
- Implement dimensional data modeling
- Optimize Spark workloads
- Perform data reconciliation across platforms
- Process JSON datasets
- Set up data monitoring and alerting
Perks/Benefits
- Hybrid work flexibility
- International projects
- Medical healthcare
- Ongoing learning reimbursement
- Recognition program
- Referral bonuses
- Sports compensation
- Team events local benefits
- Top tier equipment provision
- Well-being program
Skills/Tech-stack
Apache Iceberg | Apache Spark | CI/CD | Data Monitoring | Data Quality | Data Reconciliation | Data Warehousing | Databricks | Delta Lake | Dimensional Modeling | Git | Idempotent Pipelines | Incremental ETL | JSON | Lakehouse | PySpark | REST APIs | SQL | Scala | Slowly Changing Dimensions
Education
N/A
Roles
Related jobs
-
Entry-level Full TimeBrasil R1d ago
-
AWS | Asset bundles | Azure | Bitbucket Pipelines | CI/CDRemote workSenior-level Full TimeBrasil R1d ago
-
Analytics | Business Intelligence | CSS | Dashboard Design | Data ModelingAnnual bonus program | Birthday day off | Childcare support | Dental insurance | Discount clubSenior-level Full TimeBrasil R1d ago
-
APIs | Airflow | BigQuery | CI/CD | Cloud platformAuxílio home office | Auxílio medicamentos | Day off aniversário | Estacionamento | Gympass/TotalpassMid-level Full TimeBrasil R1d ago
-
Analista de Engenharia de Machine Learning Pleno - Shared Experience IBBA (Vaga Afirmativa para Mulheres) BRL 18K-18KAWS | AWS Cloud | AWS Lambda | Amazon ECS | Batch ProcessingChildcare support | Dental insurance | Exclusive Financial Product Discounts | Extended parental leave | Gym membership discountMid-level Full TimeSão Paulo, Brasil R1d ago
-
Access Controls | Airflow | Apache Spark | Asset bundles | CI/CDCertification incentives | Childcare allowance | Dental insurance | Educational discounts | Fitness and wellness benefitSenior-level Full TimeBrazil R1d ago
-
AWS Glue | AWS Lake | AWS Lake Formation | Amazon Athena | Amazon BedrockChildcare assistance | Continuous learning opportunities | Discounts through partner programs | Extended parental leave | Fitness and wellness programsMid-level Full TimeBrazil R1d ago
-
API | JSON | Java | JavaScript | PythonOpportunity to work on AI projects | Remote workMid-level ContractIndia; Pakistan; Nigeria; Kenya; Egypt; Ghana; … R2d ago
-
Analytics | Clojure | Data Contracts | Data Lineage | Data QualityDaycare allowance | Dental plan | Equity | Extended parental leave | Financial supportSenior-level Full TimeSão Paulo R2d ago
-
Data Engineer - GCP | PL (Hybrid/SP) BRL 119K-119KApache Airflow | Apache Kafka | Apache Spark | BigQuery | CassandraHybrid workSenior-level Full TimeSão Paulo, Brasil R2d ago
-
Apache Airflow | Apache Spark | Data Governance | Data Modeling | Data MonitoringDental care | Emotional support program | Gym membership | Health insurance | Legal supportMid-level Full TimeSão Paulo, Brasil R2d ago
-
Data Engineer - GCP | SR (Hybrid/SP) BRL 119K-119KAPIs | AWS Glue | Apache Airflow | Apache Kafka | Apache SparkHybrid workSenior-level Full TimeSão Paulo, Brasil R2d ago
-
Analista Sênior de Engenharia de Dados e IA BRL 24K-31KABAC | AWS Glue | Access Management | Agent Orchestration | Amazon AthenaChildcare assistance | Dental insurance | Discounts on financial products | Extended maternity and paternity leave | Health insuranceSenior-level Full TimeSão Paulo, Brasil R2d ago
-
AWS | Apache Spark | Azure DevOps | CI/CD | Cloud ComputingChildcare assistance | Dental insurance | Hybrid work model | Life events support | Life insuranceMid-level Full TimeBrazil R2d ago
-
AWS | Analytics engineering | Artificial Intelligence | Automated testing | Cloud ArchitectureChildcare assistance | Dental insurance | Discounts on financial products | Extended maternity leave | Extended paternity leaveMid-level Full TimeSão Paulo, Brasil R3d ago
-
Apache Spark | Azure | CI/CD | Cassandra | Data GovernanceChildcare reimbursement | Dental insurance | English training online | Extended parental leave | Flexible benefits programSenior-level Full TimeRio de Janeiro, Brasil R3d ago
-
Senior Data Engineer Brazil BRL 212K-270KApache Beam | Apache Flink | Apache Spark | CI/CD | Cloud platformCoworking credits | Dental insurance | Gympass | Health insurance | Meal allowanceSenior-level Full TimeAvenida das Nações Unidas, 12901,11° andar … R3d ago
-
LLMs Data Analyst | Senior (Hybrid/SP) BRL 84K-108KAWS | Anthropic | Azure OpenAI | CI/CD | Cloud platformHybrid workSenior-level Full TimeSão Paulo, Brasil R3d ago
-
Data Management | Data Management Cloud | Data Quality | IBM DB2 | Informatica Data QualityMid-level Full TimeBrasil R3d ago
-
AI Model Evaluation | AI model | AWS | Azure | Azure DataChildcare assistance | Continuous learning platform | Dental insurance | Discount club | Extended parental leaveSenior-level Full TimeBrazil R3d ago
-
Azure | CI/CD | Databricks | Git | GitHub100 percent remote | Childcare assistance | Continuous learning platform | Dedicated language learning platform | Dental insuranceMid-level Full TimeBrazil R3d ago
-
AWS Glue | AWS Glue Data Catalog | AWS Lake | AWS Lake Formation | AWS LambdaContinuous professional development | Fully remote within Brazil | Technical mentorship | Technical ownershipMid-level Full TimeBrazil R3d ago
-
Senior-level Full TimeBrazil Sao Paulo - Remote Office R4d ago
-
AI Data Engineer III BRL 300K-360KAirflow | Async Programming | BM25 | CI/CD | DBTBonuses | Minimal travel | Remote workSenior-level Full TimeRemote Brazil R4d ago
-
Staff Automation Engineer & AI Engineer BRL 183K-183KAWS | Audit trails | Automation Anywhere | Blue Prism | CrewAIFlexible meal allowance | Health and dental insurance | Home-office allowance | Life insurance | Remote workSenior-level Full TimeBrazil - Remote R4d ago