Senior Data Engineer (Databricks, Spark)
Tasks
- Build incremental idempotent pipelines
- Design data transformation pipelines
- Design dimensional data models
- Develop analytical datasets and metrics
- Implement data quality, validation, and monitoring
- Implement data reconciliation for migrations
- Integrate APIs and enterprise data sources
- Optimize Spark workloads
- Produce technical documentation and knowledge transfer
Perks/Benefits
- Hybrid work
- Medical healthcare
- Ongoing learning reimbursement
- Recognition program
- Referral bonuses
- Remote flexibility
- Sports compensation
- Team events
- Top tier equipment provision
- Well-being program
Skills/Tech-stack
AWS Glue | AWS Lake | AWS Lake Formation | Amazon S3 | Apache Iceberg | Apache Spark | CI/CD | Cloud platform | Data Quality | Data Reconciliation | Databricks | Delta Lake | Dimensional Modeling | Git | Google Cloud | Google Cloud Platform | JSON | Lake Formation | Lakehouse | PySpark | REST APIs | SQL | Scala | Slowly Changing Dimensions
Education
N/A
Roles
Related jobs
-
Auditing | Automation | Azure | Debugging | Enterprise IntegrationBring Your Own Device (BYOD) | Contractor engagement | Flexible work environment | Fully remote | No overtimeSenior-level Contract Full TimeBrazil R13h ago
-
Data QA Engineer – Enterprise Data | Brazil BRL 212K-270KApache JMeter | Data Normalization | Data Warehousing | Database Indexing | Database TestingFlexible scheduling | Paid time off | Remote work | Work autonomyMid-level Full TimeSão Paulo R18h ago
-
AWS Athena | AWS EC2 | AWS EMR | AWS Kinesis | AWS LambdaCareer Development Programs | Childcare support | Dental insurance | Extended family leave | Food VoucherMid-level Full TimeSão Paulo, São Paulo, Brazil21h ago
-
AWS | Apache Airflow | Apache Spark | CI/CD | Data ContractsMid-level Full TimeSão Paulo, Brazil21h ago
-
[Job-30696] Senior GenAI Engineer, Brazil BRL 234K-275KAWS | Agentic AI | Amazon Bedrock | Authentication | AzureChildcare assistance | Continuous learning platform | Dental insurance | Discount club | Extended paternity leaveSenior-level Full TimeBrazil1d ago
-
Alerting | Apache Spark | Azure DevOps | CI/CD | CloudChildcare assistance | Continuous learning platform | Discount club | Extended paternity leave | Gym partnershipsSenior-level Full TimeBrazil1d ago
-
AWS Glue | AWS Lambda | Amazon Athena | Amazon EC2 | Amazon EMRChildcare allowance | Dental insurance | EAP program | Extended maternity leave | Extended paternity leaveSenior-level Full TimeSão Paulo,1d ago
-
Azure | Dashboard Development | Data Modeling | Data Quality | Data ValidationMid-level Full TimeSão Paulo, Brazil1d ago
-
API Integration | Data Governance | Data Modeling | Data Quality | Data pipelineProfessional growth | Remote workSenior-level Full TimeBrazil R1d ago
-
AI Assisted Development | AI-Assisted Development Tools | API Design | Automation | Development toolsBirthday day off | Comprehensive healthcare coverage | Continuous training opportunities | Extended paternity leave | Financial support programsMid-level Full TimeBrazil R1d ago
-
API Integration | Asynchronous processing | Authentication | Celery | DjangoFlexible, async culture | Founding team opportunity | Fully remote | High ownership | Influence on product directionSenior-level Full TimeBrazil R1d ago
-
Airflow | Azure | Azure Data | Azure Data Factory | Azure SynapseContinuous learning | Flexible schedule | Hybrid work | Professional growth opportunities | Remote workMid-level Full TimeBrazil1d ago
-
AWS Glue | AWS Lambda | AWS Step Functions | Amazon AWS | Amazon AWS GlueMid-level Full TimeAlphaville - Barueri, BR, 06.454-0001d ago
-
Consultor(a) Data Engineer Senior BRL 54K-72KAWS | Azure | CI/CD | DBT | Data GovernanceBirthday off | Career mentoring | Childcare assistance | Corporate vehicle | Dental insuranceSenior-level Full TimeSao Paulo, Torre Paineira, Brazil1d ago
-
Senior Manager Data Engineer BRL 66K-90K.NET | Azure Data | Azure Data Factory | Azure Data Lake | Azure DevOpsBirthday off | Career mentoring | Company profit sharing | Corporate vehicle | Daycare assistanceSenior-level Full TimeSao Paulo, Torre Paineira, Brazil1d ago
-
Engenheiro de Software Fullstack | BTG Empresas BRL 54K-72K.NET | AWS Lambda | Agile | Amazon ECS | Amazon EKSChildcare allowance | Dental insurance | Employee Assistance Program (EAP) | Extended maternity leave | Extended paternity leaveSenior-level Full TimeSão Paulo1d ago
-
Applied AI solutions Architect BRL 319K-443KCI/CD | Drift Detection | Feature Store | Generative AI | GovernanceOwnership opportunities | Professional learning and development | Remote work flexibilitySenior-level Full TimeBrazil2d ago
-
Arquiteto de Dados BRL 48K-48KAgile | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeCertification support | Holidays and work life balance | Hybrid work schedule | Training and workshops | Well-being supportSenior-level Full TimeSão Paulo, State of São Paulo, …2d ago
-
API Integration | Access Control | Audit Logging | Behavioral Testing | CI/CDAnnual company off-site | Annual professional development budget | Coworking allowance | Dependent coverage support | Employee equity ownershipMid-level Full TimeBrazil R2d ago
-
AWS | AWS Lambda | Agent workflows | Amazon SQS | Distributed SystemsBirthday leave | Career development opportunities | Dental insurance | Flexible benefits program | Flexible work scheduleSenior-level Full TimeBrazil2d ago
-
AWS Athena | AWS DMS | AWS EMR | AWS Glue | AWS LambdaRemote work flexibilitySenior-level Full TimeBrazil2d ago
-
Analista Data Engineer BRL 60K-60KABAC | Apache Airflow | Azure | Azure Databricks | Azure Key VaultCareer mentoring | Childcare assistance | Dental insurance | Health insurance | Life insuranceSenior-level Full TimeSao Paulo, Torre Paineira, Brazil2d ago
-
API Integration | AWS | Airflow | Amazon Redshift | AzureFlexible working hours | Remote workSenior-level Full TimeBrazil - Remote R2d ago
-
Consultor(a) Data Engineer BRL 80K-80KCI/CD | Data Lake | Data Modeling | Data integration | Data orchestrationBirthday off | Career mentoring | Childcare assistance | Company result bonus | Dental insuranceMid-level Full TimeSao Paulo, Torre Paineira, Brazil2d ago
-
Senior Analytics Engineer USD 66K-66KAirflow | Business Intelligence | Code review | DBT | DagsterEquity | Flexible time off | MacBook equipment | Paid Holidays | Remote-friendly workSenior-level Full TimeBrazil R2d ago