Data Engineer (Senior) ID53687
Tasks
- Build centralized exposure dataset
- Capture metrics from UserCohort
- Develop index builder products
- Improve code freshness
- Improve index builder stability
- Optimize compute costs
- Optimize resource allocation
- Persist Yarn logs and Spark history
- Reduce core instances for platform clusters
- Resolve index builder issues
- Support deprecation of legacy index builders
- Support user inquiries
Perks/Benefits
- Education budget
- Fitness budget
- Flexible schedule
- Mentorship
- Personalized growth roadmaps
- Remote and office options
- Team activity budget
- Techtalks
Skills/Tech-stack
AWS EMR | Apache Airflow | Apache Spark | Java | Kubernetes | Scala | Spark Operator | YARN
Education
Roles
Related jobs
-
APIs | AWS | Amazon S3 | Apache Airflow | CI/CDEducation budget | Fitness budget | Flextime | Mentorship | Professional growthMid-level Full TimeRio de Janeiro, Brazil8h ago
-
Software Engineer, Data Acquisition BRL 258K-368KAPI | Cloud Computing | Data integration | Git | GitHubOn-call rotationSenior-level Full TimeRemote - Brazil R1d ago
-
Amazon Kinesis | Apache Airflow | Apache Hudi | Apache Iceberg | Apache KafkaMid-level Full TimeSão Paulo, SP2d ago
-
Engenheiro de Dados - área hospitalar BRL 18K-18KAWS | Apache Airflow | Apache Spark | Cloud platform | ComplianceRemote workSenior-level Full TimeSão Paulo, State of São Paulo, …2d ago
-
Analista de Dados Pleno - 127203 INT BRL 107K-118KAPIs | Apache Airflow | Apache NiFi | Automated testing | AvroMid-level Full TimeAlphaville - Barueri, BR, 06.454-0002d ago
-
Apache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsCollaborative work environment | Flexible work model | Learning platform | Onsite and Remote Flexibility | Wellness programSenior-level Full TimeSão Paulo, Brasil2d ago
-
.NET | API Gateway | AWS | AWS Lambda | AWS S3Childcare support | Dental insurance | Employee assistance program | Extended maternity leave | Extended paternity leaveSenior-level Full TimeSão Paulo ou Rio de Janeiro3d ago
-
Senior-level Full TimeBrasil3d ago
-
Backend Engineer (Senior) ID55642 BRL 304K-370KAWS | Apache Spark | Application Profiling | C# | Concurrency debuggingFlexible schedule | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeBelo Horizonte, Brazil3d ago
-
Backend Engineer (Senior) ID55642 BRL 304K-370KAWS | Apache Spark | Application Profiling | Concurrency | CsharpEducation budget | Fitness budget | Flexible schedule | Mentorship | Office work optionsSenior-level Full TimeSão Bernardo do Campo, Brazil3d ago
-
Backend Engineer (Senior) ID55642 BRL 304K-370KAmazon Web Services | Apache Spark | Application Profiling | C# | C++Education budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeBrasília, Brazil3d ago
-
Backend Engineer (Senior) ID55642 BRL 304K-370KAWS | Apache Spark | Application Profiling | C# | ConcurrencyEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionSenior-level Full TimeCampinas, Brazil3d ago
-
Backend Engineer (Senior) ID55642 BRL 304K-370KAWS | Apache Spark | Application Profiling | C# | ConcurrencyEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsSenior-level Full TimeSorocaba, Brazil3d ago
-
Backend Engineer (Senior) ID55642 BRL 304K-370KAWS | Apache Spark | Application Profiling | C# | ConcurrencyEducation budget | Fitness budget | Flexible schedule | Mentorship | Office work optionsSenior-level Full TimePorto Alegre, Brazil3d ago
-
Backend Engineer (Senior) ID55642 BRL 304K-370KAWS | Apache Spark | Application Profiling | C# | ConcurrencyEducation budget | Fitness budget | Flexible schedule | Growth roadmap | MentorshipSenior-level Full TimeRecife, Brazil3d ago
-
Backend Engineer (Senior) ID55642 BRL 304K-370KAWS | Apache Spark | C# | Concurrency | SQLEducation budget | Fitness budget | Flexible schedule | Mentorship | Office work optionSenior-level Full TimeSalvador, Brazil3d ago
-
Backend Engineer (Senior) ID55642 BRL 304K-370KAWS | Apache Spark | Application Profiling | C# | Cloud NativeEducation budget | Fitness budget | Flextime | Mentorship | Office work optionsSenior-level Full TimeFlorianópolis, Brazil3d ago
-
Backend Engineer (Senior) ID55642 BRL 304K-370KAWS | Apache Spark | Application Profiling | C Sharp | Cloud NativeEducation budget | Fitness budget | Flexible schedule | Mentorship | Office work optionSenior-level Full TimeRio de Janeiro, Brazil3d ago
-
Backend Engineer (Senior) ID55642 BRL 304K-370KAWS | Apache Spark | Application Profiling | C# | ConcurrencyEducation budget | Fitness budget | Flexible schedule | Mentorship | Office work optionSenior-level Full TimeCuritiba, Brazil3d ago
-
Backend Engineer (Senior) ID55642 BRL 304K-370KAWS | Apache Spark | Application Profiling | Concurrency | CsharpEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeSão Paulo, Brazil3d ago
-
Senior Big Data Engineer - SAP Concur Complete BRL 304K-396KACID | AWS CDK | AWS EMR | AWS Glue | AWS KinesisHealth and well-being benefits | Hybrid work | Inclusive culture | Learning opportunities | Skill growthSenior-level Full TimeSão Leopoldo, BR, 93022-7183d ago
-
Senior Data Scientist - SAP Concur Travel BRL 325K-443KA/B | A/B Testing | AWS EC2 | AWS SageMaker | Amazon EMRContinuous learning opportunities | Flexible working models | Health and wellbeing support | Skill growthSenior-level Full TimeSão Leopoldo, BR, 93022-7183d ago
-
Engenharia de Dados Sênior (Híbrido/SP) - 132080 BRL 96K-119KApache Airflow | Apache Kafka | Apache Spark | Azure | ConfluenceHybrid work | In person 3x per weekMid-level Full TimeAlphaville - Barueri, BR, 06.454-0003d ago
-
Senior-level Full TimeBrazil - Remote R3d ago
-
Apache Airflow | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeSão Paulo, Brazil4d ago