Data Engineer (Senior) ID53687
Tasks
- Build consolidated dataset for experiment analysis
- Capture UserCohort metrics
- Deprecate legacy index builders
- Develop index builder products
- Improve index builder stability
- Investigate index builder issues
- Optimize compute costs
- Optimize resource allocation
- Persist Yarn logs and Spark history
- Reduce core instances for platform clusters
Perks/Benefits
- Education budget
- Fitness budget
- Flexible schedule
- Mentorship
- Office work
- Personalized growth roadmaps
- Remote work
- Team activity budget
- Techtalks
Skills/Tech-stack
AWS EMR | Airflow | Apache Spark | Data Partitioning | Data grouping | Data joins | Java | Kubernetes | Scala | Spark Operator | Spark SQL | YARN
Education
Roles
Related jobs
-
AWS Glue | Airflow | Azure Data | Azure Data Factory | BigQueryFlexible work hours | Remote workMid-level Full TimeBrazil - Remote R21h ago
-
Especialista de Engenharia de Dados I BRL 23K-24KAWS | Apache Spark | Autoloader | CI/CD | Data GovernanceMid-level Full TimeSão Paulo, Brazil1d ago
-
.NET | Apex | C# | C++ | DartRemote workSenior-level Part TimeBrasília, Brazil R1d ago
-
Data Engineer - 131304 BRL 118K-118KAWS Glue | Amazon Athena | Amazon EMR | Amazon MSK | Amazon RedshiftMid-level Full TimeAlphaville - Barueri, BR, 06.454-0001d ago
-
Engenharia de Dados - 131749 BRL 119K-119KAWS Glue | Amazon Athena | Amazon EMR | Amazon MSK | Amazon RedshiftRemote workMid-level Full TimeAlphaville - Barueri, BR, 06.454-0001d ago
-
Mid-level Full TimeAlphaville - Barueri, BR, 06.454-0001d ago
-
Engenharia de Dados Sênior (Híbrido/SP) - 131709 BRL 60K-60KAWS | Apache Airflow | Apache Spark | Azure Data | Azure Data FactoryEnglish intermediate or advanced | Hybrid work | Team collaborationSenior-level Full TimeAlphaville - Barueri, BR, 06.454-0001d ago
-
Data Engineer (AWS, Redshift & Spark) BRL 20K-40KAWS | Amazon Redshift | Apache Spark | Data Warehousing | Database ManagementCorporate university | Dental insurance | Educational benefits | Food Voucher | Health insuranceSenior-level Full TimeSão Paulo JK, São Paulo, BR, …1d ago
-
Especialista de Engenharia de Dados I BRL 54K-60KAWS | CI/CD | Clean Code | Data Lake | Data MartHybrid work | Inclusive culture | Professional certifications support | Wellbeing focusSenior-level Full TimeSão Paulo, Brazil2d ago
-
DevOps & Site Reliability Engineer BRL 108K-136KAmazon Web Services | Azure | Azure Pipelines | Bash | CI/CDCareer development | English program | Fitness program | Home office | International projectsMid-level Full TimeBrasília, Federal District, Brazil R2d ago
-
DevOps & Site Reliability Engineer BRL 108K-136KAmazon Web Services | Azure | Azure Pipelines | Bash | CI/CDCareer development | English program | Fitness program | Games and competitions | International projectsMid-level Full TimeSão Paulo R2d ago
-
AWS | AWS Athena | AWS Glue | Apache Spark | ETLChildcare support | Continuous learning platform | Dental insurance | Extended parental leave | Gym membershipSenior-level Full TimeBrazil2d ago
-
AI Inference | AI inference systems | Authentication | GRPC | GoEducation budget | Fitness budget | Flexible schedule | Growth roadmaps | MentorshipMid-level Full TimePorto Alegre, Brazil2d ago
-
BRA Data Scientist Spec III BRL 20K-31KAPIs | Airflow | Apache Spark | Azure | CI/CDEnglish communication support | Hybrid work | Mentorship | Technical leadershipSenior-level Full TimeSANTANDER SEDE - 13 ANDAR, Brazil2d ago
-
Machine Learning Engineer BRL 172K-188KAirflow | Amazon SageMaker | CI/CD | Docker | Feature SelectionAnnual trip | Choose laptop and peripherals | Flexible working hours | Sharing Groups | Sports groupsMid-level Full TimeBlumenau, State of Santa Catarina, Brazil … R2d ago
-
AWS Glue | AWS RDS | CI/CD | Cloud SQL | Data IntegrityEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsEntry-level Full TimePorto Alegre, Brazil4d ago
-
AWS Glue | AWS RDS | CI/CD | Cloud SQL | Data MigrationEducation budget | Fitness and team activities | Flextime | Mentorship | Modern projectsEntry-level Full TimeFlorianópolis, Brazil4d ago
-
Senior Data Platform Engineer (Python/AWS) - Finance BRL 258K-360KAWS CDK | AWS Glue | AWS Lambda | AWS Step Functions | Amazon ECSPaid time off | Remote work | Work autonomy | Work with top US companiesSenior-level Full TimeSão Paulo R5d ago
-
Senior-level Full TimeRio de Janeiro, RJ, Brazil5d ago
-
Senior Specialist - Data Engineering BRL 120K-180KApache Spark | Data Cataloging | Data Governance | Data Modeling | Data QualityHybrid workSenior-level Full TimeBarueri, SP, BR5d ago
-
Apache Airflow | Apache Hive | Apache Spark | Cause analysis | Data ModelingPaid time off | Remote work | Work autonomy | Work with top companiesSenior-level Full TimeSão Paulo R6d ago
-
[Job-28122] Senior Data Engineering BRL 230K-270KApache Spark | Azure | Databricks | Python | SQLChildcare assistance | Continuous learning platform | Dental insurance | Discount club | Extended paternity leaveSenior-level Full TimeBrazil6d ago
-
Business Engineer, Business AI BRL 305K-396KAgile | Code review | Documentation | English communication | JavaKnowledge sharing | Mentorship | Travel opportunitiesSenior-level Full TimeSão Paulo, Brazil6d ago
-
Mid Software Engineer BRL 304K-396KAPI Design | Batch Processing | BigQuery | Data Enrichment | Data GovernanceMid-level Full TimeBrazil Sao Paulo - Remote Office R6d ago
-
Engenharia de Dados Sênior (Híbrido/SP)- 131721 BRL 119K-119KBatch Processing | Big Data | Big Table | Bucketing | Data CompressionMid-level Full TimeAlphaville - Barueri, BR, 06.454-0006d ago