Data Engineer (Senior) ID53687
Tasks
- Build and evolve large scale data processing systems
- Build consolidated datasets for experiment analysis
- Capture UserCohort metrics
- Deprecate legacy index builders
- Develop and maintain index builder products
- Improve index builder stability and reliability
- Investigate and resolve index builder issues
- Optimize compute costs
- Optimize resource allocation for platform infrastructure
- Persist Yarn logs and Spark history
- Reduce core instances for platform clusters
- Support user inquiries about platform and datasets
Perks/Benefits
Skills/Tech-stack
AWS EMR | Airflow | Apache Spark | Java | Kubernetes | Scala | Spark Operator | YARN
Education
Roles
Related jobs
-
Data Engineer (Lead) ID52236 USD 120K-160KAirflow | Bash | CI/CD | DBT | Data ManagementFlexible schedule | Mentorship | Personalized growth plans | Remote work | Team activity budgetsSenior-level Full TimeQUETZALTENANGO, Guatemala2d ago
-
Data Engineer (Lead) ID52236 USD 120K-162KAirflow | Bash | CI/CD | DBT | Data Pipeline DevelopmentFlexible schedule | Growth roadmaps | Mentorship | Remote options | TechtalksSenior-level Full TimeZONA 1, Guatemala2d ago
-
Data Engineer (Lead) ID52236 USD 120K-160KAirflow | Bash | CI/CD | DBT | Data ManagementFlexible schedule | Growth roadmaps | Mentorship | Remote options | TechtalksSenior-level Full TimeCHIMALTENANGO, Guatemala2d ago
-
Data Engineer (Lead) ID52236 USD 120K-162KAirflow | Bash | CI/CD | Cloud infrastructure | DBTFlexible schedule | Growth roadmaps | Mentorship | Remote work | Team activity budgetsSenior-level Full TimeHUEHUETENANGO, Guatemala2d ago
-
Data Engineer (Middle) ID50589 USD 115K-149KAirflow | Data Modeling | Data Pipelines | Database Management | PythonCareer development | Mentorship | Personalized growth roadmaps | Remote options | TechtalksMid-level Full TimeHUEHUETENANGO, Guatemala2d ago
-
Data Engineer (Middle) ID50589 USD 115K-149KAirflow | Analytical Data | Analytical Data Models | Columnar Databases | Data modelsFlexible schedule | Growth roadmaps | Mentorship | Remote options | TechtalksMid-level Full TimeZONA 1, Guatemala2d ago
-
Data Engineer (Middle) ID50589 USD 115K-149KAirflow | Analytical Data | Analytical Data Models | Columnar Databases | Data modelsFlexible schedule | Growth roadmaps | Mentorship | Remote options | TechtalksMid-level Full TimeCHIMALTENANGO, Guatemala2d ago
-
Data Engineer (Senior) ID53687 USD 118K-164KAWS | Apache Spark | Data Infrastructure | Data Processing | Index buildingFlextime | Mentorship | Personalized growth | Remote options | Team activity budgetSenior-level Full TimeQUETZALTENANGO, Guatemala2d ago
-
Data Engineer (Middle) ID50589 USD 115K-149KAirflow | Analytical Data | Analytical Data Models | Code Documentation | Columnar DatabasesFlextime | Mentorship | Personalized growth | Professional growth | Remote optionsMid-level Full TimeQUETZALTENANGO, Guatemala2d ago
-
Apache Spark | Cloud Computing | Data Modeling | ETL | GitCareer growth opportunities | Professional development | Remote work | Team collaborationMid-level Full TimeMonterrey, Nuevo León, México R6d ago
-
Java Engineer (Junior/Trainee) ID52279 INR 1400K-1400KAWS | Azure | Cloud Platforms | Data Pipelines | ETLMentorship | Personalized growth plans | Remote options | Team activity budgets | TechtalksEntry-level Full TimeZONA 1, Guatemala13d ago
-
Agile Scrum | Apache Spark | Cloud Computing | Data Modeling | ETL ProcessesCollaborative environment | Opportunities for growth | Professional development | Remote workMid-level Full TimeMonterrey, Nuevo León, México R14d ago
-
Data Engineer (Middle) ID50589 USD 102K-145KAirflow | Analytical Data | Analytical Data Models | Code readability | Columnar DatabasesCompetitive pay | Education budget | Fitness budget | Growth roadmaps | MentorshipMid-level Full TimeQUETZALTENANGO, Guatemala26d ago
-
Java Engineer ID45903 USD 140K-180KAWS | Caching | Containers | Flask | GCPEducation budgets | Fitness budgets | Growth roadmaps | Mentorship | Remote optionsSenior-level Full TimeZONA 1, Guatemala28d ago
-
Data Engineer (Middle) ID50589 USD 100K-143KAirflow | Analytical Data | Analytical Data Models | Code Documentation | Columnar DatabasesFlexible schedule | Growth roadmaps | Mentorship | Project variety | Remote optionsMid-level Full TimeZONA 1, Guatemala1mo ago