Big Data Engineer (Apache open source project - Spark, YARN, Hadoop, Zookeeper, Kafka)

Tasks

• Build high performance secure backend systems
• Design backend services and APIs
• Develop tools and capacity planning infrastructure
• Ensure data security and end to end system architecture
• Manage service lifecycle from design to operation
• Troubleshoot software issues and diagnose system problems

Perks/Benefits

• N/A

Skills/Tech-stack

Apache Hadoop | Apache Kafka | Apache Spark | Apache YARN | Apache Zookeeper | Benchmarking | Computer networks | High Availability | High Performance | High-Performance Computing | Java | Linux | Microservices | NoSQL | Performance Computing | Profiling | Python | REST API | RabbitMQ | Resource Optimization | SQL | Spring Boot