Sr Data Engineer - Platforms
Hyderabad, Telangana, India
Fanatics
Fanatics.com is the ultimate sports apparel and Fan Gear Store, featuring football Jerseys, T-shirts, Hats, Collectibles and merchandise for fans of the NFL, MLB, NBA, NHL, Soccer, and College.Fanatics is the global leader in licensed sports merchandise that changes the way fans purchase their favorite team apparel and jerseys through an innovative and tech-infused approach to making and selling fan gear in today's on-demand culture. We have the world's largest collection of officially licensed fan gear from all the leagues, teams and players our fans love. We operate more than 300 online and offline stores including e-commerce business with all major professional sports leagues (NFL, MLB, NBA, NHL, NASCAR, MLS, PGA), major media brands (NBC Sports, CBS Sports, FOX Sports) and over 150 collegiate and professional team properties. We partner with over 1000 vendors including Adidas, Nike, Reebok and Under Armor
The FanStreams team at Fanatics has the grand vision of making many of the traditional batch-oriented processes into real time systems and is seeking a Software Engineer with the passion and ingenuity to build streams of data across various domains of the Fanatics world. These streams will power Data Science, BI & Site optimizations. The FanStreams team is responsible for building, managing complex stream processing topologies using the latest open source tech stack, building metrics and visualizations on the generated streams and creating varied data sets for different forms of consumption and access patterns. We're looking for a seasoned engineer to help us build and scale the next generation of streaming platforms and infrastructure at Fanatics.
What Will You Do?- Build data platforms and streaming engines that are real-time and batch in nature
- Optimizing existing data platforms and infrastructure while exploring other technologies
- Provide technical leadership to the data engineering team on how data should be stored and processed more efficiently and quickly at scale
- Build and scale stream & batch processing platforms using the latest open-source technologies
- Work with data engineering teams and help with reference implementation for different use cases
- Improve existing tools to deliver value to the users of the platform
- Work with data engineers to create services that can ingest and supply data to and from external sources and ensure data quality and timeliness
- Bachelor's degree in Computer Science or a related field, or equivalent combination of education and experience.
- 6+ years of software development experience with at least 2+ years of experience on open-source big data technologies
- Knowledge of common design patterns used in Complex Event Processing
- Knowledge in Streaming technologies: Apache Kafka, Kafka Streams, KSQL, Spark, Spark Streaming
- Proficiency in Java, Scala
- Strong hands on experience in SQL, Hive, Spark SQL, Data Modeling, Schema design.
- Experience and deep understanding of traditional, NoSQL and columnar databases
- Experience of building scalable infrastructure to support stream, batch and micro-batch data processing
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Big Data Computer Science Data quality E-commerce Engineering Java Kafka NoSQL Open Source Scala Spark SQL Streaming
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.