Tech Lead - Data Engineering

Responsibilities

About ByteDance
Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.

Why Join Us
Creation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible.
Together, we inspire creativity and enrich life - a mission we aim towards achieving every day.
To us, every challenge, no matter how ambiguous, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always.
At ByteDance, we create together and grow together. That's how we drive impact - for ourselves, our company, and the users we serve.
Join us.

Team Introduction
Video Infrastructure is a world-leading video platform that provides multi-media storage, delivery, transcoding, and streaming services. We are building the next generation video processing platform and the largest live streaming network, which provides excellent experiences for billions of users around the world. Popular video products of TikTok and its affiliates are all empowered by our cutting-edge cloud technologies. Working in this team, you will have the opportunity to tackle challenges of large-scale networks all over the world, while leveraging your expertise in coding, algorithms, complexity analysis, and large-scale system design.

Responsibilities:
Strategically oversee and lead the construction of optimal data processing architecture and systems for new data and ETL pipelines, ensuring alignment with business goals and technological advancements.
Take charge of planning, building, and maintaining highly efficient and reliable data pipelines to move and transform data of all scales, while optimizing resource allocation and performance.
Proactively lead engineers across multiple regions and coordinate collaboration with different cross-functional partners, including CDN, Video Understanding, Video Transcoding, Live Streaming, and Real-Time Communication, to ensure seamless integration and delivery of services.

Qualifications

Minimum Qualifications:
Possess a bachelor's degree or above in Computer Science or a related technical background involving software/system engineering. Additionally, have a proven track record of managerial experience in similar fields.
Demonstrate exceptional leadership in programming, with proficiency in at least one of the following languages: C, C++, Java, Python, or Go. Be able to guide and mentor team members in coding best practices.
Boast extensive managerial experience in custom ETL/data pipeline design, implementation, and maintenance, with a focus on driving innovation and efficiency.
Be highly knowledgeable and experienced in data processing software (Hadoop, Spark, Pig, Hive) and algorithms (MapReduce, Flume). Be able to make strategic decisions on technology adoption and optimization to meet business needs.
Have remarkable ability in troubleshooting and problem-solving in large-scale distributed systems. Be able to lead and inspire the team to quickly and accurately locate and solve issues, while also implementing preventive measures to avoid future problems.

ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

#LI-IL2