Engineering Manager (Big Data Platform)
Singapore, Singapore
Centre for Strategic Infocomm Technologies
CSIT is a technical agency in the Ministry of Defence that harnesses cutting-edge digital technologies to meet Singapore’s security needs.
As an Engineering Manager of Big Data Platform, you lead engineering teams to deliver Big Data platforms for running mission-critical workflows. You set the technical direction, architect, lead and manage the development Big Data Platforms. You push the limits of technology to ensure that the whole big data pipeline runs optimally and smoothly from ingestion to processing to persistence. You have the autonomy to determine the best way to deliver value and the technology used. You are responsible for recruiting, coaching and mentoring Big Data Platform engineers.
Responsibilities
- Lead a team to deliver a highly resilient, scalable and secure Big Data Platforms.
- Lead, design, implement and maintain real-time high-volume data processing, querying and persistence solutions using Big Data technologies.
- Lead the technical discussions with key stakeholders on areas related to Big Data platforms.
- Influence decisions and drive improvements with technical leadership.
- Bring industry standards and best practices to the team.
- Understand and identify technologies and system pitfalls for the team.
- Accountable for team’s design architecture, standards and performance monitoring.
- Create and manage a high performance engineering team. Grow team capabilities through coaching and mentoring.
- Be the subject matter expert and role model for the team.
- Create best environment for innovation and synergise the team to drive innovation.
- Involve in hiring process to attract and hire capable and motivate engineers.
Requirements (Minimum Qualifications)
- Bachelor’s degree in Computer Engineering, Computer Science or equivalent experience
- Deep expertise with at least 8 years of experience in Big Data Platforms. Proven experience with technologies like OKD, Spark, Kafka, Hadoop, Elastic Stack, Kudu
- Experience in troubleshooting and resolving issues of the Big Data stack, ranging from hardware, networking, operating system to software
- Experience in managing physical and virtual infrastructures
- Experience in supporting search workloads in multi-terabytes and billions of records
- Experience in distributed systems
- Experience building microservices for Big Data platforms
- Proven experience in using DevOps tools and CI/CD pipelines effectively
- Competent in programming languages such as Scala or Java
- Experience in leading engineering teams
- Technical leadership and mentoring/coaching experiences
- Excellent communication skills
- Positive attitude and excellent teamwork
Nice-to-haves
- Experience with cluster management and DevOps tools (e.g. Ansible, Kubernetes)
- Experience working with application or product teams
- Experience working in an agile and innovative environment
- Love for open source technologies
Why join us?
- The work is purposeful and meaningful
- You will work with the best engineers
- We work with modern technologies and tech stacks
- We have excellent engineering culture and work-life balance
- We aspire to engineering and operational excellence
- We empower to innovate
- We grow together as a family
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Job stats:
1
1
0
Categories:
Big Data Jobs
Engineering Jobs
Leadership Jobs
Tags: Agile Ansible Architecture Big Data CI/CD Computer Science DevOps Distributed Systems Engineering Hadoop Java Kafka Kubernetes Microservices Open Source Pipelines Scala Spark
Region:
Asia/Pacific
Country:
Singapore
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.
Data Engineer II jobsBI Developer jobsData Scientist II jobsStaff Data Scientist jobsPrincipal Data Engineer jobsData Manager jobsJunior Data Analyst jobsData Science Manager jobsResearch Scientist jobsLead Data Analyst jobsBusiness Data Analyst jobsSenior AI Engineer jobsData Engineer III jobsSr. Data Scientist jobsData Science Intern jobsData Specialist jobsJunior Data Engineer jobsSoftware Engineer, Machine Learning jobsSenior Data Scientist, Performance Marketing jobsSoftware Engineer II jobsData Analyst Intern jobsBI Analyst jobsData Analyst II jobsSr Data Engineer jobsSenior Artificial Intelligence/Machine Learning Engineer - Remote, Latin America jobs
Snowflake jobsEconomics jobsLinux jobsHadoop jobsOpen Source jobsJavaScript jobsPhysics jobsMLOps jobsComputer Vision jobsAirflow jobsKafka jobsRDBMS jobsBanking jobsNoSQL jobsGoogle Cloud jobsData Warehousing jobsScala jobsR&D jobsKPIs jobsData warehouse jobsGitHub jobsOracle jobsClassification jobsPostgreSQL jobsSAS jobs
CX jobsStreaming jobsLooker jobsScikit-learn jobsScrum jobsTerraform jobsPandas jobsPySpark jobsDistributed Systems jobsBigQuery jobsData Mining jobsRobotics jobsJira jobsIndustrial jobsJenkins jobsRedshift jobsdbt jobsReact jobsUnstructured data jobsMicroservices jobsData strategy jobsE-commerce jobsMySQL jobsMatlab jobsNumPy jobs