Big Data Platform Engineer
Singapore, Singapore
Centre for Strategic Infocomm Technologies
CSIT is a technical agency in the Ministry of Defence that harnesses cutting-edge digital technologies to meet Singapore’s security needs.
Data processing is an essential part of national security in the modern world. As an engineer in our Big Data Platform team, you will build and own a solid data platform as the foundation to support critical national security missions. You will push the limits of technology to ensure that the whole big data pipeline runs optimally and smoothly from ingestion to processing to persistence. You are encouraged to suggest the best way to deliver value and the technologies used. Join the awesome CSIT family and use cutting-edge technologies to protect the nation.
Responsibilities· Implement and maintain real-time high-volume data processing, querying and persistence solutions using Big Data technologies· Implement highly available, resilient, scalable and sustainable Big Data platforms· Administer (configuration, backup and recovery) Big Data platform services running across multiple clusters· Deploy and manage the cluster efficiently using DevOps and automation tools· Build performance and health monitoring tools to ensure optimal system performance and availability· Work closely with different teams to ensure smooth onboarding and operations of the Big Data platform· Conduct resource planning and scaling exercises to support increasing workload· Conduct research and evaluations of new technologies· Innovate and improve the current system
Requirements (Minimum Qualifications)· Bachelor’s degree in Computer Engineering, Computer Science or equivalent experience· Able to communicate clearly· Positive attitude and excellent teamwork· Passionate about big data technologies· Love for open source technologies Nice-to-haves· Experience in managing physical and virtual infrastructures· Experience with cluster management and DevOps tools (e.g. Ansible, Kubernetes)· Experience working with application or product teams· Experience working in an agile and innovative environment
Why join us?· The work is purposeful and meaningful· You will work with the best engineers· We work with modern technologies and tech stacks· We have excellent engineering culture and work-life balance· We aspire to engineering and operational excellence· We empower to innovate· We grow together as a family
As CSIT is an agency under the Ministry of Defence (Singapore), only Singapore Citizens will be considered.
Responsibilities· Implement and maintain real-time high-volume data processing, querying and persistence solutions using Big Data technologies· Implement highly available, resilient, scalable and sustainable Big Data platforms· Administer (configuration, backup and recovery) Big Data platform services running across multiple clusters· Deploy and manage the cluster efficiently using DevOps and automation tools· Build performance and health monitoring tools to ensure optimal system performance and availability· Work closely with different teams to ensure smooth onboarding and operations of the Big Data platform· Conduct resource planning and scaling exercises to support increasing workload· Conduct research and evaluations of new technologies· Innovate and improve the current system
Requirements (Minimum Qualifications)· Bachelor’s degree in Computer Engineering, Computer Science or equivalent experience· Able to communicate clearly· Positive attitude and excellent teamwork· Passionate about big data technologies· Love for open source technologies Nice-to-haves· Experience in managing physical and virtual infrastructures· Experience with cluster management and DevOps tools (e.g. Ansible, Kubernetes)· Experience working with application or product teams· Experience working in an agile and innovative environment
Why join us?· The work is purposeful and meaningful· You will work with the best engineers· We work with modern technologies and tech stacks· We have excellent engineering culture and work-life balance· We aspire to engineering and operational excellence· We empower to innovate· We grow together as a family
As CSIT is an agency under the Ministry of Defence (Singapore), only Singapore Citizens will be considered.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Job stats:
0
0
0
Categories:
Big Data Jobs
Engineering Jobs
Tags: Agile Ansible Big Data Computer Science DevOps Engineering Kubernetes Open Source Research Security
Region:
Asia/Pacific
Country:
Singapore
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.
Data Engineer II jobsStaff Data Scientist jobsPrincipal Data Engineer jobsBI Developer jobsData Scientist II jobsData Manager jobsData Science Manager jobsJunior Data Analyst jobsResearch Scientist jobsBusiness Data Analyst jobsLead Data Analyst jobsSr. Data Scientist jobsData Science Intern jobsSenior Data Scientist, Performance Marketing jobsJunior Data Engineer jobsSoftware Engineer, Machine Learning jobsSenior AI Engineer jobsBI Analyst jobsSenior Artificial Intelligence/Machine Learning Engineer - Remote, Latin America jobsSr Data Engineer jobsData Engineer III jobsData Specialist jobsJunior Data Scientist jobsData Analyst II jobsAzure Data Engineer jobs
Linux jobsSnowflake jobsEconomics jobsPhysics jobsHadoop jobsOpen Source jobsJavaScript jobsRDBMS jobsComputer Vision jobsAirflow jobsKafka jobsScala jobsMLOps jobsNoSQL jobsData Warehousing jobsBanking jobsKPIs jobsData warehouse jobsGitHub jobsGoogle Cloud jobsClassification jobsOracle jobsScikit-learn jobsSAS jobsCX jobs
PostgreSQL jobsScrum jobsR&D jobsTerraform jobsStreaming jobsData Mining jobsLooker jobsPandas jobsDistributed Systems jobsIndustrial jobsJenkins jobsJira jobsRobotics jobsPySpark jobsBigQuery jobsReact jobsMicroservices jobsdbt jobsRedshift jobsMatlab jobsMySQL jobsData strategy jobsUnstructured data jobsE-commerce jobsNumPy jobs