Data Engineer (Information Management Systems)
Singapore, Singapore
Centre for Strategic Infocomm Technologies
CSIT is a technical agency in the Ministry of Defence that harnesses cutting-edge digital technologies to meet Singapore’s security needs.
CSIT develops digital products to advance the national security interests of Singapore. We are looking for talented software engineers with a growth mindset and a passion for creating great products to improve the effectiveness and productivity of the organisation. About this roleAs a data engineer in the Information Management Systems team, you will be responsible for developing and managing data pipelines that deliver data to downstream business-critical systems. You will have opportunities to create/improve ETL (extract, transform, load) flows that process large volumes of data. You will also build/enhance APIs to serve data to downstream services and end-users.You will have the autonomy to find the best way to solve problems, such as finding the most suitable technologies to use. Responsibilities · Write high-quality code with unit, functional and end-to-end tests· Design, build, and deploy ETL solutions that are scalable and maintainable· Triage system issues to ensure the smooth running of data pipelines and systems (detecting/debugging/tracking/resolving production incidents)· Enable easy access to data for end-users (data scientists, analysts, and software engineers) via APIs with appropriate access control mechanisms· Prepare data in ready state for AI applications RequirementsMinimum· Bachelor's degree in Computer Science, Computer Engineering, Information Systems or a related field· At least 2 years of hands-on experience in Java programming· (Fresh grads – project/internship experience will be considered)· Experience in building ETL flows (e.g. NiFi, Airflow)· Experience in back-end development using frameworks such as SpringBoot· Familiarity with microservices architecture & RESTful API designPreferred· Software development experience with Agile SCRUM practises, testing, and production error/metrics monitoring· Experience in building scalable and fault-tolerant data pipelines that are maintainable· Familiarity with databases (e.g. MongoDB) and object stores (e.g. MinIO)
Experience in the following would be advantageous:· Search engines (e.g. Elasticsearch, Solr)· Messaging systems (e.g. RabbitMQ, Kafka)· Metrics/logging systems (E.g. Elastic Stack, Prometheus/Grafana) Considerations for senior positions· Candidates with at least 3 years of experience in software development with proven track record of the above qualifications· Experience in providing technical mentorship to junior software engineers· Experience in collaborating across teams to develop and deliver complex systems/products (e.g. communicating and negotiating architectural designs and technical solutions) As CSIT is an agency under the Ministry of Defence (Singapore), only Singapore Citizens will be considered.
#LI-DNI
Experience in the following would be advantageous:· Search engines (e.g. Elasticsearch, Solr)· Messaging systems (e.g. RabbitMQ, Kafka)· Metrics/logging systems (E.g. Elastic Stack, Prometheus/Grafana) Considerations for senior positions· Candidates with at least 3 years of experience in software development with proven track record of the above qualifications· Experience in providing technical mentorship to junior software engineers· Experience in collaborating across teams to develop and deliver complex systems/products (e.g. communicating and negotiating architectural designs and technical solutions) As CSIT is an agency under the Ministry of Defence (Singapore), only Singapore Citizens will be considered.
#LI-DNI
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Job stats:
0
0
0
Category:
Engineering Jobs
Tags: Agile Airflow APIs Architecture Computer Science Data pipelines Elasticsearch Engineering ETL Grafana Java Kafka Microservices MongoDB NiFi Pipelines RabbitMQ Scrum Security Testing
Region:
Asia/Pacific
Country:
Singapore
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.
Data Engineer II jobsBI Developer jobsData Scientist II jobsStaff Data Scientist jobsPrincipal Data Engineer jobsData Manager jobsJunior Data Analyst jobsData Science Manager jobsResearch Scientist jobsLead Data Analyst jobsBusiness Data Analyst jobsSenior AI Engineer jobsData Engineer III jobsSr. Data Scientist jobsData Science Intern jobsData Specialist jobsJunior Data Engineer jobsSoftware Engineer, Machine Learning jobsSenior Data Scientist, Performance Marketing jobsSoftware Engineer II jobsData Analyst Intern jobsBI Analyst jobsData Analyst II jobsSr Data Engineer jobsSenior Artificial Intelligence/Machine Learning Engineer - Remote, Latin America jobs
Snowflake jobsEconomics jobsLinux jobsHadoop jobsOpen Source jobsJavaScript jobsPhysics jobsMLOps jobsComputer Vision jobsAirflow jobsKafka jobsRDBMS jobsBanking jobsNoSQL jobsGoogle Cloud jobsData Warehousing jobsScala jobsR&D jobsKPIs jobsData warehouse jobsGitHub jobsOracle jobsClassification jobsPostgreSQL jobsSAS jobs
CX jobsStreaming jobsLooker jobsScikit-learn jobsScrum jobsTerraform jobsPandas jobsPySpark jobsDistributed Systems jobsBigQuery jobsData Mining jobsRobotics jobsJira jobsIndustrial jobsJenkins jobsRedshift jobsdbt jobsReact jobsUnstructured data jobsMicroservices jobsData strategy jobsE-commerce jobsMySQL jobsMatlab jobsNumPy jobs