Data Engineer (Information Management Systems)
Singapore, Singapore
Centre for Strategic Infocomm Technologies
CSIT is a technical agency in the Ministry of Defence that harnesses cutting-edge digital technologies to meet Singapore’s security needs.
CSIT develops digital products to advance the national security interests of Singapore. We are looking for talented software engineers with a growth mindset and a passion for creating great products to improve the effectiveness and productivity of the organisation. About this roleAs a data engineer in the Information Management Systems team, you will be responsible for developing and managing data pipelines that deliver data to downstream business-critical systems. You will have opportunities to create/improve ETL (extract, transform, load) flows that process large volumes of data. You will also build/enhance APIs to serve data to downstream services and end-users.You will have the autonomy to find the best way to solve problems, such as finding the most suitable technologies to use. Responsibilities · Write high-quality code with unit, functional and end-to-end tests· Design, build, and deploy ETL solutions that are scalable and maintainable· Triage system issues to ensure the smooth running of data pipelines and systems (detecting/debugging/tracking/resolving production incidents)· Enable easy access to data for end-users (data scientists, analysts, and software engineers) via APIs with appropriate access control mechanisms· Prepare data in ready state for AI applications RequirementsMinimum· Bachelor's degree in Computer Science, Computer Engineering, Information Systems or a related field· At least 2 years of hands-on experience in Java programming· (Fresh grads – project/internship experience will be considered)· Experience in building ETL flows (e.g. NiFi, Airflow)· Experience in back-end development using frameworks such as SpringBoot· Familiarity with microservices architecture & RESTful API designPreferred· Software development experience with Agile SCRUM practises, testing, and production error/metrics monitoring· Experience in building scalable and fault-tolerant data pipelines that are maintainable· Familiarity with databases (e.g. MongoDB) and object stores (e.g. MinIO)
Experience in the following would be advantageous:· Search engines (e.g. Elasticsearch, Solr)· Messaging systems (e.g. RabbitMQ, Kafka)· Metrics/logging systems (E.g. Elastic Stack, Prometheus/Grafana) Considerations for senior positions· Candidates with at least 3 years of experience in software development with proven track record of the above qualifications· Experience in providing technical mentorship to junior software engineers· Experience in collaborating across teams to develop and deliver complex systems/products (e.g. communicating and negotiating architectural designs and technical solutions) As CSIT is an agency under the Ministry of Defence (Singapore), only Singapore Citizens will be considered.
#LI-DNI
Experience in the following would be advantageous:· Search engines (e.g. Elasticsearch, Solr)· Messaging systems (e.g. RabbitMQ, Kafka)· Metrics/logging systems (E.g. Elastic Stack, Prometheus/Grafana) Considerations for senior positions· Candidates with at least 3 years of experience in software development with proven track record of the above qualifications· Experience in providing technical mentorship to junior software engineers· Experience in collaborating across teams to develop and deliver complex systems/products (e.g. communicating and negotiating architectural designs and technical solutions) As CSIT is an agency under the Ministry of Defence (Singapore), only Singapore Citizens will be considered.
#LI-DNI
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Job stats:
0
0
0
Category:
Engineering Jobs
Tags: Agile Airflow APIs Architecture Computer Science Data pipelines Elasticsearch Engineering ETL Grafana Java Kafka Microservices MongoDB NiFi Pipelines RabbitMQ Scrum Security Testing
Region:
Asia/Pacific
Country:
Singapore
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.
Data Engineer II jobsStaff Data Scientist jobsPrincipal Data Engineer jobsBI Developer jobsData Scientist II jobsData Manager jobsData Science Manager jobsJunior Data Analyst jobsResearch Scientist jobsBusiness Data Analyst jobsLead Data Analyst jobsSr. Data Scientist jobsData Science Intern jobsSenior Data Scientist, Performance Marketing jobsJunior Data Engineer jobsSoftware Engineer, Machine Learning jobsSenior AI Engineer jobsBI Analyst jobsSenior Artificial Intelligence/Machine Learning Engineer - Remote, Latin America jobsSr Data Engineer jobsData Engineer III jobsData Specialist jobsJunior Data Scientist jobsData Analyst II jobsAzure Data Engineer jobs
Linux jobsSnowflake jobsEconomics jobsPhysics jobsHadoop jobsOpen Source jobsJavaScript jobsRDBMS jobsComputer Vision jobsAirflow jobsKafka jobsScala jobsMLOps jobsNoSQL jobsData Warehousing jobsBanking jobsKPIs jobsData warehouse jobsGitHub jobsGoogle Cloud jobsClassification jobsOracle jobsScikit-learn jobsSAS jobsCX jobs
PostgreSQL jobsScrum jobsR&D jobsTerraform jobsStreaming jobsData Mining jobsLooker jobsPandas jobsDistributed Systems jobsIndustrial jobsJenkins jobsJira jobsRobotics jobsPySpark jobsBigQuery jobsReact jobsMicroservices jobsdbt jobsRedshift jobsMatlab jobsMySQL jobsData strategy jobsUnstructured data jobsE-commerce jobsNumPy jobs