Big Data Engineer, Data Ingestion
Singapore, Singapore
About the Team
The Data Management Suite team is building products that cover the whole lifecycle of data pipeline, including data ingestion and Integration, data development, data catalog, data security and data governance. These products support various businesses, so data engineers and data scientists could greatly boost their productivity.
As a software engineer in the data management suite team, you will have the opportunity to build, optimize and grow one of the largest data platforms in the world. You'll have the opportunity to gain hands-on experience on core systems in the data platform ecosystem. Your work will have a direct and huge impact on the company's core products as well as hundreds of millions of users.
Responsibilities:
- Design, develop, and optimize the architecture of large-scale data ingestion systems to support real-time data pipelines, ensuring high throughput, low latency, and fault tolerance.
- Enhance the performance, scalability, and reliability of data ingestion pipelines.
- Develop and implement automated and intelligent operation and maintenance systems to monitor, diagnose, and ensure the stability and reliability of data ingestion pipelines..
- Collaborate with cross-functional teams to deliver event data ingestion, transformation, and storage solutions that meet diverse business requirements.
- Troubleshoot and resolve complex issues in production systems, ensuring minimal downtime and optimal performance.
The Data Management Suite team is building products that cover the whole lifecycle of data pipeline, including data ingestion and Integration, data development, data catalog, data security and data governance. These products support various businesses, so data engineers and data scientists could greatly boost their productivity.
As a software engineer in the data management suite team, you will have the opportunity to build, optimize and grow one of the largest data platforms in the world. You'll have the opportunity to gain hands-on experience on core systems in the data platform ecosystem. Your work will have a direct and huge impact on the company's core products as well as hundreds of millions of users.
Responsibilities:
- Design, develop, and optimize the architecture of large-scale data ingestion systems to support real-time data pipelines, ensuring high throughput, low latency, and fault tolerance.
- Enhance the performance, scalability, and reliability of data ingestion pipelines.
- Develop and implement automated and intelligent operation and maintenance systems to monitor, diagnose, and ensure the stability and reliability of data ingestion pipelines..
- Collaborate with cross-functional teams to deliver event data ingestion, transformation, and storage solutions that meet diverse business requirements.
- Troubleshoot and resolve complex issues in production systems, ensuring minimal downtime and optimal performance.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Job stats:
0
0
0
Categories:
Big Data Jobs
Engineering Jobs
Tags: Architecture Big Data Data governance Data management Data pipelines Pipelines Security
Region:
Asia/Pacific
Country:
Singapore
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.
Power BI Developer jobsBusiness Intelligence Developer jobsPrincipal Data Engineer jobsBI Developer jobsStaff Data Scientist jobsStaff Machine Learning Engineer jobsPrincipal Software Engineer jobsJunior Data Analyst jobsData Science Intern jobsDevOps Engineer jobsData Manager jobsData Science Manager jobsSoftware Engineer II jobsAccount Executive jobsStaff Software Engineer jobsData Analyst Intern jobsLead Data Analyst jobsBusiness Data Analyst jobsAI/ML Engineer jobsSr. Data Scientist jobsData Specialist jobsData Governance Analyst jobsSenior Backend Engineer jobsData Engineer III jobsBusiness Intelligence Analyst jobs
Consulting jobsMLOps jobsAirflow jobsOpen Source jobsEconomics jobsLinux jobsKPIs jobsKafka jobsTerraform jobsGitHub jobsJavaScript jobsPostgreSQL jobsRDBMS jobsData Warehousing jobsNoSQL jobsClassification jobsBanking jobsStreaming jobsScikit-learn jobsPrompt engineering jobsRAG jobsComputer Vision jobsPhysics jobsGoogle Cloud jobsPandas jobs
Hadoop jobsOracle jobsScala jobsdbt jobsBigQuery jobsLooker jobsReact jobsGPT jobsData warehouse jobsR&D jobsLangChain jobsScrum jobsPySpark jobsDistributed Systems jobsMicroservices jobsCX jobsELT jobsIndustrial jobsSAS jobsOpenAI jobsJira jobsRedshift jobsModel training jobsTypeScript jobsJenkins jobs