Senior Data Integration Engineer
Bangalore, Karnataka, India
Senior Data Integration Engineer
Role Overview
The Senior Data Integration Engineer will play a critical role in designing and deploying robust, scalable, and high-performance data pipelines that unify enterprise data sources within a modern cloud ecosystem. This role requires a strong foundation in data engineering, deep technical expertise, and a collaborative mindset to drive innovation and efficiency across the data integration landscape.
Job Responsibilities
• Develop and implement data ingestion and data processing pipelines to integrate disparate sources across the enterprise with data integration platform in Azure cloud environment.
• Program data processing tasks using appropriate technologies and frameworks.
• Implement data modeling solutions using both traditional Relational and NoSQL databases.
• Resolve technical issues independently and collaborate with other teams to address challenges.
• Apply creative problem-solving skills within own code and across teams to achieve project objectives.
• Take ownership of assigned work and demonstrate accountability for outcomes.
• Employ out-of-the-box thinking to propose innovative solutions to complex problems.
Technical Skills:
• Expert-level proficiency in Java for developing high performant applications (required). Experience with Python is a strong plus.
• Comprehensive hands-on experience with implementing ETL/ELT pipelines and tools, as well as Change Data Capture (CDC) technologies. (required)
• Demonstrated capability to process large-scale datasets using distributed computing frameworks such as Apache Spark. (required)
• Proven experience in building event-driven architectures and optimizing data pipelines for throughput, latency, and reliability. (required)
• Strong working knowledge of real-time streaming systems such as Apache Kafka (strongly preferred).
• Fluency with structured and semi-structured data formats (e.g., AVRO, JSON) and data modeling tools like Erwin, ED Studio… etc (strongly preferred).
• Practical experience with NoSQL databases including MongoDB, Couchbase, or Cassandra in high-availability environments (strongly preferred).
• Experience with containerization using Docker or Kubernetes for scalable deployment (strongly preferred).
• Familiarity with cloud-native application development practices and CI/CD pipelines using Gitlab (strongly preferred).
• Proven ability to build and deploy applications in cloud environments such as Azure (strongly preferred).
Ideal Candidate:
The ideal candidate will have:
• Strong technical experience with the required job skills, and well-rounded across the preferred qualifications.
• Strong communication skills and the ability to collaborate effectively with cross-functional teams.
• Proven experience in independently owning and delivering project tasks.
• Strong problem-solving skills and the ability to think critically about architectural decisions.
• Experience practicing Agile development methodologies such as Scrum or Kanban.
• Positive ‘Can-Do’ attitude with strong tenacity to drive through complex challenges and obstacles.
• Ability to break down high-level designs into actionable tasks and drive execution to deliver high-quality products.
Job Qualifications
Minimum Qualifications:
• Bachelor’s degree in computer science, Engineering, or a related field.
• 7+ years of experience in software engineering, data engineering, or application development.
• 3+ years of hands-on experience developing software products using modern data integration technologies.
More details about our company benefits can be found here:
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile Architecture Avro Azure Cassandra CI/CD Computer Science Data pipelines Docker ELT Engineering ETL GitLab Industrial Java JSON Kafka Kanban Kubernetes MongoDB NoSQL Pipelines Python Scrum Spark Streaming
Perks/benefits: Career development
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.