Software Engineer II

Job Role: Software Engineer 2 (Sr. Data Engineer)

Job Location: Bangalore

Working: Hybrid

Summary of Essential Job Functions

• Design, develop, and maintain scalable and efficient data pipelines using Python, Pandas, Spark, and Dataflow.
• Strong background in relational databases such as SQL Server or MySQL along with a deep understanding of the Cloud Platform.
• Putting together large, intricate data sets to satisfy both functional and non-functional business needs.
• Analyze and integrate disparate systems / data using ETL processes and logic to provide timely and accurate information to visualization team and business stakeholders.
• Optimize and troubleshoot data pipelines for performance, reliability, and scalability.
• Ensure data integrity and quality throughout the pipeline by implementing validation and testing strategies.
• Determining, creating, and implementing internal process improvements, such as redesigning infrastructure for increased scalability, improving data delivery, and automating manual procedures
• Collaborate with cross-functional teams to understand data requirements and implement solutions that meet business needs.
• Develop and maintain documentation for data pipelines, including design documents, code comments, and operational guides.
• Provide technical support for production issues including troubleshooting, query and process optimization.
• Provide technical guidance and mentorship to junior team members, promoting best practices and continuous learning.
• Having knowledge on analytics using PowerBI, Tableau, Data studio and Apache SuperSet

Work Experience & Qualifications

• Proven 4 to 6  Yrs. in design and development.
• Excellent customer-facing and internal communication skills.
• A bachelor’s degree in computer science / information science / data science.