Data Engineer

Orion Innovation is a premier, award-winning, global business and technology services firm.  Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, and maturity.  We work with a wide range of clients across many industries including financial services, professional services, telecommunications and media, consumer products, automotive, industrial automation, professional sports and entertainment, life sciences, ecommerce, and education.

Senior Data Engineer/Data Lead

Experience- 4-10 Years

Location- Kochi, Coimbatore, Chennai

Job Overview

We are seeking a talented and motivated Date Engineer to join our dynamic development team You will collaborate with cross-functional teams to create efficient, scalable, and high-performing software solutions.

Key Responsibilities:

• Design and Implement Data Pipelines: Create, deploy, and manage robust data pipelines using Azure Data Factory and other ETL tools to process structured and unstructured data.
• Data Integration: Integrate data from multiple sources (on-premises, cloud) into Azure-based data lakes, data warehouses, and analytics solutions.
• Data Modeling: Design and implement data models and schemas to ensure effective data management and accessibility.
• Optimize Data Solutions: Continuously improve data pipelines and data solutions by optimizing performance, scalability, and reliability.
• Data Security and Governance: Implement data security policies and practices to ensure the confidentiality, integrity, and availability of data in the cloud.
• Collaboration: Work with analysts, and other engineers to ensure data availability, reliability, and accessibility for business intelligence.
• Monitor and Maintain Data Systems: Monitor the performance of data pipelines and systems, providing regular updates and resolving any issues related to data processing and storage.
• Azure Services Utilization: Utilize Azure tools such as Azure SQL Data Warehouse, Azure Blob Storage, Azure Databricks, and Azure Synapse Analytics to build and maintain data systems.
• Strong experience in Azure Data Bricks, Azure Data Factory and Pyspark
• Experience in Data Fabricks

Skills & Qualifications:

• Experience: 3+ years of experience as a Data Engineer with hands-on experience in working with Azure data platforms and services.
• Azure Technologies: Strong knowledge of Azure services, including Azure Data Factory, Azure SQL Database, Azure Data Lake, Azure Blob Storage, Azure Synapse Analytics, and Azure Databricks.
• ETL Development: Proficiency in developing ETL processes and data integration workflows.
• SQL: Solid understanding and experience in writing complex SQL queries for data manipulation and transformation.
• Programming: Proficiency in languages such as PySpark, SQL, or Scala to create data solutions.
• Data Warehousing: Experience in building and maintaining data warehouses and/or data lakes.
• Problem-Solving Skills: Ability to troubleshoot and optimize complex data systems.
• Communication: Strong verbal and written communication skills for effectively working with cross-functional teams.
• Experience handling a team of 4+ Data Engineers
• Excellent communication & Articulation skills

Preferred Qualifications:

• Certifications: Azure Data Engineer Associate certification (DP-200, DP-201) or equivalent is a plus.
• Experience with BI tools: Familiarity with Power BI or other data visualization tools.

What we provide:

• Competitive Salary
• Performance based Variable Pay
• Health, Vision, Dental, and Life Insurance
• Comprehensive Employee Wellness Plan
• Retirement plan
• Paid Holidays and Vacation Time Accrual
• Encouraging and highly energetic environment
• Personal and Professional Growth Opportunities

Orion is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, creed, religion, sex, sexual orientation, gender identity or expression, pregnancy, age, national origin, citizenship status, disability status, genetic information, protected veteran status, or any other characteristic protected by law.

Candidate Privacy Policy

Orion Systems Integrators, LLC and its subsidiaries and its affiliates (collectively, “Orion,” “we” or “us”) are committed to protecting your privacy. This Candidate Privacy Policy (orioninc.com) (“Notice”) explains:

• What information we collect during our application and recruitment process and why we collect it;
• How we handle that information; and
• How to access and update that information.

Your use of Orion services is governed by any applicable terms in this notice and our general Privacy Policy.