Azure Data Engineer

Company Description

Experian is a global data and technology company, powering opportunities for people and businesses around the world. We help to redefine lending practices, uncover and prevent fraud, simplify healthcare, create marketing solutions, and gain deeper insights into the automotive market, all using our unique combination of data, analytics and software. We also assist millions of people to realize their financial goals and help them save time and money.

We operate across a range of markets, from financial services to healthcare, automotive, agribusiness, insurance, and many more industry segments.

We invest in people and new advanced technologies to unlock the power of data. As a FTSE 100 Index company listed on the London Stock Exchange (EXPN), we have a team of 22,500 people across 32 countries. Our corporate headquarters are in Dublin, Ireland. Learn more at experianplc.com.

Job Description

The Azure Big Data Engineer is an important role where you are responsible for designing, implementing, and managing comprehensive big data solutions on the Azure platform.

You will report to the Senior Manager and require you to work hybrid 2 days WFO in Hyderabad

Responsibilities:

• Design, implement, and maintain scalable and reliable data pipelines using Azure Data Factory, Databricks, and Synapse Analytics. Microsoft Fabric
• Develop, configure, and optimize data lakes and warehouses on Azure using services like Azure Data Lake Storage (ADLS), Azure Lakehouse, Warehouse and monitor data pipelines for performance, scalability, and reliability.
• Collaborate with data scientists, architects, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs.
• Ensure that data is secure and meets all regulatory compliance standards, including role-based access control (RBAC) and data encryption in Azure environments.
• Develop and configure monitoring and alerting mechanisms to proactively enhance performance and optimize data systems.
• Troubleshoot and resolve data-related issues in a timely manner.
• Produce clear, concise technical documentation for all developed solutions

Requirements:

• Experience with SSIS, SQL Jobs, BIDS & ADF
• Experience with Azure services (Microsoft Fabric, Azure Synapse, Azure SQL Database, Azure Key Vault, etc.).
• Proficiency in Azure data services, including Azure Data Factory, Azure Databricks, Azure Synapse Analytics and Azure Data Lake Storage.
• Experience in data modeling, data architecture, and implementing ETL/ELT solutions
• Proficiency in SQL and familiarity with other programming languages such as Python or Scala.
• Knowledge of data modeling, data warehousing, and big data technologies.
• Experience with data governance and security best practices.

Qualifications

• Bachelors in computer science or related field, Masters preferred

• 6+ years of professional data ingestion experience with ETL/ELT tools like SSIS, ADF, Synapse
• 2+ years of Azure cloud experience
• Bachelors in computer science or related field, Masters

Preferred:

• Experience with Microsoft Fabric and Azure Synapse.
• Understand ML/AI concepts.
• Azure certifications

Additional Information

Our uniqueness is that we truly celebrate yours. Experian's culture and people are important differentiators. We take our people agenda very seriously and focus on what truly matters; DEI, work/life balance, development, authenticity, engagement, collaboration, wellness, reward & recognition, volunteering... the list goes on. Experian's strong people first approach is award winning; Great Place To Work™ in 24 countries, FORTUNE Best Companies to work and Glassdoor Best Places to Work (globally 4.4 Stars) to name a few. Check out Experian Life on social or our Careers Site to understand why.

Experian is proud to be an Equal Opportunity and Affirmative Action employer. Innovation is a critical part of Experian's DNA and practices, and our diverse workforce drives our success. Everyone can succeed at Experian and bring their whole self to work, irrespective of their gender, ethnicity, religion, color, sexuality, physical ability or age. If you have a disability or special need that requires accommodation, please let us know at the earliest opportunity.

Experian Careers - Creating a better tomorrow together

Benefits

Experian care for employee's work life balance, health, safety and wellbeing. In support of this endeavor, we offer best-in-class family well-being benefits, enhanced medical benefits and paid time off.

#LI-Hybrid

Experian Careers - Creating a better tomorrow together

Find out what its like to work for Experian by clicking here