Data Engineer
Lahore, PK
Avanceon MEA
Avanceon is a leading automation, control systems integration, and energy management solutions provider with over 24 years of expertise. Operating from offices in Dubai, Lahore, and Pennsylvania, it serves markets across the Middle East, South...About Us?
Avanceon is a multinational corporation which specializes in automation, control systems integration, energy management solutions, and support services. With offices in Dubai, Qatar, Saudi Arabia, and Pakistan, it has established a significant market presence. Over its 24-year history, Avanceon has evolved into a comprehensive provider offering automation, energy management, service, and maintenance solutions. Through its extensive experience and diverse client base, including major blue-chip companies, it has garnered strong credentials and expertise in the industry.
Job Overview:
We are looking for a Data Engineer to join our team and design, build, and maintain robust and scalable data pipelines. The ideal candidate will play a critical role in developing systems that process and analyze data efficiently, enabling data-driven decision-making across the organization.
Key Responsibilities:
- Design, develop, and maintain ETL pipelines to ingest, transform, and load large volumes of data from various sources into data lakes and data warehouses.
- Collaborate with Data Scientists, Analysts, and Software Engineers to ensure clean and reliable data for analytical solutions and models.
- Build and optimize data storage and retrieval systems using Microsoft Azure Coud Platform
- Develop and maintain data models, databases, and schemas to support business intelligence, reporting, and analytics.
- Implement data governance principles, including quality, integrity, and security protocols.
- Monitor, troubleshoot, and improve data pipelines, ensuring systems are reliable and scalable.
- Automate data workflows and optimize performance using modern tools like Apache Spark, Airflow, or similar orchestration frameworks.
- Perform root-cause analysis on complex data issues and implement solutions.
- Keep up-to-date with emerging technologies in data engineering, proposing innovative solutions to improve data infrastructure.
Required Skills and Qualifications:
- Bachelor’s or Master’s degree in Computer Science, Data Engineering, IT, or related field.
- 3-5+ years of experience in a Data Engineering role or similar capacity.
- Proficiency with SQL and programming languages such as Python or Java.
- Experience with Azure Data Platform (Data Factory, Synapse Analytics, Databricks, AppLogic)
- Hands-on experience with ETL/ELT tools (e.g., SQL SSIS , Apache Airflow, Talend, Matillion, Informatica).
- Familiarity with big data technologies like Apache Spark, Kafka, or Hadoop.
- Knowledge of data warehousing concepts and experience with platforms like SQL Server, Azure Synapse Analytics (formerly Azure SQL Data Warehouse), Snowflake, Redshift, or BigQuery.
- Strong problem-solving skills and an ability to analyze complex data architectures.
- Familiarity with CI/CD pipelines, version control (e.g., Git), and data automation.
- Experience working in an Agile environment.
Nice-to-Have Skills
- Experience with streaming data frameworks (Kafka, Flink, Kinesis).
- Knowledge of data governance and security practices (GDPR, HIPAA compliance).
- Understanding of Machine Learning Operations (MLOps) or DataOps.
- Certifications in relevant technologies like Azure Data Engineer, or Google Professional Data Engineer.
Why Join Us?
- Opportunity to work with a talented team on impactful data-driven projects.
- Access to cutting-edge tools and technologies.
- Competitive salary, benefits, and a dynamic work environment.
- Travel for easy commute.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Agile Airflow Architecture Azure Big Data BigQuery Business Intelligence CI/CD Computer Science Databricks Data governance DataOps Data pipelines Data warehouse Data Warehousing ELT Engineering ETL Flink Git Hadoop Informatica Java Kafka Kinesis Machine Learning Matillion MLOps Pipelines Python Redshift Security Snowflake Spark SQL SSIS Streaming Talend
Perks/benefits: Career development Competitive pay
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.