Principal Data Engineer

About Emirates Global Aluminium

Emirates Global Aluminium is the world’s biggest ‘premium aluminium’ producer and the largest industrial company in the United Arab Emirates outside the oil and gas industry.  EGA is an integrated aluminium producer, with operations on four continents from bauxite mining to the production of cast primary aluminium and recycling. EGA employs over 7,000 of these people including more than 1,200 UAE Nationals. EGA operates aluminium smelters in Jebel Ali and Al Taweelah in the United Arab Emirates, an alumina refinery in Al Taweelah, a bauxite mine and associated export facilities in the Republic of Guinea, a speciality foundry in high strength recycled aluminium in Germany, and a recycling plant in the United States.

JOB PURPOSE:
The Principal Data Engineer (DE) owns the data decisions for the team. The Principal DE is the executor for overall Data strategy for the Digital transformation. The Principal DE works closely with business, digital, and IT teams to develop the overall strategy and architecture for data required to enable the digital and advanced analytics use cases. The Principal DE also drives the team’s data engineering practices and acts as a coach for data engineers on the use-cases. The Principal DE manages the overall pipeline of data flow and helps the team manage workflows seamlessly

KEY ACCOUNTABILITIES:
•    Design overall data architecture with best-in-class concepts and technologies in mind
•    Guide project teams on data strategy related to coding practices, data engineering, and analytical modelling
•    Coach team in coding to develop robust data pipelines and architecture solutions
•    Advocate and educate on the value of data driven decision making focusing on the “how and why” of solving problems 
•    Work with Product Owner to align the roadmap with strengths and opportunities within the data architecture
•    Evolve data engineering solutions continuously and challenge the status quo
•    Execute organisation vision of Industry 4.0 by developing and implementing short-term and long-term data strategies.
•    Develop the long term data roadmap in collaboration with IT teams around platform selection and usage 
•    Provide the team with a roadmap for implementing data engineering best practices 
•    build data engineering capability by providing technical leadership and career development for the orgnisation 
•    Lead, mentor, collaborate and coach a growing team of Data Engineers
•    Devise talent strategy for the team - identify resource gaps or inefficiencies, build hiring plan, recommend promotions and manage performance for consistency with the needs and vision of the department.
•    Lead multi-functional delivery teams to deliver robust data services for their department, other departments and customers. 
•    Work with other senior team members to identify, plan, develop and deliver data services
•    Perform key leadership and mentorship role in the areas of advanced data techniques, including data modeling, data ingestion, data integration, data visualization, data governance, statistical methods, and implementation involving cloud-based, traditional and hybrid architectures.
•    Review, select and integrate next-generation technologies into the architectural strategy as needed.
•    Work closely with the Data Science / Machine Learning and Analytics teams to provide data
•    required for developing, operationalizing, monitoring and evaluating predictive models, dashboards and reports for customer facing applications and internal use.
•    Implement and monitor quality control processes to ensure accuracy of data, dashboards and reports.
•    Lead the development and implementation of the data governance process. Governance must address data standardization and ways to address exponential data growth, and include establishing Data Owners and Stewards.
•    Be an SME in technical and functional aspects of our insights platform and its integration requirements
•    Proactively identify internal and external dependencies, issues, scope changes, and progress against project plan
•    Provide technical support to assist customers during and post implementation
•    Build and lead high-performing, agile teams focused on Data Engineering. 
•    Initiate and foster business partnerships with customers, vendors, IT executives, and senior business executives

AUTHORITY/ DECISION MAKING:

•    Thinking within broadly defined policies, standards and objectives. The determination of “what needs to be done” in applying polices is largely left up to the incumbent who must establish the plan, determine the priorities and prescribe the processes needed to achieve the objectives
•    Subject to general direction and broadly defined functional policy objectives. Actions which will impact other functional or operating areas usually require approval before they may be implemented.

QUALIFICATIONS & SKILLS:

 Domain Expertise
•    Bachelor’s degree required, MS or PhD preferred
•    Bachelor’s in Data Science, Computer Science, Engineering, Statistics and 10+ years of relevant experience. 
•    Minimum 5+ years of managerial experience utilizing strong leadership skills, including mentoring, communication, decision-making, and project management.
•    Knowledge of the Big Data technology landscape beyond the buzzwords; Experience with big data and analytics programming languages such as Python, R, Spark, NoSQL
•    Experience with batch and real-time processing frameworks (Hadoop, Apache Storm, Apache Kafka, Apache Spark etc.) 
•    Proficiency working with DataFrames and writing complex SQL queries
•    Familiar with production Cloud / DevOps environments and Data lake, Data transformation, ETL/ELT, and other data concepts
•    Experience of leveraging MS/Azure ecosystem to manage the development and maintenance of cloud platform operations
•    A broad set of technical skills and knowledge across hardware, software, systems and solutions development
•    A proven track record of using quantitative analysis to impact key business or product decisions
•    Solid grasp of and experience with implementing and operating software development methodologies
•    A solid grasp of common statistical applications and methods (A/B tests and multivariate experiments, probabilities, regression)
•    Understanding of Agile Software Development Lifecycle and project planning/execution skills
•    Outstanding communicating skills with stakeholders at all levels, managing stakeholders’ expectations and facilitate discussions across high risk or complexity or under constrained timescales.
•    Excellent Data analysis skills by helping teams apply a range of techniques for data profiling and sourcing system analysis from a complex single source with excellent capability to bring multiple data sources together in a conformed model for analysis
•    Outstanding capability to establish enterprise-scale data integration procedures across the data development life cycle and ensure that teams adhere to these. Able to manage resources to ensure that data services work effectively at an enterprise level.
•    Up to date with data innovation and expert in investigating emerging trends in data-related approaches, performing horizon-scanning for the organisation and introducing innovative ways of working. 
•    Expert in Data integration design and can establish standards and well informed on best practice across different industries. The candidate can distinguish how to keep those standards up to date and ensures adherence to them.
•    Good understanding of concepts and principles of data modelling and can produce, maintain and update relevant data models for specific business needs. Also, shows good knowledge on how to reverse-engineer data models from a live system.
•    Expert in Metadata management and understands how metadata repositories can support different areas of the business. Capable of promoting and communicating the value of metadata repositories and knows how to set up robust governance processes to keep repositories up to date.
•    Expert in identifying and anticipating problems and know how to prevent them by linking how problems fit into the larger picture. Has the ability to identify and describe problems and help others to describe them and knows how to build problem-solving capabilities in others.
•    Expert in setting up team-based data engineering standards for programming tools and techniques and can select appropriate development methods. Act as an advisor on the application of standards and methods and ensure compliance and takes technical responsibility for all stages and/or iterations in a software development project, providing method-specific technical advice and guidance to project stakeholders. 
•    Technical Expert in predicting and advising on data engineering future technology changes that present opportunities for a product or programme.
•    Experienced with reviewing requirements, specifications and defining test conditions with good understanding on how to identify issues and risks associated with work while being able to analyse and report test activities and results.

Agile/Digital Experience
•    Experience in Agile Development, with specific Data Engineer/Data Architect (or similar) experience preferred.
•    Understands relationship with Product Owner, Agile coach, Data Scientist, Designer and rest of technical team.

Individual Skills
•    Exceptional problem-solving skills: demonstrated ability to understand business challenges,
•    structure complex problems, develop solutions
•    Ability to partner and influence key business stakeholders at all levels of the organization
•    Strong skills in team leadership and networking, ability to work across multiple organizations to accomplish diverse goals
•    Exceptional presentation, written, and verbal communication skills
•    Strong communication skills with ability to align the organization on complex technical decisions
•    Active coach and mentor whose goals are to grow and maximize the team’s potential
•    Strong ability and enthusiasm around data strategy and ability to inspire team and organization around the usage of data

Mindset & Behaviors
•    High energy and passionate individual who inspires teammates to reach their
•    maximum potential
•    Empathetic coach who can help to develop a new group of highly motivated data engineers
•    Excited about trying new solutions outside standard approved
•    Invested in developing a culture of trust, free thought and complete transparency