Data Engineer - Industrials & Energy Sector - Staff - Consulting - Location Open
Atlanta, GA, US, 30308
EY
Mit unseren vier integrierten Geschäftsbereichen — Wirtschaftsprüfung und prüfungsnahe Dienstleistungen, Steuerberatung, Unternehmensberatung und Strategy and Transactions — sowie unserem Branchenwissen unterstützen wir unsere Mandanten dabei,...US Consulting - AI & Data - Data Engineer, Industrials & Energy Sector – Staff
The opportunity
EY is seeking Data Engineers who will ingest, build, and support large-scale data architectures that serve multiple downstream systems and business users.
Your key responsibilities
- Design, develop, optimize, and maintain data architecture and pipelines that adheres to ETL principles and business goals
- Develop and maintain scalable data pipelines, build out new integrations using AWS native technologies to support continuing increases in data source, volume, and complexity
- Define data requirements, gather and mine large scale of structured and unstructured data, and validate data by running various data tools in the Big Data Environment
- Support standardization, customization and ad hoc data analysis and develop the mechanisms to ingest, analyze, validate, normalize, and clean data
- Write unit/integration/performance test scripts and perform data analysis required to troubleshoot data related issues and assist in the resolution of data issues
- Implement processes and systems to drive data reconciliation and monitor data quality, ensuring production data is always accurate and available for key stakeholders, downstream systems, and business processes
- Lead the evaluation, implementation and deployment of emerging tools and processes for analytic data engineering to improve productivity
- Develop and deliver communication and education plans on analytic data engineering capabilities, standards, and processes
- Learn about machine learning, data science, computer vision, artificial intelligence, statistics, and/or applied mathematics
- Solve complex data problems to deliver insights that help achieve business objectives
- Implement statistical data quality procedures on new data sources by applying rigorous iterative data analytics
Skills and attributes for success
- Partner with Business Analytics and Solution Architects to develop technical architectures for strategic enterprise projects and initiatives
- Coordinate with Data Scientists to understand data requirements, and design solutions that enable advanced analytics, machine learning, and predictive modelling
- Support Data Scientists in data sourcing and preparation to visualize data and synthesize insights of commercial value
- Collaborate with AI/ML engineers to create data products for analytics and data scientist team members to improve productivity
- Foster a culture of sharing, re-use, design for scale stability, and operational efficiency of data and analytical solutions
To qualify for the role you must have
- Bachelor’s degree in Engineering, Computer Science, Data Science, or related field
- 1+ years of experience in software development, data science, data engineering, ETL, and analytics reporting development
- Exposure to designing, building, implementing, and maintaining data and system integrations using dimensional data modelling and development and optimization of ETL pipelines
- Proven track record of designing and implementing complex data solutions
- Demonstrated understanding and experience using:
- Data Engineering Programming Languages (i.e., Python)
- Distributed Data Technologies (e.g., Pyspark)
- Cloud platform deployment and tools (e.g., Kubernetes)
- Relational SQL databases
- DevOps and continuous integration
- AWS cloud services and technologies (i.e., Lambda, S3, DMS, Step Functions, Event Bridge, Cloud Watch, RDS)
- Databricks/ETL
- IICS/DMS
- GitHub
- Event Bridge, Tidal
- Strong organizational skills with the ability to manage multiple projects simultaneously and operate as a leading member across globally distributed teams to deliver high-quality services and solutions
- Understanding of database architecture and administration
- Processes high proficiency in code programming languages (e.g., SQL, Python, Pyspark, AWS services) to design, maintain, and optimize data architecture/pipelines that fit business goals
- Extracts, transforms, and loads data from multiple external/internal sources using Databricks Lakehouse/Data Lake concepts into a single, consistent source to serve business users and data visualization needs
- Utilizes the principles of continuous integration and delivery to automate the deployment of code changes to elevate environments, fostering enhanced code quality, test coverage, and automation of resilient test cases
- Excellent written and verbal communication skills, including storytelling and interacting effectively with multifunctional teams and other strategic partners
- Strong problem solving and troubleshooting skills
- Ability to work in a fast-paced environment and adapt to changing business priorities
Ideally, you’ll also have
- A passion for innovation and the strategic application of emerging technologies to solve real-world challenges
- The ability to foster an inclusive environment that values diverse perspectives and empowers team members
- Continuous learning: You’ll develop the mindset and skills to navigate whatever comes next.
- Success as defined by you: We’ll provide the tools and flexibility, so you can make a meaningful impact, your way.
- Transformative leadership: We’ll give you the insights, coaching and confidence to be the leader the world needs.
- Diverse and inclusive culture: You’ll be embraced for who you are and empowered to use your voice to help others find theirs.
Tags: Architecture AWS Big Data Business Analytics Computer Science Computer Vision Consulting Data analysis Data Analytics Databricks Data pipelines Data quality Data visualization DevOps Engineering ETL GitHub Kubernetes Lambda Machine Learning Mathematics Pipelines PySpark Python SQL Statistics Step Functions Unstructured data
Perks/benefits: Career development Flex hours Flex vacation Health care
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.