Lead Data Engineer
Norfolk Va, US
⚠️ We'll shut down after Aug 1st - try foo🦍 for all jobs in tech ⚠️
CMA CGM Group, founded by Jacques R. Saadé, is a leading worldwide shipping & logistics group. Now headed by Rodolphe Saadé, CMA CGM reinvents transport and logistics in order to offer an integrated maritime, port and land service that exceeds its customers' expectations.
Present in over 160 countries through 755 offices, 750 warehouses, equipped with a young and diverse fleet of 511 vessels, CMA CGM serves 420 of the world's 521 commercial ports and operates on more than 200 shipping lines. The group currently employs 110,000 people worldwide, including nearly 2,400 in Marseille, in its headquarters in Marseilles.
This position will: Expand and optimize our data and data pipeline architecture, as well as optimize data flow and collection for cross functional teams. Support our software developers, database architect, BI developers, and data scientists on data initiatives and ensure optimal data delivery architecture is consistent throughout ongoing projects. Create and maintain optimal data pipeline architecture. Assemble large, complex data sets that meet functional/non-functional business requirements. Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, and re-designing infrastructure for greater scalability. Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS ‘big data’ technologies. Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics. Work with stakeholders including the Executive, Product, Data, and Design teams to assist with data-related technical issues and support their data infrastructure needs. Keep our data separated and secure across national boundaries through multiple data centers and AWS regions. Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader. Work with data and analytics experts to strive for greater functionality in our data systems. Perform root cause analysis on external and internal processes and data to identify opportunities for improvement and answer questions. Build processes that support data transformation, workload management, data structures, dependency, and metadata. *Telecommuting permitted 80%: work may be performed in any location in the U.S. *Domestic and international travel to France required 20% of the time.
Skill Sets / Education & Experience Requirements: Bachelor's degree (U.S. or Foreign Equivalent) in Electronic Engineering, Computer Science, Statistics, Informatics, Information Systems, or equivalent field and twelve (12) years of IT experience in job offered or a related role. Must have eight (8) years of experience with the following: using SQL or PL/SQL; and using SSIS, Informatica, Data Stage, Data Bricks, AWS Glue/Lambda, Azure Data Factory, or any equivalent tool. Must have six (6) years of experience using Python, UNIX Shell Scripting, or Windows Power Shell. Must have four (4) years of experience with the following: using Apache Spark, PySpark, or Big Data Echo System; and experience with any Cloud Platform such as AWS, Azure, or Google Cloud Platform. Must have three (3) years of experience with GitHub, JIRA, or CI/CD tools. Must have two (2) years of experience with the following: using ERWIN, ER/Studio Data Architect, or SAP Power Designer; and using Active Batch, Autosys, IBM Tivoli Workload Scheduler, or CA Workload Automation.
QUALIFIED APPLICANTS: Use the “Apply Now” button. Please reference the job code NTVA.
HOURS: 40 hours a week, Monday – Friday
Come along on CMA CGM’s adventure!
The Company is an equal opportunity employer. All qualified applicants will receive consideration for employment. Discrimination or harassment based upon any protected characteristics as defined by state or federal law is wholly inconsistent with our company values and will not be tolerated. Alternative application methods are available for individuals who are unable to use or access our online application system. For assistance, please contact us at orf.pse_recruiting@cma-cgm.com.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Architecture AWS AWS Glue Azure Big Data CI/CD Computer Science Databricks Engineering GCP GitHub Google Cloud Informatica Jira Lambda PySpark Python R Shell scripting Spark SQL SSIS Statistics
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.