Data Engineer

Company Description

Expeditors International of Washington, Inc. is one of the world’s foremost supply chain and logistics firms. A Fortune 300 company with over $10 billion in revenue and 18,000 trained professionals, Expeditors operates in over 350 locations across six continents. Onyx is a division of Expeditors. As a team of creative and collaborative experts, we help global, blue-chip companies and their executive leadership manage strategic-level risks and opportunities stemming from their global footprint and associated supply chain strategy. Our support is unique in its blend of deep expertise in industry, economics, politics, and logistics, supported by Expeditors' global footprint and granular market knowledge. Our services include consulting projects, retained client support, and publications.

Job Description

The Data Engineer will own database and data pipeline workflows for ingestion activities. This role is pivotal in driving product development and innovation. The Data Engineer will collaborate closely with product development staff and the Data Architect on proof-of-concept development, cloud deployment, and database integration for various ETL and analytical activities. This position requires handling multiple tasks simultaneously and prioritizing work effectively. Joining Onyx offers a high-profile and exciting growth opportunity, making the Data Engineer a key player in our success.

Responsibilities:

• Translate product team requirements into optimal ETL/ELT data pipelines by developing and deploying resources, contributing to a unified system architecture, and minimizing technical debt in Azure.
• Lead or support the integration of new external data sources as needed.
• Support data analysis and data science efforts by creating datasets and optimizing complex joins and calculations.
• Implement logic to manage data quality and monitor pipelines in collaboration with the Data Architect.
• Continually identify and implement (or recommend) improvements to data infrastructure and pipelines.
• Follow best practices for data management and educate the team on these practices.
• Maintain comprehensive documentation on all pipelines and databases.
• Design conceptual and logical data models and flowcharts.
• Improve system performance through testing, troubleshooting, and integrating new elements.
• Optimize new and existing database systems.
• Define and implement security and backup procedures.

Qualifications

• Enterprise experience with a major cloud stack and a solid understanding of cloud development patterns, including cloud networking, security, secret management, etc. (Azure preferred).
• In-depth understanding of database structure principles.
• Programming experience with Python for scripting and automation.
• Experience gathering and analyzing system requirements.
• Proven experience developing data pipelines for analytics and machine learning, with a demonstrated ability to work with big data.
• Experience building, maintaining, and optimizing relational and non-relational databases.
• Knowledge of DevOps, DataOps, and/or ModelOps processes.
• Effective communication skills, with the ability to explain technical concepts to non-technical audiences.
• Motivation and ability to tackle complex problems with limited guidance.

Additional Information

Job Type: Full-time. Expeditors has an in-office work policy and offers 26 work-from-home days per year. Depending on location, employees may be required to travel for client and team meetings.

Education: Bachelor's Degree (Required)

Experience: 3+ years relevant professional experience in trade regulations and policy.

Work Location: Mexico City, Mexico

All your information will be kept confidential according to EEO guidelines.