Lead Data Engineering Consultant and Technical Manager - ref. #6002
New York, NY
Ippon Technologies USA
Ippon USA delivers cutting-edge tech solutions to elevate your business. Contact us today for expert guidance on software development and cloud services.Duties
- Design and implement data architectures, create and optimize end-to end data pipelines, and perform real-time data processing.
- Research and prototype new technologies using EMR, Kafka, Spark, Airflow, Flink, etc.
- Perform coding using various programming and scripting languages to automate data ingestion and improve data management processes.
- Support and develop data flows by developing processes that verify, standardize, and scale data input, transformation and storage.
- Customize storage and extraction, metadata, and information repositories.
- Work on a variety of projects involving data architecture, data models, data migration, data integration, data analysis, and visualization.
- Stay on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community.
- Work with Data Scientists and Data Owners to understand use cases and hypothesis to test with data.
- Establish data governance models and contribute to strategies for enterprise data management.
- Perform extensive data profiling and analysis based on the client's data by working with software development teams and clients to define reporting requirements.
- Support project delivery on Data Warehouse/BI projects for external clients, including partnering with subject matter experts on project execution.
- Deliver solutions to our customers’ data problems and most urgent data needs.
- Serve as a project lead (managing client stakeholder communication, risk escalation, and coordinating work for the project team).
- Train new personnel and mentor junior-level employees.
- Support pre-sales activity to promoting services and capabilities to current and prospective clients.
- Domestic and international travel 20% of time to speak at conferences/organized events, performing work for clients and collaborating with Global HQ office.
Requirements
- Bachelor's degree in Computer Science or a closely related field plus
- 5 years of experience with: data architecture, Kafka, Java & Scala, Python, open source RDBMS, NoSQL databases and cloud based data warehousing services such as Snowflake and Redshift
- 3 years experience in consulting and management.
***This position is available for our employee referral program.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Tags: Airflow Architecture Computer Science Consulting Consulting firm Data analysis Data governance Data management Data pipelines Data warehouse Data Warehousing Engineering Flink Java Kafka NoSQL Open Source Pipelines Python RDBMS Redshift Research Scala Snowflake Spark
Perks/benefits: Career development Conferences Team events
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.