Cloud data Engineer

Description

Technical Skills Required:

• ETL Pipelines: Design and develop complex ETL pipelines using Apache Spark and AWS Glue.
• AWS Services: Experience in designing and developing AWS Lambda, AWS Step Functions, AWS DMS Replication Jobs, and State Machines.
• ETL Logic: Develop complex ETL logic in AWS Redshift Stored Procedures/Functions with a focus on performance efficiency.
• Data Modeling: Strong experience in understanding Dimensions and Facts modeling.
• Performance: Ability to deliver performance-efficient solutions for large volumes of data and conduct performance tuning for Redshift SQL/Stored Procedures on high-volume complex datasets.
• Data Formats: Familiarity with working with JSON, S3, and XML files for configuration.
• Support: Ability to support Apache PySpark code and AWS Glue Jobs.
• Scripting: Extensive experience in Python scripting.
• Deployment: Experience in developing Terraform pipelines for code deployment.
• CI/CD: Experience with CI/CD pipelines, Jenkins, AWS CDK, TFS code repository maintenance, deployment pipelines, and VS Code Editor.
• Scheduling: Experience with BMC scheduling tool.

1. The position is hybrid for Tampa Florida
2. Experience: Minimum 10+ years of real-world implementation experience on similar projects.
3. Environment: Must thrive in a challenging and aggressive environment with pressure to deliver on a very fast schedule.
4. Collaboration: Ability to work closely with business partners to understand and implement their requirements.
5. Industry Background: Financial Services background is mandatory. Experience in Risk & Compliance is a plus.

Why Matrix

Matrix is a global, dynamic, fast-growing technical consultancy leading technology services company with 13000 employees worldwide. Since its foundation in 2001, Matrix has made more travelers and acquisitions and has executed some of the largest, most significant. The company specializes in implementing and developing leading technologies, software solutions, and products. It provides its customers with infrastructure and consulting services, IT outsourcing, offshore, training and assimilation, and Ves as representatives for the world's leading software vendors.  With vast experience in private and public sectors, ranging from Finance, Telecom, Health, Hi-Tech, Education, Defense, and Secu city, Matrix's customer base includes guest organizations in Israel and a steadily growing client base worldwide. 

We are comprised of talented, creative, and dedicated individuals passionate about delivering innovative solutions to the market. We source and foster the best talent and recognize that all employee's contributions are integral to our company's future. 

Matrix- success is based on a challenging work environment, competitive compensation and benefits, and rewarding career opportunities. We encourage a diverse work environment of sharing, learning, and ceding together. Come and join the winning team! You'll be challenged and have fun in a highly respected organization. To Learn More, Visit Matrix -ifs. Com, 

Requirements

AWS DMS MUST

AWS CDK, STEP FUNCTIONS, BMC scheduling, VS Coder optional.