AWS Data Engineer

Title

AWS Data Engineer

Job Description

We are seeking an experienced AWS Data Engineer to design, build, and maintain scalable, reliable, and cost-effective data pipelines and infrastructure on the AWS cloud platform. The successful candidate will play a crucial role in managing our data architecture, ensuring efficient data flow, and supporting data-driven decision-making within our organization. The AWS Data Engineer will work closely with data scientists, analysts, and other stakeholders to deliver high-quality data solutions that meet the business's analytical and operational needs.

Key Responsibilities:

• Data Architecture & Pipeline Development: Design, implement, and maintain data pipelines using AWS services (e.g., AWS Glue, Lambda, Redshift, Kinesis, S3, and Athena) to enable the efficient flow of data across the organization
• ETL Processes: Develop, optimize, and manage ETL (Extract, Transform, Load) processes to ensure data is available, accurate, and accessible in a timely manner
• Data Integration: Integrate data from a variety of sources, including APIs, third-party tools, and internal systems, ensuring seamless data ingestion and processing
• Data Warehousing: Set up and manage scalable data warehouses on AWS (e.g., Redshift), designing schemas and data models to support data storage and retrieval efficiency
• Data Quality & Governance: Ensure data quality, security, and governance through the implementation of best practices and the use of tools for data validation, logging, monitoring, and auditing
• Automation & Optimization: Automate data workflows and optimize performance of data processing and storage solutions, focusing on cost efficiency and system performance
• Collaboration: Work closely with cross-functional teams, including data science, analytics, and product teams, to understand and meet data needs
• Documentation & Best Practices: Maintain thorough documentation of data pipelines, architecture, and processes, and promote best practices for data engineering and AWS cloud usage within the team

Qualifications:

• Education: Bachelor’s or Master’s degree in Computer Science, Engineering, Data Science, or a related field

Experience:

• Minimum 3+ years of experience in data engineering, with at least 2 years focused on AWS data solutions
• Proven experience designing and managing data pipelines in AWS

Technical Skills:

• Proficiency in AWS data services such as AWS Glue, Redshift, Lambda, Kinesis, EMR, and S3
• Strong SQL skills and experience with relational databases (e.g., PostgreSQL, MySQL) and data warehousing
• Experience with big data tools and frameworks (e.g., Apache Spark, Hadoop)
• Proficiency in scripting languages like Python or Java for ETL and data transformation tasks
• Familiarity with data orchestration and workflow management tools (e.g., Apache Airflow)

Other Skills:

• Excellent problem-solving skills and attention to detail
• Strong communication skills, with the ability to convey complex technical concepts to non-technical stakeholders
• Ability to work in an agile, fast-paced environment and manage multiple priorities

Preferred Qualifications:

• AWS Certification (e.g., AWS Certified Data Analytics, AWS Certified Solutions Architect)
• Knowledge of data security best practices and experience with IAM, data encryption, and secure data storage on AWS
• Experience with real-time data streaming and processing (e.g., AWS Kinesis, Kafka)

This role is ideal for someone with a strong technical background in data engineering who wants to leverage AWS tools to build innovative, scalable data solutions. The AWS Data Engineer will be instrumental in transforming data into a key asset for the organization, enabling data-driven insights and strategic decisions.

As we continue to grow, we are committed to leveraging the power of AWS to deliver innovative cloud solutions that drive business transformation for our customers. We are looking for talented data professionals to join our team and help us harness the full potential of AWS to provide cutting-edge services to our clients. If you are passionate about cloud technology and eager to be part of a dynamic and forward-thinking company, we would love to hear from you!

Education

Bachelor's Degree (Required)

Languages

English