Lead - Data Engineer

Job Family:

Data Science & Analysis (Digital)

Travel Required:

Up to 10%

Clearance Required:

Ability to Obtain Public Trust

What You Will Do:

We are seeking a highly skilled and experienced Lead ETL Glue AWS Architect to join our dynamic data engineering team. The ideal candidate will possess deep expertise in AWS Glue, data warehousing, ETL processes, and cloud architecture. This role will lead the design, development, and implementation of robust and scalable ETL solutions using AWS Glue, ensuring data is efficiently and accurately processed and made available for analytics and business intelligence purposes.

Key Responsibilities:

• Design and architect ETL solutions using AWS Glue to meet business requirements and technical specifications.
• Develop and maintain data models, data architecture, and data integration strategies.
• Collaborate with data engineers, data scientists, and business stakeholders to understand data requirements and translate them into technical solutions.
• Lead the development and maintenance of ETL pipelines using AWS Glue, ensuring data is extracted, transformed, and loaded efficiently and accurately.
• Implement best practices for ETL processes, including data validation, error handling, and performance optimization.
• Develop reusable ETL components and frameworks to streamline data processing.
• Integrate AWS Glue with other AWS services such as S3, Redshift, RDS, Lambda, and CloudWatch.
• Ensure seamless data flow between on-premises systems and cloud environments.
• Provide technical leadership and mentorship to a team of data engineers.
• Conduct code reviews, provide feedback, and enforce coding standards and best practices.
• Lead technical discussions and decision-making processes related to ETL architecture and implementation.
• Monitor and optimize ETL performance, identifying and addressing bottlenecks and inefficiencies.
• Implement data partitioning, parallel processing, and other techniques to improve ETL throughput and performance.
• Create and maintain comprehensive documentation for ETL processes, data models, and architecture.
• Provide regular updates and reports on ETL performance, data quality, and project status to stakeholders.
• Ensure data processing and storage comply with security policies, data governance standards, and regulatory requirements.
• Implement data encryption, access controls, and other security measures to protect sensitive data.

What You Will Need:

• Bachelor’s degree is required
• Minimum SIX (6) years of experience in data engineering, ETL development, and data warehousing.
• Minimum FIVE (5) years of hands-on experience with AWS Glue and other AWS data services (S3, Redshift, RDS, Lambda, etc.).
• Strong proficiency in ETL tools, data modeling, and SQL.
• Experience with Python, PySpark, and other scripting languages used in ETL processes.
• Excellent understanding of cloud architecture, data integration, and data pipeline design.
• Proven ability to lead and mentor a team of data engineers.
• Strong problem-solving skills, attention to detail, and ability to work in a fast-paced environment.
• Excellent communication and collaboration skills.

What Would Be Nice To Have:

• AWS Certified Solutions Architect or AWS Certified Big Data – Specialty certification.
• Experience with real-time data processing and streaming technologies (e.g., Kinesis, Kafka).

What We Offer:

Guidehouse offers a comprehensive, total rewards package that includes competitive compensation and a flexible benefits package that reflects our commitment to creating a diverse and supportive workplace.

Benefits include:

• Medical, Rx, Dental & Vision Insurance

• Personal and Family Sick Time & Company Paid Holidays

• Parental Leave

• 401(k) Retirement Plan

• Group Term Life and Travel Assistance

• Voluntary Life and AD&D Insurance

• Health Savings Account, Health Care & Dependent Care Flexible Spending Accounts

• Transit and Parking Commuter Benefits

• Short-Term & Long-Term Disability

• Tuition Reimbursement, Personal Development, Certifications & Learning Opportunities

• Employee Referral Program

• Corporate Sponsored Events & Community Outreach

• Care.com annual membership

• Employee Assistance Program

• Supplemental Benefits via Corestream (Critical Care, Hospital Indemnity, Accident Insurance, Legal Assistance and ID theft protection, etc.)

• Position may be eligible for a discretionary variable incentive bonus

About Guidehouse
Guidehouse is an Equal Employment Opportunity / Affirmative Action employer. All qualified applicants will receive consideration for employment without regard to race, color, national origin, ancestry, citizenship status, military status, protected veteran status, religion, creed, physical or mental disability, medical condition, marital status, sex, sexual orientation, gender, gender identity or expression, age, genetic information, or any other basis protected by law, ordinance, or regulation.

Guidehouse will consider for employment qualified applicants with criminal histories in a manner consistent with the requirements of applicable law or ordinance including the Fair Chance Ordinance of Los Angeles and San Francisco.

If you have visited our website for information about employment opportunities, or to apply for a position, and you require an accommodation, please contact Guidehouse Recruiting at 1-571-633-1711 or via email at RecruitingAccommodation@guidehouse.com. All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodation.

Guidehouse does not accept unsolicited resumes through or from search firms or staffing agencies. All unsolicited resumes will be considered the property of Guidehouse and Guidehouse will not be obligated to pay a placement fee.