Big Data Lead
United States
⚠️ We'll shut down after Aug 1st - try foo🦍 for all jobs in tech ⚠️
Hexaware
We empower clients with world-class technology products, services, and solutions.
We’re looking for a data engineer to build and maintain ELT pipelines using Apache Airflow, dbt, and Snowflake in an AWS cloud environment.Should have experience in modular python coding with experience in deploying any container based services in aws with monitoring setup as well Key Skills & Experience: Strong SQL and Snowflake expertise, including performance tuning and data modeling. Proficient in Python for scripting, automation, and working with REST APIs. Experience with Apache Airflow for orchestration and workflow monitoring. Hands-on with dbt for modular, version-controlled data transformations. Solid experience with AWS services (e.g., S3, Lambda, IAM, CloudWatch) in data engineering workflows. Experience integrating and processing data from REST APIs. Understanding of data quality, governance, and cloud-native troubleshooting. ------------------------------ Primary Skills: Must have below: 10+ Years Experience Great Communicator/Client Facing Individual Contributor 100% Hands on in the mentioned skills DBT Proficiency: model development: Experience in creating complex DBT models including incremental models, snapshots and documentation. Ability to write and maintain DBT macros for reusable code Testing and documentation: Proficiency in implementing DBT tests for data validation and quality checks Familiarity with generating and maintaining documentation using DBT's built in features Version control: Experience in managing DBT projects using git ,including implementing CI/CD process from the scratch AWS Expertise: Data STORAGE solutions: In depth understanding of AWS S3 for data storage, including best practices for organization and security Experience with AWS redshift for data warehousing and performance optimization Data Integration: Familiarity with Aws glue for ETL processes and orchestration -Nice to have Experience with AWS lambda for serverless data processing tasks
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Job stats:
0
0
0
Categories:
Big Data Jobs
Leadership Jobs
Tags: Airflow APIs AWS AWS Glue Big Data CI/CD Data quality Data Warehousing dbt ELT Engineering ETL Git Lambda ML models Pipelines Python Redshift Security Snowflake SQL Testing
Region:
North America
Country:
United States
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.
Data Scientist II jobsSr. Data Engineer jobsBI Developer jobsPrincipal Data Engineer jobsBusiness Intelligence Developer jobsStaff Machine Learning Engineer jobsStaff Data Scientist jobsPrincipal Software Engineer jobsJunior Data Analyst jobsData Science Intern jobsDevOps Engineer jobsData Manager jobsSoftware Engineer II jobsData Science Manager jobsStaff Software Engineer jobsLead Data Analyst jobsData Analyst Intern jobsAI/ML Engineer jobsSr. Data Scientist jobsBusiness Data Analyst jobsData Specialist jobsBusiness Intelligence Analyst jobsData Engineer III jobsData Governance Analyst jobsSenior Backend Engineer jobs
Consulting jobsMLOps jobsAirflow jobsOpen Source jobsEconomics jobsLinux jobsKPIs jobsKafka jobsTerraform jobsGitHub jobsJavaScript jobsPostgreSQL jobsPrompt engineering jobsRDBMS jobsBanking jobsData Warehousing jobsNoSQL jobsStreaming jobsClassification jobsComputer Vision jobsRAG jobsScikit-learn jobsPhysics jobsGoogle Cloud jobsdbt jobs
GPT jobsPandas jobsHadoop jobsLooker jobsBigQuery jobsR&D jobsData warehouse jobsOracle jobsReact jobsScala jobsDistributed Systems jobsLangChain jobsScrum jobsMicroservices jobsELT jobsCX jobsPySpark jobsIndustrial jobsOpenAI jobsJira jobsSAS jobsRedshift jobsTypeScript jobsModel training jobsRobotics jobs