Big Data Lead
Mexico
Hexaware
We empower clients with world-class technology products, services, and solutions.
We’re looking for a data engineer to build and maintain ELT pipelines using Apache Airflow, dbt, and Snowflake in an AWS cloud environment.Should have experience in modular python coding with experience in deploying any container based services in aws with monitoring setup as well Key Skills & Experience: Strong SQL and Snowflake expertise, including performance tuning and data modeling. Proficient in Python for scripting, automation, and working with REST APIs. Experience with Apache Airflow for orchestration and workflow monitoring. Hands-on with dbt for modular, version-controlled data transformations. Solid experience with AWS services (e.g., S3, Lambda, IAM, CloudWatch) in data engineering workflows. Experience integrating and processing data from REST APIs. Understanding of data quality, governance, and cloud-native troubleshooting. ------------------------------ Primary Skills: Must have below: 10+ Years Experience Great Communicator/Client Facing Individual Contributor 100% Hands on in the mentioned skills DBT Proficiency: model development: Experience in creating complex DBT models including incremental models, snapshots and documentation. Ability to write and maintain DBT macros for reusable code Testing and documentation: Proficiency in implementing DBT tests for data validation and quality checks Familiarity with generating and maintaining documentation using DBT's built in features Version control: Experience in managing DBT projects using git ,including implementing CI/CD process from the scratch AWS Expertise: Data STORAGE solutions: In depth understanding of AWS S3 for data storage, including best practices for organization and security Experience with AWS redshift for data warehousing and performance optimization Data Integration: Familiarity with Aws glue for ETL processes and orchestration -Nice to have Experience with AWS lambda for serverless data processing tasks Workflow Orchestration:
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Job stats:
0
0
0
Categories:
Big Data Jobs
Leadership Jobs
Tags: Airflow APIs AWS AWS Glue Big Data CI/CD Data quality Data Warehousing dbt ELT Engineering ETL Git Lambda ML models Pipelines Python Redshift Security Snowflake SQL Testing
Region:
North America
Country:
Mexico
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.
Power BI Developer jobsPrincipal Data Engineer jobsSr. Data Engineer jobsBI Developer jobsStaff Data Scientist jobsPrincipal Software Engineer jobsStaff Machine Learning Engineer jobsData Science Intern jobsDevOps Engineer jobsData Science Manager jobsJunior Data Analyst jobsSoftware Engineer II jobsData Manager jobsData Analyst Intern jobsLead Data Analyst jobsStaff Software Engineer jobsBusiness Data Analyst jobsAccount Executive jobsAI/ML Engineer jobsSr. Data Scientist jobsData Specialist jobsData Governance Analyst jobsSenior Backend Engineer jobsBusiness Intelligence Analyst jobsData Engineer III jobs
Consulting jobsMLOps jobsAirflow jobsOpen Source jobsLinux jobsEconomics jobsKPIs jobsTerraform jobsJavaScript jobsKafka jobsGitHub jobsData Warehousing jobsPostgreSQL jobsRDBMS jobsComputer Vision jobsNoSQL jobsScikit-learn jobsClassification jobsStreaming jobsBanking jobsGoogle Cloud jobsPhysics jobsPrompt engineering jobsRAG jobsOracle jobs
Hadoop jobsPandas jobsR&D jobsBigQuery jobsdbt jobsScala jobsData warehouse jobsLooker jobsReact jobsGPT jobsPySpark jobsDistributed Systems jobsScrum jobsCX jobsIndustrial jobsLangChain jobsELT jobsMicroservices jobsRedshift jobsSAS jobsJira jobsOpenAI jobsJenkins jobsModel training jobsRobotics jobs