Big Data Lead

Mumbai, Maharashtra, India

Hexaware

We empower clients with world-class technology products, services, and solutions.

View all jobs at Hexaware

Apply now Apply later

Job Description Essential Requirements: - Minimum 6 years of Proven experience as a Python Developer, particularly in data and Devops projects. - Must have Hands-on Working experience with AWS/Azure Storage services, Service Bus, Functions, workflows, orchestration, and YAML - Having hands-on experience in building and optimizing data pipelines (batch and Streaming data loads), architectures, and datasets in AWS/Azure. - Strong knowledge of Python libraries for data analysis (e.g., Pandas, NumPy, SciPy) - Solid experience in handling and manipulating Structured and semi-structured data (must have) - Experience with data storage solutions (e.g., SQL, NoSQL, Hadoop, Spark) - Working experience of connecting, integrating third party API services, Databases and Cloud services through Python. - Experience in CI/CD pipelines to automate code testing and deployment with tools like GitLab, Jenkins and Infrastructure as Code (IaC) tools like Terraform or CloudFormation - Optimize cloud resources and implement cost-effective solutions - Excellent problem-solving skills and decision-making capabilities - Worked in projects to Automate repetitive tasks to improve team efficiency Nice to have: - Good Understanding of AWS/Azure Cloud offerings, DevOps process. - Experience in using JIRA, Asana, Gitlab applications. - Experience in Snowpark, PySpark, Databricks is preferable - Familiarity with machine learning frameworks (e.g., TensorFlow, scikit-learn) - Understanding of data visualization tools (e.g., Matplotlib, Seaborn)"
Apply now Apply later

* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰

Job stats:  1  0  0

Tags: APIs Architecture Asana AWS Azure Big Data CI/CD CloudFormation Data analysis Databricks Data pipelines Data visualization DevOps GitLab Hadoop Jenkins Jira Machine Learning Matplotlib NoSQL NumPy Pandas Pipelines PySpark Python Scikit-learn SciPy Seaborn Spark SQL Streaming TensorFlow Terraform Testing

Region: Asia/Pacific
Country: India

More jobs like this