Data Engineer III
India-Chennai (Ascendas Tech park)
INR 2800K-3380K (estimate) Senior-level Full Time
Tasks
- Build AWS Glue Lambda and Step Functions workflows
- Collaborate with data scientists analysts and BI teams
- Create CI CD pipelines with Infrastructure as Code
- Design ETL/ELT pipelines
- Ensure data governance and privacy compliance
- Implement data encryption IAM and access policies
- Implement data partitioning indexing and lifecycle policies
- Ingest, transform, and load data
- Integrate data from APIs on prem and third party sources
- Manage structured and unstructured data in AWS
- Monitor pipeline health with CloudWatch CloudTrail
- Optimize storage formats Parquet ORC
- Participate in agile sprint planning and retrospectives
- Schedule and monitor data workflows
- Set up alerts and logging
- Stream data using Kinesis or Kafka
- Tune ETL jobs and query performance
- Use AWS Lake Formation for access control
Perks/Benefits
- Accident insurance
- Employee assistance program
- Flexible working arrangement
- Group parental leave
- Health insurance
- Life insurance
- Long service awards
- Medical screening
- Paid time off
- Sabbaticals
- Study assistance
Skills/Tech-stack
AWS | AWS Glue | AWS Lake Formation | AWS Lambda | AWS VPC | Agile | Amazon Athena | Amazon Aurora | Amazon DynamoDB | Amazon EMR | Amazon Kinesis | Amazon RDS | Amazon Redshift | Amazon S3 | Amazon SNS | Amazon SQS | Apache Spark | CI/CD | CloudFormation | CloudTrail | CloudWatch | Data Governance | Data encryption | Databricks | EC2 | ELT | ETL | Git | Hadoop | IAM | Kafka | Lake Formation | ORC | Parquet | Python | SQL | Scala | Secure SDLC | Step Functions | Terraform
Related jobs
-
BI Developer - Snowflake & Salesforce Data INR 2000K-2500KAlerting | DBT | Data Quality | Data Validation | Data WarehousingChallenging projects | Great work-life balance | Professional developmentMid-level Full TimePune, MH, IN3h ago
-
Senior-level Full TimeMaharashtra, Mumbai, India4h ago
-
AWS | AWS Glue | AWS Lambda | Amazon Athena | Amazon EMRAI certifications | Ethical AI focus | Mentorship | World-class trainingSenior-level Full TimeIndia-Hyderabad5h ago
-
Manager, Tableau Developer INR 1400K-2000KAWS | Azure | CRM | Data Lakes | Data ModelingAI certifications | Mentorship | World-class trainingMid-level Full TimeIndia-Bangalore5h ago
-
Senior-level Full TimeMaharashtra, Mumbai, India5h ago
-
Senior-level Full TimeIN-TN-Chennai5h ago
-
Senior-level Full TimeIN-TN-Chennai5h ago
-
Senior-level Full TimeIN-TN-Chennai5h ago
-
ETL Test Engineer INR 1200K-1500KAgile | Amazon Redshift | Data Integrity | Data Transformation | Data ValidationMid-level Full TimeIN-TN-Chennai5h ago
-
AWS Cloud & DevOps Engineer INR 2156K-2541KAWS | Ansible | Configuration Management | DevOps | Infrastructure as CodeSenior-level Full TimeIN-AP-Hyderabad5h ago
-
Business Analytics INR 1500K-2200KAgile | Business Intelligence | Business Process | Business Process Mapping | ConfluenceMid-level Full TimeBangalore, Karnataka, India6h ago
-
Mid-level Full TimeAhmedabad, 380015, India6h ago
-
Lead/Manager Software Engineer INR 2500K-3200KAgent Orchestration | Agentic AI | Amazon ECS | Amazon EMR | Amazon Elastic Kubernetes ServiceSenior-level Full TimeBengaluru, Karnataka, India7h ago
-
Sr.Lead Software Engineer INR 2500K-3500KAWS ECS | AWS EKS | AWS EMR | Agent Development | Amazon Web ServicesSenior-level Full TimeHyderabad, Telangana, India7h ago
-
Senior Product Manager, Google Cloud Dataproc INR 2000K-2040KApache Spark | Big Data | Cloud platform | Data analytics | Go-to-marketSenior-level Full TimeBengaluru, Karnataka, India7h ago
-
Forward Deployed Engineer, Generative AI, Google Cloud INR 2500K-4500KAPI Integration | Agent systems | Cloud platform | Cost Per Request | CrewAISenior-level Full TimeGurgaon, Haryana, India; Bengaluru, Karnataka, India7h ago
-
Mid-level Full TimePune, Maharashtra, India8h ago
-
Senior-level Full TimeBangalore, Karnataka, India9h ago
-
Senior-level Full TimeBangalore, Karnataka, India9h ago
-
Data and AI Engineer (Manager) INR 2500K-3380KAWS | AWS Glue | Airflow | Amazon Redshift | Apache KafkaSenior-level Full TimeBengaluru, INDIA, India9h ago
-
Mid-level Full TimeGurugram, Haryana, India9h ago
-
AWS | AWS Lambda | Agile | Apache Spark | Data ModelingSenior-level Full TimeBengaluru, Karnataka, India9h ago
-
None Full TimePune, Maharashtra, India10h ago
-
Generative AI Engineer INR 2500K-4500KAgentic Frameworks | Autogen | Embeddings | Fine Tuning | LanggraphSenior-level Full TimePune, Maharashtra, India10h ago
-
Software Engineer (6months to 2 Years of experience - JAVA/Python Backend, CICD, APIs, GEN AI, Microservices, Cloud) INR 2000K-2156KAgile | Algorithms | Apache Kafka | Automated testing | C++Continued learning opportunities | Hybrid work arrangement | MentorshipEntry-level Full TimeBengaluru, INDIA, India10h ago