Data Engineer III
India-Chennai (Ascendas Tech park)
INR 2250K-3215K (estimate) Senior-level Full Time
Tasks
- Build data ingestion transformation loading
- Create CI/CD pipelines
- Design ETL/ELT pipelines
- Ensure data governance and privacy compliance
- Implement data encryption and access policies
- Implement data partitioning and lifecycle management
- Integrate data from APIs and databases
- Manage data lakes and warehouses
- Monitor pipeline health and performance
- Optimize storage formats
- Schedule and monitor workflows
- Set up alerts and logging for failures
- Stream data using Kinesis or Kafka
- Tune ETL jobs and query performance
- Use Lake Formation for access control
Perks/Benefits
- Employee assistance program
- Flexible working arrangement
- Group accident insurance
- Group life insurance
- Health insurance
- Long service awards
- Medical screening
- Paid time off
- Sabbaticals
- Study assistance
Skills/Tech-stack
AWS CDK | AWS Glue | AWS Lake Formation | AWS Lambda | AWS Step Functions | Agile | Amazon Athena | Amazon Aurora | Amazon CloudTrail | Amazon CloudWatch | Amazon DynamoDB | Amazon EMR | Amazon Kinesis | Amazon RDS | Amazon Redshift | Amazon S3 | Amazon SNS | Amazon SQS | Apache Spark | CI/CD | CloudFormation | Databricks | ELT | ETL | GDPR | Git | Hadoop | IAM | Kafka | Lake Formation | ORC | Parquet | Python | SQL | Scala | Step Functions | Terraform
Education
N/A
Roles
Related jobs
-
Software Engineer, Principal (Java, React) INR 1800K-2040KCloud infrastructure | Databricks | Deployment | HTML/CSS | JavaWork from office Monday to FridaySenior-level Full TimeChennai, India12h ago
-
SW Engineer (6 months - 2 yrs Experience - Java/Python, UNIX, J2EE, REST & SOAP, Automation, Gen AI) INR 600K-650K.NET | C# | CI/CD | Deep learning | GitContinued learning | Experiments | Hybrid work | MentorshipEntry-level Full TimeBengaluru, INDIA, India15h ago
-
AI [Artificial Intelligence] Engineer INR 2200K-3199KAWS | C++ | Computer Vision | Google Cloud | Hyperparameter TuningCollaborative team environment | Continuous learning | Inclusive workplace | Professional development opportunitiesMid-level Full TimeBengaluru, India16h ago
-
Machine Learning Engineer INR 2500K-3000KAWS | Automation | Google Cloud | Java | Language ModelsCollaborative team environment | Continuous learning | Professional development opportunitiesEntry-level Full TimeBengaluru, India16h ago
-
PySpark Data Engineer INR 1500K-2000KApache Airflow | Apache Hadoop | Apache Hive | Apache Spark | HDFSSenior-level Full TimeJaipur, India16h ago
-
Mid-level Full TimeBangalore South, India16h ago
-
Senior-level Full TimeChennai City Corporation, India17h ago
-
Lead Consultant-Data Engineer INR 2040K-2400KAmazon Redshift | Amazon Web Services | Apache Hadoop | Apache Kafka | Apache SparkSenior-level Full TimeIndia-Bangalore17h ago
-
Principal Consultant-Data Engineer INR 2486K-3380KAmazon Redshift | Amazon Web Services | Apache Hadoop | Apache Kafka | Apache SparkSenior-level Full TimeIndia-Bangalore17h ago
-
Amazon AWS | Amazon Redshift | Apache Hadoop | Apache Kafka | Apache SparkSenior-level Full TimeIndia-Bangalore17h ago
-
Lead Consultant - Lead Data Ops (Human-in-the-loop) INR 2000K-2040KAmazon Redshift | Amazon Web Services | Apache Hadoop | Apache Kafka | Apache SparkContinuous learning opportunities | Mentored career growth | MentorshipSenior-level Full TimeIndia-Bangalore17h ago
-
Lead Consultant - Security/Network SME INR 2040K-2400KAmazon Redshift | Amazon Web Services | Apache Hadoop | Apache Kafka | Apache SparkSenior-level Full TimeIndia-Bangalore17h ago
-
Lead Consultant - IAC Engineer INR 2486K-3380KAmazon Redshift | Amazon Web Services | Apache Hadoop | Apache Kafka | Apache SparkContinuous learning opportunities | MentorshipSenior-level Full TimeIndia-Bangalore17h ago
-
Mid-level Full TimeIN-TN-Chennai17h ago
-
Storage Administrator - NetApp & Pure INR 2486K-3487KAnsible | Bash | CIFS/SMB | Capacity Planning | CohesitySenior-level Full TimeBengaluru, India17h ago
-
Senior-level Full TimePune, Maharashtra, India17h ago
-
Staff Engineer, Data Analytics Engineering ( 6+ years Full Stack Developer - React, JavaScript, and Python / Node.js, AWS, SQL ) INR 2520K-4725KAI/ML | API Gateway | AWS Lambda | Amazon ECS | Amazon EKSSenior-level Full TimeBengaluru, KA, India18h ago
-
Analyst,Decision Intellingence INR 2000K-3000KAPI Development | AWS | Azure | Azure Cognitive | Azure Cognitive ServicesHybrid work | Travel opportunityMid-level Full TimeNew Delhi, India18h ago
-
API Gateway | AWS | Argo CD | Bash | CI/CDCharity matching | Corporate volunteering | Medical/Dental/Vision | Paid time off | Retirement planningMid-level Full TimeVadodara, GJ, IN18h ago
-
Software Engineer III - Databricks, Cloud Data Engineer INR 2000K-2400KAWS EMR | Agile | Apache Spark | Application development | Big DataSenior-level Full TimeHyderabad, Telangana, India18h ago
-
Software Engineer II - Databricks, Cloud Data Engineer INR 1500K-2500KAWS EMR | Agile | Apache Spark | Big Data | CI/CDMid-level Full TimeHyderabad, Telangana, India18h ago
-
Linguistic Engineer INR 2400K-3000KASR | Data Analysis | Data Infrastructure | Data Pipelines | DialogMid-level Full TimeHyderabad, India18h ago
-
Senior Staff Software Engineer, Application Design Center INR 2040K-3200KAngular | Artificial Intelligence | Distributed Systems | Go | JavaSenior-level Full TimeBengaluru, Karnataka, India19h ago
-
Software Engineer III, AI/ML, Google Cloud INR 2500K-4500KC++ | Computer Vision | Data Structures | Data Structures and Algorithms | Language ModelsSenior-level Full TimeBengaluru, Karnataka, India19h ago
-
Senior AI/ML Engineer II INR 2500K-4500KAzure | C++ | Deep learning | Generative AI | Hugging FaceCareer advancement programs | Dental insurance | Employee assistance program | Flexible work options | Health insuranceSenior-level Full TimeBangalore, Karnataka, India19h ago