Data Engineer III
India-Chennai (Ascendas Tech park)
INR 2800K-3380K (estimate) Senior-level Full Time
Tasks
- Collaborate with data scientists analysts and BI teams
- Create CI/CD pipelines
- Design and build ETL/ELT pipelines
- Ensure data governance and privacy compliance
- Implement auditing and access control
- Implement data encryption IAM roles and access policies
- Implement real-time and batch data streaming
- Ingest, transform, and load data
- Integrate data from APIs on prem databases and third party tools
- Manage data storage and datasets
- Monitor pipeline health and performance
- Optimize data partitioning indexing and lifecycle
- Optimize storage formats
- Participate in agile sprint planning and retrospectives
- Schedule and monitor data workflows
- Set up alerts and logging
- Tune ETL jobs and query performance
Perks/Benefits
- Employee assistance program
- Flexible working arrangement
- Group accident insurance
- Group life insurance
- Health insurance
- Medical screening
- Paid time off
- Sabbatical
- Study assistance
Skills/Tech-stack
AWS | AWS Glue | AWS Lake Formation | AWS Lambda | AWS Step Functions | AWS VPC | Amazon Athena | Amazon Aurora | Amazon DynamoDB | Amazon EC2 | Amazon EMR | Amazon Kinesis | Amazon RDS | Amazon Redshift | Amazon S3 | Apache Kafka | Apache Spark | CI/CD | CloudFormation | CloudTrail | CloudWatch | Data encryption | Databricks | ELT | ETL | GDPR | Git | Hadoop | IAM | Lake Formation | Python | SNS | SQL | SQS | Scala | Step Functions | Terraform
Education
Roles
Related jobs
-
Data Science AI Engineer, Senior Professional INR 2500K-4500KAPI Development | AWS | Agentic AI | Apache Spark | AzureFully remoteSenior-level Full TimeBangalore, KA, IN, 560100 R2h ago
-
Manufacturing Data Analytics Technical Expert INR 1628K-2146KApache Hive | Apache Spark | Data Historian | Data analytics | Data integrationSenior-level Full TimeBangalore, Karnataka, IN, 5601003h ago
-
Senior Consultant INR 1800K-2200KAmazon Aurora | Amazon Aurora PostgreSQL | Amazon Relational Database Service | Amazon Web Services | Aurora PostgreSQLSenior-level Full TimeIN-AP-Hyderabad20h ago
-
Associate, Data Analytics & AI INR 1000K-1800KAmazon SageMaker | Anthropic API | Azure Machine Learning | CRM | CrewAIWellness Fridays | Wellness resources | Work-life balance supportMid-level Full TimePune, Maharashtra, India R20h ago
-
Senior-level Full TimeIN-AP-Hyderabad20h ago
-
Senior-level Full TimeHybrid, Hyderabad, Telangana, India R21h ago
-
Senior AI Engineer INR 2000K-3800KAWS | Agent Orchestration | Amazon Bedrock | Artificial Intelligence | Confidence scoringComprehensive health benefits | Flexible work environment | Generous time off | Global days of service | Hybrid work modelSenior-level Full TimeBengaluru, Karnataka, India21h ago
-
Technical Program Manager, AI Agent Prototyping INR 1875K-3000KA/B | A/B Testing | B testing | Cloud Computing | Data QualityMid-level Full TimeBengaluru, Karnataka, India22h ago
-
GCP and Databricks Assistant Manager Hiring INR 1500K-2000KApache Spark | BigQuery | Bitbucket | Cloud Composer | Cloud FunctionsMid-level Full TimeBangalore, Karnataka, India23h ago
-
Manager - Fraud Analytics & Monitoring (Detection) INR 618K-618KAnomaly Detection | Artificial Intelligence | Behavioral analytics | Decisioning systems | Early WarningAnnual health checkup | Dental benefits | Gender neutral policy | Group term life insurance | Inclusive and diverse team cultureMid-level Full TimeMumbai, India23h ago
-
Finance - Analytics Finance - Associate INR 1960K-2461KCRM | Data Governance | Data Pipelines | Data Quality | Data StewardshipSenior-level Full TimeBengaluru1d ago
-
AI/ML enhanced control engineering INR 2500K-3000KDecision Trees | Deep learning | Differential Equations | Finite Difference Method | Finite Volume MethodSenior-level Full Timebengaluru, India1d ago
-
DE&A - Core - Big Data Engineering - ETL INR 2040K-2400KApache Hive | Apache Spark | Batch Processing | BigQuery | Cloud ArchitectureSenior-level Full TimeBangalore, Karnataka, India1d ago
-
Senior-level Full TimeIndia1d ago
-
AI Engineer INR 2000K-2600KAPI-driven | API-driven Development | Agent Development | Agent Development Framework | Agent Development KitMid-level Full TimePune, Maharashtra, India1d ago
-
Senior Manager INR 2000K-3000KBureau data | Credit Risk | Credit risk modeling | Data Analysis | Data ProcessingSenior-level Full TimeGurugram, Haryana, India1d ago
-
Mid-level Full TimeHyderabad, India1d ago
-
Manager Data Reliability Engineering INR 1500K-2000KAWS | Apache Airflow | Apache Kafka | Apache Spark | AzureMid-level Full TimeHyderabad1d ago
-
Lead, AI Engineer INR 2000K-4500KAI Assistants | API Integration | AWS | AWS Bedrock | AWS CDKBenefits | Bonus eligibility | Competitive pay | Equity | Hybrid work environmentSenior-level Full TimeAhmedabad, Gujarat1d ago
-
Staff Software Engineer, Machine Learning INR 2500K-3285KAgentic AI | C++ | Data Pipelines | Deep learning | Generative AIHealth and wellness programs | Time offSenior-level Full TimeBengaluru, KA, India1d ago
-
Sr. Data Engineer INR 3200K-4500KAWS | Apache Airflow | Apache Spark | Cloud platform | Data ModelingCommuter benefits | Dental insurance | Disability insurance | Financial wellness support | Health insuranceSenior-level Full TimeBengaluru, India1d ago
-
Associate Data Scientist - AI/ML 1 Job INR 1500K-2000KData Modeling | Data Preprocessing | Data Visualization | Data cleaning | ExcelContinuous learning opportunities | Flexible work arrangements | Inclusive workplace | Stable employmentMid-level Full TimeHyderabad, IN1d ago
-
Abinitio | Agile | Autosys | Cloud platform | Code CoverageSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India1d ago
-
Senior Software Engineer - Linux, Filesystems & Storage INR 3375K-4590KAgile Scrum | C# | Debugging | Device Drivers | Dm-cryptSenior-level Full TimeBangalore - Carina, India R1d ago
-
Manager, Software Engineering - ML, NLP, Gen AI INR 1100K-1680KAWS | AWS Bedrock | Agile | Azure | Azure AIEqual employment opportunity | Flexible work schedule | Hybrid work environmentMid-level Full TimeGurgaon - Cyber Park, India1d ago