Apache Airflow & AWS (S3/EMR/Bedrock) Data Platform Administrator / Operations Engineer
Pune, Maharashtra, India
INR 2535K-4200K (estimate) Senior-level Full Time
Tasks
- Analyze S3 usage and costs
- Configure Amazon Bedrock model endpoints
- Enable S3 access logging
- Encrypt S3 data with AWS KMS
- Execute retries and backfills
- Govern Bedrock costs
- Handle SLA miss events
- Implement S3 storage tiering and transitions
- Manage Bedrock access controls
- Manage EMR autoscaling
- Manage pipeline failure recovery
- Monitor Apache Airflow DAGs
- Monitor Bedrock invocations
- Optimize Amazon S3 storage with lifecycle policies
- Perform EMR lifecycle management
- Perform root cause analysis for pipeline failures
- Provide SLA based operational support
- Provision and configure Amazon EMR clusters
- Rerun failed task instances
- Resolve DAG execution delays
- Secure S3 with IAM policies and bucket policies
Perks/Benefits
Skills/Tech-stack
AWS | AWS IAM | AWS KMS | Access Logging | Amazon Bedrock | Amazon EMR | Amazon S3 | Apache Airflow | Autoscaling | Backfilling | Bucket policies | Cause analysis | DAG monitoring | Intelligent Tiering | Lifecycle Policies | Object level permissions | Retry strategies | Root Cause Analysis | Root cause | S3 versioning | SLA management | Storage class transitions | Storage lifecycle policies
Education
N/A
Related jobs
-
Senior-level Full TimeIN-TN-Chennai4h ago
-
AWS Data Engineer INR 1500K-2040KAWS CDK | AWS Step Functions | Amazon Glue | Amazon RDS | Amazon RedshiftSenior-level Full TimeIN-TN-Chennai4h ago
-
AWS Data Engineer INR 1500K-2040KAWS CDK | AWS Step Functions | Amazon Glue | Amazon RDS | Amazon RedshiftSenior-level Full TimeIN-TN-Chennai4h ago
-
Senior-level Full TimeIN-AP-Hyderabad4h ago
-
Assistant Vice President - AI Runtime Security INR 1500K-6000KAI Governance | AI RMF | Access Control | Amazon CloudWatch | Anomaly DetectionExecutive-level Full TimeIndia5h ago
-
Mid-level Full TimeHyderabad, TS, IN; Bengaluru, KA, IN7h ago
-
Junior GenAI Developer INR 600K-900KAWS | Amazon Bedrock | Anthropic API | Chroma | EmbeddingsCertification programs | Health insurance | Language courses | Mentorship | Professional developmentEntry-level Full TimeAll Cities, India R7h ago
-
Junior GenAI Developer INR 600K-900KAWS | Amazon Bedrock | Amazon OpenSearch | Chroma | EmbeddingsCertification programs | Health insurance | Language courses | Mentorship | Professional developmentEntry-level Full TimeAll Cities, India R7h ago
-
Junior GenAI Developer INR 600K-900KAWS | Agentic Workflows | Chroma | Embeddings | FaissCompany events | Health insurance | Internship opportunities | Language courses | MentorshipEntry-level Full TimeAll Cities, India R7h ago
-
Data Engineer INR 1500K-2000KAWS | Ab Initio | Apache Flink | Apache Spark | Apache Spark StreamingMid-level Full TimeBengaluru, Karnataka, India10h ago
-
DE&A - Snowflake - Specialist INR 1000K-2000KAgile | Amazon S3 | CI/CD | Data Migration | Data ModelingMid-level Full TimeBengaluru South, Karnataka, India11h ago
-
Python & AI/ML Developer INR 1800K-2600KArtificial Intelligence | Automation | Cause analysis | Machine Learning | PythonMid-level Full TimeBengaluru, Karnataka, India13h ago
-
Platform Engineer - Intermediate INR 1300K-1700KAWS | Ansible | Automated Runbooks | Bash | CI/CDHealthcare packages | Hybrid work setting | Online learning platform | Paid time offMid-level Full TimeIND-Trivandrum-Equifax Analytics-PEC, India17h ago
-
Data Engineer - Specialist INR 1500K-2146KAWS | AWS Glue | Amazon Kinesis | Amazon S3 | Apache AirflowEmployee assistance programme | Flexible schedule | Health insurance | Parental leave | Professional development opportunitiesSenior-level Full TimeEcospace Campus 3A, 4th Floor, Outer …17h ago
-
Data Engineer – Specialist INR 1628K-2146KAWS | AWS Glue | Amazon Kinesis | Amazon S3 | Apache AirflowEmployee assistance programme | Flexible schedules | Health insurance | Holiday purchase scheme | Parental leaveSenior-level Full TimeEcospace Campus 3A, 4th Floor, Outer …17h ago
-
Senior Data Engineer INR 2400K-3380KAWS | Agile | Amazon Web Services | Ataccama | AtlanEmployee assistance programme | Flexible schedules | Health insurance | Holiday purchase scheme | Parental leaveSenior-level Full TimeEcospace Campus 3A, 4th Floor, Outer …17h ago
-
Senior Data Engineer INR 2000K-2146KAWS | AWS Glue | Amazon Athena | Amazon MWAA | Amazon RedshiftEmployee assistance programme | Flexible schedules | Health insurance | Parental leave | Professional development opportunitiesSenior-level Full TimeBuilding No 12D, Floor 5, Raheja …17h ago
-
Junior Data Engineer INR 300K-410KAWS | Agile | Azure Event | Azure Event Hubs | CI/CDCollaborative culture | Professional growth and developmentEntry-level Full TimeGCC, India17h ago
-
Senior-level Full TimeBengaluru - Unit 3, India17h ago
-
Senior Engineer, AI/Machine Learning INR 2500K-4500KAWS | Agile | Apache Airflow | Apache Kafka | C++Senior-level Full TimeIndia-Pune17h ago
-
Senior Engineer, AI & Machine Learning INR 2500K-4500KAWS | Agent Studio | Agile | Airflow | Apache KafkaSenior-level Full TimeIndia-Pune17h ago
-
AI Engineer INR 2940K-4000KAWS | Azure | CI/CD | Cloud Computing | GCPEmployee assistance programme | Health insurance | Professional developmentSenior-level Full TimeEcospace Campus 3A, 4th Floor, Outer …17h ago
-
Data Engineer INR 2000K-2146KAWS | Amazon Redshift | Amazon Web Services | Apache Spark | BigQueryEmployee assistance programme | Health insurance | Professional developmentSenior-level Full TimeEcospace Campus 3A, 4th Floor, Outer …17h ago
-
Data Engineer – Specialist INR 2040K-3100KAWS | Ataccama | Atlan | CI/CD | Cloud platformEmployee assistance programme | Flexible schedules | Health insurance | Holiday purchase scheme | Parental leaveSenior-level Full TimeEcospace Campus 3A, 4th Floor, Outer …17h ago
-
Tech Lead – Data Team INR 2400K-3380KAWS | Ataccama | Atlan | BaaN | CI/CDEmployee assistance programme | Flexible schedules | Health insurance | Paid Holidays | Parental leaveSenior-level Full TimeEcospace Campus 3A, 4th Floor, Outer …17h ago