Cloud DevOps & Integration - Consultant
INR 1500K-2600K (estimate) Mid-level Full Time
Tasks
- Architect ETL/ELT pipelines
- Build and maintain feature stores
- Control cloud costs across data stack
- Deploy and manage containerized data services using infrastructure as code
- Develop automated machine learning training pipelines
- Ensure data quality, integrity, and security
- Implement event driven streaming with Kafka
- Ingest telemetry and log data into cloud data warehouse
- Manage workflows with Apache Airflow and dbt
- Monitor and optimize query performance
- Optimize sharding strategies
- Process multi terabyte datasets with distributed computing
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Lake | AWS Lake Formation | Apache Airflow | Apache Kafka | Apache Spark | Azure Cosmos | Azure Cosmos DB | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure Event | Azure Event Hubs | Azure Functions | Azure Synapse | Azure Synapse Analytics | Cloud Bigtable | Cloud Dataflow | Cloud Dataproc | Cloud Functions | Cloud Pub/Sub | Cloud Storage | Cosmos DB | DBT | Data Factory | Data Lake Storage | Data Modeling | Docker | ELT | ETL | Event Hubs | Google BigQuery | Google Cloud | Google Cloud Bigtable | Google Cloud Dataflow | Google Cloud Dataproc | Google Cloud Functions | Google Cloud Pub/Sub | Google Cloud Storage | Google Dataplex | Kubernetes | Lake Formation | Microsoft Purview | Pub/Sub | PySpark | Python | SCD | SQL | Scala | Slowly Changing Dimensions | Snowflake Schema | Star Schema | Synapse Analytics | Terraform
Education
Bachelor of Engineering | Bachelor of Science | High School Diploma
Roles
Cloud Engineer | Cloud) | DevOps | DevOps Engineer | Engineer | Integration Engineer
Related jobs
-
Practice Customer Engineer, Data Analytics INR 1500K-3000KApache Spark | Batch Processing | Big Data | C++ | Cloud platformSenior-level Full TimeBengaluru, Karnataka, India; Mumbai, Maharashtra, India3h ago
-
Staff Software Engineer, AI Garage INR 2500K-5000KAI Evaluation | Agentic AI | Artificial Intelligence | C plus plus | C#Senior-level Full TimeHyderabad, Telangana, India3h ago
-
Senior-level Full TimeBangalore, Karnataka, India3h ago
-
Senior-level Full TimeBangalore, Karnataka, India3h ago
-
Cloud DevOps - Consultant INR 2000K-2700KAWS Lake | AWS Lake Formation | Amazon Web Services | Apache Airflow | Apache KafkaClient-facing consulting experience | Growth mindset | Team collaborationMid-level Full TimeGurgaon, Haryana, India3h ago
-
Manager- Data Engineer INR 1500K-2200KAzure Data | Azure Data Factory | Azure Data Lake | Azure DevOps | Azure SQLMid-level Full TimeBangalore, Karnataka, India4h ago
-
AI Engineer INR 3000K-5000KAI Services | Alerting | Application Insights | Audit Logging | AuthenticationCareer development support | Cross-functional collaboration | Flexible ownership of AI platform | Industry certification supportSenior-level Full TimeMumbai, India5h ago
-
AWS | AWS CodeDeploy | AWS Lambda | Agile | Amazon AuroraSenior-level Full TimeBengaluru, Karnataka, India5h ago
-
Lead Software Engineer Python Gen AI INR 3500K-5500KAWS | Agents | Amazon Web Services | Anomaly Detection | AuthenticationSenior-level Full TimeBengaluru, Karnataka, India5h ago
-
Senior-level Full TimePune, Maharashtra, India5h ago
-
Senior Software Test Engineer (python, pyspark, SQL, databricks, playwright/ selenium) INR 2156K-2800KAPI Testing | Airflow | Azure Kubernetes | Azure Kubernetes Service | BitbucketEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India7h ago
-
React.Js Developer-HDFC-Gurugram INR 1500K-3000KAPI Design | AWS | AWS Lambda | Apache Kafka | DockerSenior-level Full TimeIndia - Bengaluru8h ago
-
Assistant Manager - Forward Deployed Engineer / AI Engineer INR 1860K-4000KAutogen | Cloud Computing | CrewAI | FastAPI | FlaskMid-level Full TimeBangalore, Karnataka, India8h ago
-
Mid-level Full TimeBangalore, Karnataka, India8h ago
-
Senior SDET – Performance Engineering INR 2500K-4000KAKS | APM | Azure | C# | CI/CD401k | Cafe Amenities | Fitness Center | Health insurance | Recreational facilitiesSenior-level Full TimePune, MH, India9h ago
-
Data & Analytics Engineer - Consultant INR 1500K-2500KApache Spark | Data Modeling | Data Warehousing | Databricks | Delta LakeSenior-level Full TimeBangalore, Karnataka, India9h ago
-
AI / ML Engineer II / III INR 1800K-3000KAirflow | Anomaly Detection | Apache Spark | Classification | Data EngineeringMid-level Full TimeBengaluru, India9h ago
-
Senior-level Full TimeBangalore, KA, India10h ago
-
Agentic AI Lead INR 2500K-5000KAgent safety | Agent safety evaluation | Agents SDK | Airflow | CI/CDTeam leadershipSenior-level Full TimeChennai, TN, India10h ago
-
Applied AI ML - India Lead INR 3000K-5000KAmazon Web Services | Cloud Computing | Continuous Delivery | Continuous integration | Drift DetectionSenior-level Full TimeBengaluru, Karnataka, India11h ago
-
Senior-level Full TimeBangalore, India11h ago
-
AWS Database | AWS Database Migration Service | AWS Glue | AWS Lambda | AWS Step FunctionsSenior-level Full TimeGurugram 8 B, India14h ago
-
AWS | AWS CloudFormation | AWS Lambda | Amazon Bedrock | Amazon EC2Career growth resources | Mentorship | Travel opportunities | Work-life balanceSenior-level Full TimeBengaluru, Karnataka, IND14h ago
-
Senior-level ContractINDIA - HYDERABAD - BIRLASOFT OFFICE, …14h ago
-
Mid-level ContractINDIA - HYDERABAD - BIRLASOFT OFFICE, …14h ago