Cloud DevOps & Integration - Consultant
INR 1500K-2600K (estimate) Mid-level Full Time
Tasks
- Architect ETL/ELT pipelines
- Build and maintain feature stores
- Control cloud costs across data stack
- Deploy and manage containerized data services using infrastructure as code
- Develop automated machine learning training pipelines
- Ensure data quality, integrity, and security
- Implement event driven streaming with Kafka
- Ingest telemetry and log data into cloud data warehouse
- Manage workflows with Apache Airflow and dbt
- Monitor and optimize query performance
- Optimize sharding strategies
- Process multi terabyte datasets with distributed computing
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Lake | AWS Lake Formation | Apache Airflow | Apache Kafka | Apache Spark | Azure Cosmos | Azure Cosmos DB | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure Event | Azure Event Hubs | Azure Functions | Azure Synapse | Azure Synapse Analytics | Cloud Bigtable | Cloud Dataflow | Cloud Dataproc | Cloud Functions | Cloud Pub/Sub | Cloud Storage | Cosmos DB | DBT | Data Factory | Data Lake Storage | Data Modeling | Docker | ELT | ETL | Event Hubs | Google BigQuery | Google Cloud | Google Cloud Bigtable | Google Cloud Dataflow | Google Cloud Dataproc | Google Cloud Functions | Google Cloud Pub/Sub | Google Cloud Storage | Google Dataplex | Kubernetes | Lake Formation | Microsoft Purview | Pub/Sub | PySpark | Python | SCD | SQL | Scala | Slowly Changing Dimensions | Snowflake Schema | Star Schema | Synapse Analytics | Terraform
Education
Bachelor of Engineering | Bachelor of Science | High School Diploma
Roles
Cloud Engineer | Cloud) | DevOps | DevOps Engineer | Engineer | Integration Engineer
Related jobs
-
Senior Agentic AI Engineer ID80140 INR 2000K-5000KAnthropic API | CI/CD | Infrastructure as Code | Langchain | LanggraphFlexible hours | Learning budget | Mentorship | Performance reviews | Remote workSenior-level Full TimeBengaluru, India6h ago
-
Lead AI Engineer ID80141 INR 2500K-5000KAWS S3 | Amazon Web Services | Azure | CI/CD | Cloud SecurityAnnual learning budget | Collaborative culture | Flexible hours | Internal TechTalks | MentorshipSenior-level Full TimeBengaluru, India6h ago
-
Senior-level Full TimeBangalore - Karnataka - India Chennai …6h ago
-
Mid-level Full TimeBangalore - Karnataka - India6h ago
-
Staff Data Engineer INR 1500K-2500KAPIs | AWS | Agentic Workflows | Automated testing | Cloud PlatformsSenior-level Full TimeHyderabad, Telangana , India R9h ago
-
Data Engineer, YouTube Business Organization INR 1000K-2000KApache Flume | Apache Spark | Data Governance | Data Lakes | Data ModelingMid-level Full TimeBengaluru, Karnataka, India9h ago
-
Senior Software Engineer, Generative AI, Gaming INR 2500K-5000K3D mathematics | C++ | Computer Graphics | Computer Vision | Data ProcessingSenior-level Full TimeBengaluru, Karnataka, India9h ago
-
Sr Advanced Data Engineer INR 1500K-3000KAWS | Apache Spark | Azure | Data Cleansing | Data ModelingSenior-level Full TimeBengaluru, Karnataka, India9h ago
-
Senior Artificial Intelligence/Machine Learning Engineer INR 2500K-5000KAWS | Agile | Azure | Embedding Models | Hugging FaceCompany-paid certifications | Financial consultations | Internal events | Language courses | Legal consultationsSenior-level Full TimeIndia9h ago
-
AI Senior Software Engineer INR 2000K-4500KAI Foundry | AI Search | AI gateway | AWS Bedrock | AngularSenior-level Full TimeBengaluru, India9h ago
-
Software Engineer II - Python INR 1500K-2500KAWS | Automated testing | Cloud | Code Refactoring | Data AnalysisMid-level Full TimeBengaluru, Karnataka, India10h ago
-
Senior Data Engineer INR 3000K-4000KAWS | Airflow | Apache Spark | CI/CD | DBTBike to work | Career mentorship | Educational assistance | Employee assistance programme | Employee discountSenior-level Full TimeMumbai, MH, India R10h ago
-
Data Engineer 2 INR 1500K-2500KAgile Development | Cassandra | Cloud Computing | Data Catalog | Data GovernanceSenior-level Full TimePune, Maharashtra, India10h ago
-
Data Engineer Manager - AWS Databricks INR 1500K-2600KAWS | Apache Spark | Automation | CI/CD | Data GovernanceSenior-level Full TimeHyderabad, TS, India11h ago
-
Data Engineer INR 3000K-4000KAmazon S3 | Databricks | ELT | ETL | PythonBike to work | Educational assistance | Employee assistance program | Employee discount | Enhanced parental leaveSenior-level Full TimeBengaluru, KA, India R11h ago
-
Senior Software Engineer INR 1163K-3000KAutomated testing | Batch Processing | CI/CD | DAX | Data GovernanceFlexible work arrangement | Hybrid work modelSenior-level Full TimeIndia, Telangana, Hyderabad R12h ago
-
Senior / Lead Data Engineer - Azure Databricks INR 1500K-3000KAzure Databricks | Azure DevOps | CI/CD | Cloud Security | Conformed DimensionsSenior-level Full TimeHyderabad, TS, India12h ago
-
Lead Software Engineer - Java/Python, Data Engineering INR 3000K-4200KAPI Design | AWS | Airflow | Apache Iceberg | AzureSenior-level Full TimeHyderabad, Telangana, India12h ago
-
Lead Software Engineer - Java/Python, Data Engineering INR 3000K-4200KAPI Design | AWS | AWS Bedrock | Airflow | Apache IcebergSenior-level Full TimeHyderabad, Telangana, India12h ago
-
Lead Software Engineer - Java/Python, Data Engineering INR 3000K-4200KAPI Design | AWS | AWS Bedrock | Apache Airflow | Apache IcebergSenior-level Full TimeHyderabad, Telangana, India12h ago
-
Sr Lead Software Engineer - Java/Python, Data Engineering INR 2500K-4300KAPI Design | AWS | Airflow | Apache Iceberg | Apache KafkaSenior-level Full TimeHyderabad, Telangana, India12h ago
-
Apprentice - AI Engineer INR 300K-324KAWS | Anthropic SDK | Azure | Docker | EmbeddingsCareer development | Collaborative team | Exposure to global teams | Holiday allowance | Hybrid work environmentEntry-level Apprenticeship Full TimeWhitefield, Bangalore, India R13h ago
-
Solution Database Engineer INR 1500K-2600KAgile | Azure Data | Azure Data Factory | Azure DevOps | Common table expressionsSenior-level Full TimeBengaluru, KA, India R14h ago
-
Senior-level Full TimeNoida, Uttar Pradesh, India14h ago
-
AI Platform Engineer — Agentic SDLC INR 2000K-5000KAKS | Azure DevOps | Azure OpenAI | CI CD pipeline authoring | CI/CDSenior-level Full TimeBengaluru, KA, India14h ago