Consultant - Cloud Data Engineer
INR 1500K-2500K (estimate) Mid-level Full Time
Tasks
- Architect ETL/ELT pipelines
- Build and maintain feature stores
- Build automated machine learning training pipelines
- Deploy and manage containerized data services
- Ensure data quality, integrity, and security
- Implement data governance and lineage
- Implement infrastructure-as-code
- Ingest real time telemetry and log data
- Monitor and optimize query performance
- Optimize sharding strategies
- Reduce cloud costs
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Airflow | Apache Kafka | Apache Spark | Azure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Databricks | Azure Event | Azure Event Hubs | Azure Functions | Azure Synapse | Azure Synapse Analytics | Bigtable | Cloud Dataflow | Cloud Dataproc | Cloud Functions | Cloud PubSub | Cloud Storage | Cosmos DB | DBT | Data Factory | Data Lake Storage Gen2 | Dataplex | Docker | Event Hubs | Google BigQuery | Google Cloud | Google Cloud Dataflow | Google Cloud Dataproc | Google Cloud Functions | Google Cloud PubSub | Google Cloud Storage | Kubernetes | Microsoft Purview | PySpark | Python | SQL | Slowly Changing Dimensions | Snowflake Schema | Star Schema | Synapse Analytics | Terraform
Roles
Cloud Data Engineer | Cloud) | Data Engineer | Engineer | Senior Data Engineer
Related jobs
-
Senior-level Full TimeBANGALORE, Karnataka, Inde3h ago
-
Advanced Engineer-AI/ML INR 3264K-4800KAPI Integration | ASR | AUTOSAR | AWS | Audio ProcessingEmployee discounts | Recognition rewards program | Training opportunities | Tuition reimbursement | Wellness benefitsSenior-level Full TimeBangalore - Karnataka, India - Kalyani …4h ago
-
Senior Software Engineer - Data License Analytics, Pune INR 3000K-4720KAWS S3 | Agent to Agent | Agent to Agent A2A | Apache Airflow | Apache IcebergSenior-level Full TimePune4h ago
-
AI Lead and Automation Tester - Document Intelligence INR 2500K-5000KAI Workflow Orchestration | AI workflow | Automation Testing | Clinical Trial Compliance | Clinical trialSenior-level Full TimeIN-TN-Chennai4h ago
-
Senior-level Full TimeBangalore - Karnataka - India5h ago
-
Lead Data Platform Engineer INR 2040K-3900KAPI Integration | AWS | AWS CloudWatch | AWS DataZone | AWS GlueEnhanced medical benefits | Family well-being benefits | Hybrid work | Paid time off | Wellbeing programsSenior-level Full TimeHyderabad, India6h ago
-
Anomaly Detection | Autoencoders | Bayesian optimization | Classification | ClusteringOnsite workEntry-level Full TimeHyderabad, India6h ago
-
AI Agent Development Kit | API Gateway | Agent Development Kit | Agentic AI | Audit LoggingSenior-level Full TimeMumbai, Maharashtra, India6h ago
-
AI/ML Infrastructure Software Engineer INR 3000K-5000KC++ | JAX | Keras | Machine Learning | Machine Learning FairnessSenior-level Full TimeBengaluru, Karnataka, India6h ago
-
Data Engineer INR 1300K-2000KAPI Integration | Data Modeling | Data Transformation | Data pipeline | Power BIMid-level Full TimeHyderabad, Telangana, India6h ago
-
Senior QA Engineer (Data Platform Testing) INR 2500K-3000KAPI Gateway | API Testing | AWS Lambda | CI/CD | CloudWatchSenior-level Full TimeHyderabad, India7h ago
-
Generative AI Lead INR 3264K-5876KAI Governance | APIs | Cloud Architecture | Cloud infrastructure | Data LakeHybrid workSenior-level Full TimeHyderabad, India7h ago
-
Senior-level Full TimeHyderabad, India7h ago
-
Sr. Principal Business Systems Analyst 1 INR 3700K-5000KAgentic Frameworks | Azure DevOps | Big Data | C# | C++Senior-level Full TimeBengaluru, KA, IN8h ago
-
Mid-level Full TimeChennai, Tamil Nadu, India8h ago
-
AWS | Ansible | Azure | Bash | CI/CDMid-level Full TimeHyderabad, Telangana, India10h ago
-
Mid-level Full TimeBangalore, KA, IN, 56007611h ago
-
Engineering Technical Leader – Embedded Software INR 3000K-3500KBash | Board Support | Board Support Package | Bootloader | C plus plusSenior-level Full TimeBengaluru, India11h ago
-
Data Engineer INR 1000K-2000KAzure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | CI/CDMid-level Full TimeHyderabad, Telangana, India12h ago
-
AWS | Airbyte | Airflow | Azure | CI/CDCollaboration across teams | Inclusive work environment | Learning opportunities | Professional growth | Remote workSenior-level Full TimeIndia12h ago
-
Auditability | Cloud infrastructure | Databases | Deployment Automation | IntegrationSenior-level Full TimeBengaluru, Karnataka, India12h ago
-
Senior Consultant INR 2700K-4000KAWS OpenSearch | Agile | Apache Kafka | At Least Once Delivery | At least onceSenior-level Full TimeBangalore, IN, 56006612h ago
-
Senior Consultant INR 2700K-4000KAWS OpenSearch | Agile | Apache Kafka | At Least Once Delivery | At least onceSenior-level Full TimeBangalore, IN, 56006612h ago
-
Applied AI ML Lead INR 4000K-5572KAI Agents | Data Governance | Data Management | Deep learning | Experiment trackingSenior-level Full TimeBengaluru, Karnataka, India12h ago
-
Senior Analytics Engineer – Data Applications INR 2771K-4064KAirflow | Anomaly Detection | Apache Spark | CI/CD | DBTSenior-level Full TimeBengaluru, INDIA, India13h ago