Assistant Manager - Cloud Engineering
INR 1800K-2500K (estimate) Mid-level Full Time
Tasks
- Architect ETL/ELT pipelines
- Build ML training pipelines
- Build feature stores
- Build streaming event driven architectures
- Deploy containerized data services
- Ensure data quality, integrity, security
- Implement data modeling star schema
- Ingest real time telemetry and log data
- Manage Slowly Changing Dimensions
- Manage infrastructure as code
- Model data with dbt
- Monitor and optimize query performance
- Optimize cloud costs
- Optimize sharding strategies
- Orchestrate workflows with Apache Airflow
- Process large datasets with Apache Spark
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Data | AWS Data Catalog | AWS Lake Formation | Apache Airflow | Apache Kafka | Apache Spark | Azure | Azure Cosmos | Azure Cosmos DB | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Databricks | Azure Event | Azure Event Hubs | Azure Functions | Azure Purview | Azure Synapse | Azure Synapse Analytics | Cloud Bigtable | Cloud Cost Optimization | Cloud Dataflow | Cloud Dataproc | Cloud Functions | Cloud PubSub | Cloud Storage | Cloud platform | Cosmos DB | Cost Optimization | DBT | Data Catalog | Data Factory | Data Governance | Data Ingestion | Data Lake Storage Gen2 | Data Quality | Data Security | Data Warehouse | Docker | ELT | ETL | Event Hubs | Feature Store | Google BigQuery | Google Cloud | Google Cloud Bigtable | Google Cloud Dataflow | Google Cloud Dataproc | Google Cloud Functions | Google Cloud Platform | Google Cloud PubSub | Google Cloud Storage | Google Dataplex | Kubernetes | Lake Formation | Machine Learning | Machine learning training | Microsoft Purview | PySpark | Python | Query Optimization | Real Time | Real-time Data | Real-time data ingestion | SCD Type 1 | SCD Type 3 | SCD Type-2 | SQL | Scala | Sharding | Slowly Changing Dimensions | Snowflake Schema | Star Schema | Synapse Analytics | Terraform | Type 1 | Type 2)
Related jobs
-
Senior-level Full TimeIN-TN-Chennai4h ago
-
Senior-level Full TimeIN-AP-Hyderabad4h ago
-
ETL Data Engineer INR 1500K-2500KAdvanced SQL | Amazon Kinesis | Apache Hudi | Apache Iceberg | Apache SparkMid-level Full TimeIN-TN-Chennai4h ago
-
Data Processing | Data Storage | Debugging | Distributed Computing | Generative AIEducational content updates | Team and project mobilitySenior-level Full TimeBengaluru, Karnataka, India5h ago
-
Senior Software Engineer, BigQuery INR 2000K-2500KBig Data | BigQuery | C++ | Cloud Computing | Data WarehouseSenior-level Full TimePune, Maharashtra, India5h ago
-
Software Engineer III, AI/ML, Google Cloud INR 2500K-5000KC++ | Computer Vision | Data Structures | Data Structures and Algorithms | LLMSenior-level Full TimeBengaluru, Karnataka, India5h ago
-
Mid-level Full TimeIndia, Telangana, Hyderabad; India, Karnataka, Bangalore; …6h ago
-
Data Analytics Professional INR 1200K-2000KAWS Glue | AWS Lambda | Amazon Athena | Amazon S3 | Apache AirflowMid-level Full TimeBengaluru, IN, 5601038h ago
-
Principal Business Systems Analyst 2 INR 3700K-5000KApache Hadoop | Apache Spark | Azure DevOps | Big Data | CNNSenior-level Full TimeBengaluru, KA, IN8h ago
-
BTL / ETL - Data Engineer - SQL / DBT In Azure Databricks INR 1500K-2500KADLS | Azure Databricks | Azure DevOps | Azure Synapse | DBTSenior-level Full TimeGurugram, Haryana, India8h ago
-
Embedded Test Engineer INR 660K-1200KArtifactory | Bitbucket | C# | C++ | CI/CDAdditional Paid Leave Volunteering | Flexible hours | Health insurance | Home working | On-demand trainingMid-level Full TimeChennai, TN, IN, 6000978h ago
-
Ardoq | Bird | Collibra | Data Architecture | Data GovernanceSenior-level Full TimeRemote, India R9h ago
-
Associate Principal Engineer, Data Engineer (Enterprise Data Architect-Banking Domain) INR 1524K-2541KAgile | Ardoq | Bird | Collibra | Data ArchitectureMid-level Full TimeRemote, India R9h ago
-
Data Engineer INR 3000K-4000KAmazon S3 | Databricks | ELT | ETL | PythonBike to work | Career mentorship | Employee assistance programme | Employee discount | Fitness classesSenior-level Full TimeBengaluru, KA, India10h ago
-
Senior Software Engineer INR 2475K-3465KCI/CD | Database performance | Database performance tuning | Exception Handling | FastAPIEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India11h ago
-
Software Engineer II INR 1500K-2000KAlerting | Apache Spark | Azure | Azure Cosmos | Azure Cosmos DBLive site operations | On-call rotation | Security screening requiredMid-level Full TimeIndia, Karnataka, Bangalore11h ago
-
Senior-level Full Timebangalore, India11h ago
-
Software Developer 2, Data Platform INR 3000K-4000KAWS | Automated testing | Azure | CI/CD | Data LineageFlexible vacation | Flexible work options | Hackathons | Mentorship programs | Recognition programsSenior-level Full TimeBangalore, KA, India12h ago
-
ClickHouse | Cloud Native | Containerization | Data Integrity | Data PipelinesEmployee stock purchase programs | Equity opportunities | Flexible paid time off | Fully remote work | Generous parental leaveMid-level Full TimeIndia R14h ago
-
API | ClickHouse | Dashboards | Data Engineering | Data ModelingFlexible paid time off | Fully remote | Growth Funding | Health and wellbeing benefits | Learning resourcesMid-level Full TimeIndia R15h ago
-
AWS | Airflow | Alerting | CI/CD | Cloud platformConference participation | Continuous learning support | Equity participation | Flexible paid time off | Healthcare coverageMid-level Full TimeIndia15h ago
-
India: Intern/Trainee (Software Engineer) INR 180K-192KAgentic AI | Autogen | Azure AI | Azure Cognitive | Azure Cognitive SearchEntry-level Full Time InternshipGoa Office, India16h ago
-
India: Intern/Trainee (Software Engineer) INR 180K-192KAI Agents | AWS SageMaker | Agentic AI | Autogen | Azure AIEntry-level Full Time InternshipGoa Office, India16h ago
-
Senior-level Full TimeBengaluru, Karnataka, India16h ago
-
Software Engineer - (Machine learning Platform) INR 3000K-5000KA/B | A/B Testing | AI Agents | AWS | AirflowSenior-level Full TimeBengaluru, Karnataka, India16h ago