Consultant - Cloud Data Engineer
INR 1000K-2000K (estimate) Mid-level Full Time
Tasks
- Architect ETL/ELT pipelines
- Build automated machine learning training pipelines
- Build feature stores
- Build streaming event driven architectures
- Deploy containerized data services
- Ensure data quality, integrity, and security
- Implement infrastructure-as-code
- Ingest real time telemetry and log data
- Manage Slowly Changing Dimensions
- Manage data workflows with orchestration
- Model data using star schema snowflake schema
- Monitor and optimize query performance
- Optimize cloud costs
- Optimize sharding strategies
- Process multi terabyte datasets with distributed computing
- Transform data with modular modeling
Perks/Benefits
- Client-facing consulting experience
- Flexible work environment
- Growth mindset
- Professional development
- Team collaboration
Skills/Tech-stack
AWS Data | AWS Data Catalog | Apache Airflow | Apache Kafka | Apache Spark | Azure | Azure Data | Azure Data Catalog | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Databricks | Azure Event | Azure Event Hubs | Azure Functions | Azure Synapse | Azure Synapse Analytics | Bigtable | Cloud Dataflow | Cloud Dataproc | Cloud Functions | Cloud PubSub | Cloud Storage | Cosmos DB | DBT | Data Catalog | Data Factory | Data Lake Storage Gen2 | Data Modeling | Dataplex | Distributed Computing | Docker | Event Hubs | Feature Store | GCP | Google BigQuery | Google Cloud | Google Cloud Dataflow | Google Cloud Dataproc | Google Cloud Functions | Google Cloud PubSub | Google Cloud Storage | Infrastructure as Code | Kubernetes | Microsoft Purview | PySpark | Python | SQL | Scala | Slowly Changing Dimensions | Snowflake Schema | Star Schema | Synapse Analytics | Terraform | “as-code”
Related jobs
-
Mid-level Full TimeBangalore, Karnataka, India4h ago
-
Azure Data Engineer Consultant INR 1500K-2000KADLS | Azure | Azure Blob | Azure Blob Storage | Azure DataMid-level Full TimeBangalore, Karnataka, India4h ago
-
Senior Software Engineer INR 2000K-3380KAWS | Apache Kafka | Apache Spark | Azure | Batch ProcessingSenior-level Full TimeBengaluru, KA, IN4h ago
-
Senior-level Full TimeNew Delhi, IN, 1100375h ago
-
Senior-level Full TimeBangalore8h ago
-
Snowflake Data Engineer- Consultant INR 1500K-2700KAWS | AWS Data | AWS Data Pipeline | AWS Glue | AWS IAMCorporate social responsibility programs | Discounts on products and services | Maternity leave | Networking opportunities | Paternity leaveMid-level Full TimeBangalore, Karnataka, India8h ago
-
Software Engineer - Productivity Engineering INR 1200K-2500KAmazon SQS | Anthropic | Async/Await | Data Modeling | DjangoEqual employment opportunity | Hybrid work environmentMid-level Full TimeBengaluru, KA, India8h ago
-
Consultant - Cloud AI Developer INR 1000K-1700KAI/ML | AWS | Application Modernization | Application rationalization | Azure OpenAIMid-level Full TimeGurgaon, Haryana, India9h ago
-
Staff Analytics Engineer - Finance INR 2800K-3465KCI/CD | DBT | Data Governance | Data Modeling | Data QualityHybrid work | On-site onboardingSenior-level Full TimeBengaluru, India9h ago
-
AM - Cloud Data Engineer INR 1500K-2400KAWS N/A | Apache Airflow | Apache Kafka | Apache Spark | Azure DataSenior-level Full TimePune, Maharashtra, India9h ago
-
Consultant - Cloud Data Engineer INR 1000K-2000KApache Airflow | Apache Kafka | Apache Spark | Azure Data | Azure Data FactoryMid-level Full TimeGurgaon, Haryana, India9h ago
-
Consultant - Cloud Data Engineer INR 1000K-2000KAWS N/A | Apache Airflow | Apache Druid | Apache Druid N/A | Apache KafkaMid-level Full TimeGurgaon, Haryana, India9h ago
-
AM - Cloud Data Engineer INR 1500K-2400KAWS Lake Formation | Apache Airflow | Apache Kafka | Apache Spark | AzureSenior-level Full TimeBangalore, Karnataka, India9h ago
-
Consultant - Cloud Data Engineer INR 1500K-2400KAWS Lake Formation | Apache Airflow | Apache Kafka | Apache Spark | Azure DataSenior-level Full TimePune, Maharashtra, India9h ago
-
Consultant - Cloud Data Engineer INR 1000K-2000KApache Airflow | Apache Kafka | Apache Spark | Azure | Azure CosmosMid-level Full TimeBangalore, Karnataka, India9h ago
-
Consultant - Cloud Data Engineer INR 1500K-2400KApache Airflow | Apache Kafka | Apache Spark | Azure | Azure DataSenior-level Full TimeBangalore, Karnataka, India9h ago
-
Consultant - Cloud Data Engineer INR 1000K-2000KAWS Lake Formation | Apache Airflow | Apache Kafka | Apache Spark | AzureMid-level Full TimeBangalore, Karnataka, India9h ago
-
Mid-level Full TimeBangalore, Karnataka, India10h ago
-
Software Engineer II INR 2000K-4590KAWS | Automated testing | CI/CD | Cause analysis | Cloud ComputingLearning and trainingSenior-level Full TimeMumbai, India10h ago
-
Mid-level Full TimePune, Maharashtra, India11h ago
-
Software Engineer (Data Engineering & Building APIs) INR 1200K-1680KAWS | AWS Lambda | Agile | Algorithms | CI/CDHybrid work environmentMid-level Full TimeGurgaon - Cyber Park, India14h ago
-
GCP Data Engineer - VOIS INR 1000K-1500KAlerting | Apache Spark | BigQuery | Cloud Composer | Cloud StorageContinuous learning | International team collaborationMid-level Full TimePune, IN14h ago
-
POD Engineers (Jr) INR 938K-1400KAWS S3 | Amazon Web Services | Apache Kafka | Apache Spark | AzureTravel opportunityMid-level Full TimeAndaman and Nicobar Islands, AN, IN14h ago
-
Sr. Software Engineer - ETL(Extract, Transform, Load) Job INR 3000K-4000KAWS | Agile | Apache Ranger | Apache Spark | CI/CDCareer development | Flexible work arrangements | Inclusive team environment | Stable employment | Travel opportunitySenior-level Full TimeBangalore, KA, IN14h ago
-
Staff Engineer, Artificial Intelligence INR 2000K-3500KAPI Design | AWS | Apache Spark | Data Governance | Data PipelinesSenior-level Full TimeIndia - Bangalore - 5th floor, …14h ago