Data Engineering Consultant
Primary location: Chennai, India
INR 2500K-3500K (estimate) Senior-level Full Time
Tasks
- Apply infrastructure as code
- Build CI/CD pipelines
- Build data platforms
- Conduct system design reviews
- Contribute to architecture decisions
- Deploy cloud data systems
- Design data pipelines
- Design storage patterns
- Develop backend services
- Develop data ingestion systems
- Develop data processing systems
- Develop data transformation systems
- Ensure high availability
- Ensure low latency
- Expose data services and APIs
- Implement data models
- Implement error handling
- Implement retries
- Maintain data pipelines
- Mentor junior engineers
- Monitor data workloads
- Operate containers
- Operate workflow orchestration
- Optimize cloud resources
- Schedule data workloads
- Set up monitoring and alerting
- Troubleshoot performance issues
- Troubleshoot reliability issues
- Troubleshoot scalability issues
- Write maintainable code
- Write well-tested code
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Airflow | CI/CD | Cloud infrastructure | Data Modeling | Data Warehousing | Docker | ELT | ETL | Git | Infrastructure as Code | Python | Relational databases | SQL | “as-code”
Education
Related jobs
-
Mid-level Full TimePune, India9h ago
-
Amazon Web Services | Cloud platform | Data Catalog | Data Compliance | Data GovernanceContract-to-hire | Hybrid work | Performance and scalability focus | Stakeholder collaborationMid-level ContractShaikpet, India10h ago
-
API Security | Application Security | Application Security Testing | Azure DevOps | Branch PoliciesContract-to-hire | Hybrid work mode | On-call coverageMid-level ContractShaikpet, India10h ago
-
Mid-level Full TimeKarnataka, Bengaluru, India10h ago
-
Junior Software Engineer INR 480K-800KAzure Data | Azure Data Factory | Azure Data Lake | Azure Synapse | Azure Synapse AnalyticsClient facing communication experience | Night shift rotation | Remote workEntry-level Full TimeHyderabad/Remote, India R11h ago
-
Software Engineer - Data Engineer INR 2475K-3465KAWS | Azure | CI/CD | Computer Vision | Data GovernanceCollaborative work environment | Professional development | Training opportunitiesSenior-level Full TimeBangalore - Karnataka, India - Kalyani …11h ago
-
Associate Engineer - AI/ML with Python INR 2500K-4000KAWS | Celery | Django | Docker | ElasticsearchCollaborative work environment | In-office 5 days a week | Learning and development opportunities | Professional growth and developmentMid-level Full TimeBangalore - Karnataka, India - Kalyani …11h ago
-
Mid-level Full TimeIN-TN-Chennai12h ago
-
Senior-level Full TimeIN-TN-Chennai12h ago
-
Databricks Platform Engineer INR 264KApache Spark | Azure Monitor | CI/CD | Cluster policies | DatabricksMid-level Full TimeIN-KA-Bangalore12h ago
-
Databricks Data Engineer INR 1500K-2200KApache Kafka | Apache Spark | Azure | Azure Data | Azure Data LakeMid-level Full TimeIN-KA-Bangalore12h ago
-
Agentic AI Engineer INR 2000K-5000KAI LLM Gateway | AI/LLM | Azure | Azure Cosmos | Azure Cosmos DBSenior-level Full TimeIN-KA-Bangalore12h ago
-
Mid-level Full TimeIN-KA-Bangalore12h ago
-
Data Engineer INR 1500K-2500KApache Airflow | BigQuery | Cloud Composer | Cloud Dataflow | Cloud FunctionsMid-level Full TimeIndia-Telangana-Hyderabad12h ago
-
Quality Data Analytics Specialist INR 1500K-2700KAlation | Data Management | Data Quality | Data Reconciliation | Data ValidationSenior-level Full TimePune, India14h ago
-
Sr Data and AI specialist INR 2000K-4500KAgentic AI | Cloud Computing | DAX | Data Modeling | Data TransformationMentoringSenior-level Full TimeAhmedabad, Gujarat, India14h ago
-
Assistant Manager - Analytics\..RBG - Analytics INR 1200K-2500KAdobe Analytics | Churn Prediction | Classification | Clickstream | ClusteringMid-level Full TimeBengaluru, Karnataka, India15h ago
-
Assistant Manager - Analytics\..RBG - Analytics INR 1200K-2500KAdobe Analytics | Churn Prediction | Classification | Clickstream analytics | ClusteringMid-level Full TimeBengaluru, Karnataka, India15h ago
-
Software Engineer II - Big Data (ETL) / DevOps Engineer + AWS INR 1500K-2500KAWS | Agent Frameworks | Apache Spark | Athena | AuroraMid-level Full TimeBengaluru, Karnataka, India15h ago
-
Senior Software Engineer-Data INR 2000K-4580KAI Foundry | Agent Orchestration | Apache Spark | Azure AI | Azure AI FoundrySenior-level Full TimeIndia, Telangana, Hyderabad16h ago
-
Analyst-Data Science INR 2771K-4064KActive Learning | Algorithms | Apache Hive | Apache Spark | Bayesian MethodsEntry-level Full TimeGurugram, HR, India17h ago
-
Data Engineer (LBC) INR 1500K-2500KBusiness Intelligence | DAX | Data Analysis | Data Catalog | Data QualitySenior-level Full TimePune, IN17h ago
-
Expert D&T Data Visualization Engineer INR 3000K-4000KAstrato | Dashboard Design | Data Modeling | Data Visualization | ETLAccess to modern ERP systems | Career growth | Collaborative inclusive environment | Continuous improvement culture | Global team exposureSenior-level Full TimeHyderabad, India18h ago
-
Data Modeller INR 1500K-2500KData Governance | Data Modeling | Data Warehousing | Database Design | ETLSenior-level Full TimePune, Maharashtra, India18h ago
-
Senior-level Full TimeBangalore,Karnataka,India18h ago