Senior Data Engineering Consultant
Primary location: Bengaluru, India
INR 3000K-4500K (estimate) Senior-level Full Time
Tasks
- Automate data engineering deployments
- Build AI-ready data pipelines
- Build CI/CD pipelines
- Build batch and real-time data pipelines
- Build enterprise data models
- Design scalable secure data platforms
- Develop Azure Data Factory pipelines
- Develop Azure Databricks workflows
- Develop Azure Synapse solutions
- Develop Azure data lake solutions
- Enable LLM RAG workflows
- Enable automated testing and release management
- Implement data governance and compliance
- Implement data quality and lineage for AI workloads
- Implement dataops best practices
- Implement infrastructure-as-code
- Implement lakehouse design patterns
- Implement medallion architecture
- Implement monitoring and performance tuning
- Integrate Event Hub pipelines
- Integrate vector database and embeddings
- Mentor junior engineers
- Optimize data processing workflows
- Support cloud migration/modernization
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Databricks | Azure DevOps | Azure Kubernetes | Azure Kubernetes Service | Azure SQL | Azure Synapse | Bicep | CI/CD | Compliance | Data Factory | Data Governance | Data Lake | Data Lineage | Data Modeling | Data Quality | Data Security | DataOps | Databricks Workflows | Delta Lake | Docker | ELT | ETL | Embeddings | Event Hub | Git | GitHub Actions | Infrastructure as Code | Kubernetes | Kubernetes Service | LLM-Ops | Lakehouse | Langchain | MLOps | Medallion Architecture | Microsoft Azure | PySpark | Python | Retrieval-Augmented Generation | SQL | Semantic Search | Spark SQL | Terraform | Vector Databases | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Power BI Contractor INR 1628K-2500KAzure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | CI/CDRemote workSenior-level Contract Full TimeMumbai, Maharashtra, India21h ago
-
Director, Data Architecture/Engineering INR 3600K-5000KAPI Integration | Agile | Automated testing | CI/CD | Container OrchestrationComprehensive healthcare | Flexible time off | Hybrid work model | Retirement plan | Tuition reimbursementSenior-level Full TimeM11 - Commers III, 43, 44 … R1d ago
-
Senior Data Science Consultant INR 2771K-4132KArtificial Intelligence | Clustering | Data Visualization | Decision Tree | GCPSenior-level Full Time111442-IND-BENGALURU-INTL BLR BLK B3 PETUNIA, India1d ago
-
Data Science Consultant INR 650K-1000KArtificial Intelligence | Cloud platform | Clustering | Data Validation | Data VisualizationMid-level Full Time111442-IND-BENGALURU-INTL BLR BLK B3 PETUNIA, India1d ago
-
IN_Associate_AI/ML_Intelligent Power_Advisory_Gurgaon INR 3000K-4500KArtificial Intelligence | Fine Tuning | Java | Machine Learning | Model Fine-tuningFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeGurugram 10 C, India1d ago
-
IN_Specilaist 3_ GenAI/Python _AI in Delivery_Advisory_Gurgaon INR 2000K-5000KAWS | Adversarial Networks | Autoregressive models | Azure | CI/CDSenior-level Full TimeGurugram Novus Tower, India1d ago
-
Databricks Data Engineer - Manager INR 1500K-2700KApache Spark | Azure | Azure Blob | Azure Blob Storage | Azure DataEmployee networks | Flexible work programs | Hybrid work schedule | Medical insurance | Paid volunteer daysMid-level Full TimeBangalore, India1d ago
-
M02 INR 2800K-4064KAWS EMR | AWS Glue | AWS Lambda | AWS Step Functions | AgileHybrid work schedule | Paid time off | Professional development | Work-life balanceSenior-level Full TimeHyderabad, India1d ago
-
IN_Specilaist 3_ GenAI/Python _AI in Delivery_Advisory_Gurgaon INR 2000K-5000KAWS | Adversarial Networks | Autoregressive models | CI/CD | Cloud platformFlexible work programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeGurugram Novus Tower, India1d ago
-
IN_Specilaist 3_ GenAI/Python _AI in Delivery_Advisory_Gurgaon INR 2000K-5000KAWS | Adversarial Networks | Azure | CI/CD | Data AugmentationFlexibility programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeGurugram Novus Tower, India1d ago
-
Senior-level Full TimeIND-HYDERABAD, India1d ago
-
SAP COE Master Data Governance (MDG) Techno‑Functional INR 1000K-2200KABAP | BADI | BRF+ | Data Cleansing | Data GovernanceSenior-level Full TimeIND GBS Bangalore - Office, India1d ago
-
Data Engineering Consultant INR 980K-1820KApache Spark | Azure | Azure Data | Azure Data Factory | Data AuditingMid-level Full TimePrimary location: Hyderabad, India1d ago
-
Supply Chain Analytics Consultant INR 800K-1600KCause analysis | Data Flow | Data Modeling | Data flow debugging | Data loadingCareer development resources | Health and wellness benefits | Inclusive work environment | Work-life integrationMid-level Full TimeBEP01 - Embassy Prime, BEP01 (BEP01), …1d ago
-
Senior Manager – Data Platforms & Analytics Applications INR 3264K-5400KAWS Data | AWS Data Analytics | AWS Solutions | AWS Solutions Architect | AgileSenior-level Full TimeBANGL/RNDV - VAN BANGALORE R&D, India1d ago
-
Mid-level Full TimeHyderabad, TS, India1d ago
-
Delivery Lead - AI Engineer INR 4000K-5500KAWS | Apache Spark | Automation | Azure | Cloud platformSenior-level Full TimePune, Maharashtra, India1d ago
-
Fusion ERP Reporting & Analytics Technical Consultant INR 2000K-3600KAccounts Payable | Accounts Receivable | Application Composer | BI Publisher | Cash ManagementFlexible medical insurance | Life insurance | Retirement benefits | Volunteer programsSenior-level Full TimePUNE, MAHARASHTRA, India1d ago
-
Platform Architecture System INR 2000K-5000KAgent systems | Agentforce | Apex | Data Ingestion | Data ModelingSenior-level Full TimePune, Maharashtra, India1d ago
-
Manager Data Integration INR 2520K-4064KApache Airflow | BigQuery | Bigtable | Celigo | Cloud ComposerSenior-level Full TimeBengaluru, KA, India1d ago
-
Oracle AI-Oracle AI Developer-Senior INR 4000K-5000KAI Governance | AI Security | AWS | Agile | AlgorithmsHealth and wellness packages | Learning opportunities | MentorshipSenior-level Full TimeNoida, UP, IN, 2013012d ago
-
Senior Consultant (Databricks) INR 2000K-2800KAmazon Web Services | Apache Airflow | Apache Spark | Azure | Azure DataSenior-level Full TimeIndia - Remote R2d ago
-
Amazon Web Services | Angular | Apache Airflow | Apache Hadoop | AzureSenior-level Full TimeBengaluru Millenia, India2d ago
-
Senior Data Engineer-1 INR 3000K-4000KAzure Data | Azure Data Factory | Azure Portal | Azure SQL | Azure SQL DatabaseSenior-level Full TimeBangalore - India2d ago
-
Software Engineering Lead Analyst - HIH - Evernorth INR 2700K-4000KAWS | Apache Spark | Artifactory | CI/CD | ConfluenceSenior-level Full TimeHIH - Hyderabad, India2d ago