IN_Manager_Data Engineer_D&A_Advisory_Mumbai
Mumbai Shivaji Park, India
INR 3000K-4000K (estimate) Senior-level Full Time
Tasks
- Apply RBAC and encryption for PII
- Build near real time data pipelines
- Create data orchestration workflows
- Design batch data pipelines
- Develop Databricks notebooks jobs
- Implement Delta lakehouse tables
- Implement data quality checks
- Manage dependencies and retries
- Manage secrets for regulated data
- Optimize Spark workloads
- Perform incident triage
- Set up observability logging metrics alerts
- Support audit requirements
- Tune jobs and clusters for cost optimization
Perks/Benefits
Skills/Tech-stack
Alerting | Azure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Databricks | Azure Databricks Workflows | CI/CD | Cost Optimization | Data Factory | Data Lake Storage Gen2 | Data Modeling | Data Quality | Databricks | Databricks Jobs | Databricks Workflows | Delta Lake | Delta Live Tables | Delta Live) | Encryption | Git | Logging | Metrics | Observability | PySpark | Python | RBAC | SQL | Secrets management | Spark | Spark Tuning
Education
Roles
Related jobs
-
AI Data Engineer III INR 3000K-3880KAWS | Agile | Apache Airflow | CI/CD | DBTContinuous learning | Generous leave policies | Health insurance | Hybrid work | Wellness programsSenior-level Full TimeBengaluru, Karnataka, India3h ago
-
AI/ML Engineer INR 2000K-2700KAgentic Systems | Apache Spark | Automated testing | Azure OpenAI | Database ConnectivityEntry-level Full TimeChennai, TN, IN3h ago
-
Data Engineer_Sr_Python Specialist INR 1500K-2400KAI Pipelines | APIs | Alerting | Data Lineage | Data ModelingSenior-level Full Timebangalore, India5h ago
-
ETL Migration Engineer - Data Integration - Lead Consultant INR 1650K-2600KAPI | AWS | AWS Glue | Amazon EKS | Apache AirflowSenior-level Full TimeChennai, IN, 6000325h ago
-
ETL QA - Consultant INR 850K-1500KAgile | Case design | Data Mapping | Data Migration | Data QualityMid-level Full TimePune, IN, 4110575h ago
-
Data Engineer INR 3000K-3500KAlerting | Amazon Redshift | Apache Spark | Argo Workflows | AzureAgile working options | Birthday off | Flexible working hoursSenior-level Full TimeGurgaon5h ago
-
IT Analyst INR 950K-1250KAzure | Azure ML | Azure OpenAI | Cognitive Services | EmbeddingsContinuing education program | Continuous learning | Family-friendly perks | Flexible time off | Health care coverageMid-level Full TimeIN - NOIDA CANDOR TECHSPACE SECTOR …10h ago
-
Senior Data Engineer INR 3000K-4000KAzure Databricks | Data Governance | Data Modeling | Data Monitoring | Data QualitySenior-level Full TimeHyderabad, TG, IN10h ago
-
Information Security Automation Engineer INR 1000K-1500KAI Programming | API | AWS | Agile | AuditabilityMid-level Full TimeGurgaon, HR, IN, 12200210h ago
-
Cloud Computing | Computer Vision | Data Pipelines | Data Quality | Data Quality EvaluationAccidental insurance | Hybrid work options | Life insurance | Medical insurance | Paid parental leaveSenior-level Full TimeBangalore, India (Hybrid) R16h ago
-
Senior Machine Learning Engineer - AI-Assisted Data Annotation INR 2400K-3500KConfidence scoring | Few-Shot Learning | Few-shot | Fine Tuning | Human-in-the-loopAccidental insurance | Flexible hours | Hybrid work | Life insurance | Medical insuranceSenior-level Full TimeBangalore, India (Hybrid) R16h ago
-
Benchmarking | Deep learning | Distributed Training | Efficient Deep Learning | Experiment trackingAccidental insurance | Flexible hours | Health insurance | Hybrid work | Life insuranceSenior-level Full TimeBangalore, India (Hybrid) R17h ago
-
Staff Engineer – Data/AI Platform Engineering INR 3000K-5000KAzure | Batch Processing | Data Catalog | Data Governance | Data IngestionAccidental insurance | Flexible hours | Hybrid work | Life insurance | Medical insuranceSenior-level Full TimeBangalore, India (Hybrid) R17h ago
-
Cloud Platforms | Computer Vision | Data Quality | Fine Tuning | Language ModelsAccidental insurance | Flexible hours | Hybrid work options | Life insurance | Medical insuranceSenior-level Full TimeBangalore, India (Hybrid) R17h ago
-
API | AWS | Airflow | CSV | CronFlexible work arrangements | Health and wellness benefits | Hybrid work arrangement | Inclusive work culture | Learning and development opportunitiesMid-level Full TimeIndia20h ago
-
Consultant - Data Warehouse -238 INR 2520K-4000KBusiness Intelligence | Cloud Platforms | Data Governance | Data Modeling | Data VisualizationEmployee engagement initiatives | Training and mentorshipMid-level Full TimeBengaluru, Karnataka21h ago
-
Python Robot QA INR 1524K-2541KAgile | Azure DevOps | Backup and Recovery | Case management | Continuous integrationHybrid workSenior-level Full TimeIN-AP-Hyderabad21h ago
-
Senior-level Full TimeIN-KA-Bangalore21h ago
-
Agentic AI Engineer INR 1000K-1500KAPIs | Agentic AI | Automation | Automation Anywhere | Cloud ComputingEnhanced medical benefits | Family well-being benefits | Paid time off | Wellbeing benefits | Work-life balance benefitsMid-level Full TimeHyderabad, India21h ago
-
Senior-level Full Timebengaluru, India22h ago
-
ML and GenAI INR 1000K-1000KAPIs | Algorithms | Data Structures | Event Driven | Event-driven architectureMid-level Full TimeGurgaon, Haryana, India22h ago
-
RAG + Agentic AI Engineer (India) (Remote) INR 2500K-3500KAccess Control | Agent Orchestration | Asynchronous programming | Auditability | BM25Growth opportunities | Ownership and autonomy | Remote workMid-level Full TimeMaharashtra, Pune, India R22h ago
-
Staff Engineer, Data Engineering INR 2400K-3100KAPIs | Airflow | Apache Kafka | Apache Spark | AzureSenior-level Full TimeBengaluru, KA, India22h ago
-
Manager- Data Aggregation-304 INR 1200K-2500KAirflow | Amazon Redshift | Data Deidentification | Data Governance | Data ManagementMid-level Full TimeBengaluru, Karnataka22h ago
-
DevOps Lead INR 3000K-5000KAmazon Web Services | Azure DevOps | CI/CD | Cloud Security | CloudFormationCareer growth opportunities | Flexible work environment | Hybrid work environmentSenior-level Full TimeKARNATAKA, Bengaluru, India23h ago