Deputy Manager-Data Engineering
Tasks
- Build Databricks notebooks and jobs
- Collaborate with business and technical stakeholders
- Create Azure Data Factory pipelines and triggers
- Design data pipelines and transformations
- Develop ETL/ELT pipelines
- Document runbooks and pipeline architecture
- Implement data quality validation and alerting
- Integrate data sources and handle schema management
- Manage Azure resources and monitoring
- Orchestrate and schedule data pipelines
- Own production pipeline monitoring and incident response
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Airflow | Azure | Azure Data | Azure Data Factory | Azure Databricks | Azure Key Vault | Azure Monitor | Data Factory | Data Quality | ELT | ETL | Git | Key Vault | Pipeline Orchestration | Pipeline scheduling | PySpark | Python | SQL | Version control
Related jobs
-
Agentic AI architect INR 2500K-4800KAPIs | AWS | Agent Orchestration | Autogen | AzureEmployee referral bonuses | Flexible work options | Fun culture | In-house technology training | Learning and development programsSenior-level Full TimeChennai, India5h ago
-
AI Developer (Python) INR 1800K-2500KCI/CD | Document parsing | ETL | FastAPI | Generative AIFlexible work options | In-house technology training | Learning and development programs | Medical insurance | Performance bonusesMid-level Full TimeChennai, India5h ago
-
Sr. Data Engineer I INR 2400K-4000KAWS | AWS Glue | Amazon EMR | Apache Kafka | Cloud MigrationContinuous learning | International travel | Mentorship | Professional growthSenior-level Full TimeBangalore, India5h ago
-
Senior Manager – Data Scientist INR 2520K-3500KAWS | AWS SageMaker | Agent systems | Agentic AI | AzureCareer growth | Continuous learning opportunities | Mentorship | Mentorship and coachingSenior-level Full TimeIndia-Gurugram5h ago
-
Research Engineer INR 1200K-1800KData Processing | Deep learning | Distributed Computing | LLM | Language ModelsMid-level Full TimeGurugram, India6h ago
-
Senior-level Full TimeIN-AP-Hyderabad6h ago
-
Python Robot QA INR 1500K-2541KAPI Testing | Agile | Azure DevOps | Backup and Recovery | Case managementFlexible work timing | Hybrid work modelSenior-level Full TimeIN-AP-Hyderabad R6h ago
-
DBT Data Engineer INR 400K-1200KAPI Development | AWS Glue | AWS S3 | Amazon Redshift | Apache AirflowSenior-level Full TimeIN-AP-Hyderabad6h ago
-
Data Engineer INR 1500K-2000KAPI Development | AWS SQS | Amazon Aurora | Amazon Redshift | Amazon S3Senior-level Full TimeIN-AP-Hyderabad6h ago
-
Database Developer INR 1200K-2200KAWS Aurora | AWS Aurora PostgreSQL | AWS Cloud | AWS Cloud Database Services | AWS DMSSenior-level Full TimeIN-KA-Bangalore6h ago
-
Staff Engineer, Test Development Engineering (Embedded Firmware Development Engineer) INR 1236K-2156KARM Microcontroller | C# | DMA | GDB | GitSenior-level Full TimeBengaluru, KA, India6h ago
-
AI Engineer INR 300K-300KAPI Development | Agent Development | Agent Development Framework | Agent Development Kit | AnthropicInternal demos | Internal training sessionsEntry-level Full TimePune, Maharashtra, India7h ago
-
Partner Engineer, Generative AI INR 2500K-4500KAWS | Azure | Bias Mitigation | C++ | Conversational AISenior-level Full TimeBangalore, India | Mumbai, India7h ago
-
Tools and Automation Engineer INR 1000K-1400KAIOps | Active Directory | Ansible | Automation Anywhere | CopilotMid-level Full TimeAhmedabad, Gujarat, India7h ago
-
Associate Manager - Data Engineering-Data Engineering INR 800K-1050KData Engineering | Data Pipelines | Data Quality | ELT | ETLMid-level Full TimePune, Maharashtra, India7h ago
-
Senior-level Full TimeGurgaon, Haryana, India8h ago
-
Consultant-B2 INR 1500K-2000KAI Search | Agentic architecture | Assistants API | Autogen | Azure AIMid-level Full TimeGurugram, Haryana, India8h ago
-
Senior-level Full TimeMumbai, Maharashtra, India9h ago
-
Python , web scrapping data conversion VBA INR 1500K-2156KAPI | Alerting | BeautifulSoup | Data Automation | Data EngineeringHybrid working | UK time zoneSenior-level Full TimeGurgaon, HR, India9h ago
-
AI/ML Engineer INR 2500K-3000KAWS | Anomaly Detection | Automated retraining | Azure | ChromaCollaborative work environment | Competitive compensation | Continuous learning opportunities | Growth-oriented cultureMid-level Full TimeGujarat, Surat, India9h ago
-
Principal Engineer, Data Analytics Engineering 9+ years (Data Engineering , GenAI , Python , SQL) INR 2500K-5000KAWS | Airflow | Amazon Bedrock | Anthropic API | CI/CDSenior-level Full TimeBengaluru, KA, India9h ago
-
GCP Cloud Engineer INR 2500K-4500KAI Pipelines | BigQuery | Blue-Green Deployment | Blue/green | CI/CDSenior-level Full TimeChennai, Tamil Nadu, India10h ago
-
Associate Process Manager INR 2000K-2500KAPI Gateway | AWS Bedrock | AWS Lambda | AWS Step Functions | Agent systemsMid-level Full TimePune, Maharashtra, India10h ago
-
Mid-level Full TimeBengaluru, IN, 56010310h ago
-
Senior_AI_developer INR 3000K-4500KCI/CD | CNN | Computer Vision | Data Preprocessing | Deep learningSenior-level Full Timepune, India11h ago