Lead Azure Data Engineer
Tasks
- Build Data Lakes and Data Warehouses
- Collaborate with cross-functional teams
- Create technical documentation
- Design ETL/ELT pipelines
- Develop data processing pipelines
- Implement data models for quality and governance
- Implement monitoring automation and CI CD
- Optimize SQL queries
- Optimize Spark jobs and data pipelines
- Process batch and real-time data
- Support reporting and visualization
Perks/Benefits
- N/A
Skills/Tech-stack
Automation | Azure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | Batch Processing | CI/CD | Data Factory | Data Governance | Data Lake | Data Modeling | Data Quality | Data Warehouse | Databricks | Delta Lake | DevOps | ELT | ETL | Monitoring | PySpark | RBAC | Real Time | Real-time Processing | SQL | Spark | Synapse Analytics | Time processing
Education
N/A
Roles
Azure Data Engineer | Data Engineer | Engineer | Senior Data Engineer
Related jobs
-
Senior-level Full TimeIN-HR-Gurgaon4h ago
-
Cloud Data Engineer INR 1500K-2500KAnsible | Apache Hadoop | Apache Spark | CI/CD | Cloud platformTravel opportunities up to 30 percentMid-level Full TimeBengaluru, Karnataka, India; Hyderabad, Telangana, India6h ago
-
Azure DevOps | Bash | CI/CD | Centralized Logging | Distributed tracingLearning-focused culture | MentorshipMid-level Full TimeBangalore, Karnataka, India9h ago
-
Azure DevOps | Bash | CI/CD | Distributed tracing | DockerLearning-focused culture | MentorshipMid-level Full TimeBangalore, Karnataka, India9h ago
-
Azure DevOps | Bash | CI/CD | Distributed tracing | DockerLearning culture | MentorshipMid-level Full TimeBangalore, Karnataka, India9h ago
-
Senior Associate Developer INR 1500K-2000KAWS EMR | AWS Glue | AWS Lambda | AWS S3 | Amazon RedshiftMid-level Full TimeMumbai, Maharashtra, India13h ago
-
Software Engineering LMTS - Hyderabad (Java + Spark + AI/ML) INR 2800K-4500KAWS | Agile | Apache Iceberg | Apache Spark | AzureCross-team collaboration | Hybrid work environment | Mentorship | Technical roadmapping leadershipSenior-level Full TimeIndia - Hyderabad17h ago
-
Data & AI Scientist INR 3000K-5000KABAC | Airflow | Audit Logging | Azure DevOps | Azure MLFlexible working options | Hybrid workingSenior-level Full TimeHyderabad Knowledge Park Tower 2, India17h ago
-
Senior Software Engineer INR 3000K-6000KAPI | Asynchronous processing | CI/CD | Distributed Systems | DockerMid-level Full TimeBengaluru, Karnataka, India17h ago
-
Senior Engineer Digital & AI Solutions INR 3000K-5000KAPI Development | Agent systems | CI/CD | Cloud Computing | ContainerizationFood allowance | Gratuity | Group term life insurance | Internet allowance | Medical insuranceSenior-level Full TimeHyderabad, Telengana, India1d ago
-
Staff Machine Learning Engineer INR 3000K-4500KAPIs | Agentic Workflows | Airflow | Anomaly Detection | Bias detectionAgile work environment | Collaborative culture | In-office three days weeklySenior-level Full TimeBangalore R1d ago
-
AI Observability | AWS | Azure | CI/CD | DockerCareer advancement | Flexible work environment | Fully remote | Professional development | Work-life balanceSenior-level Full TimeIndia R1d ago
-
Senior-level Full TimeIndia1d ago
-
API Testing | Apache Airflow | Azure | Bitbucket | CI/CDEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India1d ago
-
Senior-level Full TimeIndia - Bengaluru; India - Chennai …1d ago
-
AI Software Engineer - Senior INR 2500K-4800KAWS | Agent Orchestration | Agile | Autogen | Automated testingSenior-level Full TimePune, Maharashtra, India1d ago
-
AI Software Engineer - Senior INR 2500K-5000KAI Governance | AI orchestration | APIs | Agent systems | AgileSenior-level Full TimePune, Maharashtra, India1d ago
-
Senior Data Engineer INR 1500K-2500KAlerting | Apache Pinot | BigQuery | Cloud platform | Cost OptimizationSenior-level Full TimeBangalore, India1d ago
-
Senior Manager - C2 INR 3000K-5000KAI Observability | Docker | Embedding Models | Evaluation | Generative AISenior-level Full TimeGurugram, Haryana, India1d ago
-
Java Full Stack Engineer - Professional INR 1300K-2200KAmazon Web Services | Apache Kafka | AppDynamics | Automation | Cause analysisClient office work requirement | Hybrid work modelMid-level Full TimeIndia R1d ago
-
Senior Data Engineer INR 1500K-2500KAWS | Amazon EMR | Amazon Redshift | Amazon S3 | Apache AirflowSenior-level Full TimePune1d ago
-
GenAI Engineer INR 1200K-2500KAWS | Artificial neural networks | Azure | Data Structures | DatabricksMid-level Full TimeIndia1d ago
-
Senior Staff Engineer, Machine Learning Platform INR 3000K-5000KAirflow | Apache Hadoop | Apache Kafka | Apache Spark | CI/CDSenior-level Full TimePune, IN1d ago
-
Assistant Manager INR 1200K-2000KAPI Integration | CI/CD | Data Engineering | Data Governance | Data QualityMid-level Full TimeGurugram, Haryana, India1d ago
-
Platform Engineer INR 1600K-2500KAWS | Alerting | ArgoCD | Autoscaling | AzureBenefits package | Equal opportunity employment | On-call rotationsMid-level Full TimeIndia - Bengaluru1d ago