Lead Data Engineer
Tasks
- Build data lakehouse and data warehouse solutions
- Collaborate with business for requirement gathering
- Design data ingestion and transformation pipelines
- Develop Python based APIs on Azure Functions
- Ensure secure Azure environment access
- Implement CI/CD pipelines for data platforms
- Lead data engineering projects
- Manage data modelling relational and dimensional
- Migrate on-premise data warehouses to Azure
- Operationalize data solutions
- Perform capacity planning and performance tuning
- Provide technical guidance to data engineering team
- Support data visualization development
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Databricks | Azure DevOps | Azure Functions | Azure Key Vault | Azure Logic | Azure Logic Apps | Azure SQL | Azure SQL Database | Azure Service | Azure Service Principals | CI/CD | Data Factory | Data Lake Storage Gen2 | Data encryption | Data masking | Dimensional Modeling | Key Vault | Logic Apps | Managed Identity | Microsoft Azure | Power BI | PySpark | Python | Relational modeling | SQL Database | Service principals
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Senior-level Full TimeIN-TN-Chennai8h ago
-
Manager - Data Engineering INR 804K-1500KAWS | Automation | Azure | Azure Data | Azure Data FactoryMid-level Full TimeBengaluru, KA, India9h ago
-
Senior Manager - C2 INR 3000K-5000KAI Observability | Docker | Embedding Models | Evaluation | Generative AISenior-level Full TimeGurugram, Haryana, India10h ago
-
Executive-level Full TimeMumbai, Maharashtra, India10h ago
-
GenAI Engineer INR 1200K-2500KAWS | Artificial neural networks | Azure | Data Structures | DatabricksMid-level Full TimeIndia12h ago
-
Assistant Vice President - Program Delivery INR 4000K-5199KCollibra | Databricks | ETL | Hadoop | Power BIAnnual health checkup | Dental benefits | Gender neutral policy | Group term life insurance | Learning and development frameworkExecutive-level Full TimeGurugram, India12h ago
-
Bootloader | C# | CAN | Configuration Management | DebuggingFlexi benefits | Health insurance | Hybrid working model | Internal job rotation | Life insuranceEntry-level Full TimeBangalore, IN12h ago
-
Assistant Manager INR 1200K-2000KAPI Integration | CI/CD | Data Engineering | Data Governance | Data QualityMid-level Full TimeGurugram, Haryana, India13h ago
-
Executive-level Full TimeBangalore, Karnataka, India14h ago
-
AI Engineer II INR 3000K-5000KAWS | Agile | Apache Hive | Apache Kafka | Apache SparkCareer growth | Holistic well-being support | Learning opportunities | Supportive leadership cultureSenior-level Full TimeBengaluru, KA, India14h ago
-
Senior Data Integration Engineer I INR 3264K-4401KAWS IAM | Airflow | Amazon VPC | Apache Flink | Apache SparkSenior-level Full TimeBengaluru15h ago
-
Senior Data Engineer I INR 2500K-3380KAgile | Apache Airflow | Apache Hadoop | Apache Hive | Apache KafkaInclusive culture | Professional development time | Supportive team environment | Work-life balanceSenior-level Full TimeGurugram, HR, India16h ago
-
Data Engineer INR 1340K-1680KAWS | Azure | ClickHouse | DBT | Data ArchitectureDonation matching | Flexible PTO | Flexible schedule | Health insurance | Lunch stipendMid-level Full TimeBengaluru, Karnataka, India17h ago
-
Senior Analyst-Data Science INR 2500K-4400KA/B | A/B Testing | B testing | Causal Inference | Data PreparationSenior-level Full TimeGurugram, HR, India17h ago
-
IN_Associate_AI Engineer_GCC_Advisory_Hyderabad INR 2500K-4800KAPI Development | Anthropic API | Async Programming | Autogen | CI/CDFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeHyderabad - Salarpuria, India21h ago
-
Data Engineer (SQL + Python/Java) INR 700K-1500KAWS EMR | Agile Scrum | Amazon Web Services | Apache Spark | Continuous DeliveryHybrid work flexibility | Remote work supportMid-level Full TimeGurgaon - Cyber Park, India21h ago
-
Lead Data Scientist INR 2520K-3500KA/B | A/B Testing | AWS | Agentic AI | Applied AIEmployee assistance program | Medical insurance | Paid time off | Parental leave | Professional developmentSenior-level Full TimeGurgaon - Cyber Park, India21h ago
-
IN_Sr Associate_ AWS Devops With MLOPs Developer_Application Technology_Advisory_ PAN INDIA (early joiners) INR 3000K-4000KAWS | AWS Lambda | Amazon CloudFormation | Amazon EKS | Amazon S3Flexibility programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India21h ago
-
Vice President - Principal Data Engineer INR 3584K-5500KAPI | AWS | Agile | Anomaly Detection | AzureComprehensive healthcare | Flexible time off | Hybrid work model | Retirement plan | Support for working parentsSenior-level Full TimeM11 - Commers III, 43, 44 … R21h ago
-
Mid-level Full TimeBangalore, KA, IN21h ago
-
EY - GDS Consulting - AIA - Gen AI - Senior INR 2000K-3300KAWS CloudFormation | Amazon Bedrock | Amazon Web Services | Apache Spark | AuthenticationCoaching | Continuous learning | Inclusive cultureSenior-level Full TimeChennai, TN, IN, 60003221h ago
-
Operations Sr. Assistant I INR 2500K-3500KAWS | Azure | Cloud Computing | Computer Vision | Data PipelinesSenior-level Full TimeIND - Ranjangaon - B200A, India21h ago
-
Artificial Intelligence Lead - Airbus India Innovation Centre INR 2500K-4800KAmazon SageMaker | Anomaly Detection | Computer Vision | Data Analysis | Language ModelsFlexible working arrangements | Inclusive work environmentSenior-level Full TimeBangalore (Airbus), India21h ago
-
Software Engineer IV INR 2000K-3000KApache Airflow | Apache Hudi | Apache Iceberg | Apache Spark | AvroMid-level Full TimeIndia - Bangalore-Navigator Bldg21h ago
-
Senior Data Platform Support Engineer -GCP Certified INR 3000K-3500KAirflow | Bash | BigQuery | CI/CD | Cloud ComposerHybrid work modelSenior-level Full TimePune, India R21h ago