Senior Data Engineer
Bengaluru, Karnataka
INR 1500K-2040K (estimate) Senior-level Full Time
Tasks
- Collaborate with BI developers and analysts
- Define and enforce data engineering standards
- Design, build, and maintain data pipelines
- Develop and optimize data workflows
- Drive adoption of Microsoft Fabric
- Ensure high availability and scalability
- Implement Lakehouse architecture
- Implement data governance, security, and compliance
- Integrate data from multiple sources
- Lead design and architecture of data platforms
- Maintain data lineage cataloging and documentation
- Manage Delta Lake storage and processing
- Mentor junior data engineers and conduct code reviews
- Monitor troubleshoot and optimize pipeline performance
- Optimize large scale data processing and cost
Perks/Benefits
Skills/Tech-stack
Agile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | CI/CD | Data Factory | Data Governance | Data Lake Storage | Data Lineage | Data Modeling | Data Security | Delta Lake | ELT | ETL | Lakehouse | Microsoft Fabric | Power BI | PySpark | SQL | Scrum
Education
N/A
Roles
Related jobs
-
Senior-level Full TimeHyderabad, India7h ago
-
Senior-level Full TimeIN-KA-Bangalore8h ago
-
Senior Consultant INR 1900K-2600KAWS Lambda | Agile | Alerting | Amazon Web Services | Apache SparkGlobal team collaborationSenior-level Full TimeIN-KA-Bangalore8h ago
-
AI Engineer (Manager level) INR 1200K-1800KAI Search | Agile | Apache Spark | Azure AI | Azure AI SearchMid-level Full TimeHyderabad, India9h ago
-
ML Engineer (Data) INR 1500K-2000KAmazon SageMaker | Apache Spark | BERT | CI/CD | CachingCoaching | Hybrid work | Learning opportunities | Mentoring | Paid volunteer dayMid-level Full TimeBengaluru9h ago
-
Software Engineering INR 1500K-2000KApache Hadoop | Apache Kafka | Apache Spark | Azure | Azure ComputeMicrosoft cloud background check | On-call rotationMid-level Full TimeBengaluru, KA, IN9h ago
-
Software Engineer III - Python Developer + AWS + LLM / Gen AI INR 2000K-4000KAWS | Agile | Application Resiliency | Azure | CI/CDSenior-level Full TimeBengaluru, Karnataka, India10h ago
-
Senior Azure Data Engineer INR 2250K-3000KAzure Data | Azure Data Factory | Azure DevOps | Azure Functions | Azure SynapseSenior-level Full TimeThane, Maharashtra, India10h ago
-
AWS | Access Control | Alerting | Audit Logging | AzureSenior-level Full TimePune, MH, India10h ago
-
Security Engineer II - Java, AWS, AI/ML Security INR 1400K-2000KAI red teaming | API Security | AWS | Access Management | AzureContinuous learning cultureMid-level Full TimeBengaluru, Karnataka, India11h ago
-
Data Scientist- Air Quality INR 1400K-1800KAccess Control | Airflow | Ansible | Azure | CI/CDHealth safety wellbeing support | Hybrid work model | Mentoring and team collaboration | Professional development supportMid-level Full TimeBengaluru, Karnataka, India13h ago
-
Senior-level Full TimeIndia13h ago
-
Senior-level Full TimeChennai, Tamil Nadu, India13h ago
-
Python Pyspark with GCP INR 2400K-4000KCloud platform | Google Cloud | Google Cloud Platform | PySpark | PythonEntry-level Full TimeBangalore, Karnataka, India13h ago
-
Remote Senior Data Engineer (ETL Data Modeling) INR 2040K-3500KAPIs | AWS EMR | AWS Glue | AWS Lake Formation | Amazon RedshiftDynamic working environment | Flexible schedule | Flexible working hours | International work environment | Low hierarchySenior-level Full TimeKarnataka, Bengaluru, India R14h ago
-
Senior-level Full TimePune, Maharashtra, India14h ago
-
Software Engineer III - Data Engineer INR 2000K-3500KAWS | Airflow | Azure | Big Data | Data GovernanceSenior-level Full TimeMumbai, Maharashtra, India14h ago
-
Senior Data Engineer INR 2400K-3380KAzure | Azure Data | Azure Data Engineering | Azure Fabric | Cloud servicesSenior-level Full TimeGurgaon14h ago
-
Senior-level Full TimeIndia15h ago
-
Data Engineer - Global Research Modernization INR 1050K-1600KBeautifulSoup | Data Engineering | Data Governance | Data Quality | Data ValidationMid-level Full TimeMumbai, Maharashtra, India15h ago
-
AI/ML Engineer INR 2500K-4000KAI Foundry | AI Search | AWS Bedrock | App Service | Automated retrainingSenior-level Full Timetelengana, India15h ago
-
Artificial Intelligence | Data Governance | Data Quality | Data Science | LLMMid-level Full TimeMumbai, Maharashtra, India15h ago
-
DE&A - Core - Data Engineering - Informatica INR 3000K-4000KBI Publisher | Business Suite | Cause analysis | Data Engineering | Data PipelinesSenior-level Full TimeIndia16h ago
-
Senior ML Engineer INR 2500K-4725KAPI Design | Audio Processing | Azure Machine Learning | CI/CD | DVCCareer progression opportunities | Collaborative team environment | Health coverage | Personal development | Professional developmentSenior-level Full TimeTelangana, Hyderabad, India16h ago
-
Senior Cloud Services Engineer INR 2125K-3200KAlert response | Azure Automation | Azure SQL | Azure SQL Database | Azure SQL Managed InstanceSenior-level Full TimeBangalore, Karnataka, India16h ago