Data Engineer
Tasks
- Architect and implement ETL pipelines in Azure Data Factory
- Automate infrastructure provisioning with Infrastructure-as-Code
- Build medallion architecture with Delta Lake
- Build real-time streaming platforms
- Configure and maintain Power BI Gateways
- Create DAX measures calculated tables and time intelligence
- Deliver analytics ready datasets for Power BI
- Deploy and operate data workloads on Azure Kubernetes Service
- Design scalable batch and streaming data pipelines
- Develop interactive Power BI dashboards
- Develop microservices data producers and consumers
- Implement data governance access control and lineage
- Implement data quality validation deduplication and schema evolution
- Monitor log and alert streaming and data workloads
- Optimize Power BI report and data model performance
- Optimize Spark and streaming workloads
- Set up CI CD pipelines for data and streaming
- Transform data with Power Query
Perks/Benefits
- Barrier free access
- Canteen and café
- Childcare
- Coaching
- Company doctor
- Company pension
- Employee discounts
- Employee events
- Employee phone possible
- Flexible working hours
- Good Connectivity
- Health measures
- Hybrid work possible
- Meal allowance
- Mobility offers
- Parking
Skills/Tech-stack
Apache Flink | Apache Kafka | Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Databricks | Azure Functions | Azure IAM | Azure Key Vault | Azure Kubernetes | Azure Kubernetes Service | Azure Monitor | Azure Service | Azure Service Bus | BI Desktop | BI Gateway | CI/CD | DAX | Data Factory | Data Lake Storage Gen2 | Data Modeling | Data Vault | Databricks Unity | Databricks Unity Catalog | Delta Lake | Docker | Git | GitLab | Infrastructure as Code | Key Vault | Kubernetes Service | Log Analytics | M-language | Object-Oriented | Object-oriented programming | Power BI | Power BI Gateway | Power BI Service | Power BI desktop | Power Query | Pulumi | PySpark | Python | RBAC | SCD Type 1 | SCD Type-2 | SQL | Service Bus | Spark SQL | Spark Structured Streaming | Star Schema | Structured Streaming | T-SQL | Terraform | Type 1 | Type 2) | Unity Catalog | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Senior Staff AI Engineer INR 2500K-5000KAWS | Agents | Azure | Code Quality | Code Quality AutomationRelocation assistanceSenior-level Full TimeBengaluru, India3h ago
-
Senior GenAI Data Integration Engineer INR 3000K-5000KApp Engine | BigQuery | Cloud Functions | Cloud Run | Function CallingSenior-level Full TimeHyderabad, India10h ago
-
Senior-level Full TimeHyderabad, India10h ago
-
Senior-level Full TimeIN-MH-Pune11h ago
-
Oracle PL/SQL Developer INR 1200K-2400KAgile | Data Modeling | Database normalization | ETL | EXPLAIN ANALYZESenior-level Full TimeIN-AP-Hyderabad11h ago
-
Senior-level Full TimeIN-HR-Gurgaon11h ago
-
Mid-level Full TimeBengaluru, Karnataka11h ago
-
Mid-level Full TimeBengaluru, Karnataka11h ago
-
Associate Engineer - Data Engineer pyTorch INR 980K-1500KData Pipelines | Data Transformation | Data cleaning | ETL | Feature EngineeringMid-level Full TimeBangalore - Karnataka, India - Kalyani …11h ago
-
Senior Manager INR 3000K-5000KFeature Engineering | Hugging Face | Hugging Face Transformers | Intent detection | Language ProcessingSenior-level Full TimeGurugram, Haryana, India12h ago
-
Senior-level Full TimeBangalore, Karnataka, India13h ago
-
Java Developer INR 1500K-2700KAWS | Azure | CI/CD | Docker | GCPAgile working environment | Code reviews | Design discussionsSenior-level Full TimeBangalore, Karnataka, India13h ago
-
Senior-level Full TimeBangalore, Karnataka, India13h ago
-
Executive-level Full TimeBangalore, Karnataka, India13h ago
-
Business Intelligence Analyst INR 1500K-2500KDAX | Data Governance | Data Mining | Data Quality | Data VisualizationMid-level Full TimePune, Maharashtra, India13h ago
-
Senior Data Engineer (Python, PySpark, Kafka) INR 1500K-2500KApache Kafka | Data Warehousing | Dimensional Modeling | Git | GitHubSenior-level Full TimeBangalore, India14h ago
-
Mid-level Full TimeBengaluru, Karnataka, India14h ago
-
Scientist 4, Data Science INR 3700K-5000KAWS | Azure | Causal Inference | Deep learning | Distributed ComputingSenior-level Full TimeBengaluru, KA, India15h ago
-
Data Engineer INR 3000K-4000KAI machine learning | Cortex AI | Data Modeling | Machine Learning | Performance TuningSenior-level Full TimePune, Maharashtra, India15h ago
-
Engineer - Data Science INR 2500K-4000KAgile | Anomaly Detection | Azure IoT | Azure IoT Hub | Azure Machine LearningSenior-level Full TimeHadapsar, Pune, Maharashtra, IND, 41101315h ago
-
Sr. AI / ML Engineer – OpenAI Expert INR 2500K-5000KAI Search | Agent systems | Agentic AI | Agents SDK | Assistants APISenior-level Full TimePune, Maharashtra, India15h ago
-
Principal Platform Engineer-Databricks INR 3000K-4000KAWS | Automation | Azure | CI/CD | ComplianceCareer growth | Engineering culture focused on innovation | Global collaboration | Mission-driven workSenior-level Full TimeBangalore, Karnataka, IN16h ago
-
AI Analyst INR 180K-180KAI Foundry | Agent architecture | Autogen | Azure AI | Azure AI FoundryEmployee assistance program | Employee resource groups | Flexible time off | Medical insurance plans | Paid parental leaveEntry-level Full TimeCHANDIGARH, CHANDIGARH, India17h ago
-
Knowledge Graph, Graph DB, Python/Senior Consultant Specialist INR 3000K-4200KAgile methodology | Amazon Neptune | Data Governance | Data Lineage | Data ModelingContinuous professional development | Flexible working | Inclusive workplace | Opportunities for growthSenior-level Full TimeHyderabad, Telangana, India R17h ago
-
Senior Associate — Data Scientist, Applied AI/ML INR 1400K-2800KAWS | Agentic Workflows | Alerting | Azure | CI/CDMid-level Full TimeBengaluru, Karnataka, India17h ago