Data Engineer
Tasks
- Architect and implement ETL pipelines in Azure Data Factory
- Automate infrastructure provisioning with Infrastructure-as-Code
- Build medallion architecture with Delta Lake
- Build real-time streaming platforms
- Configure and maintain Power BI Gateways
- Create DAX measures calculated tables and time intelligence
- Deliver analytics ready datasets for Power BI
- Deploy and operate data workloads on Azure Kubernetes Service
- Design scalable batch and streaming data pipelines
- Develop interactive Power BI dashboards
- Develop microservices data producers and consumers
- Implement data governance access control and lineage
- Implement data quality validation deduplication and schema evolution
- Monitor log and alert streaming and data workloads
- Optimize Power BI report and data model performance
- Optimize Spark and streaming workloads
- Set up CI CD pipelines for data and streaming
- Transform data with Power Query
Perks/Benefits
- Barrier free access
- Canteen and café
- Childcare
- Coaching
- Company doctor
- Company pension
- Employee discounts
- Employee events
- Employee phone possible
- Flexible working hours
- Good Connectivity
- Health measures
- Hybrid work possible
- Meal allowance
- Mobility offers
- Parking
Skills/Tech-stack
Apache Flink | Apache Kafka | Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Databricks | Azure Functions | Azure IAM | Azure Key Vault | Azure Kubernetes | Azure Kubernetes Service | Azure Monitor | Azure Service | Azure Service Bus | BI Desktop | BI Gateway | CI/CD | DAX | Data Factory | Data Lake Storage Gen2 | Data Modeling | Data Vault | Databricks Unity | Databricks Unity Catalog | Delta Lake | Docker | Git | GitLab | Infrastructure as Code | Key Vault | Kubernetes Service | Log Analytics | M-language | Object-Oriented | Object-oriented programming | Power BI | Power BI Gateway | Power BI Service | Power BI desktop | Power Query | Pulumi | PySpark | Python | RBAC | SCD Type 1 | SCD Type-2 | SQL | Service Bus | Spark SQL | Spark Structured Streaming | Star Schema | Structured Streaming | T-SQL | Terraform | Type 1 | Type 2) | Unity Catalog | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Data Engineer II INR 2000K-3000KAWS | Amazon Kinesis | Apache Airflow | Apache Beam | Apache FlinkComplimentary games | Family leave | Health insurance | Mental well-being support | Paid time offSenior-level Full TimeLocations: Hyderabad, Telangana, India2h ago
-
Senior-level Full TimeHyderabad, India3h ago
-
Senior BI Engineer - Tableau & Python INR 3000K-4000KBusiness Intelligence | Data Modeling | Data Visualization | Data Warehousing | DatabricksCareer growth | Certification support | Flexible collaboration | Innovation time | MentorshipSenior-level Full TimeHyderabad, TS, India4h ago
-
Applied AI ML Senior Associate INR 3264K-5000KAWS | Azure | CI/CD | Cloud platform | Distributed SystemsSenior-level Full TimeBengaluru, Karnataka, India4h ago
-
Associate Program Manager INR 2000K-4000KAI Agents | AI Foundry | AI Governance | AI orchestration | APIsMid-level Full TimeChandigarh, India4h ago
-
AI/ML Engineer INR 1860K-4000KAI Agent Builder | AI Pipelines | AI vector search | Agent Builder | AirflowMid-level Full TimeChennai, Tamil Nadu, India4h ago
-
GenAI Developer INR 1500K-2129KDeep learning | Docker | GenAI | Language Processing | Machine LearningWell-being focusEntry-level Full TimePune, Maharashtra, India5h ago
-
Senior-level Full TimeHyderabad, Telangana, India6h ago
-
Azure DevOps | BI Desktop | BI Gateway | CI/CD | DAXMid-level Full TimeIndia6h ago
-
Manager of Software Engineering - Java Full stack developer INR 2000K-3200KAPI first | AWS | CI/CD | Databricks | DockerSenior-level Full TimeHyderabad, Telangana, India R6h ago
-
Engineering-L2-Bengaluru-Analyst-Software Engineering INR 1500K-2500KApache Spark | Avro | CI/CD | Data Clustering | Data ModelingEntry-level Full TimeBengaluru, Karnataka, India6h ago
-
ML-Ops INR 3700K-5000KAsyncio | CI/CD | CProfile | Caching | DjangoLeadership development | Training sessionsSenior-level Full TimeMumbai, Maharashtra, India8h ago
-
Generative AI Engineer INR 1200K-2500KAI Services | AWS | Amazon SageMaker | Anthropic API | AzureCollaborative team environment | Leadership development | Training programsMid-level Full TimeMumbai, Maharashtra, India8h ago
-
Staff GenAI Engineer INR 2000K-5000KAWS | Agentic AI | Azure | CI/CD | ClassificationCollaborative team environment | Global consulting environment | Leadership development program | Mentorship programs | Training sessionsSenior-level Full TimeMumbai, MH, India8h ago
-
Mid-level Full TimeMumbai, Maharashtra, India8h ago
-
Senior-level Full TimeMumbai, Maharashtra, India8h ago
-
Executive, R&D Injectable (AI/ML) INR 3000K-5000KAPIs | Anomaly Detection | Computer system | Computer system validation | Data AnalysisExecutive-level Full TimeAhmedabad City, Gujarat, India8h ago
-
SQL and Power BI Developer INR 800K-1200KDAX | Data Modeling | Data Validation | Data Warehousing | Database DesignMid-level Full TimeHyderabad, India R8h ago
-
Lead Software Engineer - Python and AI INR 3500K-6000KAI assisted code | AI-assisted code review | AWS ECS | AWS Lambda | Agent FrameworksSenior-level Full TimeBengaluru, Karnataka, India9h ago
-
Lead Data Engineer - Azure + Fabric INR 1200K-2700KAzure | Azure DevOps | CDC | CI/CD | Data GovernanceSenior-level Full TimeGurugram, Haryana, India9h ago
-
Databricks Engineer - Senior/ Lead INR 1500K-2800KACID | ADLS Gen2 | Apache Spark | Azure Data | Azure Data FactorySenior-level Full TimeHyderabad, TS, India9h ago
-
Data Engineer - Azure + Fabric INR 1400K-2700KAccess Control | Apache Spark | Azure Data | Azure DevOps | Azure SynapseSenior-level Full TimeGurugram, Haryana, India9h ago
-
Mid-level Full TimeNoida R9h ago
-
Embedded Software Senior Lead Engineer INR 2475K-3465KAgile | Automated Build | Automated Build and Test | Board Support | Board Support PackageEmployee assistance program | Employee resource groups | Flexible time off | Holiday leave | Medical insuranceSenior-level Full TimeHYDERABAD, TELANGANA, India9h ago
-
Senior-level Full TimeIndia10h ago