Data Engineer
Tasks
- Architect and implement ETL pipelines in Azure Data Factory
- Automate infrastructure provisioning with Infrastructure-as-Code
- Build medallion architecture with Delta Lake
- Build real-time streaming platforms
- Configure and maintain Power BI Gateways
- Create DAX measures calculated tables and time intelligence
- Deliver analytics ready datasets for Power BI
- Deploy and operate data workloads on Azure Kubernetes Service
- Design scalable batch and streaming data pipelines
- Develop interactive Power BI dashboards
- Develop microservices data producers and consumers
- Implement data governance access control and lineage
- Implement data quality validation deduplication and schema evolution
- Monitor log and alert streaming and data workloads
- Optimize Power BI report and data model performance
- Optimize Spark and streaming workloads
- Set up CI CD pipelines for data and streaming
- Transform data with Power Query
Perks/Benefits
- Barrier free access
- Canteen and café
- Childcare
- Coaching
- Company doctor
- Company pension
- Employee discounts
- Employee events
- Employee phone possible
- Flexible working hours
- Good Connectivity
- Health measures
- Hybrid work possible
- Meal allowance
- Mobility offers
- Parking
Skills/Tech-stack
Apache Flink | Apache Kafka | Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Databricks | Azure Functions | Azure IAM | Azure Key Vault | Azure Kubernetes | Azure Kubernetes Service | Azure Monitor | Azure Service | Azure Service Bus | BI Desktop | BI Gateway | CI/CD | DAX | Data Factory | Data Lake Storage Gen2 | Data Modeling | Data Vault | Databricks Unity | Databricks Unity Catalog | Delta Lake | Docker | Git | GitLab | Infrastructure as Code | Key Vault | Kubernetes Service | Log Analytics | M-language | Object-Oriented | Object-oriented programming | Power BI | Power BI Gateway | Power BI Service | Power BI desktop | Power Query | Pulumi | PySpark | Python | RBAC | SCD Type 1 | SCD Type-2 | SQL | Service Bus | Spark SQL | Spark Structured Streaming | Star Schema | Structured Streaming | T-SQL | Terraform | Type 1 | Type 2) | Unity Catalog | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Mid-level Full TimePune, India4h ago
-
Data Engineer II INR 2040K-3380KAWS CloudFormation | Amazon Kinesis | Amazon Redshift | Amazon Web Services | Apache AirflowComplimentary games | Family leave | Healthcare coverage | Mental well-being support | Paid time offSenior-level Full TimeLocations: Hyderabad, Telangana, India8h ago
-
Data Engineer II INR 2040K-3380KAWS | Amazon Kinesis | Amazon Redshift | Apache Airflow | Apache BeamComplimentary games | Family leave | Healthcare coverage | Hybrid work model | Mental well-being supportSenior-level Full TimeLocations: Hyderabad, Telangana, India8h ago
-
Data Engineer II INR 2200K-3465KAmazon Kinesis | Amazon Redshift | Amazon Web Services | Apache Airflow | Apache BeamFree games | Healthcare benefits | Hybrid work schedule | Mental health support | Paid time offMid-level Full Time地点：Hyderabad, Telangana, India8h ago
-
Data Engineer II INR 2200K-3465KAWS | Amazon Kinesis | Amazon Redshift | Apache Airflow | Apache BeamFamily leave | Free games | Health insurance | Hybrid work | Mental health supportMid-level Full Time地点：Hyderabad, Telangana, India8h ago
-
Senior Data Engineer INR 1500K-2500KAWS Glue | AWS Lambda | Amazon EMR | Amazon S3 | Apache AirflowSenior-level Full TimeSaidapet8h ago
-
Senior-level Full TimeHyderabad, India8h ago
-
Senior-level Full TimeIN-AP-Hyderabad9h ago
-
ETL Data with QA Tester INR 1500K-2500KDBT | Data Aggregation | Data Quality | Data Transformation | Data ValidationRemote workSenior-level Full TimeIN-AP-Hyderabad9h ago
-
Agentic AI | Alembic | Autogen | Azure AI | Azure OpenAIEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India9h ago
-
Agile | Airflow | Azure | Azure Data | Azure Data FactoryEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time off | Wellness plansMid-level Full TimeChennai, TN, India10h ago
-
Software Engineer III - Python Developer + LLM / Gen AI INR 2500K-5000KAWS | Agile | Application Resiliency | CI/CD | Cloud ComputingSenior-level Full TimeBengaluru, Karnataka, India11h ago
-
Backend Developer (Node.js) - GGS - BLR INR 1500K-2800KAPM | Bash | Database Query | Database Query Plan | GitHybrid workMid-level Full TimeKarnataka, Bengaluru, India11h ago
-
Sr. Expert INR 2516K-3356KAlgorithms | Cloud Computing | Data Aggregation | Data Engineering | Data IngestionEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeVadodara, GJ, India11h ago
-
API Development | Amazon Redshift | Amazon Web Services | Apache Spark | AzureSenior-level Full TimeBangalore, Karnataka, India12h ago
-
API Design | Apache Airflow | Apache Spark | CI/CD | Cloud ComposerMid-level Full TimePune, Maharashtra, India R12h ago
-
Senior-level Full Timecoimbatore, India12h ago
-
Lead ML Engineer INR 2500K-5000KAgile | Autogen | Automl | Azure | CI/CDEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India13h ago
-
Support Engineer – Developer Portal INR 600K-700KAI Automation | API Integration | Agentic AI | Automation Anywhere | ExcelAccommodation support | Equal opportunity employment | Inclusive cultureEntry-level Full TimeHyderabad, India13h ago
-
Senior Data Engineer INR 3000K-4000KAWS | Amazon Aurora | Apache Airflow | Apache Kafka | Apache SparkAccreditations | Bike to work | Career development | Educational assistance | Employee assistance programSenior-level Full TimeMumbai, MH, India14h ago
-
ETL Developer INR 2800K-4000KAPI Keys | Adeptia | Automated testing | Azure Data | Azure Data FactorySenior-level Full TimeIndia14h ago
-
Data Engineer INR 3000K-4000KAWS | Cloud Computing | Data Architecture | Data Governance | Data ManagementAccreditation support | Bike to work | Career development program | Educational assistance | Employee assistance programMid-level Full TimeBengaluru, KA, India15h ago
-
Mid-level Full TimeNoida, Uttar Pradesh, India15h ago
-
Sr. AI Engineer - Data Pipelines & Context Systems INR 4000K-5449KABAC | API Design | Asynchronous programming | Auditability | ChunkingFlexible work arrangementsSenior-level Full TimeBangalore15h ago
-
Algorithms | Apache Airflow | Argo Workflows | Azure | Azure ComputeCollaborative team environment | Flexible work environment | Opportunity to innovate | Opportunity to work on impactful projectsSenior-level Full TimeIndia15h ago