Data Engineer
Tasks
- Architect data lakes using Azure Data Lake Storage
- Build data pipelines using Azure Data Factory
- Deliver data engineering solutions
- Design end-to-end data pipelines
- Develop analytics solutions using Azure Synapse Analytics
- Develop data processing frameworks using Azure Databricks
- Ensure high availability of data systems
- Gather requirements and translate to technical solutions
- Implement ETL and ELT workflows
- Implement data governance, security, and compliance
- Mentor junior team members
- Optimize data performance scalability and cost
- Troubleshoot production data issues
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Hive | Apache Kafka | Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Databricks | Azure DevOps | Azure Monitor | Azure Synapse | Azure Synapse Analytics | CI/CD | Data Factory | Data Lake Storage Gen2 | Data Modeling | Data Processing | Distributed data | Distributed data processing | ELT | ETL | Encryption | HDInsight | Log Analytics | PySpark | Python | RBAC | SQL | Scala | Snowflake Schema | Spark SQL | Star Schema | Synapse Analytics
Education
N/A
Roles
Related jobs
-
Mid-level Full TimeIN-KA-Bangalore4h ago
-
AI Engineer with RAG / MCP INR 1500K-2500KDocument processing | LLMs | Microservices | Prompt engineering | PythonMid-level Full TimeIN-AP-Hyderabad4h ago
-
Senior-level Full TimeIN-TN-Chennai4h ago
-
Data Bricks Infra Engineer INR 1500K-2500KAccess Control | Caching | Data Governance | Databricks | Databricks SQLWork from office 5 days per weekSenior-level Full TimeGurugram, Haryana, India6h ago
-
Software Engineer INR 2000K-3300KAKS | Angular | App Service | Azure | Azure AppEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India6h ago
-
Senior-level Full TimeBangalore, Karnataka, India6h ago
-
Associate Software Engineer - Scala and spark INR 1500K-2000KAgile | Apache Spark | CI/CD | Databricks | GitHubEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India6h ago
-
Sr. Data Engineer INR 1500K-2500KACID | Amazon Redshift | Amazon S3 | Apache Kafka | Azure DataWork from office 5 days per weekSenior-level Full TimeBengaluru, Karnataka, India6h ago
-
Principal Software Engineer - AI Platform INR 2515K-3500KAgile | Apache Airflow | CI/CD | Cloud Native | Data AnalysisFlexible medical benefits | Life insurance | Retirement options | Volunteer programsSenior-level Full TimeIndia7h ago
-
Senior Software Engineer (Java/Python) INR 2200K-4000KAPI Gateway | AWS CLI | AWS Lambda | Amazon CloudWatch | Amazon DynamoDBSenior-level Full TimeHyderabad, India8h ago
-
Consultant - Python Developer with Gen AI and AI Foundry INR 2000K-4500KAWS | Autogen | Azure | Azure OpenAI | ClaudeSenior-level Full TimeBangalore, Karnataka, India8h ago
-
Senior Azure Data Engineer INR 1500K-2500KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimePune, Maharashtra, India8h ago
-
Mid-level Full TimeBengaluru, India8h ago
-
Senior-level Full TimeBengaluru, India8h ago
-
Data Engineer II INR 1500K-2500KAWS | Apache Airflow | Astronomer | BigQuery | CI/CDCareer growth | Holistic well-being support | Learning opportunitiesSenior-level Full TimeBengaluru, KA, India9h ago
-
Software Development Lead INR 1500K-2700KAPIs | Agile | BigQuery | Continuous Delivery | Continuous integrationSenior-level Full TimeChennai, Tamil Nadu, India9h ago
-
Staff - Software Engineering INR 2515K-3500KAWS | AWS Glue | AWS Lambda | Amazon Kinesis | Amazon SNSCareer growth and development | Flexible workSenior-level Full TimePune9h ago
-
Principal Engineer - Data Engineering INR 1500K-5800KApache Iceberg | Apache Spark | Change Data Capture | Cloud Architecture | Data CaptureExecutive-level Full TimeHyderabad, India10h ago
-
Staff Software Engineer (Python) INR 3000K-5000KAPIs | Alerting | Amazon Web Services | Authentication | Cloud platformCollaborative team environment | Diverse projects | Global consulting environment | Leadership development | Training sessionsSenior-level Full TimeMumbai, MH, India11h ago
-
Senior Software Engineer INR 2500K-3465KAPIs | Amazon Web Services | CI/CD | Cloud platform | Distributed SystemsEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimePune, MH, India11h ago
-
AI Engineer II INR 1685K-3000KAWS | Apache Hive | Apache Spark | Cloud platform | Continuous DeliveryCareer development and training | Counseling support | Dental insurance | Disability benefits | Flexible working modelMid-level Full TimeGurugram, HR, India11h ago
-
(Services) Data Engineer INR 1500K-2400KAPI Integration | Apache Spark | Azure | Azure Data | Azure Data FactorySenior-level Full TimeHyderabad12h ago
-
FinOps Engineer INR 1500K-3500KAWS | Amazon QuickSight | Amazon Redshift | Azure | Cloud billingCross-functional collaboration | Hybrid work | Mandatory office days 3 per weekSenior-level Full TimeBangalore12h ago
-
Data & GenAI Engineer INR 1500K-2500KAPI Gateway | Apache Spark | Authentication | CI/CD | Data ContractsMid-level Full TimeBengaluru, KA, IN13h ago
-
DE-Legacy Modernization-Gen AI Developer-UC-GDSF02 INR 1850K-3550K.NET | AI Foundry | API Gateway | AS400 | AWSMid-level Full TimeHyderabad, TG, IN, 50008115h ago