Senior Data Engineer
Tasks
- Build data ingestion frameworks for batch and real-time workflows
- Collaborate with cross-functional teams
- Design scalable ETL/ELT pipelines
- Develop Delta Lake architectures
- Ensure data quality and security standards
- Implement CI/CD practices for workflows
- Implement data solutions on Azure Cloud
- Monitor and troubleshoot pipeline performance
- Participate in architecture discussions
- Write high performance SQL queries
Perks/Benefits
- N/A
Skills/Tech-stack
Agile methods | Azure Data | Azure Data Factory | Azure Data Lake | Azure Synapse | Business Intelligence | CI/CD | Cloud Native | Cloud Native Architecture | Data Architecture | Data Factory | Data Governance | Data Lake | Data Modeling | Data Processing | Data Transformation | Databricks | Delta Lake | Distributed data | Distributed data processing | Git | Microsoft Azure | Performance optimization | PySpark | SQL | Troubleshooting | Version control
Education
Roles
Related jobs
-
Azure | Csharp | Data Ingestion | Data cleaning | Machine LearningCommunity forums | Laptop provided | Medical insurance | Mentorship | No weekend workSenior-level Full TimeIndia R22h ago
-
Senior Machine Learning Engineer INR 3500K-5000KAWS | Azure | CI/CD | Cloud platform | DatabricksHybrid work | Learning and development programs | Mentorship | Remote workSenior-level Full TimeBangalore, India R1d ago
-
Senior Machine Learning Engineer (Job Location: Mahadevapura) INR 3384K-4725KAWS | Azure | CI/CD | Databricks | Distributed SystemsHybrid work model | Learning and development programs | Mentoring | Remote work optionsSenior-level Full TimeBangalore, India R1d ago
-
Senior Software Engineer INR 3200K-4225KAccess Control | Airflow | Artificial Intelligence | Astronomer | CI/CDSenior-level Full TimePune, India R1d ago
-
Data Engineer (Data Application Developer) INR 2516K-3356KAWS | Amazon Kinesis | Amazon SQS | DBT | Data ModelingCommunity involvement support | Employee support programs | Hybrid work options | In-person work options | Remote work optionsSenior-level Full TimeRemote (IND), India R1d ago
-
Senior-level Full TimeBangalore, INDIA R2d ago
-
AI Solutions Architect INR 2500K-4500KAWS | Convolutional Neural Networks | Data Governance | Distributed Systems | DockerSenior-level Full TimeIndia - Remote R2d ago
-
Senior Azure Fabric Data Engineer INR 1500K-2000KAirflow | Azure | Azure Data | Azure Data Factory | Azure Data LakeRemote work | Work from homeSenior-level Full TimeIndia - Remote R2d ago
-
Senior Software Engineer INR 1800K-2400KAWS | Apache Atlas | Google Cloud | JUnit | JavaCareer development | Employee resource groups | Flexible WFH policy | Generous PTO | Internet reimbursementSenior-level Full TimeIndia-Bangalore-Remote R2d ago
-
Senior-level Full TimeRemote, India R2d ago
-
Senior Staff Engineer, Generative AI INR 2500K-4500KAPI Development | AWS | Airflow | Artificial Intelligence | Azure MLContinuous learning opportunities | Flexible work hours | Remote work optionsSenior-level Full TimeRemote, India R2d ago
-
Senior Staff Engineer, Generative AI INR 2500K-4500KAI Deployment | AI/ML | AI/ML cloud services | API Development | AirflowFlexible work hours | Health benefits | Learning and development opportunities | Remote workSenior-level Full TimeRemote, India R2d ago
-
Senior Staff Engineer, Generative Ai INR 2500K-4500KAPI Development | AWS SageMaker | Azure ML | BERT | BicepSenior-level Full TimeRemote, India R2d ago
-
Senior Staff Engineer, Generative Ai INR 2500K-4500KAI/ML | AI/ML libraries | AWS | Agentic AI | AirflowSenior-level Full TimeRemote, India R2d ago
-
Senior Software Engineer INR 3100K-3500KAPI Design | Audit Logging | Backward Compatibility | Compliance | Data ModelingSenior-level Full TimeIndia - Remote R3d ago
-
Sr. Data Engineer INR 2500K-3380KAWS | Azure | C# | Data Governance | Data ModelingHybrid work environmentSenior-level Full TimeIndia - Remote R3d ago
-
Senior Staff Engineer, ERP Oracle Technical (ODI & EBS) INR 300K-370KAnalytics Cloud | Autonomous Data Warehouse | Data Integrator | Data Modeling | Data WarehouseSenior-level Full TimeRemote, India R3d ago
-
Associate Principal Engineer, ERP Oracle Technical (ODI & EBS) INR 1500K-2000KAnalytics Cloud | Autonomous Data Warehouse | Data Integrator | Data Modeling | Data WarehouseMid-level Full TimeRemote, India R3d ago
-
Associate Principal Engineer, ERP Oracle Technical (ODI & EBS) INR 1500K-2000KAnalytics Cloud | Autonomous Data Warehouse | Data Integrator | Data Modeling | Data WarehouseMid-level Full TimeRemote, India R3d ago
-
Data Product Lead INR 1500K-1900KAccount Segmentation | Apache Solr | Artificial Intelligence | CI/CD | CRM systemsSenior-level Full TimeIndia - Pune - Remote R3d ago
-
Mid-level Full TimeIndia - Remote R3d ago
-
Data Exploration | Data Ingestion | Data Validation | Data cleaning | Feature EngineeringFlexible schedule | Part-time freelance | Remote workMid-level FreelanceIndia - Remote R3d ago
-
AI Software Engineer (Python/Java) - India INR 2535K-4225KAPIDesign | AWS | Azure | CI/CD | CloudFormationFlexible hours | Remote workSenior-level Full TimeIndia (Remote) R3d ago
-
Senior QA Engineer – Data / Analytics INR 2520K-3380KAPI Testing | AWS Athena | AWS Glue | AWS Kinesis | AWS LambdaCareer growth opportunities | Diverse team | Flexible work environmentSenior-level Full TimeBengaluru, India- Hybrid R3d ago
-
Senior Database Engineer-#3084 (Remote) INR 300K-370KAWS Aurora | AWS RDS | Automation | Backup & Recovery | BashSenior-level Full TimeChennai, India R3d ago