Data Engineer
Tasks
- Apply medallion architecture for data transformation
- Build and maintain data ingestion pipelines
- Build and manage workflows using orchestration tools
- Collaborate with architecture and participate in design reviews
- Document data processes and pipelines
- Implement batch and streaming data processing
- Implement data governance, security, and quality standards
- Manage Delta Lake storage and optimize performance
- Support CI/CD pipelines and automation
- Support metadata management and lineage tracking
- Troubleshoot and optimize data pipelines
Perks/Benefits
Skills/Tech-stack
AI/ML | AI/ML data | AI/ML data preparation | AWS | Azure | CI/CD | Cloud Platforms | Data Modeling | Data Pipelines | Data Preparation | Data Quality | Databricks | Delta Lake | DevOps | Encryption | GCP | Geospatial Data | Git | Glue Catalog | Lakehouse Architecture | ML data preparation | Metadata Management | Power BI | Purview | PySpark | RBAC | SQL | Schema evolution | Spark | Unity Catalog | Workflows
Education
Bachelor's | Computer Science | Master's | Related Field | Software Engineering
Roles
Related jobs
-
Azure | Csharp | Data Ingestion | Data cleaning | Machine LearningCommunity forums | Laptop provided | Medical insurance | Mentorship | No weekend workSenior-level Full TimeIndia R1d ago
-
Senior Machine Learning Engineer INR 3500K-5000KAWS | Azure | CI/CD | Cloud platform | DatabricksHybrid work | Learning and development programs | Mentorship | Remote workSenior-level Full TimeBangalore, India R1d ago
-
Senior Machine Learning Engineer (Job Location: Mahadevapura) INR 3384K-4725KAWS | Azure | CI/CD | Databricks | Distributed SystemsHybrid work model | Learning and development programs | Mentoring | Remote work optionsSenior-level Full TimeBangalore, India R1d ago
-
Senior Software Engineer INR 3200K-4225KAccess Control | Airflow | Artificial Intelligence | Astronomer | CI/CDSenior-level Full TimePune, India R1d ago
-
Data Engineer (Data Application Developer) INR 2516K-3356KAWS | Amazon Kinesis | Amazon SQS | DBT | Data ModelingCommunity involvement support | Employee support programs | Hybrid work options | In-person work options | Remote work optionsSenior-level Full TimeRemote (IND), India R1d ago
-
Senior-level Full TimeBangalore, INDIA R2d ago
-
AI Solutions Architect INR 2500K-4500KAWS | Convolutional Neural Networks | Data Governance | Distributed Systems | DockerSenior-level Full TimeIndia - Remote R2d ago
-
Senior Azure Fabric Data Engineer INR 1500K-2000KAirflow | Azure | Azure Data | Azure Data Factory | Azure Data LakeRemote work | Work from homeSenior-level Full TimeIndia - Remote R2d ago
-
Senior Software Engineer INR 1800K-2400KAWS | Apache Atlas | Google Cloud | JUnit | JavaCareer development | Employee resource groups | Flexible WFH policy | Generous PTO | Internet reimbursementSenior-level Full TimeIndia-Bangalore-Remote R2d ago
-
Senior-level Full TimeRemote, India R3d ago
-
Senior Staff Engineer, Generative AI INR 2500K-4500KAPI Development | AWS | Airflow | Artificial Intelligence | Azure MLContinuous learning opportunities | Flexible work hours | Remote work optionsSenior-level Full TimeRemote, India R3d ago
-
Senior Staff Engineer, Generative AI INR 2500K-4500KAI Deployment | AI/ML | AI/ML cloud services | API Development | AirflowFlexible work hours | Health benefits | Learning and development opportunities | Remote workSenior-level Full TimeRemote, India R3d ago
-
Senior Staff Engineer, Generative Ai INR 2500K-4500KAPI Development | AWS SageMaker | Azure ML | BERT | BicepSenior-level Full TimeRemote, India R3d ago
-
Senior Staff Engineer, Generative Ai INR 2500K-4500KAI/ML | AI/ML libraries | AWS | Agentic AI | AirflowSenior-level Full TimeRemote, India R3d ago
-
Senior Software Engineer INR 3100K-3500KAPI Design | Audit Logging | Backward Compatibility | Compliance | Data ModelingSenior-level Full TimeIndia - Remote R3d ago
-
Senior Staff Engineer, ERP Oracle Technical (ODI & EBS) INR 300K-370KAnalytics Cloud | Automation | Autonomous Data Warehouse | Data Integrator | Data QualitySenior-level Full TimeRemote, India R3d ago
-
Sr. Data Engineer INR 2500K-3380KAWS | Azure | C# | Data Governance | Data ModelingHybrid work environmentSenior-level Full TimeIndia - Remote R3d ago
-
Senior Staff Engineer, ERP Oracle Technical (ODI & EBS) INR 300K-370KAnalytics Cloud | Autonomous Data Warehouse | Data Integrator | Data Modeling | Data WarehouseSenior-level Full TimeRemote, India R3d ago
-
Associate Principal Engineer, ERP Oracle Technical (ODI & EBS) INR 1500K-2000KAnalytics Cloud | Autonomous Data Warehouse | Data Integrator | Data Modeling | Data WarehouseMid-level Full TimeRemote, India R3d ago
-
Associate Principal Engineer, ERP Oracle Technical (ODI & EBS) INR 1500K-2000KAnalytics Cloud | Autonomous Data Warehouse | Data Integrator | Data Modeling | Data WarehouseMid-level Full TimeRemote, India R3d ago
-
Data Product Lead INR 1500K-1900KAccount Segmentation | Apache Solr | Artificial Intelligence | CI/CD | CRM systemsSenior-level Full TimeIndia - Pune - Remote R3d ago
-
Mid-level Full TimeIndia - Remote R3d ago
-
Data Exploration | Data Ingestion | Data Validation | Data cleaning | Feature EngineeringFlexible schedule | Part-time freelance | Remote workMid-level FreelanceIndia - Remote R3d ago
-
AI Software Engineer (Python/Java) - India INR 2535K-4225KAPIDesign | AWS | Azure | CI/CD | CloudFormationFlexible hours | Remote workSenior-level Full TimeIndia (Remote) R3d ago
-
Senior QA Engineer – Data / Analytics INR 2520K-3380KAPI Testing | AWS Athena | AWS Glue | AWS Kinesis | AWS LambdaCareer growth opportunities | Diverse team | Flexible work environmentSenior-level Full TimeBengaluru, India- Hybrid R3d ago