Data Engineer
Tasks
- Apply data security governance and access control
- Build and optimize ETL/ELT workflows
- Contribute to data platform architecture
- Design and maintain scalable data pipelines
- Develop and maintain data models data warehouses and data lakes
- Ensure data quality consistency accuracy and reliability
- Implement data integrations with APIs databases cloud platforms and third party systems
- Implement data validation monitoring and testing frameworks
- Maintain documentation for data pipelines and models
- Monitor data pipelines and troubleshoot issues
- Optimize data processing workflows for performance scalability and cost efficiency
- Prepare and deliver datasets for machine learning models
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache Airflow | Azure | CI/CD | Dagster | Data Lake | Data Warehouse | ELT | ETL | GCP | Git | PySpark | Python | SQL | Spark
Education
N/A
Roles
Related jobs
-
Data Engineer INR 3000K-4000KAWS | Amazon Aurora | Automation | Azure | Data ManagementBike to work | Career development program | Educational assistance | Employee assistance program | Employee discountSenior-level Full TimeBengaluru, KA, India R8h ago
-
AI Engineer INR 450K-700KData Preprocessing | Deep learning | Language Processing | MLOps | Machine LearningCareer development | Hybrid work flexibilityExecutive-level Full TimeNoida, India R13h ago
-
Staff Software Engineer, Machine Learning INR 3000K-4580KC++ | Classification | Data Pipelines | Deep learning | EmbeddingsHealth and wellness programs | Time away for employeesSenior-level Full TimeBengaluru, KA, India R14h ago
-
Senior Software Engineer, Data Platform INR 2000K-4200KApache Pinot | Artifactory | Git | Go | JavaSenior-level Full TimeIndia (Remote) R14h ago
-
AI/ML Engineering Lead/(Gen AI,Python,LLM,ETL)Associate Director INR 2000K-4000KApache Airflow | Apache Beam | Auditability | Automated testing | BigQueryContinuous professional development | Flexible working | Inclusive diverse environment | Opportunities for growthMid-level Full TimePune, Maharashtra, India R15h ago
-
API | AWS SageMaker | Azure Machine Learning | CI/CD | Context engineeringAdvanced AI exposure | Collaborative environment | Continuous learning | Contract engagement | End-to-end ownershipSenior-level Contract Full TimeIndia R16h ago
-
Azure | Azure AD | Azure Data | Azure Data Factory | Azure Data LakeFlexible work arrangements | Healthcare benefits | Insurance | Paid time off | Professional training and developmentSenior-level Full TimeIndia R18h ago
-
Senior Agentic Engineer, AI Platform INR 3000K-5000KAPI Development | AWS | Agent Orchestration | Authentication | AutoscalingSenior-level Full TimeBengaluru R19h ago
-
SW Engineer (1 - 2 years of exp in .Net / Python, Full-stack development, Angular / React, GenAI) INR 1500K-2500K.NET | API Management | Agile | Angular | Azure DevOpsHybrid work schedule | Limited direction working environmentMid-level Full TimeBengaluru, India R20h ago
-
Senior-level Full TimeHyderabad, India R20h ago
-
Senior Data Engineer INR 3600K-5000KAWS | Apache Airflow | Apache Spark | Azure | CI/CDFinancial wellness support | Flexible remote work on Fridays | Hybrid work schedule | Mental health support | Paid time offSenior-level Full TimeBengaluru, India R1d ago
-
Senior Software Engineer, MLOps/SRE INR 2475K-3500KAerospike | Amazon Web Services | Apache Airflow | Apache Spark | CI/CD401k pension | Disability insurance | Financial wellness support | Healthcare benefits | Life insuranceSenior-level Full TimeBengaluru, India R1d ago
-
Associate Principal Engineer, AI Architect INR 1800K-3300KAPI Integration | AWS | Agent Orchestration | Azure | Backend architectureMid-level Full TimeRemote, India R1d ago
-
Principal Engineer, AI Architect INR 2000K-5000KAWS | Agent Orchestration | Azure | Backend architecture | Cloud ComputingSenior-level Full TimeRemote, India R1d ago
-
Principal Engineer, Python fullstack (React+Genai) INR 2000K-5000KAWS | Agentic AI | Azure | CI/CD | ComplianceSenior-level Full TimeRemote, India R1d ago
-
Senior Staff Engineer ( AI ) INR 2500K-5000KAI orchestration | AWS | Access Control | Agent systems | AuditabilityEnhanced medical benefits | Family wellbeing benefits | Paid time offSenior-level Full TimeHyderabad, India R1d ago
-
Senior Software Engineer - (Backend,AI) INR 3242K-5000KAPI Gateway | AWS | AWS Lambda | Agent Orchestration | Amazon APIFamily well-being benefits | Health benefits | Hybrid work | Paid time off | Wellbeing supportSenior-level Full TimeHyderabad, India R1d ago
-
GCP Data Engineer / Associate Director, Data and Analytics INR 1000K-2000KAgile | Artificial Intelligence | As-a-Service | Automated testing | CI/CDFlexible working | Inclusive work environment | Professional developmentMid-level Full TimeHyderabad, Telangana, India R1d ago
-
Senior Data Engineer INR 3000K-4000KAI | AWS | Amazon Aurora | Automated reporting | AzureBike to work | Educational assistance | Employee assistance programme | Employee discount | Enhanced maternity/paternity leaveSenior-level Full TimeMumbai, MH, India R1d ago
-
Software Engineer, Machine Learning INR 3242K-4580KClassification Models | Data Mining | Deep learning | Distributed Training | Embedding ModelsFlexible work hybrid work arrangementSenior-level Full TimeBengaluru, KA, India R1d ago
-
Databricks SME INR 1500K-2700KAWS | Airflow | Apache Spark | CI/CD | DBTBike to work | Career progression and mentorship | Educational assistance | Employee assistance programme | Fitness classesSenior-level Full TimeMumbai, MH, India R1d ago
-
Software Engineer III, Big Data INR 2040K-3465KApache Flink | Apache Hive | Apache Spark | Cloud Composer | Cloud StorageHybrid workSenior-level Full TimeHyderabad, Telangana 500081, India R1d ago
-
Python, LLM, GenAI/Senior Consultant Specialist INR 3000K-5000KAuthentication | Authorization | CI/CD | Caching | ChunkingFlexible working | Inclusive work culture | Professional developmentSenior-level Full TimePune, Maharashtra, India R1d ago
-
Python, LLM, GenAI/Senior Consultant Specialist INR 3000K-5000KAsync Programming | Authentication | Authorization | CI/CD | CachingFlexible working | Professional development opportunitiesSenior-level Full TimePune, Maharashtra, India R1d ago
-
Senior Data Engineer (with AI/ML experience) India INR 2500K-4500KAWS | Agile | Amazon Redshift | Apache Spark | Azure Machine LearningCompany-supported English classes | Continuous learning | Professional training | Really good hardware | Referral programSenior-level Full TimePune R1d ago