Data Engineer
RMZ Ecoworld 32, India
INR 1500K-2700K (estimate) Mid-level Full Time
Tasks
- Collaborate with data stakeholders to define requirements
- Design data pipelines and ETL processes
- Develop and maintain data pipeline outputs
- Develop and maintain documentation
- Ensure data quality and integrity
- Manage CI CD deployment process
- Mentor junior data engineers
- Monitor and troubleshoot data pipeline issues
- Optimize data pipelines for performance and reliability
- Oversee data infrastructure
Perks/Benefits
Skills/Tech-stack
Ansible | Apache Spark | Avro | Azure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen 2 | Azure Databricks | Azure DevOps | Azure Synapse | Azure Synapse Analytics | Blob Storage | CI/CD | Data Factory | Data Lake Storage Gen 2 | Delta Lake | ETL | Git | Microsoft Azure | Parquet | PostgreSQL | PySpark | Python | SQL | SQL Server | Synapse Analytics | Testing | Version control
Education
Roles
Related jobs
-
Software Engineer III - Python Developer + LLM / Gen AI INR 2500K-5000KAWS | Agile | Application Resiliency | CI/CD | Cloud ComputingSenior-level Full TimeBengaluru, Karnataka, India3h ago
-
API Development | Amazon Redshift | Amazon Web Services | Apache Spark | AzureSenior-level Full TimeBangalore, Karnataka, India4h ago
-
Support Engineer – Developer Portal INR 600K-700KAI Automation | API Integration | Agentic AI | Automation Anywhere | ExcelAccommodation support | Equal opportunity employment | Inclusive cultureEntry-level Full TimeHyderabad, India6h ago
-
Senior Data Engineer INR 3000K-4000KAWS | Amazon Aurora | Apache Airflow | Apache Kafka | Apache SparkAccreditations | Bike to work | Career development | Educational assistance | Employee assistance programSenior-level Full TimeMumbai, MH, India6h ago
-
Data Engineer INR 3000K-4000KAWS | Cloud Computing | Data Architecture | Data Governance | Data ManagementAccreditation support | Bike to work | Career development program | Educational assistance | Employee assistance programMid-level Full TimeBengaluru, KA, India7h ago
-
Sr. AI Engineer - Data Pipelines & Context Systems INR 4000K-5449KABAC | API Design | Asynchronous programming | Auditability | ChunkingFlexible work arrangementsSenior-level Full TimeBangalore7h ago
-
Algorithms | Apache Airflow | Argo Workflows | Azure | Azure ComputeCollaborative team environment | Flexible work environment | Opportunity to innovate | Opportunity to work on impactful projectsSenior-level Full TimeIndia7h ago
-
AI Engineer INR 3264K-5876KAPI Integration | Data Pipelines | Enterprise Search | JavaScript | Language ModelsCompany year end break | Flexible time off | Learning and development stipend | Medical, dental, and vision insurance | Paid parental leaveEntry-level Full TimeChennai, Tamil Nadu, India8h ago
-
VP- Salesforce Developer - IB Tech & CRM/ Analytics INR 3000K-4000KAPI Gateway | AWS Lambda | Amazon API | Amazon API Gateway | Amazon S3Executive-level Full TimePune, India9h ago
-
AI Engineer II INR 3715K-5572KAWS | Agent Orchestration | Apache Kafka | Data Safety | Evaluation and monitoringCareer growth opportunities | Comprehensive well-being support | Learning opportunitiesSenior-level Full TimeBengaluru, KA, India9h ago
-
Senior AI Engineer I INR 3715K-5876KAWS | Agent Orchestration | Distributed Systems | Event Driven | Event-driven architectureSenior-level Full TimeBengaluru, KA, India9h ago
-
Research Engineer – Generative AI and Computer Vision INR 360K-420KAUC | Active Learning | Adversarial Networks | Anomaly Detection | Anomaly Detection MetricsEntry-level Full Timebengaluru, India9h ago
-
Agentic AI Engineer - Assistant Manager INR 2500K-5000KAPI Design | AWS | Agent systems | Azure | CI/CDFlexible work/life support | Inclusive development opportunities | Paid volunteer days | Vibrant employee networksSenior-level Full TimeBangalore, India14h ago
-
AI Engineer Advisor INR 1500K-3000KAPI Gateway | AWS Lambda | Amazon Bedrock | Amazon ECS | Amazon S3Mid-level Full TimeGurgaon, HR, IN14h ago
-
Data Engineer INR 2500K-2700KAPIs | AWS | Aurora | Data Governance | Data ModelingPaid time off | Volunteer time offMid-level Full TimeIND-BANGALORE, India14h ago
-
Senior-level Full TimeIND-HYDERABAD, India14h ago
-
Embedded Software Engineer - C, Linux (5 - 7 yrs) INR 2500K-4000KBring-up | C# | C++ | Debugging | Device DriversSenior-level Full TimeIND-BANGALORE, India14h ago
-
Systems Integration Analyst INR 1200K-2500KAPI Development | Agentic AI | Artificial Intelligence | Data Preprocessing | Data VisualizationMid-level Full TimeBengaluru, KA, IN14h ago
-
Specialist - AI INR 2000K-4500KAWS Bedrock | AWS SageMaker | GitHub Copilot | Language Models | Large Language ModelsFlexible working hours | Hybrid remote/office | Work-life balanceMid-level Full TimeIndia, Mumbai14h ago
-
Advanced Software Engr INR 3000K-5500KAmazon SageMaker | Amazon Web Services | Apache Flink | Apache Spark | AzureSenior-level Full TimeBengaluru, Karnataka, India22h ago
-
Quantum Prod Support INR 2000K-2700KBatch monitoring | Cron | ITIL | Incident Management | Incident escalationHybrid work schedule | Rotational shiftsSenior-level Full TimeIndia - Bengaluru1d ago
-
Senior Systems Development Engineer INR 2800K-3500KAnalytics | C# | Computer Architecture | File systems | JavaComp time | Onsite work | Overtime compensation | Rotational weekend scheduleSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
AI Engineer INR 2000K-4000KCI/CD | Data labeling | Docker | Feature Engineering | Function CallingCertification assistance | Internal Training Portal | Mentor program | Tuition assistance | Wellness programMid-level Full TimeNoida, India1d ago
-
Associate Architect INR 1500K-2500KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsOnsite work | Supportive team environmentMid-level Full TimeBangalore, India - Bangalore, India1d ago
-
Senior-level Full TimeHitech City, TG, India1d ago