Data Engineer- Service
Tasks
- Align data workflows with platform configurations
- Collaborate with clients on data requirements
- Configure data pipelines for initial load and delta load
- Develop data ingestion workflows for real time and batch processing
- Document data integration processes and troubleshooting steps
- Extract data for client reporting and analysis
- Monitor data pipelines for accuracy timeliness consistency
- Optimize data flows to improve performance and reduce latency
- Share best practices and lessons learned
- Troubleshoot data issues during deployment and operations
- Validate incoming data completeness accuracy integrity
Perks/Benefits
Skills/Tech-stack
AWS | Apache Hive | Apache Kafka | Apache NiFi | Apache Spark | ELT | ETL | GCP | HDFS | Hadoop | Java | MariaDB | NoSQL | PySpark | Python
Education
Roles
Related jobs
-
APIs | Automation | CMDB | CNAPP | CSPMEducation reimbursement | Health plans | Hybrid work | Parental leave | Remote workSenior-level Full TimeRemote - India R6h ago
-
Bash | Cloud platform | Data Pipelines | Data Processing | DockerFlexible asynchronous culture | Friendly relaxed atmosphere | Supportive entrepreneurial team | Work life impactMid-level Full TimeBangalore, India6h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | Dataset EngineeringAsynchronous culture | Flexible remote work | Friendly work environment | Mission-driven workMid-level Full TimeDelhi, India6h ago
-
Senior-level Full TimeBengaluru, India6h ago
-
Procode Developer INR 1500K-2500KAzure | Azure Functions | Azure Logic | Azure Logic Apps | Azure OpenAICareer growth programs | Certification support | Flexible work hours | Remote work | Work-life balanceMid-level Full TimeGurgaon, IN10h ago
-
Senior-level Full TimeBengaluru, KA, IN10h ago
-
Risk Data Engineer INR 2800K-4000KAWS | Automation | Azure | Bitbucket | Cloud platformHealth and wellbeing servicesSenior-level Full TimeBengaluru, IN10h ago
-
Data Engineer INR 3000K-3880KAWS | Batch Processing | Data Cleansing | Data Governance | Data LakeHybrid work environment | Relocation assistance | Remote work options within country | Travel up to 10 percentSenior-level Full TimeIN: Pune - Building 5, India10h ago
-
AI/LLM Platform Engineer INR 2500K-4500KADK | AI gateway | API Design | API Lifecycle Management | API lifecycleSenior-level Full TimeBangalore, KA, IN10h ago
-
Machine Learning Operations Engineer INR 1800K-3000KAlerting | CI/CD | CUDA | Drift Detection | Entity recognitionMid-level Full TimePune, India10h ago
-
Software Development Specialist INR 2800K-4000KAI machine learning | Agile | Apache Spark | Azure CLI | Data EngineeringSenior-level Full TimeBangalore, KA, IN10h ago
-
Senior Data Engineer INR 2500K-3500KAWS | ETL | GCP | Looker | Power BIHybrid work | Professional development | Remote workSenior-level Full TimeDelhi NCR R1d ago
-
Data Engineer (Elasticsearch + Datawarehousing) INR 1500K-2700KAPI | API Development | AWS | Apache Spark | AzureMid-level Full TimeIndia - Remote R1d ago
-
Lead DevOps Engineer INR 2800K-5000KAPI Gateway | AWS | AWS API | AWS API Gateway | AWS CloudFormationSenior-level Full TimeBangalore1d ago
-
L1 Data Engineer - Remote INR 1500K-2400KAzure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | CI/CDCollaborative team | Remote workSenior-level Full TimeIndia - Remote R1d ago
-
.NET | Agentic AI | Autonomous Agents | C# | CI/CDFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportMid-level Full TimeBengaluru Millenia, India1d ago
-
Sr. Software Engineer - Power BI Job INR 3000K-4000KAnalysis Services | Azure DevOps | Azure Synapse | Azure Synapse Analytics | DAXFlexible work arrangements | Inclusive team environment | Stable employment | Training and continuous learningSenior-level Full TimePune, IN1d ago
-
Sr. Software Engineer - Data Bricks Job INR 3000K-4000KARM Templates | Access Control | Algorithms | Analysis Services | Apache SparkContinuous learning | Flexible work arrangements | Inclusive team environment | Stable employmentSenior-level Full TimePune, IN1d ago
-
Module Lead - Data Bricks Job INR 3000K-4000KARM Templates | Access Control | Application Insights | Auditing | Azure CosmosSenior-level Full TimePune, IN1d ago
-
Data Migration-Pune INR 800K-1500KAWS S3 | Azure Blob | Azure Blob Storage | Blob Storage | Data IntegratorMid-level Full TimeKolkata, India1d ago
-
Applied AI and ML Engineer INR 1500K-2500KAgentic Systems | Bias Mitigation | Cloud Platforms | Data analytics | Database queryingMid-level Full TimeBengaluru, Karnataka, India1d ago
-
Applied AI and ML Engineer II INR 1500K-2500KAgentic Systems | Auditability | Deep learning | Drift monitoring | Generative AIMid-level Full TimeBengaluru, Karnataka, India1d ago
-
ARM Cortex | Bolero | Bootloader | CAN | Configuration ManagementSenior-level Full TimeBangalore, IN2d ago
-
Data Engineer INR 1500K-2000KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Gen2Mid-level Full TimeBangalore, Karnataka, IN2d ago
-
Engineeing Manager, Machine Learning INR 1068K-1890KA/B | A/B Testing | Apache Airflow | Apache Spark | B testingCommuter benefits | Financial wellness support | Healthcare dental and vision | Hybrid work schedule | Mental health supportMid-level Full TimeBengaluru, India2d ago