Reference Data Engineer(Java, Data Pipelines)
IND PUNE FL2, India
INR 2755K-3500K (estimate) Senior-level Full Time
Tasks
- Automate data lifecycle workflows
- Build data validation controls
- Build logging and monitoring
- Design data pipelines
- Implement reconciliation processes
- Ingest and integrate reference data
- Manage data governance and lineage
- Monitor pipeline performance
- Normalize identifiers and attributes
- Optimize relational database schemas
- Support schema evolution strategies
- Troubleshoot incidents
Perks/Benefits
Skills/Tech-stack
AWS | Alerting | CI/CD | CSV | Data Governance | Data Lineage | Data Reconciliation | Data Validation | Distributed Systems | Event Driven | Event-driven architecture | JSON | Java | Logging | Microsoft Azure | Monitoring | Performance Tuning | PostgreSQL | Relational Database | Schema Design | Testing | XML
Education
Bachelor of Arts | Bachelor of Engineering | Bachelor of Engineering Technology | Bachelor of Science | Master of Science
Roles
Related jobs
-
Databricks Data Engineer (Databricks, PySpark, Cloud, MLOps) | 100% Remote | Contract 12 + Months | AS A INR 1500K-2600KAmazon Web Services | Apache Spark | CI/CD | Cloud platform | DatabricksRemote workSenior-level Full TimeIndia, India R3h ago
-
Data Engineer II INR 2000K-3000KAWS | Amazon Kinesis | Apache Airflow | Apache Beam | Apache FlinkComplimentary games | Family leave | Health insurance | Mental well-being support | Paid time offSenior-level Full TimeLocations: Hyderabad, Telangana, India6h ago
-
Senior-level Full TimeHyderabad, India6h ago
-
AI Architect INR 2000K-4800KAI code assistant | Backend Services | Cloud Computing | Code Assistant | Code QualitySenior-level Full TimeHyderabad, India6h ago
-
Applied AI ML Senior Associate INR 3264K-5000KAWS | Azure | CI/CD | Cloud platform | Distributed SystemsSenior-level Full TimeBengaluru, Karnataka, India7h ago
-
Associate Program Manager INR 2000K-4000KAI Agents | AI Foundry | AI Governance | AI orchestration | APIsMid-level Full TimeChandigarh, India7h ago
-
AI/ML Engineer INR 1860K-4000KAI Agent Builder | AI Pipelines | AI vector search | Agent Builder | AirflowMid-level Full TimeChennai, Tamil Nadu, India7h ago
-
Senior-level Full TimeHyderabad, Telangana, India9h ago
-
Engineering-L2-Bengaluru-Analyst-Software Engineering INR 1500K-2500KApache Spark | Avro | CI/CD | Data Clustering | Data ModelingEntry-level Full TimeBengaluru, Karnataka, India10h ago
-
ML-Ops INR 3700K-5000KAsyncio | CI/CD | CProfile | Caching | DjangoLeadership development | Training sessionsSenior-level Full TimeMumbai, Maharashtra, India11h ago
-
Generative AI Engineer INR 1200K-2500KAI Services | AWS | Amazon SageMaker | Anthropic API | AzureCollaborative team environment | Leadership development | Training programsMid-level Full TimeMumbai, Maharashtra, India11h ago
-
Staff GenAI Engineer INR 2000K-5000KAWS | Agentic AI | Azure | CI/CD | ClassificationCollaborative team environment | Global consulting environment | Leadership development program | Mentorship programs | Training sessionsSenior-level Full TimeMumbai, MH, India11h ago
-
Mid-level Full TimeMumbai, Maharashtra, India11h ago
-
Senior-level Full TimeMumbai, Maharashtra, India11h ago
-
D&T Technical Solutions Manager - Marketing and Commercial INR 2000K-3814KAPI Design | API LED | API-led Architecture | Access Control | AgileMid-level Full TimePune, IN12h ago
-
Lead Software Engineer - Python and AI INR 3500K-6000KAI assisted code | AI-assisted code review | AWS ECS | AWS Lambda | Agent FrameworksSenior-level Full TimeBengaluru, Karnataka, India12h ago
-
Lead Data Engineer - Azure + Fabric INR 1200K-2700KAzure | Azure DevOps | CDC | CI/CD | Data GovernanceSenior-level Full TimeGurugram, Haryana, India12h ago
-
Databricks Engineer - Senior/ Lead INR 1500K-2800KACID | ADLS Gen2 | Apache Spark | Azure Data | Azure Data FactorySenior-level Full TimeHyderabad, TS, India12h ago
-
Data Engineer - Azure + Fabric INR 1400K-2700KAccess Control | Apache Spark | Azure Data | Azure DevOps | Azure SynapseSenior-level Full TimeGurugram, Haryana, India12h ago
-
Mid-level Full TimeNoida R13h ago
-
Senior-level Full TimeIndia13h ago
-
Staff Software Engineer (Python) INR 3700K-5000KAPI Development | Alerting | Amazon Web Services | Authentication | Batch ProcessingCollaborative team environment | Global projects | Leadership development | Training sessionsSenior-level Full TimeMumbai, MH, India13h ago
-
AI / ML Data Scientist I INR 1000K-1890KAWS | Apache Spark | Artificial Intelligence | Cloud platform | ConfluenceMid-level Full TimeBengaluru, India13h ago
-
Data QA - Snowflake - India INR 800K-1500KAutomated testing | Case design | Data Quality | Data Validation | Manual TestingMid-level Full TimeIndia13h ago
-
Lead - Data Platform Engineering INR 2500K-4500KAWS | Azure | Cloud Data | Cloud Data Platforms | Customer 360Senior-level Full TimeChennai, India14h ago