Custom Software Engineer
Pune, PDC2C, India
INR 2500K-3500K (estimate) Senior-level Full Time
Tasks
- Build data profiling and validation pipelines
- Build reusable data flows workflows transforms
- Cluster recurring issues using AI diagnostics and recommend remediation
- Create automated validation strategies schema checks reconciliation referential integrity regression comparisons
- Create data enrichment standardization harmonization rules
- Design AI native agentic ETL workflows for transformation recommendations
- Design batch and near real time data pipelines
- Develop SAP BusinessObjects Data Services ETL jobs
- Establish evaluation harnesses using golden datasets drift detection
- Gate releases of ETL logic through quality thresholds
- Generate ETL mappings and job scaffolding with validation
- Implement data quality validation cleansing matching deduplication
- Implement data transformation logic using queries transforms lookups hierarchies
- Implement error handling restartability idempotency recovery mechanisms
- Implement retrieval grounded assistance using metadata catalogs mapping documents business rules historical defects
- Integrate BODS pipelines with cloud data platforms and analytics ecosystems
- Monitor pipelines job execution data volumes quality metrics
- Optimize ETL performance scalability resource tuning parallelism pushdown
- Perform root cause analysis for load failures and data issues
- Support data governance using lineage aware jobs audit trails
- Transition legacy ETL to modular metadata driven AI augmented data architectures
Perks/Benefits
- N/A
Skills/Tech-stack
Automation | Batch Data Processing | Batch data | BusinessObjects Data Services | Data Governance | Data Lineage | Data Modeling | Data Processing | Data Quality | Data Services | Data Transformation | Data Warehousing | Data integration | Data pipeline | Data pipeline performance | Data profiling | ETL | Metadata Management | Near-Real-Time data | Near-real-time | Pipeline performance | Real-time Data | SAP BusinessObjects | SAP BusinessObjects Data Services | Scripting
Education
Roles
Related jobs
-
Junior and Senior Copy Writer / AI prompt Engineer INR 300K-350KAutomation | ChatGPT | Content Generation | Marketing content | Prompt engineeringEntry-level Full Timevillivakam chennai, India11h ago
-
Senior-level Full TimeIN-KA-Bangalore13h ago
-
Mid-level Full TimeIN-TN-Chennai13h ago
-
Agentic AI Engineer INR 1800K-2500KAI orchestration | API Integration | Automated testing | Automation | Azure DevOpsMid-level Full TimeIndia, West Bengal, Kolkata13h ago
-
Data & Analytics Engineer - AM INR 1500K-2500KApache Spark | Data Modeling | Data Warehousing | Databricks | Delta LakeSenior-level Full TimeBangalore, Karnataka, India15h ago
-
Senior QA Engineer(Data Platform Testing) INR 2515K-2829KAPI Gateway | API Testing | AWS Lambda | Alerting | CI/CDReward and recognition | Volunteering opportunities | Wellness | Work-life balanceSenior-level Full TimeHyderabad, India15h ago
-
Lead Software Engineer INR 4000K-5000KAWS | Agent Development | Agent systems | Amazon ECS | Amazon EKSSenior-level Full TimeBengaluru, Karnataka, India16h ago
-
Data Scientist and AI Engineer INR 2500K-5000KAlteryx | CI/CD | Classification | Cloud Build | Cloud FunctionsSenior-level Full TimeChennai, Tamil Nadu, India16h ago
-
Big Data Lead INR 1500K-2500KAPI first | API first resilience | Azure Cosmos | Azure Cosmos DB | Azure DataHybrid work scheduleSenior-level Full TimeIndia16h ago
-
Senior-level Full TimeIndia16h ago
-
API Testing | Allure | BDD | CI/CD | CucumberExecutive-level Full TimePune, India16h ago
-
GCP Data Engineer INR 1500K-2500KAPI Integration | BigQuery | Cloud platform | Data Governance | Data ModelingSenior-level Full TimeGurugram, Haryana, India17h ago
-
Data Engineer (AWS+Pyspark) INR 1500K-2000KAWS Glue | Amazon Athena | Amazon Aurora | Amazon DynamoDB | Amazon EC2Mid-level Full TimeHyderabad, Telangana, India18h ago
-
Associate Process Manager INR 1500K-3000KAI Agents | AI Governance | AI monitoring | AWS | AWS BedrockMid-level Full TimePune, Maharashtra, India19h ago
-
Senior Consultant_AWS Developer INR 1500K-3500KAWS Glue | AWS Lambda | AWS Step Functions | AWS Storage Gateway | AWS storageSenior-level Full TimeThane, IN, 40060420h ago
-
Applied AI ML Lead INR 3264K-5000KAI Libraries | API Development | AWS | Agentic AI | Agentic AI librariesSenior-level Full TimeBengaluru, Karnataka, India20h ago
-
Mid-level Full TimePune, Maharashtra, India20h ago
-
Senior Data Systems Software Engineer INR 1500K-3000KA/B | A/B Testing | API Versioning | API interoperability | AutomationLife insurance | Medical insurance | Retirement options | Volunteer programsSenior-level Full TimeBENGALURU, KARNATAKA, India23h ago
-
Mid-level Full TimePune, MH, IN, 41101423h ago
-
AI & Automation Engineer INR 3264K-5876KAPIs | Data Pipelines | Data Warehousing | Data models | EvaluationCareer development | Flexible vacation | Headspace app access | Hybrid work model | Mental health daysSenior-level Full TimeIndia, Bengaluru, Karnataka R1d ago
-
Lead Data Engineer/ Data Architect INR 2000K-2800KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeHyderabad, Telangana, India - Remote R1d ago
-
Mid-level Full TimeBangalore, KA, IN1d ago
-
Data Engineer INR 1500K-2500KData Analysis | Data Engineering | Data Management | Data Modeling | Data pipelineHybrid workingSenior-level Full TimeHyderabad Knowledge Park Tower 2, India1d ago
-
AI And A - Machine Learning Engineer - VG - W4 - CDAO0230 INR 3799K-5876KData Engineering | Data Mining | Data Pipelines | Data Quality | Data discoveryCareer development | Coaching and feedback | Discounts and offers | Flexible working | Health and well-being supportSenior-level Full TimeHyderabad, TG, IN, 500081 R1d ago
-
Custom Software Engineer INR 1000K-2000KAgile | Cloud Architecture | Data Processing | Data analytics | DatabricksMid-level Full TimeBengaluru, BDC6F, India1d ago