Custom Software Engineer
Pune, PDC2C, India
INR 2500K-3500K (estimate) Senior-level Full Time
Tasks
- Build data profiling and validation pipelines
- Build reusable data flows workflows transforms
- Cluster recurring issues using AI diagnostics and recommend remediation
- Create automated validation strategies schema checks reconciliation referential integrity regression comparisons
- Create data enrichment standardization harmonization rules
- Design AI native agentic ETL workflows for transformation recommendations
- Design batch and near real time data pipelines
- Develop SAP BusinessObjects Data Services ETL jobs
- Establish evaluation harnesses using golden datasets drift detection
- Gate releases of ETL logic through quality thresholds
- Generate ETL mappings and job scaffolding with validation
- Implement data quality validation cleansing matching deduplication
- Implement data transformation logic using queries transforms lookups hierarchies
- Implement error handling restartability idempotency recovery mechanisms
- Implement retrieval grounded assistance using metadata catalogs mapping documents business rules historical defects
- Integrate BODS pipelines with cloud data platforms and analytics ecosystems
- Monitor pipelines job execution data volumes quality metrics
- Optimize ETL performance scalability resource tuning parallelism pushdown
- Perform root cause analysis for load failures and data issues
- Support data governance using lineage aware jobs audit trails
- Transition legacy ETL to modular metadata driven AI augmented data architectures
Perks/Benefits
- N/A
Skills/Tech-stack
Automation | Batch Data Processing | Batch data | BusinessObjects Data Services | Data Governance | Data Lineage | Data Modeling | Data Processing | Data Quality | Data Services | Data Transformation | Data Warehousing | Data integration | Data pipeline | Data pipeline performance | Data profiling | ETL | Metadata Management | Near-Real-Time data | Near-real-time | Pipeline performance | Real-time Data | SAP BusinessObjects | SAP BusinessObjects Data Services | Scripting
Education
Roles
Related jobs
-
Alteryx | Azure | Business Intelligence | Dashboarding | Data ModelingFlexible remote work | Professional growthMid-level Full TimeIndia7h ago
-
AWS Glue | AWS Lambda | Amazon EMR | Amazon Kinesis | Amazon RedshiftCareer progression | Collaborative culture | Continuous learning | Innovation-focused culture | International organizationMid-level Full TimeIndia7h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Competitive salary | Flexible environment | Remote-friendly workMid-level Full TimeHyderabad, India8h ago
-
Bash | Data Ingestion | Data Processing | Docker | GCPAsynchronous culture | Friendly work environment | Hands-off managementMid-level Full TimePune, India8h ago
-
Senior Data Engineer INR 3000K-4000KAWS | Airflow | Apache Spark | Cloud platform | Data ModelingCommuter benefits | Dental insurance | Disability insurance | Financial wellness support | HealthcareSenior-level Full TimeBengaluru, India12h ago
-
Custom Software Engineer INR 2500K-3500KBusinessObjects Data Services | Data Governance | Data Lineage | Data Modeling | Data QualitySenior-level Full TimeKolkata, KDC1A, India12h ago
-
Custom Software Engineer INR 2500K-3500KBusinessObjects Data Services | Data Governance | Data Lineage | Data Modeling | Data QualitySenior-level Full TimeBengaluru, BDC11A, India12h ago
-
Custom Software Engineer INR 1300K-2000KCloud Computing | Data Modeling | Data Warehouse | Data Warehousing | ETLMid-level Full TimeBengaluru, BDC7A, India12h ago
-
Custom Software Engineer INR 2500K-3500KAnomaly Detection | Batch Processing | BusinessObjects Data Services | Data Governance | Data LineageSenior-level Full TimeBengaluru, BDC11A, India12h ago
-
Mid-level Full TimeBangalore, KA, IN12h ago
-
Mid-level Full TimeBangalore, KA, IN12h ago
-
Mid-level Full TimeBangalore, KA, IN12h ago
-
Z2_Sr. Data Engineer|Data Science INR 3000K-3900KAzure | Azure Databricks | CI/CD | DAX | Data GovernanceSenior-level Full TimeBangalore, KA, IN12h ago
-
Senior Engineer - Databricks INR 2800K-4000KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageFlexible working hours | Paid parental leave | Paid training and development programs | Remote or mobile workingSenior-level Full TimeBangalore RMZ-ECO WORLD, India12h ago
-
Data Engineer INR 2600K-3880KAzure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | DAXSenior-level Full TimeBangalore, KA, IN12h ago
-
Data Engineer I INR 900K-900KAzure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure DatabricksEntry-level Full TimeBangalore, India Office12h ago
-
Sr. Data Engineer INR 3000K-4000KAWS CodePipeline | AWS Glue | AWS Lambda | Amazon Athena | Amazon EMRSenior-level Full TimeHyderabad, Telangana, India13h ago
-
Software Engineer INR 1300K-2000KAgile | Cloud services | Data Modeling | Database Design | Design PatternsMid-level Full TimePune, India19h ago
-
Senior-level Full TimeGurgaon, India21h ago
-
Data Engineer INR 2400K-3380KAPI Integration | Alerting | Azure Data | Azure Data Factory | Azure Data LakeCollaborative work environment | Community outreach volunteering | Employee resource groups | Professional mentoring program | Training and developmentMid-level Full TimeRemote-India R23h ago
-
Senior-level Full TimeIN-AP-Hyderabad23h ago
-
GCP Data Engineer INR 1500K-2400KAlation | Amazon Redshift | Apache Airflow | Apache Flink | Apache KafkaSenior-level Full TimeIN-AP-Hyderabad23h ago
-
GCP Data Engineer INR 1500K-2400KAirflow | Alation | Amazon Redshift | Apache Spark | AzureBest practice development | Code reviews | MentoringSenior-level Full TimeIN-AP-Hyderabad23h ago
-
GCP Data Engineer INR 1500K-2400KAmazon Redshift | Apache Airflow | Apache Flink | Apache Spark | BigQuerySenior-level Full TimeIN-AP-Hyderabad23h ago
-
GCP Data Engineer INR 1500K-2400KAlation | Amazon Redshift | Apache Airflow | Apache Flink | Apache KafkaSenior-level Full TimeIN-AP-Hyderabad23h ago