Custom Software Engineer
Bengaluru, BDC11A, India
INR 2500K-3500K (estimate) Senior-level Full Time
Tasks
- Build data profiling and validation pipelines
- Build reusable data flows transforms and workflows
- Create automated validation strategies for ETL logic
- Create data quality rules for validation cleansing matching deduplication and standardization
- Design agentic ETL recommendations using metadata and business rules
- Design batch and near real time data pipelines
- Develop SAP BusinessObjects Data Services ETL jobs
- Establish evaluation harnesses for generated rules and drift detection
- Implement data enrichment standardization and harmonization
- Implement error handling restartability idempotency and recovery
- Implement grounded retrieval using metadata catalogs and historical defects
- Integrate BODS pipelines with cloud data platforms
- Monitor pipelines and quality metrics
- Optimize ETL job performance and scalability
- Perform root cause analysis and document preventive actions
- Support data governance with lineage and audit trails
Perks/Benefits
- N/A
Skills/Tech-stack
Anomaly Detection | Batch Processing | BusinessObjects Data Services | Data Governance | Data Lineage | Data Modeling | Data Pipelines | Data Quality | Data Services | Data Transformation | Data Validation | Data Warehousing | Data integration | Data profiling | ETL | Idempotency | Metadata Management | Near Real Time Data Pipelines | Near-Real-Time data | Near-real-time | Parallelism | Pushdown | Real-time data pipelines | Regression testing | SAP BusinessObjects | SAP BusinessObjects Data Services | Schema checks
Education
Roles
Related jobs
-
Mid-level Full TimeHyderabad, IND-TG, India9h ago
-
Associate Data Engineer INR 1500K-2500KAgile | Apache NiFi | Azure DevOps | C plus plus | Database systemsMid-level Full TimePune, India11h ago
-
Senior-level Full TimeBANGALORE, Karnataka, Inde12h ago
-
Advanced Engineer-AI/ML INR 3264K-4800KAPI Integration | ASR | AUTOSAR | AWS | Audio ProcessingEmployee discounts | Recognition rewards program | Training opportunities | Tuition reimbursement | Wellness benefitsSenior-level Full TimeBangalore - Karnataka, India - Kalyani …12h ago
-
Senior Consultant INR 2000K-4500KAPI Testing | Adversarial Testing | Amazon SageMaker | Azure Machine Learning | Bias detectionSenior-level Full TimeIN-AP-Hyderabad13h ago
-
Assistant Director - Insights And Analytics INR 3000K-5199KCode reuse | Data Governance | Data Quality | Data Wrangling | Machine LearningExecutive-level Full TimeBangalore, Karnataka, India R13h ago
-
Senior-level Full TimeBangalore - Karnataka - India13h ago
-
Lead Data Platform Engineer INR 2040K-3900KAPI Integration | AWS | AWS CloudWatch | AWS DataZone | AWS GlueEnhanced medical benefits | Family well-being benefits | Hybrid work | Paid time off | Wellbeing programsSenior-level Full TimeHyderabad, India14h ago
-
Anomaly Detection | Autoencoders | Bayesian optimization | Classification | ClusteringOnsite workEntry-level Full TimeHyderabad, India14h ago
-
Data Engineer INR 1300K-2000KAPI Integration | Data Modeling | Data Transformation | Data pipeline | Power BIMid-level Full TimeHyderabad, Telangana, India15h ago
-
Senior QA Engineer (Data Platform Testing) INR 2500K-3000KAPI Gateway | API Testing | AWS Lambda | CI/CD | CloudWatchSenior-level Full TimeHyderabad, India15h ago
-
Mid-level Full TimePune, Maharashtra, India15h ago
-
Database Track Sr.Engineer INR 2000K-3000KCapacity Planning | Data Architecture | Database Design | Database performance | Database performance tuningSenior-level Full TimeIndia16h ago
-
Database Track Sr.Engineer INR 2000K-2700KAlways On | Always On Availability | Always On Availability Groups | Availability Groups | Azure MigrateSenior-level Full TimeIndia16h ago
-
Mid-level Full TimeChennai, Tamil Nadu, India17h ago
-
Senior-level Full TimeAhmedabad, Gujarat, India R17h ago
-
Mid-level Full TimeBangalore, KA, IN, 56007619h ago
-
Strategic AI Initiatives Intern INR 180K-288KCommand Line | Command-line Interface | Data Pipelines | Data integration | EmbeddingsEntry-level InternshipBengaluru, India20h ago
-
Data Engineer INR 1000K-2000KAzure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | CI/CDMid-level Full TimeHyderabad, Telangana, India20h ago
-
Applied AI ML Lead INR 4000K-5572KAI Agents | Data Governance | Data Management | Deep learning | Experiment trackingSenior-level Full TimeBengaluru, Karnataka, India20h ago
-
Senior Analytics Engineer – Data Applications INR 2771K-4064KAirflow | Anomaly Detection | Apache Spark | CI/CD | DBTSenior-level Full TimeBengaluru, INDIA, India21h ago
-
Lead - AI/ML Engineer (Generative AI Agent Systems) INR 3700K-5000KAI Agent Development Kit | Agent Development Kit | Agent Engine | Autonomous Agents | Cloud platformSenior-level Contract Full TimePune, MH, India22h ago
-
IN-Senior Associate_ Data Engineer Databricks_Data and Analytics_Advisory_ Bangalore INR 1500K-2500KAWS | Agile | Amazon Web Services | Apache Spark | Auto LoaderSenior-level Full TimeBengaluru Millenia, India1d ago
-
Apache Hadoop | Apache Spark | Azure Blob | Azure Blob Storage | Azure DataImmediate joinerMid-level Full TimeHyderabad, Telangana, India - Remote R1d ago
-
Senior-level Full TimeBengaluru, Karnataka, India1d ago