Custom Software Engineer
Bengaluru, BDC11A, India
INR 2500K-3500K (estimate) Senior-level Full Time
Tasks
- Build data profiling and validation pipelines
- Build reusable data flows transforms and workflows
- Create automated validation strategies for ETL logic
- Create data quality rules for validation cleansing matching deduplication and standardization
- Design agentic ETL recommendations using metadata and business rules
- Design batch and near real time data pipelines
- Develop SAP BusinessObjects Data Services ETL jobs
- Establish evaluation harnesses for generated rules and drift detection
- Implement data enrichment standardization and harmonization
- Implement error handling restartability idempotency and recovery
- Implement grounded retrieval using metadata catalogs and historical defects
- Integrate BODS pipelines with cloud data platforms
- Monitor pipelines and quality metrics
- Optimize ETL job performance and scalability
- Perform root cause analysis and document preventive actions
- Support data governance with lineage and audit trails
Perks/Benefits
- N/A
Skills/Tech-stack
Anomaly Detection | Batch Processing | BusinessObjects Data Services | Data Governance | Data Lineage | Data Modeling | Data Pipelines | Data Quality | Data Services | Data Transformation | Data Validation | Data Warehousing | Data integration | Data profiling | ETL | Idempotency | Metadata Management | Near Real Time Data Pipelines | Near-Real-Time data | Near-real-time | Parallelism | Pushdown | Real-time data pipelines | Regression testing | SAP BusinessObjects | SAP BusinessObjects Data Services | Schema checks
Education
Roles
Related jobs
-
Alteryx | Azure | Business Intelligence | Dashboarding | Data ModelingFlexible remote work | Professional growthMid-level Full TimeIndia6h ago
-
AWS Glue | AWS Lambda | Amazon EMR | Amazon Kinesis | Amazon RedshiftCareer progression | Collaborative culture | Continuous learning | Innovation-focused culture | International organizationMid-level Full TimeIndia6h ago
-
Senior Data Engineer INR 3000K-4000KAWS | Airflow | Apache Spark | Cloud platform | Data ModelingCommuter benefits | Dental insurance | Disability insurance | Financial wellness support | HealthcareSenior-level Full TimeBengaluru, India11h ago
-
Custom Software Engineer INR 2500K-3500KBusinessObjects Data Services | Data Governance | Data Lineage | Data Modeling | Data QualitySenior-level Full TimeKolkata, KDC1A, India11h ago
-
Custom Software Engineer INR 2500K-3500KBusinessObjects Data Services | Data Governance | Data Lineage | Data Modeling | Data QualitySenior-level Full TimeBengaluru, BDC11A, India11h ago
-
Custom Software Engineer INR 1300K-2000KCloud Computing | Data Modeling | Data Warehouse | Data Warehousing | ETLMid-level Full TimeBengaluru, BDC7A, India11h ago
-
Custom Software Engineer INR 2500K-3500KAutomation | Batch Data Processing | Batch data | BusinessObjects Data Services | Data GovernanceSenior-level Full TimePune, PDC2C, India11h ago
-
Mid-level Full TimeBangalore, KA, IN11h ago
-
Mid-level Full TimeBangalore, KA, IN11h ago
-
Mid-level Full TimeBangalore, KA, IN11h ago
-
Z2_Sr. Data Engineer|Data Science INR 3000K-3900KAzure | Azure Databricks | CI/CD | DAX | Data GovernanceSenior-level Full TimeBangalore, KA, IN11h ago
-
Senior Engineer - Databricks INR 2800K-4000KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageFlexible working hours | Paid parental leave | Paid training and development programs | Remote or mobile workingSenior-level Full TimeBangalore RMZ-ECO WORLD, India11h ago
-
Sr. Data Engineer INR 3000K-4000KAWS CodePipeline | AWS Glue | AWS Lambda | Amazon Athena | Amazon EMRSenior-level Full TimeHyderabad, Telangana, India12h ago
-
Software Engineer INR 1300K-2000KAgile | Cloud services | Data Modeling | Database Design | Design PatternsMid-level Full TimePune, India18h ago
-
Senior-level Full TimeGurgaon, India20h ago
-
Data Engineer INR 2400K-3380KAPI Integration | Alerting | Azure Data | Azure Data Factory | Azure Data LakeCollaborative work environment | Community outreach volunteering | Employee resource groups | Professional mentoring program | Training and developmentMid-level Full TimeRemote-India R22h ago
-
Senior-level Full TimeIN-AP-Hyderabad22h ago
-
GCP Data Engineer INR 1500K-2400KAlation | Amazon Redshift | Apache Airflow | Apache Flink | Apache KafkaSenior-level Full TimeIN-AP-Hyderabad22h ago
-
GCP Data Engineer INR 1500K-2400KAirflow | Alation | Amazon Redshift | Apache Spark | AzureBest practice development | Code reviews | MentoringSenior-level Full TimeIN-AP-Hyderabad22h ago
-
GCP Data Engineer INR 1500K-2400KAmazon Redshift | Apache Airflow | Apache Flink | Apache Spark | BigQuerySenior-level Full TimeIN-AP-Hyderabad22h ago
-
GCP Data Engineer INR 1500K-2400KAlation | Amazon Redshift | Apache Airflow | Apache Flink | Apache KafkaSenior-level Full TimeIN-AP-Hyderabad22h ago
-
SAP Data Engineer (Freelancer) INR 1850K-2700KABAP | AWS Glue | AWS Glue Data Catalog | AWS S3 | Apache ParquetMid-level FreelanceMumbai, MH R23h ago
-
AI Adoption Customer Engineer INR 1800K-2800KAgent systems | Artificial Intelligence | Change Management | Cloud Architecture | Data GovernanceTravel 30 percentSenior-level Full TimeMumbai, Maharashtra, India1d ago
-
Big Data Lead INR 1200K-2000KAzure Data | Azure Data Lake | Azure Data Lake Storage | CI/CD | Cloud StorageSenior-level Full TimeIndia1d ago
-
Big Data Lead INR 1500K-2000KABAC | AWS | Airflow | Amazon Kinesis | AzureCross-team collaboration | MentoringSenior-level Full TimeIndia1d ago