Custom Software Engineer
Kolkata, KDC1A, India
INR 2500K-3500K (estimate) Senior-level Full Time
Tasks
- Apply canonical data modeling
- Auto generate ETL mappings and job scaffolding
- Build profiling and validation pipelines
- Build reusable data flows workflows and transforms
- Create data enrichment standardization and harmonization logic
- Design automated validation strategies schema checks row counts reconciliation rules referential integrity and regression comparisons
- Design batch and near real time data pipelines
- Develop SAP BusinessObjects Data Services ETL jobs
- Develop agentic ETL tooling for metadata analysis and transformation recommendations
- Establish evaluation harnesses with golden datasets and drift detection
- Implement data quality rules validation cleansing matching deduplication standardization
- Implement data transformation queries transforms lookups and hierarchies
- Implement error handling restartability idempotency and recovery
- Implement retrieval grounded assistance with metadata catalogs mapping documents and business rules
- Integrate BODS pipelines with cloud data platforms and analytics ecosystems
- Monitor pipelines and quality metrics with SLA aligned alerts
- Optimize ETL job performance and scalability
- Perform root cause analysis and preventive action automation
- Support data governance with lineage aware jobs and audit trails
- Use AI augmented diagnostics for incident clustering and remediation
Perks/Benefits
- N/A
Skills/Tech-stack
BusinessObjects Data Services | Data Governance | Data Lineage | Data Modeling | Data Quality | Data Services | Data Transformation | Data Warehousing | Data integration | Data profiling | ETL | Lineage | Metadata Management | Near-real-time | Real Time | SAP BusinessObjects | SAP BusinessObjects Data Services | SQL
Education
N/A
Roles
Related jobs
-
Data Warehouse, ETL, Cloud / Consultant Specialist INR 3000K-4000KAWS | Agile | Ansible | Cloud platform | Confluent KafkaFlexible working | Inclusive work environment | Professional developmentSenior-level Full TimePune, Maharashtra, India R7h ago
-
Principal AI Engr INR 2500K-5000KAI Foundry | AI Observability | AI Search | AI auditing | Agent systemsSenior-level Full TimeBengaluru, Karnataka, India8h ago
-
Senior-level Full TimeIN-TN-Chennai8h ago
-
Databricks Data Engineer INR 1500K-2200KApache Spark | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksMid-level Full TimeIN-KA-Bangalore8h ago
-
Business Intelligence (Data Analytics & AI) - Associate INR 2000K-4064KAPIs | Alteryx | Data Governance | Data Modeling | Data QualitySenior-level Full TimeMumbai, Maharashtra, India9h ago
-
Mid-level Full TimeBangalore, Karnataka, India; Hyderabad, Telangana, India10h ago
-
GCP, Digital Analytics, Bigquery/Senior Consultant Specialist INR 2500K-3900KAttribution Modeling | Batch Processing | BigQuery | Cloud platform | Customer AnalyticsCareer growth | Flexible working | Inclusive workplace | Opportunities for professional developmentSenior-level Full TimeHyderabad, Telangana, India R10h ago
-
BI Analytics Engineer INR 2000K-4000KData Modeling | Data Pipelines | Data Visualization | Data Warehousing | Power BISenior-level Full TimePune, Maharashtra, IND, 41101311h ago
-
Senior - Azure Data Engineering INR 3000K-4000KApache Spark | Azure | Azure Data | Azure Data Factory | Data FactorySenior-level Full TimeBangalore, Karnataka, India13h ago
-
Senior-level Full TimePune, Maharashtra, India13h ago
-
Vice President, Full-Stack Engineer INR 4000K-5000KAI chatbots | AWS | Access Control | Amazon Web Services | AzureExecutive-level Full TimePune, MH, India13h ago
-
Data Engineer INR 1400K-1800KACID transactions | AI Ready | AI Ready Datasets | API | Anomaly DetectionCollaborative team | Health and wellbeing program | Hybrid work modelSenior-level Full TimeMumbai, Maharashtra, India14h ago
-
Senior-level Full TimeGurugram, HR, India14h ago
-
Mid-level Full TimeIndia14h ago
-
Senior-level Full TimeMitratech India15h ago
-
Genetics Data Engineer 1 INR 3000K-4600KAPI Development | AWS | Agentic AI | Azure | BcftoolsCareer development opportunities | Flexible work culture | Inclusive workplaceSenior-level Full TimeBangalore, Karnataka, IN, 56003715h ago
-
APIs | Airflow | Apache Iceberg | Apache Kafka | Apache SparkSenior-level Full TimeBengaluru15h ago
-
Ecommerce Analytics Engineer INR 2500K-4400KAlteryx | Cloud Data | Cloud Data Platforms | DBT | Data GovernanceSenior-level Full TimeBengaluru, Karnataka, India15h ago
-
Senior Analyst - Data Governance & Management (SQL, Power BI) INR 2500K-4132KAgile | Automation | BigQuery | Data Catalog | Data GovernanceSenior-level Full TimeGurugram, HR, India16h ago
-
Lead Software Engineer - Python, Data, Cloud INR 3000K-4500KAPI Development | AWS Glue | Amazon Athena | Amazon Redshift | Amazon S3Senior-level Full TimeBengaluru, Karnataka, India16h ago
-
Azure Databricks | Azure DevOps | Data Quality | Data Warehousing | DatabricksCollaborative Agile environment | Fully remote | Hands on cloud data platform exposureMid-level Full TimeIndia R16h ago
-
Mid-level Full TimeGurgaon, Haryana, India17h ago
-
Data Analytics/Engineer (Python and MS Fabric exp) INR 2500K-4720KAWS | Apache Airflow | Azure Data | Azure Data Factory | Azure SynapseCross-functional collaboration | Mentorship | Professional developmentSenior-level Full TimeIND-Pune-Smartworks, India21h ago
-
AI Architect INR 3000K-5000KAPIs | Artificial Intelligence | Cloud Computing | Data Management | Data integrationSenior-level Full TimeMumbai (ex Bombay), IN21h ago
-
AWS S3 | Amazon Redshift | Amazon Web Services | Apache Spark | Azure DataSenior-level Full TimeBengaluru Millenia, India21h ago