Custom Software Engineer
Kolkata, KDC1A, India
INR 2500K-3500K (estimate) Senior-level Full Time
Tasks
- Apply canonical data modeling
- Auto generate ETL mappings and job scaffolding
- Build profiling and validation pipelines
- Build reusable data flows workflows and transforms
- Create data enrichment standardization and harmonization logic
- Design automated validation strategies schema checks row counts reconciliation rules referential integrity and regression comparisons
- Design batch and near real time data pipelines
- Develop SAP BusinessObjects Data Services ETL jobs
- Develop agentic ETL tooling for metadata analysis and transformation recommendations
- Establish evaluation harnesses with golden datasets and drift detection
- Implement data quality rules validation cleansing matching deduplication standardization
- Implement data transformation queries transforms lookups and hierarchies
- Implement error handling restartability idempotency and recovery
- Implement retrieval grounded assistance with metadata catalogs mapping documents and business rules
- Integrate BODS pipelines with cloud data platforms and analytics ecosystems
- Monitor pipelines and quality metrics with SLA aligned alerts
- Optimize ETL job performance and scalability
- Perform root cause analysis and preventive action automation
- Support data governance with lineage aware jobs and audit trails
- Use AI augmented diagnostics for incident clustering and remediation
Perks/Benefits
- N/A
Skills/Tech-stack
BusinessObjects Data Services | Data Governance | Data Lineage | Data Modeling | Data Quality | Data Services | Data Transformation | Data Warehousing | Data integration | Data profiling | ETL | Lineage | Metadata Management | Near-real-time | Real Time | SAP BusinessObjects | SAP BusinessObjects Data Services | SQL
Education
N/A
Roles
Related jobs
-
Technical specialist- Data Engineer, AS INR 2475K-3465KAgile | Airflow | Apache Beam | Apache Hadoop | Apache SparkAccident insurance | Best in class leave policy | Certification sponsorship | Childcare assistance reimbursement | Employee assistance programMid-level Full TimePune - Margarpatta, India3h ago
-
Data Platform Engineer INR 1000K-2000KAWS | Data Modeling | Data Warehouse | Data integration | ETLMid-level Full TimeBengaluru, BDC7A, India3h ago
-
Data Platform Operations Engineer (Databricks, DBT, Snowflake, AWS, Aurora) - Mumbai, MH - AS A INR 500K-1500KAWS | Amazon Aurora | Amazon S3 | Backup and Recovery | CDCMid-level Full TimeMumbai, MH12h ago
-
Amazon Aurora | Amazon RDS | Amazon S3 | Amazon Web Services | CI/CDMid-level Full TimeDahisar West, Mumbai City, Maharashtra12h ago
-
Data and Digital Initiatives INR 3000K-4000KAI | API Integration | Cloud Computing | Credit Risk | DashboardingFlexible working | Inclusive work environment | Opportunities to grow | Professional developmentSenior-level Full TimeMumbai, Maharashtra, India14h ago
-
SDET ETL Testing INR 1500K-2500KAWS | AWS Command Line Interface | AWS Data | AWS Data Catalog | AWS GlueSenior-level Full TimeIN-HR-Gurgaon15h ago
-
AWS Data Engineer- Gen AI INR 1500K-2500KAWS CDK | AWS Glue | AWS Step Functions | Amazon RDS | Amazon RedshiftSenior-level Full TimeIN-TN-Chennai15h ago
-
AWS Data Engineer- Airflow INR 1500K-2000KAWS Glue | AWS Lambda | Amazon Redshift | Amazon S3 | Apache HadoopMid-level Full TimeIN-AP-Hyderabad15h ago
-
Entry-level Full TimeIndia15h ago
-
Senior-level Full TimePune, Maharashtra, India17h ago
-
Senior-level Full TimePune, Maharashtra, India17h ago
-
Mid-level Full TimeIndia18h ago
-
Lead Software Engineer - Data Engineering INR 3500K-5000KAWS | Airflow | Authentication | Authorization | CI/CDSenior-level Full TimeBengaluru, Karnataka, India18h ago
-
Senior Analyst - AI/ML INR 3000K-5000KAlgorithms | Artificial Intelligence | Automl | Data Science | Data StructuresMentorshipSenior-level Full TimePune, Maharashtra, IND, 41101419h ago
-
AI/ML Engineer_MS INR 2500K-5000KAI Foundry | AI Search | AWS Bedrock | Amazon QuickSight | App ServiceSenior-level Full Timetelengana, India21h ago
-
CLOUD AMAZE - DW Architect (Practice) INR 1500K-2500KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksSenior-level Full TimeIndia21h ago
-
Senior INR 3000K-5000KAI Foundry | Azure AI | Azure AI Foundry | Azure OpenAI | Azure OpenAI ServiceSenior-level Full TimeGurgaon, Haryana, India21h ago
-
Engineering Lead,Microservices,Java Springboot /Sr. Associate Director, Technology Management INR 1300K-2200KApache Airflow | Apache Beam | Apache Flink | BigQuery | ClickHouseMid-level Full TimePune, Maharashtra, India R22h ago
-
Senior-level Full TimeBengaluru, KA, India22h ago
-
Data Analyst Technical Lead (Alteryx) INR 3000K-4000KAPI Integration | Alteryx Designer | Alteryx Server | Data Cleansing | Data ReconciliationUK shiftSenior-level Full TimeNoida, UP, India22h ago
-
Mid-level Full TimeBangalore, Karnataka, India22h ago
-
GCP Data Engineer INR 1500K-2000KAgile | Apache Airflow | Ascend.io | CI/CD | Cloud ComposerFlexible work model | Wellbeing cultureMid-level Full TimeHyderabad, India22h ago
-
Databricks -Project Lead-Data Engg INR 1500K-2500KAzure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | Data FactoryClient communication support | Flexible to work US shiftsSenior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …1d ago
-
Senior Data Engineer (Data Analytics),Hyderabad INR 3000K-4000KAPI | AWS | Agile | Amazon DynamoDB | Amazon RedshiftEqual opportunity employer | Fast track growth opportunitiesSenior-level Full TimeHyderabad - Phoenix Equinox Tower 2, …1d ago
-
Data Engineer - Fabric Pipelines / Orchestration INR 2040K-3000KApache Spark | Azure Synapse | Data Quality | Data Warehousing | Data integrationContract employment | Quarterly renewal | Remote workSenior-level Full TimeDelhi, DL, IN1d ago