Custom Software Engineer
Tasks
- Apply canonical data modeling to reduce duplication
- Auto generate ETL mappings and job scaffolding
- Build retrieval grounded AI assisted ETL recommendations
- Build reusable data flows transforms and workflows
- Create data profiling and validation pipelines
- Design automated validation strategies for ETL releases
- Design batch and near real time data pipelines
- Develop SAP BusinessObjects Data Services ETL jobs
- Implement data quality validation cleansing matching deduplication and standardization
- Implement error handling restartability and idempotency
- Integrate BODS pipelines with cloud data platforms
- Monitor pipelines and data quality metrics
- Optimize ETL performance and scalability
- Perform root cause analysis for data issues
- Support lineage and audit trails for governance
Perks/Benefits
- N/A
Skills/Tech-stack
Anomaly Detection | Batch ETL | BusinessObjects Data Services | Data Governance | Data Modeling | Data Pipelines | Data Quality | Data Reconciliation | Data Services | Data Warehousing | Data governance frameworks | Data integration | Data profiling | ETL | Governance frameworks | Lineage | Metadata Management | Near Real Time Data Pipelines | Near-Real-Time data | Near-real-time | Real-time data pipelines | SAP BusinessObjects | SAP BusinessObjects Data Services | Script automation
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Roles
Related jobs
-
Data Migration-Pune INR 800K-1500KAWS S3 | Azure Blob | Azure Blob Storage | Blob Storage | Data IntegratorMid-level Full TimeKolkata, India1d ago
-
Data Engineer INR 1500K-2000KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Gen2Mid-level Full TimeBangalore, Karnataka, IN1d ago
-
Sr Software Engineer INR 2400K-3500KAI Builder | Anomaly Detection | Azure Data | Azure Data Services | Azure DevOpsSenior-level Full TimeRemote Pune-Baroda, India R1d ago
-
Sr Operations Consultant INR 1800K-3000KAPI Integration | DAX | Data Modeling | Functions | Generative AISenior-level Full TimeRemote Pune-Baroda, India R1d ago
-
Staff Software Engineer - Data Platform INR 2500K-3500KAmazon AWS | CI/CD | Caching | Data integration | Database DesignHybrid work | Onsite in Bengaluru as neededSenior-level Full TimeBangalore, India2d ago
-
Lead Data Engineer - ETL INR 2000K-2500KAWS CodePipeline | AWS Glue | AWS Lambda | Amazon EMR | Amazon KinesisSenior-level Full TimeGurugram, Haryana, India2d ago
-
Senior-level Full TimeGurugram, Haryana, India2d ago
-
Senior-level Full TimeGurugram, Haryana, India; Hyderabad; Noida, Uttar …2d ago
-
Senior-level Full TimeGurugram, Haryana, India; Hyderabad; Noida, Uttar …2d ago
-
Data Engineer - Snowflake/DBT INR 1500K-2500KCI/CD | DBT | Data Governance | Data Modeling | Data SecurityMid-level Full TimeBangalore, India2d ago
-
Senior Data Engineer - Snowflake/DBT INR 1500K-2040KCI/CD | DBT | Data Modeling | Data Warehousing | DatabricksSenior-level Full TimeBangalore, India2d ago
-
Senior Data Engineer INR 3000K-4000KAWS Glue | AWS Lambda | AWS Step Functions | Amazon S3 | CloudWatchCab facility | Flexible working hours | Free medical insurance | Maternity leave | Meal facilitySenior-level Full TimeGurgaon (SEZ1)2d ago
-
Senior-level Full TimeGurugram, Sri Lanka2d ago
-
Cloud Data Engineer I, Professional Services, Google Cloud INR 1200K-1500KApache Hive | Apache Pig | Apache Spark | Big Data | C plus plusMid-level Full TimeBengaluru, Karnataka, India2d ago
-
Assistant Director, Decision Systems Data INR 2000K-4000KAgile | Apache Airflow | CI/CD | Cloud Bigtable | Cloud DataflowExecutive-level Full TimeBangalore, Karnataka, India R2d ago
-
Data Engineer INR 1800K-2500KAgile | Apache Airflow | CI/CD | Cloud Composer | ClusteringFlexible work model | Inclusive workplaceMid-level Full TimeHyderabad, India2d ago
-
Data Quality Engineer (Mid-level) INR 1500K-2000KAgile | Amazon Web Services | Azure | C# | CassandraMid-level Full TimePune, India2d ago
-
Mid-level Full TimePune, India2d ago
-
Assistant Manager - Cloud Engineering INR 1500K-2000KAWS Lake Formation | Apache Airflow | Apache Kafka | Apache Spark | Azure CosmosClient relationship management | Consulting experience | Professional developmentMid-level Full TimePune, Maharashtra, India2d ago
-
AWS Glue | AWS IAM | AWS Lambda | Amazon EC2 | Amazon EMRSenior-level Full TimeHyderabad, Telangana, India2d ago
-
GCP Data Engineer INR 1500K-2500KApache Airflow | BigQuery | Cloud Composer | Cloud Functions | Cloud platformSenior-level Full TimeIndia - Bengaluru; India - Chennai2d ago
-
Senior AI Engineer - Remote INR 2500K-4200KAWS CloudFormation | Apache Tomcat | Best practices | CI/CD | CircleCIMentorship | Professional development | Remote workSenior-level Full TimeBengaluru, KA, India R2d ago
-
Senior AI Engineer - Remote INR 2500K-4200KAWS | AWS DocumentDB | Apache Tomcat | CI/CD | CircleCIDistributed team culture | Remote workSenior-level Full TimePune, MH, India R2d ago
-
Senior AI Engineer - Remote INR 2500K-4200KAWS Bedrock | AWS CloudFormation | Apache | Apache Tomcat | Azure AICareer growth opportunities | Mission-driven work | Remote workSenior-level Full TimeNew Delhi, DL, India R2d ago
-
Consultant - AI Engineer with Claude INR 2000K-4000KAWS | Autogen | Azure | Claude | Cloud ComputingSenior-level Full TimeBangalore, Karnataka, India2d ago