Custom Software Engineer
Hyderabad, HDC4A, India
INR 1317K-2000K (estimate) Mid-level Full Time
Tasks
- Assist in transitioning legacy ETL to modular metadata driven architectures
- Build data profiling and validation pipelines
- Conduct root cause analysis for load failures
- Create data transformation logic with queries transforms lookups and hierarchies
- Design batch and near real time data pipelines
- Develop SAP BusinessObjects Data Services ETL jobs
- Implement data enrichment standardization and harmonization
- Implement data quality rules
- Implement error handling restartability and recovery
- Monitor pipelines and quality metrics with alerts
- Optimize ETL performance and scalability
- Set up lineage aware governance and audit trails
- Support modernization with cloud data platforms integration
Perks/Benefits
- N/A
Skills/Tech-stack
Anomaly Detection | BusinessObjects Data Services | Data Governance | Data Lineage | Data Modeling | Data Quality | Data Services | Data Transformation | Data Warehousing | Data profiling | ETL | Metadata Management | Near-real-time | Real Time | SAP BusinessObjects | SAP BusinessObjects Data Services
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Staff Software Engineer - Data Platform INR 2500K-3500KAmazon AWS | CI/CD | Caching | Data integration | Database DesignHybrid work | Onsite in Bengaluru as neededSenior-level Full TimeBangalore, India8h ago
-
Senior-level Full TimeGurugram, Haryana, India; Hyderabad; Noida, Uttar …16h ago
-
Data Engineer - Snowflake/DBT INR 1500K-2500KCI/CD | DBT | Data Governance | Data Modeling | Data SecurityMid-level Full TimeBangalore, India17h ago
-
Senior Data Engineer - Snowflake/DBT INR 1500K-2040KCI/CD | DBT | Data Modeling | Data Warehousing | DatabricksSenior-level Full TimeBangalore, India17h ago
-
Senior Data Engineer INR 3000K-4000KAWS Glue | AWS Lambda | AWS Step Functions | Amazon S3 | CloudWatchCab facility | Flexible working hours | Free medical insurance | Maternity leave | Meal facilitySenior-level Full TimeGurgaon (SEZ1)18h ago
-
Cloud Data Engineer I, Professional Services, Google Cloud INR 1200K-1500KApache Hive | Apache Pig | Apache Spark | Big Data | C plus plusMid-level Full TimeBengaluru, Karnataka, India19h ago
-
Assistant Manager - Cloud Engineering INR 1500K-2000KAWS Lake Formation | Apache Airflow | Apache Kafka | Apache Spark | Azure CosmosClient relationship management | Consulting experience | Professional developmentMid-level Full TimePune, Maharashtra, India23h ago
-
AWS Glue | AWS IAM | AWS Lambda | Amazon EC2 | Amazon EMRSenior-level Full TimeHyderabad, Telangana, India23h ago
-
GCP Data Engineer INR 1500K-2500KApache Airflow | BigQuery | Cloud Composer | Cloud Functions | Cloud platformSenior-level Full TimeIndia - Bengaluru; India - Chennai23h ago
-
Consultant - AI Engineer with Claude INR 2000K-4000KAWS | Autogen | Azure | Claude | Cloud ComputingSenior-level Full TimeBangalore, Karnataka, India1d ago
-
Data Engineer_Sr_Python Specialist INR 1500K-2400KAI Pipelines | APIs | Alerting | Data Lineage | Data ModelingSenior-level Full Timebangalore, India1d ago
-
ETL Migration Engineer - Data Integration - Lead Consultant INR 1650K-2600KAPI | AWS | AWS Glue | Amazon EKS | Apache AirflowSenior-level Full TimeChennai, IN, 6000321d ago
-
ETL QA - Consultant INR 850K-1500KAgile | Case design | Data Mapping | Data Migration | Data QualityMid-level Full TimePune, IN, 4110571d ago
-
Data Engineer INR 3000K-3500KAlerting | Amazon Redshift | Apache Spark | Argo Workflows | AzureAgile working options | Birthday off | Flexible working hoursSenior-level Full TimeGurgaon1d ago
-
Senior Data Engineer INR 3000K-4000KAzure Databricks | Data Governance | Data Modeling | Data Monitoring | Data QualitySenior-level Full TimeHyderabad, TG, IN1d ago
-
IN_Manager_Data Engineer_D&A_Advisory_Mumbai INR 3000K-4000KAlerting | Azure | Azure Data | Azure Data Factory | Azure Data LakeFlexible work arrangements | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeMumbai Shivaji Park, India1d ago
-
Technical Program Manager - AI INR 3000K-4000KArtificial Intelligence | Data Quality | Data quality assessment | Evaluation metrics | Feature SelectionCareer growth opportunities | Flexible and inclusive working environment | Learning programs | Social coverage life medical pension | Supportive colleaguesSenior-level Full TimeBangalore, KA, IN1d ago
-
Senior Data Engineer for After-Sales Vehicle Documentation INR 2000K-3200KAWS | Apache Spark | BI | Data Quality | Data quality monitoringAccessibility accommodations | Cafeteria | Childcare | Coaching | Employee eventsSenior-level Full TimeBangalore, IN1d ago
-
AWS Data Engineer INR 2000K-3000KAWS Glue | AWS Lambda | Amazon Redshift | Amazon S3 | Amazon Web ServicesSenior-level Full TimeGurugram, Haryana, India1d ago
-
Mid-level Full TimeDGS India - Pune - Kharadi …1d ago
-
Cloud Engineer with Python FSD, AI/ML, AS INR 3000K-4000KA/B | A/B Testing | Angular | Apache Spark | Auto ScalingAccident insurance | Best in class leave policy | Childcare assistance reimbursement | Complementary health screening | Comprehensive hospitalization insuranceSenior-level Full TimePune - Business Bay, India1d ago
-
Lead Product AI Data Engineer INR 2000K-4000KAWS | Amazon Redshift | Apache Airflow | Azure Data | Azure Data FactoryHybrid workSenior-level Full TimeR131-Bangalore, India1d ago
-
Software Development Engineer 5 INR 2000K-4000KAWS EMR | AWS Lambda | AWS S3 | Apache Hudi | Apache IcebergSenior-level Full TimeIndia - Bangalore Office1d ago
-
Data Engineer INR 1500K-2541KAPI Development | CI/CD | Dashboard Development | Data Quality | Data WarehouseHybrid work | Relocation assistanceMid-level Full TimeIN: Pune - Building 5, India1d ago
-
Senior Specialist, Observability Data Engineer INR 3000K-4000KAWS | Agile | Apache Airflow | Apache Kafka | ContainerizationSenior-level Full TimeIND - Telangana - Hyderabad (HITEC …1d ago