Custom Software Engineer
Hyderabad, HDC4A, India
INR 1317K-2000K (estimate) Mid-level Full Time
Tasks
- Assist in transitioning legacy ETL to modular metadata driven architectures
- Build data profiling and validation pipelines
- Conduct root cause analysis for load failures
- Create data transformation logic with queries transforms lookups and hierarchies
- Design batch and near real time data pipelines
- Develop SAP BusinessObjects Data Services ETL jobs
- Implement data enrichment standardization and harmonization
- Implement data quality rules
- Implement error handling restartability and recovery
- Monitor pipelines and quality metrics with alerts
- Optimize ETL performance and scalability
- Set up lineage aware governance and audit trails
- Support modernization with cloud data platforms integration
Perks/Benefits
- N/A
Skills/Tech-stack
Anomaly Detection | BusinessObjects Data Services | Data Governance | Data Lineage | Data Modeling | Data Quality | Data Services | Data Transformation | Data Warehousing | Data profiling | ETL | Metadata Management | Near-real-time | Real Time | SAP BusinessObjects | SAP BusinessObjects Data Services
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Principal Architect AI Data Engineer INR 2000K-5000KAWS | Agent Orchestration | Azure | CI/CD | ContainersSenior-level Full TimeGurugram, Haryana, India5h ago
-
Architect AI Data Engineer INR 3000K-5000KAPI Integration | AWS | Agent Orchestration | Azure | Azure DatabricksSenior-level Full TimeNoida, Uttar Pradesh, India5h ago
-
Senior-level Full TimeGurugram, Haryana, India5h ago
-
Senior-level Full TimeNoida, Uttar Pradesh, India5h ago
-
Senior AWS Data Engineer INR 1500K-2500KAPI Gateway | AWS API | AWS API Gateway | AWS CloudFormation | AWS EMRSenior-level Full TimeIndia13h ago
-
Senior Analytics Engineer – Data Applications INR 2771K-4000KAirflow | Anomaly Detection | CI/CD | DBT | DashHybrid work modelSenior-level Full TimeBengaluru, INDIA, India16h ago
-
Agentic AI/ Data Scientist INR 3500K-5000KAWS | AWS SQS | AWS Step Functions | Agent systems | Agentic FrameworksSenior-level Full TimeIndia1d ago
-
Lead Software Engineer - Big Data INR 2500K-3500KApache Hive | Apache Impala | Apache Kafka | Apache Pig | Apache SparkSenior-level Full TimeMumbai, Maharashtra, India1d ago
-
Database Engineer INR 500K-1500KCI/CD | DB2 | Data Warehousing | Database performance | Database performance tuningMid-level Full TimePune, MH, India1d ago
-
Apache Airflow | Apache HBase | Apache Hive | Apache Impala | Apache KafkaSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Staff AI/ML Engineer, YouTube Create INR 2500K-5000KAgentic framework | Algorithms | Artificial Intelligence | Audio Processing | Computer VisionSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Senior Engineer - Data Analyst INR 3000K-5012KAPI | Automation | Big Data | Big data analytics | CI/CDSenior-level Full TimeHadapsar, Pune, Maharashtra, IND, 4110131d ago
-
Machine Learning Engineer (MLE-3) INR 3000K-5000KAnomaly Detection | Apache Airflow | Boosting | Classification | Data VisualizationSenior-level Full TimeBengaluru, India1d ago
-
AWS | Advanced Excel | Agile Development | Apache Spark | AzureExecutive-level Full TimeKolkata, West Bengal, India R1d ago
-
Mid-level Full TimePune, Maharashtra, India1d ago
-
Databricks Developer INR 1500K-2400KACID | Batch Processing | CI/CD | Cluster management | Data IngestionWork from office 5 days per weekMid-level Full TimeGurugram, Haryana, India1d ago
-
Associate-Digital Product Management INR 1685K-3300KAPI Integration | Anthropic | Data Governance | Data Ingestion | Data ValidationCareer growth opportunities | Holistic well-being support | Leadership development programs | Training opportunitiesMid-level Full TimeGurugram, HR, India1d ago
-
Associate-Digital Product Management INR 1685K-3300KAPIs | Anthropic | Data Quality | Data Visualization | Data integrationMid-level Full TimeGurugram, HR, India1d ago
-
AWS | Amplitude | Apache Airflow | BigQuery | CCPAFlexible time off | Learning reimbursement | Life insurance | Long-term disability | Medical/Dental/Vision insuranceMid-level Full TimeIndia1d ago
-
AWS | AWS SageMaker | CI/CD | CloudWatch | Credit RiskCareer growth opportunities | Collaborative engineering culture | Continuous learning culture | Fully remote | High-impact projectsSenior-level Full TimeIndia R1d ago
-
Lead Assistant Manager - Azure Data Engineer INR 1500K-2500KAgile | Amazon Redshift | Apache Airflow | Apache Hadoop | Apache HiveSenior-level Full TimeNoida, Uttar Pradesh, India1d ago
-
Executive - Data Governance INR 600K-840KCI/CD | Data Cleansing | Data Denormalization | Data Modeling | Data NormalizationExecutive-level Full TimeBangalore, Karnataka, India1d ago
-
Sr Data Engineer, Python + Spark (Data Federation skillset - Data Lakehouse - Eg: Starburst) - Chennai INR 1500K-2500KAWS EMR | AWS Glue | AWS S3 | Apache Hudi | Apache Iceberg401k retirement plan | Dental insurance | Medical insurance | Paid Holidays | Paid time offSenior-level Full TimeIndia1d ago
-
Apache Kafka | Azure Data | Azure Data Factory | Azure Data Lake | Azure DatabricksCareer growth | Flexible engagement options | Inclusive work environment | Learning opportunities | Remote-friendly work environmentMid-level Full TimeIndia1d ago
-
Assistant Manager- Python Gen AI Engineer INR 1200K-2500KAI Agents | API Development | Agile | Containerization | Data PipelinesWork from client office 5 days per weekMid-level Full TimeBangalore, Karnataka, India1d ago