Senior Data Engineer
Tasks
- Align data structures with business processes
- Create and maintain data models and schema designs
- Design scalable cloud-native data pipelines
- Develop and optimize ETL/ELT workflows
- Ensure data quality lineage governance and observability
- Implement ingestion frameworks using messaging and REST APIs
- Integrate DTCC data sources into unified trade record schema
- Optimize SQL Server queries indexing and performance
- Populate and maintain trade exceptions databases
- Process and normalize financial messages including ISO 15022
- Troubleshoot data issues and provide trade discrepancy insights
Perks/Benefits
- N/A
Skills/Tech-stack
API Integration | AWS | Amazon EKS | Amazon RDS | Amazon S3 | Data Governance | Data Lineage | Data Modeling | Data Observability | Data Quality | ELT | ETL | IBM MQ | ISO 15022 | Kafka | Messaging Systems | REST API | SQL | SQL Server | Schema Design | Stored Procedures
Education
N/A
Roles
Related jobs
-
Asst Mgr - AI Solutions INR 96K-180KAPIs | Artificial Intelligence | Feature Engineering | Generative AI | GitEntry-level Full TimeMumbai A.O, MUM-KND-AFS(FD), IN4h ago
-
Senior Data Engineer INR 3000K-4000KAPI Development | AWS | Algorithms | Amazon Redshift | AzureDiscounted gym memberships | Flexible working | Hybrid working | Life assurance | Life assurance and community involvementSenior-level Full TimeHyderabad, India4h ago
-
API Gateway | AWS CloudWatch | AWS Cost Optimization | AWS Glue | AWS LambdaCollaborative environment | Continuing education | Growth opportunities | Professional training opportunities | Remote work flexibilitySenior-level Full TimeIndia7h ago
-
Senior-level Full TimeIN Office Bangalore8h ago
-
Lead AI Engineer INR 3000K-5500KAI Governance | API Integration | Agent Orchestration | Agent systems | Clause ExtractionSenior-level Full TimeIND-Bangalore, India11h ago
-
Custom Software Engineer INR 1300K-2000KAgile methodologies | Data Warehousing | Data integration | Databricks | Development LifecycleMid-level Full TimeBengaluru, BDC14A, India11h ago
-
Custom Software Engineer INR 1300K-2000KAgile | Data integration | Databricks | ETL | Microsoft AzureMid-level Full TimeBengaluru, BDC14A, India11h ago
-
Custom Software Engineer INR 1300K-2000KAgile methodologies | Analytics services | Azure Analytics | Azure Analytics Services | Azure DataMid-level Full TimeBengaluru, BDC14A, India11h ago
-
Custom Software Engineer INR 1300K-2000KAgile | Analytics services | Azure Analytics | Azure Analytics Services | Azure DataMid-level Full TimeBengaluru, BDC14A, India11h ago
-
Custom Software Engineer INR 2700K-3500KAnalytics | Automation | Cause analysis | Cloud adoption | Data EngineeringSenior-level Full TimeNavi Mumbai, MDC5C, India11h ago
-
Application Support Engineer INR 2500K-4000KData Processing | Data integration | Distributed Computing | ETL | PySparkSenior-level Full TimeBhubaneswar, BBDC1A, India11h ago
-
Custom Software Engineer INR 1300K-2000KAgile | Analytics services | Azure Analytics | Azure Analytics Services | Azure DataMid-level Full TimeBengaluru, BDC14A, India11h ago
-
Mid-level Full TimeBengaluru, BDC7A, India11h ago
-
Custom Software Engineer INR 1300K-2000KAgile | Data Warehousing | Data integration | Databricks | ETLMid-level Full TimeBengaluru, BDC14A, India11h ago
-
Data Engineer INR 1000K-2000KCloud Data | Cloud data warehousing | Data Modeling | Data Warehousing | ETLMid-level Full TimeIndore, INDC1A, India11h ago
-
Data Engineer INR 1500K-2000KAWS | Airflow | Azure | BigQuery | CI/CDCollaboration with founder | Direct ownershipMid-level Full TimeNagpur, Maharashtra, India11h ago
-
Senior Data Engineer INR 3000K-4000KAWS Glue | AWS IAM | AWS Lambda | AWS S3 | AWS SQSEquity | Health coverage | Paid leaveSenior-level Full TimePune, India13h ago
-
Senior Software Engineer - Data Platform INR 3222K-4200KBackend Development | Data Engineering | Data Modeling | Data Pipelines | Dimensional dataCollaborative team environment | Continuous learning culture | Ownership and impactSenior-level Full TimeBangalore16h ago
-
Senior Data Engineer INR 2000K-4000KARM | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageCross-functional collaboration | Mentorship | Self service analytics enablement | Technical leadershipSenior-level Full TimeBangalore18h ago
-
Mid-level Full TimeIndia18h ago
-
Lead Data Platform Engineer INR 3000K-4000KAPI Gateway | AWS | AWS API | AWS API Gateway | AWS DataZoneEnhanced medical benefits | Family wellbeing benefits | Hybrid work | Paid time off | Wellbeing and safety benefitsSenior-level Full TimeHyderabad, India19h ago
-
AWS | Agent Orchestration | Agent memory | Agent observability | Agent planningMid-level Full TimeHinjawadi, MH, India22h ago
-
Senior-level Full TimeBengaluru, Karnataka, India22h ago
-
Cognitive Engineer INR 1500K-3000KAPI Integration | Agent architecture | Application Default Credentials | Asynchronous programming | Automated testingMid-level Full TimeIndia22h ago
-
Staff Software Engineer - AI Engineer INR 2500K-4800KA/B | A/B Testing | API Design | AWS | Agent OrchestrationSenior-level Full TimeBengaluru, Karnataka, India22h ago