Senior Data Engineer
Tasks
- Align data structures with business processes
- Create and maintain data models and schema designs
- Design scalable cloud-native data pipelines
- Develop and optimize ETL/ELT workflows
- Ensure data quality lineage governance and observability
- Implement ingestion frameworks using messaging and REST APIs
- Integrate DTCC data sources into unified trade record schema
- Optimize SQL Server queries indexing and performance
- Populate and maintain trade exceptions databases
- Process and normalize financial messages including ISO 15022
- Troubleshoot data issues and provide trade discrepancy insights
Perks/Benefits
- N/A
Skills/Tech-stack
API Integration | AWS | Amazon EKS | Amazon RDS | Amazon S3 | Data Governance | Data Lineage | Data Modeling | Data Observability | Data Quality | ELT | ETL | IBM MQ | ISO 15022 | Kafka | Messaging Systems | REST API | SQL | SQL Server | Schema Design | Stored Procedures
Education
N/A
Roles
Related jobs
-
Asst Mgr - AI Solutions INR 96K-180KAPIs | Artificial Intelligence | Feature Engineering | Generative AI | GitEntry-level Full TimeMumbai A.O, MUM-KND-AFS(FD), IN3h ago
-
Senior Data Engineer INR 3000K-4000KAPI Development | AWS | Algorithms | Amazon Redshift | AzureDiscounted gym memberships | Flexible working | Hybrid working | Life assurance | Life assurance and community involvementSenior-level Full TimeHyderabad, India3h ago
-
API Gateway | AWS CloudWatch | AWS Cost Optimization | AWS Glue | AWS LambdaCollaborative environment | Continuing education | Growth opportunities | Professional training opportunities | Remote work flexibilitySenior-level Full TimeIndia6h ago
-
Senior-level Full TimeIN Office Bangalore7h ago
-
Lead AI Engineer INR 3000K-5500KAI Governance | API Integration | Agent Orchestration | Agent systems | Clause ExtractionSenior-level Full TimeIND-Bangalore, India10h ago
-
Senior Data Engineer INR 3000K-4000KAWS Glue | AWS IAM | AWS Lambda | AWS S3 | AWS SQSEquity | Health coverage | Paid leaveSenior-level Full TimePune, India12h ago
-
Senior Software Engineer - Data Platform INR 3222K-4200KBackend Development | Data Engineering | Data Modeling | Data Pipelines | Dimensional dataCollaborative team environment | Continuous learning culture | Ownership and impactSenior-level Full TimeBangalore15h ago
-
Senior Data Engineer INR 2000K-4000KARM | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageCross-functional collaboration | Mentorship | Self service analytics enablement | Technical leadershipSenior-level Full TimeBangalore17h ago
-
Mid-level Full TimeIndia17h ago
-
Lead Data Platform Engineer INR 3000K-4000KAPI Gateway | AWS | AWS API | AWS API Gateway | AWS DataZoneEnhanced medical benefits | Family wellbeing benefits | Hybrid work | Paid time off | Wellbeing and safety benefitsSenior-level Full TimeHyderabad, India19h ago
-
AWS | Agent Orchestration | Agent memory | Agent observability | Agent planningMid-level Full TimeHinjawadi, MH, India21h ago
-
Senior-level Full TimeBengaluru, Karnataka, India21h ago
-
Cognitive Engineer INR 1500K-3000KAPI Integration | Agent architecture | Application Default Credentials | Asynchronous programming | Automated testingMid-level Full TimeIndia22h ago
-
Staff Software Engineer - AI Engineer INR 2500K-4800KA/B | A/B Testing | API Design | AWS | Agent OrchestrationSenior-level Full TimeBengaluru, Karnataka, India22h ago
-
Software Engineering - Data, Lakehouse and AI Data Platform Engineer-Hyderabad-Vice President INR 3000K-6000KApache Iceberg | Apache Spark | Avro | CI/CD | ContainerizationExecutive-level Full TimeBengaluru, Karnataka, India22h ago
-
Senior Software Engineer - AI Platform INR 2500K-4800KA/B | A/B Testing | AWS | Airflow | Audit trailsSenior-level Full TimeBengaluru, Karnataka, India22h ago
-
Senior-level Full TimeBengaluru, Karnataka, India22h ago
-
Senior-level Full TimeIndia22h ago
-
Staff Software Development Test Engineer INR 1632K-3000KAPI Testing | Cause analysis | Data Lake | Data Modeling | Data PipelinesSenior-level Full TimeBengaluru, Karnataka, India22h ago
-
Senior Software Development Test Engineer INR 2000K-3000KAPI Testing | Cause analysis | Data Lineage | Data Pipeline Testing | Data QualitySenior-level Full TimeBengaluru, Karnataka, India22h ago
-
Applied AI/ML Senior Associate INR 3799K-5000KApache Hive | Apache Spark | Keras | Language Processing | Machine LearningSenior-level Full TimeBengaluru, Karnataka, India23h ago
-
Data Engineer INR 2000K-3000KAWS | Airflow | DBT | Kubernetes | Performance TuningCareer growth opportunities | High visibility work | Open source contributionsMid-level Full TimeBengaluru23h ago
-
AWS | AWS Lake Formation | AWS Lambda | Airflow | Amazon EMRCareer development opportunities | Employee Assistance Program (EAP) | Financial wellness tools | Flexible working environment | LinkedIn LearningSenior-level Full TimePune, MH, India1d ago
-
Senior Engineer- Fullstack INR 2475K-5000KAPIs | Analytics | Backend Services | Data Modeling | Data correctnessHybrid work schedule | In person collaboration three days per weekSenior-level Full TimeBangalore, Karnataka, India R1d ago
-
Lead Software Engineer - Java, AWS, React INR 2500K-5000KAWS | Agile | Analysis and Design | Asynchronous Communication | Automated testingSenior-level Full TimeHyderabad, Telangana, India1d ago