Data Engineer
Tasks
- Collaborate with business stakeholders to align data structures
- Create and maintain data models and schema designs
- Design scalable cloud native data pipelines for trade lifecycle processing
- Develop and optimize ETL/ELT workflows
- Ensure data quality lineage governance and observability
- Implement ingestion frameworks using messaging and API extraction
- Integrate DTCC data sources into unified trade record schema
- Optimize SQL Server queries indexing and database performance
- Populate and maintain trade exceptions databases
- Process and normalize financial messages including ISO 15022
- Troubleshoot data issues and provide insights for trade discrepancies
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Amazon EKS | Amazon RDS | Amazon S3 | Data Governance | Data Lineage | Data Modeling | Data Observability | Data Processing | Data Quality | Docker | ELT | ETL | ISO 15022 | Indexing | Kafka | Kubernetes | MQ | REST APIs | Real Time | Real-time Data | Real-time Data Processing | SQL Server | Schema Design | Stored Procedures
Education
N/A
Roles
Related jobs
-
Senior-level Full TimeBangalore, KA, IN, 5600762h ago
-
Associate Consultant_AI/ML Engineer INR 1000K-2000KAI Evaluation | AI Planning | AI Planning and Orchestration | AI Safety | Agent architecturesMid-level Full TimeHyderabad, IN, 5000812h ago
-
Senior Data Engineer (Managed Services) INR 1500K-3000KAutomation | Azure | Azure Data | Azure Data Factory | Azure SynapseCareer growth and progression | Company bonus scheme | Comprehensive benefits package | Hybrid work schedule | Inclusive cultureSenior-level Full TimeHyderabad, Telangana, India R5h ago
-
Data Engineer INR 3600K-4720KAWS Glue | AWS IAM | AWS Lambda | AWS S3 | Airbyte401k match | Catered lunches | Comprehensive healthcare | Flexible vacation | HSA contributionsSenior-level Full TimeIndia | Pune13h ago
-
Sr Software Engineer INR 1500K-2700KAgile | Cloud services | Code review | Data Modeling | Design PatternsSenior-level Full TimePune, India14h ago
-
Software Engineer INR 1500K-2000KAgile | Cloud Computing | Code review | Data Modeling | Design PatternsMid-level Full TimePune, India14h ago
-
Sr Software Engineer INR 1500K-2700KAgile | Cloud services | Code review | Data Model | Data ModelingSenior-level Full TimePune, India14h ago
-
Senior-level Full TimeKochi, India18h ago
-
DevOps Engineer (AI Platform) INR 2000K-4800KAccess Control | Application Insights | Azure DevOps | Bicep | Cloud NetworkingSenior-level Full TimePune, Maharashtra, India18h ago
-
ML Developer (with Computer Vision Expertise)- Eurasia INR 2500K-5000KAWS | Adversarial Networks | Algorithms | Azure | Convolutional Neural NetworksSenior-level Full TimePune City, India18h ago
-
Software Developer (AIML) INR 1800K-2700KAWS | Azure | CI/CD | Computer Vision | Convolutional Neural NetworksFlexible working hours | Growth and learning | Referral bonus | Team building events | Training and booksMid-level Full TimePune, India18h ago
-
Data Science - AI ML INR 2500K-5000KAWS | Azure | Bayesian Models | Campaign Optimization | ChatbotsSenior-level Full TimeGurgaon, HR, India19h ago
-
Engineer - Generative AI INR 1860K-4000KAPI Design | API Gateway | AWS CloudWatch | AWS Lambda | Amazon APIHealth and wellness benefits | Route network access | Team collaboration | Travel opportunitiesMid-level Full TimeGurugram, Haryana, India19h ago
-
Senior-level Full TimePune, Maharashtra, India21h ago
-
AI and Automation Engineer INR 2000K-4800KAI Security | BigQuery | Chain-of-Thought | Claude API | Cloud FunctionsAnnual leave | Casual leave | Public holidays | Sick leaveSenior-level Full TimeGurugram, India21h ago
-
Lead - Data Scientist INR 2500K-4720KAnomaly Detection | Cloud Computing | Data Governance | Deep learning | DevSecOpsCareer development opportunities | Inclusive workplace | Mentoring and team developmentSenior-level Full TimeNoida,Uttar Pradesh,India R21h ago
-
Sr.Data Engineering INR 1500K-2500KAzure | Azure Data | Azure Data Factory | Azure Databricks | Azure Key VaultSenior-level Full Timebengaluru, India21h ago
-
Associate Consultant - Data Engineer(Python/Pyspark) INR 1500K-2200KAgile | Azure | Azure Data | Azure Data Factory | Azure Data LakeMid-level Full TimeBangalore, Karnataka, India22h ago
-
Staff Software Engineer, Data Platform INR 3700K-4600KAmazon Kinesis | Apache Beam | Apache Flink | Apache Kafka | Apache MesosSenior-level Full TimeBengaluru, India R22h ago
-
Bi Data Analyst (6-9 YRS)- CHN/BLR INR 1500K-3000KClassification | Data Modeling | Data Visualization | Decision Trees | Deep learningSenior-level Full TimeIndia23h ago
-
Engineering Lead - Data & Analytics INR 1600K-3000KAWS | Agentic Analytics | Agile | Artificial Intelligence | Automated DeploymentSenior-level Full TimePune, MAHĀRĀSHTRA, India23h ago
-
Java Fullstack Engineer with GenAI & React INR 1500K-2500KAgile Development | Azure | Design Patterns | Docker | Extreme programmingEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India1d ago
-
Data Scientist INR 1800K-3000KApache Spark | Artificial neural networks | Chunking | Data Structures | Deep learningMid-level Full TimeKarnataka, India1d ago
-
Senior-level Full TimeMumbai, Maharashtra, India1d ago
-
Data Engineer III INR 2000K-3000KAI tools | Data Modeling | Data Pipelines | Data analytics | NoSQLSenior-level Full TimeBengaluru, Karnataka, India1d ago