Data Engineering Lead - Cogentiq: I2C Platform
Tasks
- Build batch and real-time data pipelines
- Build labeled datasets and feature engineering frameworks
- Conduct design reviews and enforce data standards
- Create AI-ready datasets
- Define audit trails lineage and compliance controls
- Define end-to-end data architecture
- Design canonical data models
- Develop data KPI dashboards
- Enable feedback loops for model improvement
- Enforce role based access and data security
- Ensure financial data accuracy and consistency
- Establish data lake and warehouse strategy
- Implement data transformation normalization and enrichment
- Implement data validation reconciliation and monitoring
- Ingest data from ERP banking email EDI SFTP and customer portals
- Lead and manage data engineering team
- Support near real-time reporting
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Access Control | Amazon Redshift | Apache Airflow | Apache Kafka | Apache Spark | Audit trails | Azure | Data Governance | Data Lineage | Data Modeling | Data Pipelines | Data Quality | Data Security | Data Validation | Data Warehousing | ELT | ETL | Event-driven architecture | Feature Engineering | Google BigQuery | Google Cloud | Machine Learning | Machine learning data | Machine learning data pipelines | Python | Real Time | Real-time event-driven architecture | Role-Based Access | Role-Based Access Control | SQL | Snowflake
Education
N/A
Related jobs
-
Principal AI Engineer INR 2000K-4500KAPI Integration | AWS Bedrock | Agent Orchestration | CI/CD | Deep learningSenior-level Full TimeBangalore, KA, IN7h ago
-
Lead AI Software Engineer INR 2000K-4500KAI Agents | AWS | Azure | CI/CD | Cloud platformCareer growth | Career growth in technology domain | Continuous learningSenior-level Full TimePune City, India17h ago
-
Senior-level Full TimeIndia20h ago
-
Data Integration Lead INR 1500K-2500KCICD | Control-M | IBM InfoSphere | IBM Infosphere DataStage | InfoSphere-DataStageClient facing communication | Production support experienceSenior-level Full TimeIndia20h ago
-
Amaze - Cloud Data Architect INR 1200K-2000KApache Airflow | Azure | Integration Services | Java | Power BISenior-level Full TimeIndia20h ago
-
CLOUD AMAZE - DW Lead (Practice) INR 1500K-2500KAzure | Azure Databricks | Cloud Computing | Data Architecture | Data EngineeringSenior-level Full TimeIndia21h ago
-
Data Integration Lead INR 1500K-3000KData Standardization | Data Validation | Data extraction | HTML | IXBRLSenior-level Full TimeIndia21h ago
-
Senior-level Full TimeIndia21h ago
-
Senior-level Full TimeIndia22h ago
-
Lead Data Scientist INR 3000K-4000KAWS | Azure | Classification | Clustering | Experiment designFlexibility | Health benefitsSenior-level Full TimePune City,India R23h ago
-
Mid-level Full TimeHyderabad, Telangana, India1d ago
-
Lead Data Scientist-Digital Banking Kotak 811-Regional Sales INR 3000K-4000KCI/CD | Data Analysis | Deep learning | Experiment design | Exploratory Data AnalysisSenior-level Full TimeBangalore, Karnataka, India1d ago
-
Lead Data Architect INR 1500K-2500KAWS | Agile | Amazon Redshift | Apache Spark | BigQueryRelocationSenior-level Full TimeIND - Bangalore, India1d ago
-
Lead AI Engineer INR 2500K-3500KAgent Development | Debugging | Incident Response | LLM API | Language ModelGrowth and innovation | Hybrid work policy | Inclusive company culture | Remote work option | Self-directionSenior-level Full TimeNoida, India R1d ago
-
IN_Manager_Data Analyst_Digital Integration_Advisory_Kolkata INR 1400K-2300KAlation | Azure Data | Azure Data Services | Azure Purview | CollibraFlexible working | Inclusive benefits programs | Mentorship | Wellbeing supportMid-level Full TimeKolkata DN 57, India1d ago
-
Director Data Engineering INR 3000K-6000KAPI Management | APIs | Azure API | Azure API Management | Azure DataExecutive-level Full TimeBangalore, India1d ago
-
Experienced Lead engineer in Storage/Networking domain INR 1500K-2772KAccess Control | Algorithms | BGP | Cloud Architecture | Data StructuresHealth and wellbeing benefits | Hybrid work | Inclusive workplace | Professional developmentSenior-level Full TimeBengaluru, Karnātaka, India1d ago
-
Lead Data Science Consultant INR 1880K-2436KAWS | Agile | Azure | Cloud Computing | Credit RiskEqual opportunity workplace | Onsite 3 days per weekSenior-level Full Time111442-IND-BENGALURU-INTL BLR BLK B3 PETUNIA, India1d ago
-
Senior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India1d ago
-
Lead Software Engineer - Full Stack Developer and Gen AI INR 2500K-3465KAngular | Azure DevOps | C# | CI/CD | ContainerizationSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India1d ago
-
Lead Engineer INR 2500K-4800KAI Platform | Agile | Automation | Cloud Computing | Code generationAccident insurance | Certification sponsorship | Childcare assistance reimbursement | Employee assistance program | Flexible leave policySenior-level Full TimeBangalore, Velankani Tech Park, India1d ago
-
Lead Consultant - Bespoke Engineering & AI Innovation INR 2475K-4800KAWS | Autogen | Azure | Bicep | CI/CDSenior-level Full TimeIndia - Chennai1d ago
-
IN-Manager_Scrum Master_Data and Analytics_Advisory_Hyderabad INR 1500K-2000KAWS | Agile | Azure | Azure DevOps | Daily standupMid-level Full TimeHyderabad - Salarpuria, India1d ago
-
IN_Manager_Data Analyst_Digital Integration_Advisory_Kolkata INR 1400K-2300KAlation | Azure Purview | Collibra | DBT | Data ModelingEmployee wellbeing support | Flexibility programs | Inclusive benefits | MentorshipMid-level Full TimeKolkata DN 57, India1d ago
-
Data Platforms and AI Access Control Lead INR 2475K-3380KAI Security | API Security | Access Control | Access Management | Access deprovisioningSenior-level Full TimeBengaluru Campus 31, India1d ago