Data Engineering Lead - Cogentiq: I2C Platform
Tasks
- Build batch and real-time data pipelines
- Build labeled datasets and feature engineering frameworks
- Conduct design reviews and enforce data standards
- Create AI-ready datasets
- Define audit trails lineage and compliance controls
- Define end-to-end data architecture
- Design canonical data models
- Develop data KPI dashboards
- Enable feedback loops for model improvement
- Enforce role based access and data security
- Ensure financial data accuracy and consistency
- Establish data lake and warehouse strategy
- Implement data transformation normalization and enrichment
- Implement data validation reconciliation and monitoring
- Ingest data from ERP banking email EDI SFTP and customer portals
- Lead and manage data engineering team
- Support near real-time reporting
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Access Control | Amazon Redshift | Apache Airflow | Apache Kafka | Apache Spark | Audit trails | Azure | Data Governance | Data Lineage | Data Modeling | Data Pipelines | Data Quality | Data Security | Data Validation | Data Warehousing | ELT | ETL | Event-driven architecture | Feature Engineering | Google BigQuery | Google Cloud | Machine Learning | Machine learning data | Machine learning data pipelines | Python | Real Time | Real-time event-driven architecture | Role-Based Access | Role-Based Access Control | SQL | Snowflake
Education
N/A
Related jobs
-
Gen AI INR 2500K-4500KAWS | Agent systems | Airflow | Asynchronous programming | Attention MechanismsSenior-level Full TimeIN-KA-Bangalore16h ago
-
AI Engineering Lead INR 2475K-4500KAWS | AWS Bedrock | Agentic Workflows | Azure | Azure Prompt FlowCompany-provided equipment | English lessons | Flexible working options | Learning opportunities | Mentorship programsSenior-level Full TimeHyderabad, TS, India18h ago
-
Lead Data Scientist INR 2520K-3380KApache Hadoop | Artificial Intelligence | Azure Kubernetes | Azure Kubernetes Service | Azure Machine LearningEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeVadodara, GJ, India19h ago
-
Lead Software Engineer - Apache Spark, AWS INR 2000K-4500KAWS | Agile methodology | Amazon Kafka | Apache Airflow | Apache SparkSenior-level Full TimeBengaluru, Karnataka, India19h ago
-
Lead software engineer (Full stack - Java) INR 2520K-3200KAWS | ActiveMQ | Agile | Artificial Intelligence | Automated testingDevelopment opportunities | Reward and recognition | Volunteering | Wellness | Work-life balanceSenior-level Full TimeHyderabad, India22h ago
-
Global HR Reporting and Analytics Lead (Workday reporting) INR 3000K-4000KBusiness Intelligence | Data Architecture | Data Governance | Data Privacy | Data QualityCoaching and mentoring | Training and developmentSenior-level Full TimeDelhi, India1d ago
-
Lead Data Scientist INR 2475K-3465KAdvanced Analytics | Agile | Artificial Intelligence | Cloud Computing | Data ArchitectureFlexible work environment | Internal mobility | Volunteering opportunities | Well-being programs | Work-life balanceSenior-level Full TimeKA Bangalore, India1d ago
-
Lead Developer, Java and MLOPs INR 2000K-4000KAWS | Angular | CI/CD | Distributed Systems | DockerHybrid work | In person work 2 days per week | Virtual workSenior-level Full TimeBengaluru, India1d ago
-
Mid-level Full TimeIND07, India1d ago
-
Principal Data Engineer - Commercial Effectiveness INR 3000K-4000KAgile | Ansible | Apache Airflow | Apache Spark | Azure DataSenior-level Full TimeBengaluru Campus 31, India1d ago
-
Lead AI Engineer INR 2500K-4800KAPI Design | AWS | CI/CD | Containerization | Cost OptimizationDisability programs | Flexible working hours | Life insurance | Private medical care | Wellbeing activitiesSenior-level Full TimeIN-KA-BANGALORE-NEON BUILDING WEST TOWER, India1d ago
-
Lead Data Analyst, Cloud FinOps INR 2000K-3000KAPI Development | API Integration | AWS Athena | AWS Cost and Usage Report | AWS FinOpsHybrid work scheduleSenior-level Full TimeBangalore, India1d ago
-
TM Analytics Lead INR 2000K-3500KAML Transaction Monitoring | Data Management | Data Visualization | Financial Crime Compliance | Financial crimeSenior-level Full TimeNoida, Candor TechSpace, India1d ago
-
GenAI Support Lead - Manager INR 2000K-3500KAI Agents | AI Safety | AI workflows | API Testing | BenchmarkingEmployee networks | Flexible work/life support | Hybrid work model | Paid volunteer daysSenior-level Full TimeHyderabad, India1d ago
-
Advanced Engineer: ML, LLM, NLP, RAG INR 2500K-3465KAWS | Audio Processing | Azure | CI/CD | Cloud platformEmployee discounts | Flexible work environment | Remote work options | Training opportunities | Tuition reimbursementSenior-level Full TimeIN Bangalore Sattva Knowledge Court Bdg … R1d ago
-
Payments Data Lead Engineer INR 3000K-4000KAutomation | Batch Processing | CI/CD | Cause analysis | Data EngineeringSenior-level Full TimePune, Gera Commerzone SEZ, India1d ago
-
Manager of Software Engineering-Java, Flink,Kafka INR 1000K-2400KAWS | Agile methodologies | Amazon EKS | Apache Flink | Apache KafkaMid-level Full TimeHyderabad, Telangana, India1d ago
-
Data Science Research Lead, Ads Insights and Measurement INR 2516K-3356KCausal Inference | Data models | Difference-in-differences | Differential Privacy | Fixed effectsSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Lead Software Engineer - Data Engineer INR 1500K-2400KABAC | AWS | AWS Glue | AWS Lambda | AWS Step FunctionsSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Senior Software Engineer-Python INR 3000K-4000KAccess Control | Alerting | Apache Spark | Azure | CI/CDBirthday off | Flexible working hours | Personal flexibilitySenior-level Full TimeGurgaon1d ago
-
Director, Data Quality Insights (R-19228) INR 1800K-2000KAgile | Application development | Audit management | CI/CD | Data EngineeringExecutive-level Full TimeHyderabad - India1d ago
-
Lead Agentic AI & Java Integration Engineer INR 2500K-4000KData Privacy | DeepEval | Distributed Systems | Embeddings | Event DrivenSenior-level Full TimeBangalore, KA, IN2d ago
-
Lead Agentic AI & Java Integration Engineer INR 2500K-4200KDeepEval | Distributed Systems | Embeddings | Event Driven | Event-driven architectureSenior-level Full TimeBangalore, KA, IN2d ago
-
SMTS/LMTS - AI ML Engineers INR 2211K-3500KAI Trust Layer | AI trust | Benchmarking | Context engineering | Continuous Deployment1-on-1 coaching | Adoption Assistance | Fertility benefits | Generous parental leave | On-demand trainingSenior-level Full TimeIndia - Bangalore2d ago
-
Data Platform Operations Service Manager INR 1500K-2205KAI Platform | Agile | As-a-Service | Azure AI | Azure AI PlatformMid-level Full TimeBengaluru Campus 31, India2d ago