Technical Lead - Data Engineer (Data&AI)
Tasks
- Build and manage data pipelines with Apache Airflow
- Collaborate with data scientists on ML readiness
- Design and manage internal REST APIs
- Design data models and integration frameworks
- Develop and optimize data processing applications
- Enforce data governance and data quality
- Implement Change Data Capture
- Implement monitoring and logging
- Ingest data from third-party APIs
- Lead ETL/ELT pipeline development
- Manage Dockerized application deployments
- Mentor team members through technical leadership
- Orchestrate services with Kubernetes
- Own CI/CD pipelines
- Process batch and streaming data
- Support MLOps model lifecycle alignment
- Use Airbyte for data integration
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Airbyte | Apache Airflow | Azure | CI/CD | Change Data Capture | Data Capture | Data Governance | Data Quality | Databricks | Datadog | Delta Lake | Docker | Dynatrace | ELT | ETL | FastAPI | Flask | Git | GitLab | Kafka | Kubernetes | MLOps | Machine Learning | Python | REST API | SQL | Snowflake | Spark Streaming | Splunk | Streaming Data
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Senior Data Engineer INR 1500K-2600KDBT | Data Marts | Data Modeling | Data Quality | Data ReconciliationSenior-level Full TimeBangalore, KA, IN, 5600763h ago
-
Senior Software Engineer, Machine Learning INR 3600K-5400KA/B | A/B Testing | Amazon S3 | Apache Airflow | B testingDental insurance | Financial wellness support | Health insurance | Mental health support | Paid time offSenior-level Full TimeBengaluru, India R4h ago
-
Senior Staff Engineer INR 2500K-4000KAlgorithms | Amazon Web Services | Big Data | Cloud Computing | Code reviewCustomer-focused culture | Flexible work arrangementsSenior-level Full TimeBangalore4h ago
-
Senior Software Engineer(AI/ML), Trust INR 4500K-6500KA/B | A/B Testing | Anomaly Detection | Apache Airflow | Apache KafkaSenior-level Full TimeBangalore, India5h ago
-
Senior-level Full TimeGurugram, India5h ago
-
Apache Airflow | Apache Spark | Batch Processing | Cloud infrastructure | Data GovernanceHigh impact ownership | Professional growth opportunities | Remote first working environment | Technical leadership opportunitiesSenior-level Contract Full TimeIndia6h ago
-
ABAP | BDC | Business Intelligence | Data Modeling | Data PipelinesCareer development | Employee communities | Global onboarding | Health insurance | Hybrid workSenior-level Full TimeIndia R6h ago
-
API Versioning | Asynchronous processing | Authentication | CI/CD | CeleryCollaborate with backend and frontend teams | Full-time employment | Fully remote | Hands on experience with production LLM and VLM systems | Work on AI infrastructure model routing and microservicesMid-level Full TimeIndia R7h ago
-
ACID transactions | Apache Spark | Azure Data | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeIndia8h ago
-
CI/CD | Deep learning | Edge Computing | Experiment tracking | Hugging FaceSenior-level Full TimeIndia8h ago
-
Associate Director, Machine Learning Engineering INR 1000K-1890KAmazon Web Services | Computer Vision | Data Preprocessing | Deep learning | Feature EngineeringContinuing education program | Continuous learning | Family-friendly perks | Financial wellness programs | Flexible time offMid-level Full TimeIN - GURUGRAM DLF DOWNTOWN BLOCK …14h ago
-
Agentic AI Engineer (ITSM & Enterprise Automation) INR 2515K-4680KAPI Authentication | Artificial Intelligence | Authentication | Authorization | Change ManagementCareer growth and developmentSenior-level Full TimePune15h ago
-
Agentic AI Engineer (ITSM & Enterprise Automation) INR 2500K-4680KAPI Authentication | API authorization | Asynchronous Workflows | Authentication | AuthorizationAnnual bonus opportunity | Career growth and development | Flexible work arrangementSenior-level Full TimePune15h ago
-
Machine Learning Engineer IV INR 4443K-7998KAPIs | Batch Processing | Cost Optimization | Distributed Systems | EmbeddingsBonuses | Disability insurance | Health insurance | Life insurance | Paid parental leaveSenior-level Full TimePune, India R15h ago
-
ML Developer (with Computer Vision) INR 3000K-5000KAWS | Algorithms | Azure | Computer Vision | Convolutional Neural NetworksMid-level Full TimePune City, India18h ago
-
Lead Agentic AI Engineer ID80141 INR 2500K-5000KAgentic AI | Amazon Web Services | Azure | CI/CD | Cloud SecurityAnnual learning budget | Flexible hours | Growth opportunities | Internal TechTalks | MentorshipSenior-level Full TimeKolkata, India18h ago
-
Lead Agentic AI Engineer ID80141 INR 2500K-5000KAPI Integration | AWS | Anthropic | Azure | CI/CDAnnual learning budget | Flexible hours | Internal technical talks | Mentorship | People focused supportSenior-level Full TimeNoida, India18h ago
-
Lead Agentic AI Engineer ID80141 INR 2500K-5000KAWS | AWS S3 | Azure | CI/CD | Cloud SecurityCollaborative culture | Flexible hours | Internal TechTalks | Learning budget | MentorshipSenior-level Full TimeTrivandrum, India18h ago
-
Lead Agentic AI Engineer ID80141 INR 2500K-5000KAWS | Agentic AI | Azure | CI/CD | Cloud SecurityCollaborative culture | Flexible hours | Internal technical talks | Learning budget | MentorshipSenior-level Full TimeHyderabad, India18h ago
-
Lead Agentic AI Engineer ID80141 JPY 8600K-10000KAWS | Agentic AI | Azure | CI/CD | Cloud SecurityAnnual learning budget | Flexible hours | Internal tech talks | Mentorship | Performance and compensation reviewsSenior-level Full TimeKochi, India18h ago
-
Lead Agentic AI Engineer ID80141 INR 2500K-5000KAWS | Agentic AI | Azure | CI/CD | Cloud infrastructureFlexible hours | Internal technical talks | Learning budget | Mentorship | People focused supportSenior-level Full TimeNew Delhi, India18h ago
-
Lead Agentic AI Engineer ID80141 INR 2500K-5000KAWS | Azure | CI/CD | Cloud Security | Cloud infrastructureCollaborative culture | Flexible hours | Internal tech talks | Learning budget | MentorshipSenior-level Full TimeMumbai, India18h ago
-
Lead Agentic AI Engineer ID80141 INR 2500K-5000KAWS | Agentic AI | Azure | CI/CD | Cloud SecurityChallenging projects | Collaborative culture | Flexible hours | Internal TechTalks | Learning budgetSenior-level Full TimeBangalore North, India18h ago
-
Lead Agentic AI Engineer ID80141 INR 2500K-5000KAWS | Agentic AI | Azure | CI/CD | Cloud SecurityAnnual learning budget | Collaborative culture | Flexible hours | Internal TechTalks | MentorshipSenior-level Full TimeCoimbatore South, India18h ago
-
Lead Agentic AI Engineer ID80141 INR 2500K-5000KAWS | Agentic Models | Azure | CI/CD | Cloud SecurityAutonomy | Challenging projects | Collaborative culture | Flexible hours | Internal TechTalksSenior-level Full TimeChennai, India18h ago