Data engineering lead
INR 3000K-4000K (estimate) Senior-level Full Time
Tasks
- Build and optimize scalable data pipelines
- Conduct architecture reviews and code quality governance
- Create engineering standards testing frameworks and release readiness
- Define technical roadmaps and execution plans
- Drive agile delivery reuse automation and operational stability
- Enable analytics BI and AI ML use cases with governed data assets
- Ensure data quality, governance, and lineage
- Implement observability error handling retries and checkpointing
- Lead and mentor data engineering team
- Lead data architecture design and implementation
- Manage cluster configuration autoscaling caching and tuning
- Optimize Spark performance and platform reliability
- Oversee end to end data lifecycle accuracy and timeliness
- Partner with stakeholders to clarify requirements and acceptance criteria
- Redesign pipelines and storage for performance and cost
Perks/Benefits
- N/A
Skills/Tech-stack
AWS DMS | AWS Lambda | AWS Step Functions | Amazon Aurora | Amazon CloudWatch | Amazon EventBridge | Amazon S3 | Apache Spark | Autoscaling | CI/CD | Caching | Checkpointing | Cluster configuration | Data Governance | Data Lakes | Data Lineage | Data Modeling | Data Quality | Data Reconciliation | Data Warehouses | Database Architecture | Databricks | Databricks Unity | Databricks Unity Catalog | Delta Lake | Delta Lakehouse | Delta Sharing | Dimensional data | Dimensional data modeling | ETL | Git | GitHub Actions | Observability | Partitioning | PySpark | Python | Retry Mechanisms | SLAs | SLO | SQL | Spark Structured Streaming | Step Functions | Storage Optimization | Structured Streaming | Unity Catalog | Version control | Z-ordering
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Data Engineer | Data Engineering | Data Engineering Lead | Engineer | Engineering Lead | Lead
Related jobs
-
Machine Learning Engineer V INR 6866K-12359KAPIs | Agentic Workflows | Asynchronous Workflows | Classification | Cloud NativeBonuses | Disability insurance | Life insurance | Paid parental leave | Paid time offSenior-level Full TimeRemote, India R7h ago
-
Senior-level Full TimeIN-TN-Chennai13h ago
-
Senior-level Full TimeIN-MH-Pune13h ago
-
Data Engineer - Python /GenAI INR 2000K-3000KData Engineering | Distributed Systems | Generative AI | Language Models | Large Language ModelsSenior-level Full TimeIN-MH-Pune13h ago
-
Data Engineer - Python /GenAI INR 2000K-3000KData Engineering | Deep learning | Distributed Systems | GenAI | LLMSenior-level Full TimeIN-MH-Pune13h ago
-
Data Engineer - Python /GenAI INR 2000K-3000KData Engineering | Distributed Systems | Generative AI | LLM | Machine LearningSenior-level Full TimeIN-MH-Pune13h ago
-
Data Engineer - Python /GenAI INR 2000K-3000KData Engineering | Distributed Systems | Generative AI | Inference | LLMSenior-level Full TimeIN-MH-Pune13h ago
-
Senior-level Full TimeIN-TN-Chennai13h ago
-
Senior-level Full TimeIN-TN-Chennai13h ago
-
Senior-level Full TimeIN-TN-Chennai13h ago
-
PL/SQL Developer INR 1200K-2400KBackup & Recovery | CI/CD | Data Modeling | Data Quality | Database InternalsSenior-level Full TimeIN-TN-Chennai13h ago
-
Data Engineer - Python /GenAI INR 2000K-3000KData Engineering | Deep learning | Distributed Systems | GenAI | LLM-OpsSenior-level Full TimeIN-MH-Pune13h ago
-
Agentic Data Delivery Lead INR 3000K-5000KAI Governance | AWS | Access Control | Agent systems | Apache HadoopSenior-level Full TimePune, Maharashtra, India13h ago
-
Azure Data Engineer INR 1500K-2000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Functions | Azure SynapseHybrid work modeSenior-level Full TimeNoida, Uttar Pradesh, India13h ago
-
Software Engineer III - (ADLC , Python) INR 3000K-4000KAWS | Agile | Architecture | CI/CD | Data VisualizationSenior-level Full TimeHyderabad, Telangana, India14h ago
-
Data Engineer, Global Affairs INR 1500K-2500KArtificial Intelligence | Big Data | C++ | Cloud platform | Data PipelinesMid-level Full TimeHyderabad, Telangana, India14h ago
-
Principal Engineer, Python fullstack (React+Genai) INR 3000K-5000KAPI Integration | AWS | Agent Orchestration | Azure | ComplianceSenior-level Full TimeRemote, India R14h ago
-
DE&A - Core - Big Data Engineering - Hadoop Ecosystem INR 3000K-4200KAPI | AWS | Apache Hadoop | Apache Spark | AzureSenior-level Full TimePune, Maharashtra, India15h ago
-
AES - DE - Generative AI Prompt Engineers INR 2000K-3500KAnthropic API | Azure OpenAI | CI/CD | Code Analysis | Cost controlsMid-level Full TimePune, Maharashtra, India15h ago
-
Data Engineer INR 704K-2000KAPIs | Batch Processing | CDP | Customer Data | Customer Data PlatformAgile culture | Documentation | Knowledge sharingMid-level Full TimeIndia15h ago
-
AI/ML Engineer INR 2500K-3885KAzure | Deep learning | DeepSpeed | Distributed Systems | DockerCar lease | Certification programs | Corporate pension scheme | Dental & vision coverage | Education reimbursementMid-level Full TimeBangalore, Karnataka, India16h ago
-
Principal Engineer, Machine Learning INR 4000K-5000KArtificial Intelligence | Computer Vision | Deep learning | Docker | Foundation ModelsSenior-level Full TimeRemote, India R16h ago
-
Associate Principal Engineer, Machine Learning INR 1800K-3300KAdversarial Networks | Agent Orchestration | Agent systems | Computer Vision | Deep learningMid-level Full TimeRemote, India R16h ago
-
Data Engineer INR 3000K-4000KAWS | Data Architecture | Data Governance | Data Modeling | Data MonitoringBike to work | Career progression | Educational assistance | Employee assistance program | Employee discountMid-level Full TimeBengaluru, KA, India16h ago
-
Senior-level Full Time Part Timebangalore, India16h ago