Lead Data Engineer (Databricks)
Hybrid (Bengaluru, Karnataka, IN)
R
INR 2400K-3900K (estimate) Senior-level Full Time
Tasks
- Architect for scale and reliability
- Build data pipelines
- Champion DataOps practices
- Conduct code review
- Create infrastructure as code
- Design Lakehouse architecture
- Identify delivery blockers
- Implement CI/CD
- Implement automated testing
- Implement pipeline observability
- Lead client data engagements
- Manage delivery timelines
- Manage technical scope
- Manage version control
- Mentor data engineers
- Own data platform architecture
- Productionize data solutions
- Promote knowledge sharing
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | AWS Redshift | Amazon S3 | Apache Spark | Automated testing | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Synapse | CI/CD | Cloud Dataflow | Cloud Storage | Data Factory | Data Lake Storage | Data Modeling | Data Warehousing | DataOps | Databricks | Databricks Workflows | Delta Lake | ELT | ETL | Google BigQuery | Google Cloud | Google Cloud Dataflow | Google Cloud Storage | Infrastructure as Code | Lakehouse | Observability | Python | Scala | Unity Catalog | Version control | “as-code”
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Engineering Lead,Microservices,Java Springboot /Sr. Associate Director, Technology Management INR 1500K-2400KApache Airflow | Apache Beam | Apache Flink | BigQuery | Cloud StorageMid-level Full TimePune, Maharashtra, India R22h ago
-
Senior-level Full TimeIndia, Bengaluru (Hybrid) R22h ago
-
Principal Engineer, Technical Architect INR 2000K-5000K.NET | API first | API-first design | Access Control | Agent OrchestrationSenior-level Full TimeRemote, India R1d ago
-
Principal Engineer, Technical Architect INR 2000K-5000K.NET | API Design | Access Control | Artificial Intelligence | Batch inferenceSenior-level Full TimeRemote, India R1d ago
-
AI Agents | Amplitude | DBT | Databricks | LLMDirect visibility to senior leadership | Documentation and training support | Hybrid workSenior-level Full TimeBangalore, INDIA R1d ago
-
GCP, Airflow/CONSULTANT SPECIALIST INR 1500K-2500KAccess Control | Apache Airflow | Audit Logging | CI/CD | Cloud ComposerContinuous professional development | Flexible workingSenior-level Full TimePune, Maharashtra, India R1d ago
-
GCP, Airflow, Bigquery/Senior Consultant Specialist INR 1500K-2500KApache Airflow | Apache NiFi | CI/CD | Cloud Composer | Cloud DataflowContinuous professional development | Flexible workingSenior-level Full TimePune, Maharashtra, India R1d ago
-
Automated testing | Command Line | Debugging | Docker | GitHubFlexible work arrangement | Fully remote | Project-based engagementSenior-level Contract Full TimeIndia R1d ago
-
Manager , Decision Systems Data INR 700K-1200KAgile | Apache Airflow | BigQuery | Bigtable | CI/CDCareer development | Supportive work environmentMid-level Full TimeBangalore, Karnataka, India R1d ago
-
Principal Engineer, Sitecore Architect (Optimizely) INR 4000K-6500KA/B | A/B Testing | A/B Testing Tools | ASP.NET MVC | ASP.Net CoreSenior-level Full TimeRemote, India R1d ago
-
Senior-level Full TimeBangalore, India R1d ago
-
Staff Software Engineer, Data (Employer of Record) INR 3715K-5449KAWS | AWS Glue | AWS Lambda | Agile | Amazon S3Flexible collaboration across time zones | Remote workSenior-level Full TimeIndia - Field R1d ago
-
Principal Data Engineer INR 2500K-4200KAnnotation Pipeline | Azure | CI/CD | Cloud Data | Cloud Data EngineeringSenior-level Full TimeRemote (India) R2d ago
-
Lead Performance Engineer INR 3584K-5000KAWS | Agile | Apache JMeter | Azure | CI/CDFlexible hybrid work model | Health insurance | Life insurance | Paid time off | Pension/retirement benefitsSenior-level Full TimeHyderabad, India R2d ago
-
Cloud Operations AI Engineer INR 3000K-4000KAWS Bedrock | AWS CloudTrail | AWS Lambda | Amazon CloudWatch | Amazon ECSFlexible working hours | Hybrid work | Remote workSenior-level Full TimeRemote, India R2d ago
-
AKS | AWS | ArangoDB | Authentication | AzureFully remoteMid-level Full TimeIndia R2d ago
-
Sub Value Stream Technology Delivery Lead/Senior Associate Director, Data and Analytics INR 700K-2000KAgile methodologies | CI/CD | Cloud platform | Data Engineering | Data QualityMid-level Full TimePune, Maharashtra, India R2d ago
-
Senior Software Engineer, (Python, GenAI, MCP) INR 3080K-4400KAPIs | AWS | Data Streaming | Databases | DockerSenior-level Full TimeRemote - Bangalore, India R2d ago
-
Ardoq | Bird | Collibra | Data Architecture | Data GovernanceSenior-level Full TimeRemote, India R2d ago
-
Associate Principal Engineer, Data Engineer (Enterprise Data Architect-Banking Domain) INR 1524K-2541KAgile | Ardoq | Bird | Collibra | Data ArchitectureMid-level Full TimeRemote, India R2d ago
-
Senior Data Engineer PHP 384K-456KAPI Gateway | API Integration | AWS | AWS QuickSight | BoxBonuses | Ongoing education and training | Unlimited vacationSenior-level Full TimeManila, PH / Mumbai, IN - … R2d ago
-
ClickHouse | Cloud Native | Containerization | Data Integrity | Data PipelinesEmployee stock purchase programs | Equity opportunities | Flexible paid time off | Fully remote work | Generous parental leaveMid-level Full TimeIndia R2d ago
-
API | ClickHouse | Dashboards | Data Engineering | Data ModelingFlexible paid time off | Fully remote | Growth Funding | Health and wellbeing benefits | Learning resourcesMid-level Full TimeIndia R2d ago
-
Senior Data Engineer INR 3600K-4580KApache Airflow | Batch Processing | Billing integration | CRM Integration | DBTCommunity involvement | Employee wellbeing programs | Hybrid work | Remote work | Work-life balanceSenior-level Full TimeRemote (IND), India R2d ago
-
AWS | Autogen | Embedding Models | GenAI | GoSenior-level Full TimeBangalore - Carina, India R2d ago