Lead Data Engineer (Databricks)
INR 2400K-3900K (estimate) Senior-level Full Time
Tasks
- Architect for scale and reliability
- Build data pipelines
- Champion DataOps practices
- Conduct code review
- Create infrastructure as code
- Design Lakehouse architecture
- Identify delivery blockers
- Implement CI/CD
- Implement automated testing
- Implement pipeline observability
- Lead client data engagements
- Manage delivery timelines
- Manage technical scope
- Manage version control
- Mentor data engineers
- Own data platform architecture
- Productionize data solutions
- Promote knowledge sharing
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | AWS Redshift | Amazon S3 | Apache Spark | Automated testing | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Synapse | CI/CD | Cloud Dataflow | Cloud Storage | Data Factory | Data Lake Storage | Data Modeling | Data Warehousing | DataOps | Databricks | Databricks Workflows | Delta Lake | ELT | ETL | Google BigQuery | Google Cloud | Google Cloud Dataflow | Google Cloud Storage | Infrastructure as Code | Lakehouse | Observability | Python | Scala | Unity Catalog | Version control | “as-code”
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Principal Data Engineer Data Technology INR 3000K-4000KAPIs | AWS | Apache Spark | CI/CD | Cloud platformSenior-level Full TimePune, Maharashtra, India R9h ago
-
Java Big Data Developer - Experienced INR 1500K-3000KApache Hadoop | Apache Kafka | Apache Spark | Design Patterns | DockerSenior-level Full TimePune, IN R11h ago
-
Mid-level Full TimePune, Maharashtra, India R13h ago
-
Java Big Data Developer - Senior INR 1200K-3000KApache Hadoop | Apache Kafka | Apache Spark | Design Patterns | DockerSenior-level Full TimePune, IN R14h ago
-
VP - Data Quality lead INR 3000K-4000KArtificial Intelligence | Business Intelligence | Cause analysis | Cloud platform | Cross-Functional CollaborationSenior-level Full TimeHyderabad, Telangana, India R16h ago
-
ASR | AWS | Audio Processing | Cloud platform | ContainerizationFlexible working hours | Fully remote | Mentorship | Professional growthSenior-level Full TimeIndia R19h ago
-
Mid-level Full TimeIndia - Remote R23h ago
-
Azure Data | Azure Data Factory | Azure OpenAI | CI/CD | DAXHybrid scheduleSenior-level Full TimeIND-Pune-Smartworks, India R23h ago
-
Data Analytics Lead INR 2771K-4064KDashboards | Data Analysis | Descriptive Analytics | Excel | Executive CommunicationCharity match program | Employee assistance program | Group medical insurance | Paid time off | Parental leaveSenior-level Full TimeGurgaon - Cyber Park, India R23h ago
-
Senior Data Engineer INR 3000K-4200KAPI Development | AWS | Automated testing | Data Modeling | Database DesignEquipment provided | High autonomy | Medical coverage | Paid annual leave | Public holidaysSenior-level Full TimeIndia, India - Remote R23h ago
-
Data Solutions Engineer INR 3380K-4580KAPI Development | Access Control | CI/CD | Cloud Platforms | Data GovernanceSenior-level Full TimeBangalore, India R23h ago
-
Sr Consultant- AI & Automation INR 3000K-5500KAWS | Azure | CI/CD | Computer Vision | Data AnalysisSenior-level Full TimeRemote, India R23h ago
-
Senior Data Engineer - Career INR 1500K-2500KCI/CD | Cloud platform | Data Governance | Data Modeling | Data PipelinesHealthcare packages | Hybrid work setting | Online learning platform | Paid time offSenior-level Full TimeIND-Pune-Equifax Analytics-PEC, India R23h ago
-
Data Scientist - Specialist INR 3600K-5400KAgentic AI | Amazon Web Services | Apache Spark | Azure | Big DataCareer growth | Healthcare package | Hybrid work | Online learning platform | Paid time offSenior-level Full TimeIND-Pune-Equifax Analytics-PEC, India R23h ago
-
Site Reliability Engineer-Career INR 3000K-4720KAWS | Ansible | Bash | Blameless postmortems | CI/CDGuided career tracks | Healthcare package | Hybrid work setting | Online learning platform | Organizational growth potentialSenior-level Full TimeIND-Trivandrum-Equifax Analytics-PEC, India R23h ago
-
Data Engineer with GCP INR 1500K-2500KBatch Processing | BigQuery | Cloud Storage | Cloud platform | Data GovernanceSenior-level Full TimeIN-AP-Hyderabad R1d ago
-
Service Engineer INR 1300K-2000KAutomated testing | Azure Data | Azure Data Factory | Azure Databricks | Azure SynapseHybrid work flexibilityMid-level Full TimeIndia, Telangana, Hyderabad R1d ago
-
Agentic AI | Alerting | Anomaly Detection | Apache Airflow | Artifact RegistryMid-level Full TimePune, Maharashtra, India R1d ago
-
Data Engineering Support Lead INR 1500K-2500KAWS Glue | AWS Lambda | Agile | Amazon Athena | Automated DeploymentHybrid work arrangement | MentorshipSenior-level Full TimePune, Maharashtra, India R1d ago
-
Senior Data Engineer INR 3000K-4000KAWS | Airflow | Amazon Aurora | Apache Kafka | Apache SparkBike to work | Career mentorship | Educational assistance | Employee assistance program | Employee discountSenior-level Full TimeMumbai, MH, India R1d ago
-
AWS | AWS CloudFormation | AWS Glue | AWS Lake | AWS Lake FormationFlexible location | Fully remote work | Ownership culture | Technical autonomySenior-level Contract Full TimeIndia R1d ago
-
Data Engineer L3 INR 2516K-3380KAPIs | Airflow | Alerting | Attribution Modeling | BigQueryCommuting reimbursement | Monthly long weekend day off | Paid Maternity Leave | Paid paternity leave | Wellness reimbursementSenior-level Full TimeRemote (Chennai, IN); Remote (Mumbai, IN) R1d ago
-
Azure Data Engineer INR 1500K-2500KAzure Data | Azure Data Factory | Azure Data Lake | Azure Functions | Azure SynapseSenior-level Full TimeHyderabad, Telangana, India R1d ago
-
QA Lead – Data Engineering & ETL INR 1500K-2500KAgile | Apache Airflow | Automation Testing | Azure | CI/CDCareer development | Flexible work hours | Inclusive and collaborative work culture | Insurance | Learning opportunitiesSenior-level Full TimeBangalore, India R1d ago
-
Senior-level Full TimeHybrid (Bangalore, Karnataka, IN); Hybrid (Pune, … R1d ago