Databricks Engineer - Lead / Manager
Hyderabad, TS, India
INR 1500K-2800K (estimate) Senior-level Full Time
Tasks
- Build Delta Lake tables
- Design scalable data pipelines
- Develop ETL/ELT workflows
- Develop SQL queries and transformations
- Ensure data quality, validation, and monitoring
- Implement security access control and governance
- Integrate Databricks with Azure Data Lake Storage
- Optimize Spark jobs
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Databricks | Azure DevOps | CI/CD | CSV | Data Factory | Data Lake Storage Gen2 | Data Modeling | Delta Lake | Event Hub | Git | GitHub Actions | JSON | Kafka | Parquet | PySpark | Python | RBAC | SQL | Spark Structured Streaming | Structured Streaming
Education
N/A
Related jobs
-
Senior-level Full TimeIndia8h ago
-
Agile | Alerting | Automation | CI/CD | ClusteringAgile environment | Professional growthSenior-level Full TimeIndia10h ago
-
AI Governance | AWS | Agentic Workflows | CI/CD | Cloud NativeSenior-level Full TimeAPAC - India - Bengaluru - …11h ago
-
API Development | Agent Orchestration | Agent alignment | Anthropic | Async ProgrammingSenior-level Full TimeBengaluru Millenia, India11h ago
-
AWS | Authentication | CI/CD | Docker | Exception HandlingEqual employment opportunity | Flexible work programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimePune, India11h ago
-
AWS | Authentication | CI/CD | Data Modeling | DockerFlexible work arrangements | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimePune, India11h ago
-
AWS | Apache Kafka | Azure | Bootstrap | CSSFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeChennai - Menon Eternity, India11h ago
-
Agile | Apache Spark | Azure Blob | Azure Blob Storage | Azure DataFlexibility programmes | Inclusive benefits | MentorshipSenior-level Full TimeBengaluru Millenia, India11h ago
-
Databricks and Splunk Engineer - Senior Associate INR 3264K-4500KAmazon Web Services | Analytics | Azure | Cloud Computing | Cyber ThreatEmployee networks | Flexible work/life support | Hybrid work schedule | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeBangalore, India R13h ago
-
Senior Software Engineer INR 2771K-4064KAngular | Apache Hadoop | Apache Hive | Apache Spark | DockerSenior-level Full TimeBangalore, India14h ago
-
HPC Systems Engineer INR 1800K-3000KAnsible | C# | Cause analysis | Configuration Management | DebuggingEvening and weekend maintenance participation | Rotating on-call | Vendor travelMid-level Full TimeMumbai15h ago
-
DevOps Engineer, India INR 1837K-2500KCI/CD | Grafana | Infrastructure as Code | Prometheus | “as-code”Buddy mentoring | Certificate training programs | Charity opportunities | Comprehensive onboarding | Flexible working hoursEntry-level Full TimeIndia R17h ago
-
AI Integration Engineer – Digital Transformation (m/f/d) INR 2500K-3584KABAC | API Gateway | AWS Glue | AWS Lambda | AWS Secrets1 to 1 counselling | Discount vouchers | Hybrid work model | Language classes | Learning and developmentSenior-level Full TimeGurugram R20h ago
-
Senior-level Full TimeBangalore North, India20h ago
-
Senior-level Full TimeBangalore North, India20h ago
-
Senior-level Full TimeBangalore North, India20h ago
-
Data Engineer (ETL ODI) - AMS INR 1500K-2500KAPIs | Data Governance | Data Integrator | Data Modeling | Data QualityMid-level Full TimeBangalore North, India20h ago
-
Software Engineer INR 1200K-2500KAI Evaluation | Agile | Artifactory | Automated testing | Azure DevOpsEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India21h ago
-
Mid-level Full TimeGurugram - Haryana - India Pune …21h ago
-
Advanced Engineer - AI/ML with Devops(GCP,AWS) INR 2500K-4200KAWS | Airflow | Amazon Web Services | Apache Spark | Artificial IntelligenceAccess to cutting-edge technologies | Collaborative work environment | Professional development | Training opportunitiesSenior-level Full TimeBangalore - Karnataka, India - Kalyani …23h ago
-
Sr AI Solutions Engineer (Generative AI & Agentic AI) INR 3242K-4062KAI Agent Builder | Agent Builder | Agent Orchestration | BigQuery | Claude APISenior-level Full TimePune, MH, India23h ago
-
Data Integration Engineer INR 2525K-4000KAnthropic | Azure OpenAI | Data Modeling | ETL | Function CallingMid-level Full TimeBengaluru, IN23h ago
-
Data Engineer INR 3000K-4000KAWS | Amazon Aurora | Automation | Azure | Data ManagementBike to work | Career development program | Educational assistance | Employee assistance program | Employee discountSenior-level Full TimeBengaluru, KA, India R1d ago
-
AI Development Strategy Lead INR 2500K-5000KAgent Orchestration | BI frameworks | Business Intelligence | C++ | Cloud DataSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Data and AI Engineer, Google Cloud INR 2000K-3300KAlgorithms | Architectural frameworks | Batch Processing | Cloud platform | Data PipelinesSenior-level Full TimeBengaluru, Karnataka, India; Hyderabad, Telangana, India1d ago