Databricks Engineer - Senior/ Lead
Hyderabad, TS, India
INR 1500K-2800K (estimate) Senior-level Full Time
Tasks
- Apply security access control governance in Azure
- Build ETL/ELT workflows
- Design data pipelines on Azure Databricks
- Develop SQL queries and transformations
- Ensure data quality, validation, monitoring
- Integrate Databricks with Azure Data Lake Storage
- Manage Delta Lake tables
- Optimize Spark jobs performance cost scalability
- Process structured and semi-structured data
Perks/Benefits
- N/A
Skills/Tech-stack
ACID | ADLS Gen2 | Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure DevOps | CI/CD | CSV | Data Factory | Data Lake Storage | Data Modeling | Delta Lake | Event Hub | Git | GitHub Actions | JSON | Kafka | Parquet | PySpark | PySpark SQL | Python | RBAC | SQL | Spark Structured Streaming | Structured Streaming
Education
N/A
Roles
Related jobs
-
ML-Ops INR 3700K-5000KAsyncio | CI/CD | CProfile | Caching | DjangoLeadership development | Training sessionsSenior-level Full TimeMumbai, Maharashtra, India3h ago
-
Generative AI Engineer INR 1200K-2500KAI Services | AWS | Amazon SageMaker | Anthropic API | AzureCollaborative team environment | Leadership development | Training programsMid-level Full TimeMumbai, Maharashtra, India3h ago
-
Staff GenAI Engineer INR 2000K-5000KAWS | Agentic AI | Azure | CI/CD | ClassificationCollaborative team environment | Global consulting environment | Leadership development program | Mentorship programs | Training sessionsSenior-level Full TimeMumbai, MH, India3h ago
-
Mid-level Full TimeNoida R4h ago
-
AI / ML Data Scientist I INR 1000K-1890KAWS | Apache Spark | Artificial Intelligence | Cloud platform | ConfluenceMid-level Full TimeBengaluru, India5h ago
-
Lead - Data Platform Engineering INR 2500K-4500KAWS | Azure | Cloud Data | Cloud Data Platforms | Customer 360Senior-level Full TimeChennai, India5h ago
-
Software Engineer 2 INR 1500K-2500KAPI Design | AWS | Asynchronous Communication | Data Structures | Distributed SystemsMid-level Full TimeHybrid - Bangalore, India R5h ago
-
Lead Software Engineer (Full Stack) INR 506K.NET | AWS | Angular | Asynchronous programming | AzureRemote work flexibility | Supportive team culture | Work-life balanceSenior-level Full TimeBengaluru, Karnataka, India; Pune, Maharashtra, India6h ago
-
Senior-level Full TimeBangalore, India R6h ago
-
Senior Data Engineer INR 3000K-4000KAWS | AWS Managed Airflow | Airflow | Apache Spark | AzureMedical insurance | Remote-first workplace | Term Life and Personal Accident | Wellness allowanceSenior-level Full TimeIndia - Bangalore R6h ago
-
Airflow | Apache Spark | CI/CD | Contextual Bandits | Data DriftExposure to advanced ML technologies | Ownership across full ML lifecycle | Professional development | Supportive collaboration environmentSenior-level Full TimeIndia7h ago
-
Developer III INR 1400K-2500KAgile Scrum | Azure Data | Azure Data Factory | Cloud Storage | Cloud platformSenior-level Full TimeHitech City, TG, India7h ago
-
Senior Software Engineer - Data + AI Observability INR 1500K-3000KAIOps | AWS | Azure | C++ | Cloud platformSenior-level Full TimeBengaluru, India8h ago
-
Senior Data Engineer INR 3000K-4000KAmazon Web Services | Apache Spark | Cloud platform | Continuous Delivery | Data GovernanceSenior-level Full TimeBangalore, India; Chennai, India; Hyderabad, India; …8h ago
-
Data Engineer, Flex Analytics INR 1500K-2400KAWS Glue | Amazon Kinesis | Amazon Redshift | Amazon Web Services | Data ArchitectureInclusive cultureEntry-level Full TimeHyderabad, Telangana, IND11h ago
-
Business Intelligence Engineer, Flex Analytics INR 2000K-2700KAmazon QuickSight | Amazon Redshift | Data Modeling | Data Visualization | Data pipelineEntry-level Full TimeHyderabad, Telangana, IND11h ago
-
Business Intelligence Engineer, Flex Analytics INR 2000K-2700KAWS DynamoDB | AWS EC2 | Amazon QuickSight | Amazon Redshift | Data ModelingMid-level Full TimeHyderabad, Telangana, IND11h ago
-
Data Engineer Sr. Consultant INR 2800K-4200KData Mapping | Data Reconciliation | Data Transformation | Data Validation | Defect TrackingSenior-level Full TimeChennai, TN, IN R11h ago
-
Databricks - Technical Specialist-Data Engg INR 1500K-2500KABAC | APIs | Azure Data | Azure Data Factory | CI/CDMid-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …11h ago
-
Mid-level Full TimeBengaluru, KA, IN R11h ago
-
Senior Machine Learning Engineer INR 5000K-7000KAgentic Workflows | Benchmarking | Caching | Cloud infrastructure | ContainerizationComprehensive benefits | High ownership | Mission-driven impact | Rapid iterationSenior-level Full TimeNoida, Uttar Pradesh, India11h ago
-
Technical Specialist-App Development INR 1200K-2800KAgentic AI | FastAPI | Graph RAG | Knowledge Graph RAG | Knowledge graphMid-level Full TimeINDIA - NOIDA- BIRLASOFT OFFICE, IN11h ago
-
Platform Engineer INR 2500K-5000KAPI Design | Agentic Frameworks | Backend Development | Distributed Systems | Infrastructure as CodeFull autonomy | Remote workSenior-level Full TimeIndia - Remote R11h ago
-
Senior Staff - IT Data Engineering and Analytics INR 3000K-5000K.NET | API Management | ASP.Net Core | AWS | AirflowSenior-level Full TimeBangalore, India R1d ago
-
AI/ML Test Engineer - Immediate Joiners Only INR 400K-480KData Preprocessing | Data pipeline | End to End | End-to-End Testing | F1-scoreEntry-level Full TimeBengaluru, KA, India1d ago