Senior Databricks Data Engineer
Tasks
- Apply data quality governance security and performance best practices
- Build optimize Spark batch and real time jobs
- Deploy and manage solutions on Azure and AWS
- Design scalable data pipelines
- Develop Kafka streaming ingestion and processing
- Develop and maintain Databricks workflows
- Develop microservices based data platform components
- Implement Delta Lake data architecture
- Integrate SQL and NoSQL databases
- Manage containerized workloads on Kubernetes
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Apache Kafka | Apache Spark | Azure | CI/CD | Databricks | Delta Lake | Java | Kubernetes | Microservices | NoSQL | Python | SQL
Education
N/A
Related jobs
-
Airflow | Azure Data | Azure Data Factory | Azure DevOps | Azure FunctionsEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India13h ago
-
Senior Data Engineer- AWS INR 2000K-2500KAWS Glue | AWS Lambda | Amazon Redshift | Amazon Web Services | Apache AirflowSenior-level Full TimeBangalore North, India16h ago
-
Mid-level Full TimeBengaluru17h ago
-
Java, GCP, ReactJS/Consultant Specialist INR 2200K-3200KAnsible | Apache Airflow | Apache Atlas | BigQuery | ClaudeFlexible working | Professional developmentMid-level Full TimeHyderabad, Telangana, India R17h ago
-
Senior-level Full TimeIN-KA-Bangalore18h ago
-
Java, GCP, ReactJS/Consultant Specialist INR 2200K-3200KAnsible | Apache Airflow | Apache Atlas | BigQuery | ClaudeFlexible working | Professional developmentMid-level Full TimeHyderabad, Telangana, India R18h ago
-
Consultant - Cloud AI Developer INR 1400K-2500KAWS | Application Modernization | Application rationalization | Azure | Azure OpenAIMid-level Full TimeBangalore, Karnataka, India18h ago
-
AI Outcome Customer Engineer, FDE, Google Cloud INR 3799K-6000KAI Model Deployment | AI model | APIs | Access Management | Cloud infrastructureSenior-level Full TimeMumbai, Maharashtra, India; Bengaluru, Karnataka, India19h ago
-
AI Customer Engineer, Developer AI, Google Cloud INR 2500K-5000KAI Agents | API Gateway | Audit Logging | Cloud platform | Distributed tracingConference participation | Travel opportunitiesSenior-level Full TimeBengaluru, Karnataka, India19h ago
-
Mid-level Full TimePune, Maharashtra, India19h ago
-
DTICI_SalesProductServices_DataEngineer_T9 INR 1500K-2500KAWS | Agile | Apache Spark | Azure | Azure DataMid-level Full TimeBengaluru, Karnataka, India19h ago
-
Entry-level Full TimePune, Maharashtra, India20h ago
-
AI Full stack Engineer INR 2000K-5000KAPI Development | Agentic AI | BigQuery | Cloud SQL | Cloud platformSenior-level Full TimeIndia20h ago
-
Associate Process Manager INR 500K-1500KAzure SQL | Azure Synapse | BI Data modeling | Compliance | DAXMid-level Full TimeMumbai, Maharashtra, India20h ago
-
Agentic AI | Automation Anywhere | Azure OpenAI | Databases | Generative AIEntry-level Full Timebangalore, India21h ago
-
Lead Software Engineer - Data Platforms, REST APIs, SQL INR 3000K-5000KAWS | Agile | Authentication | Automated testing | CI/CDSenior-level Full TimeHyderabad, Telangana, India21h ago
-
QA Engineer INR 940K-1600KData Quality | Data Reconciliation | Data Validation | Data Warehousing | ETL TestingCareer development | Flexible work hours | Inclusive work culture | Insurance | Learning opportunitiesMid-level Full TimePune, India R21h ago
-
QA (ETL Test Engineer) INR 1000K-2000KAgile Scrum | Azure DevOps | Batch Processing | Data Modeling | Data ProcessingMid-level Full TimeNoida, Uttar Pradesh, India21h ago
-
Senior Analyst - AI/ML INR 2500K-5000KAWS | Artificial Intelligence | Automl | Azure | Cloud platformMentorship | TrainingSenior-level Full TimePune, Maharashtra, IND, 41101422h ago
-
Principal Software Engineer INR 1500K-3000KApache Spark | C# | C++ | Continuous integration | Distributed SystemsSenior-level Full TimeIndia, Karnataka, Bangalore23h ago
-
Mid-level Full TimeBengaluru, Karnataka, India23h ago
-
Data Engineering / Sr. Associate Director, Software Engineering INR 1000K-2000KAPIs | Airflow | Apache Beam | Auditability | Backwards CompatibilityCareer developmentMid-level Full TimeHyderabad, Telangana, India R23h ago
-
Mid-level Full TimeBengaluru, Karnataka, India1d ago
-
Mid-level Full TimeHadapsar, Pune, Maharashtra, IND, 4110131d ago
-
Automation & AI Lead – UiPath + Azure AI INR 3000K-4500KAI Center | AI Search | API Management | Agent Service | App ServiceSenior-level Full TimePune, Maharashtra, India1d ago