Databricks Engineer
Chennai, Tamil Nadu, India
INR 1500K-2700K (estimate) Senior-level Full Time
Tasks
- Build CI/CD pipelines for Databricks notebooks and jobs
- Build Databricks pipelines for financial crime use cases
- Design Databricks data lakehouse solutions
- Design and implement Delta Lake tables and lakehouse architecture
- Develop batch and streaming data pipelines with PySpark and Spark SQL
- Enable GenAI workloads and vector search
- Implement Delta Live Tables pipelines with data quality expectations
- Implement Unity Catalog governance security and data lineage
- Integrate Databricks with Kafka and cloud storage services
- Monitor pipeline health and manage cloud costs
- Set up MLflow tracking and model lifecycle management
Perks/Benefits
- N/A
Skills/Tech-stack
Auto Loader | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure DevOps | CI/CD | Change Data Feed | Data Lake Storage | Data feed | Databricks | Databricks Feature Store | Databricks Jobs | Delta Lake | Delta Live Tables | Delta Live) | Feature Store | GitHub Actions | GitLab CI | Great Expectations | Infrastructure as Code | Kafka | MLflow | Photon | PySpark | Schema evolution | Spark SQL | Structured Streaming | Terraform | Time Travel | Unity Catalog | Vector Search | Z-Order | “as-code”
Education
Roles
Related jobs
-
Software Engineer III - Python INR 3000K-5000KAlerting | CI/CD | Docker | Infrastructure as Code | KubernetesSenior-level Full TimeBengaluru, Karnataka, India3h ago
-
Agentic AI | Agile | Artificial Intelligence | Docker | Generative AISenior-level ContractShaikpet, India3h ago
-
Senior AI Engineer / Data Scientist (Agentic AI) INR 2000K-5000KAI Search | AI Services | Agentic AI | Azure | Azure AISenior-level Full TimeChennai, India4h ago
-
Senior-level Full TimeIN-KA-Bangalore4h ago
-
Mid-level Full TimeNoida, Uttar Pradesh, India5h ago
-
Agile | Apache Airflow | Azure Data | Azure Data Factory | Azure DevOpsEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India5h ago
-
Mid-level Full TimeBangalore, Karnataka, IN6h ago
-
Senior AI Engineer INR 2500K-5000KAPI Design | Agile | Azure | Azure AI | Azure ArcHybrid work | On-call supportSenior-level Full TimeBangalore, Karnataka, IN6h ago
-
Data Engineer - Associate Director INR 1500K-2600KAWS | AWS Glue | Agile | Apache Airflow | Apache HadoopMid-level Full TimeBangalore, Karnataka, India7h ago
-
Software Engineer III - ( Java , Python) INR 2000K-3500KAI Assisted Development | AWS | Agile | CI/CD | JavaSenior-level Full TimeHyderabad, Telangana, India8h ago
-
Sr. Data Engineer INR 2800K-4000KApache Airflow | Apache Spark | Batch Processing | CI/CD | Cloud ComposerSenior-level Full TimeGurgaon, Haryana, India9h ago
-
Software Engineer II - Java, UI, Spark, Kafka INR 1600K-2800KAngular | Apache Airflow | Apache Hive | Apache Spark | Automated testingMid-level Full TimeMumbai, Maharashtra, India9h ago
-
Mid-level Full TimeHyderabad, TS, India9h ago
-
Senior Data Scientist INR 2000K-5000KAWS | Artificial neural networks | Azure | Chunking | Data StructuresSenior-level Full TimeBengaluru, Karnataka, India9h ago
-
Oracle AI Developer INR 2475K-3465KAzure DevOps | LLM integration | Langchain | Langgraph | Language ModelsSenior-level Full TimeGurugram, HR, IN12h ago
-
Mid-level Full TimeGurgaon, HR, India12h ago
-
Software Engineer II INR 1500K-2500KAzure | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Mid-level Full TimeIndia, Telangana, Hyderabad13h ago
-
Senior Data Engineer INR 3000K-4000KAWS | Airflow | Cloud platform | Data Modeling | Data TransformationCommuter benefits | Dental insurance | Financial wellness support | Health insurance | Life insuranceSenior-level Full TimeBengaluru, India13h ago
-
Senior Software Engineer INR 4000K-6000KAI Model Garden | AI vector search | Alerting | Bash | BigQuerySenior-level Full TimeNoida, UP, IN17h ago
-
Senior-level Full TimeOff Embassy Golf Links Business Park, …17h ago
-
Lead Consultant - Snowflake and Cortex AI Engineer INR 4000K-5000KAlerting | Audit Logging | Azure DevOps | CI/CD | Contract testingSenior-level Full TimeIndia - Bangalore17h ago
-
Sr Technical Lead-Azure Data Engineer INR 1500K-2800KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Senior-level Full TimeINDIA - BENGALURU - HP, IN17h ago
-
Data Engineer (AWS, Azure & Microsoft Copilot Studio) INR 3200K-4720KAI Foundry | AWS Bedrock | AWS Glue | AWS Identity | AWS Identity and Access ManagementHealthcare life sciences industry focus | Remote workSenior-level Full TimeBangalore, KA, IN17h ago
-
Senior Data Engineer II INR 3715K-5000KAPI Integration | Amazon Web Services | Apache Spark | Azure | Data GovernanceEmployee assistance program | Employee share plan | Flexible work arrangements | Generous holidays | Professional mentoringSenior-level Full TimeHyderabad, IN17h ago
-
Data Engineer (AWS, Azure & Microsoft Copilot Studio) INR 3200K-4580KAWS Glue | AWS Identity | AWS Identity and Access Management | AWS Lambda | Access ManagementSenior-level Full TimeBangalore, KA, IN17h ago