Databricks Engineer
Chennai, Tamil Nadu, India
INR 1500K-2700K (estimate) Senior-level Full Time
Tasks
- Build CI/CD pipelines for Databricks notebooks and jobs
- Build Databricks pipelines for financial crime use cases
- Design Databricks data lakehouse solutions
- Design and implement Delta Lake tables and lakehouse architecture
- Develop batch and streaming data pipelines with PySpark and Spark SQL
- Enable GenAI workloads and vector search
- Implement Delta Live Tables pipelines with data quality expectations
- Implement Unity Catalog governance security and data lineage
- Integrate Databricks with Kafka and cloud storage services
- Monitor pipeline health and manage cloud costs
- Set up MLflow tracking and model lifecycle management
Perks/Benefits
- N/A
Skills/Tech-stack
Auto Loader | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure DevOps | CI/CD | Change Data Feed | Data Lake Storage | Data feed | Databricks | Databricks Feature Store | Databricks Jobs | Delta Lake | Delta Live Tables | Delta Live) | Feature Store | GitHub Actions | GitLab CI | Great Expectations | Infrastructure as Code | Kafka | MLflow | Photon | PySpark | Schema evolution | Spark SQL | Structured Streaming | Terraform | Time Travel | Unity Catalog | Vector Search | Z-Order | “as-code”
Education
Roles
Related jobs
-
Machine Learning Engineer - APAC INR 3000K-4408KA/B | A/B Testing | B testing | CI/CD | ClassificationBenefits for family | Flexible working arrangements | Learning and development resources | Sabbaticals | Study assistanceMid-level Full TimeIndia-Bengaluru (Helios Business Park)1d ago
-
26-2292: Databricks Engineer- India, Hyderabad INR 1000K-2000KAIOps | Access Control | Amazon S3 | Anonymization | Apache KafkaMid-level Full TimeHyderabad/Vijayawada1d ago
-
Lead Software Engineer - Workday INR 1800K-2600KAPI Gateway | AWS CloudWatch | AWS Elastic Load Balancing | AWS Lambda | AWS VPCSenior-level Full TimeOff Embassy Golf Links Business Park, …1d ago
-
Software Site Reliability Engineer - AI & Data Platforms INR 2500K-4300KAWS | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkMid-level Full TimeHyderabad1d ago
-
Software Site Reliability Engineer - AI & Data Platforms INR 2500K-4300KAWS | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkMid-level Full TimeBengaluru1d ago
-
Senior AI Engineer (m/f/d) INR 3242K-5000KAPIs | AWS | Agents | Angular | AzureHome office setup budget | Learning and development budget | Relocation support | Visa support | Work from homeSenior-level Full TimeRemote EMEA, Remote India R1d ago
-
Senior Data Engineer INR 1500K-2500KAirflow | Apache Spark | Confluence | Data Warehousing | DatabricksSenior-level Full TimeBengaluru, KA, IN1d ago
-
Senior Software Engineer, Google Cloud INR 2000K-3300KAgentic AI | CI/CD | Cloud Computing | Code review | Distributed SystemsSenior-level Full TimeBengaluru, Karnataka, India2d ago
-
BigQuery | CI/CD | Cloud Functions | Cloud Run | Cloud StorageContinuous professional development | Flexible workingMid-level Full TimeHyderabad, Telangana, India R2d ago
-
Mid-level Full TimeIndia2d ago
-
Lead Software Engineer - (SRE principles , AI tools, AWS) INR 3000K-6000KAIOps | API Gateway | AWS ECS | AWS Lambda | Amazon APISenior-level Full TimeBengaluru, Karnataka, India2d ago
-
Senior-level Full TimeMADURAI, TAMIL NADU, India2d ago
-
Analytics Engineer INR 2800K-4200KCI/CD | DBT | Dashboards | Data Quality | DatabricksHealth insurance | Hybrid work model | Mental health support | Paid time off | Transport allowanceSenior-level Full TimeBangalore (Hybrid) R2d ago
-
API | Apache Hadoop | Apache Kafka | Apache Spark | Azure DataHybrid workSenior-level Full TimeBangalore, Karnataka, India R2d ago
-
API | Agile | Apache Hadoop | Apache Kafka | Apache SparkHybrid work | Technical research opportunities | Training supportSenior-level Full TimeBangalore, Karnataka, India R2d ago
-
Apache Airflow | Apache Hadoop | Apache Kafka | Apache Spark | Azure DataHybrid work | Training opportunitiesSenior-level Full TimeBangalore, Karnataka, India R2d ago
-
Senior AI Engineer INR 3264K-5000KAI Foundry | Access Control | Agent Frameworks | Authentication | AzureSenior-level Full TimeIndia2d ago
-
Entry-level Full TimeBangalore, Karnataka, India2d ago
-
Platform Engineer INR 1500K-3900KADLS Gen2 | Azure | Azure Databricks | Azure Networking | Azure StorageSenior-level Full TimeChennai, Tamil Nadu, India2d ago
-
Senior Software Engineer II (Java Microservices) INR 3000K-4500KAWS | Agile | Apache Kafka | Apache Spark | AzureCareer development | Distributed collaboration | Learning opportunities | Work from Anywhere cultureSenior-level Full TimeIndia R2d ago
-
AI Engineer (Manager level) INR 1200K-2500KApache Spark | Azure AI | Azure CI | Azure CI/CD | Azure CognitiveMid-level Full TimeHyderabad, India2d ago
-
Senior Data Engineer | Offshore INR 1500K-2500KCI/CD | DBT | Data Dictionary | Data Quality | Dimensional ModelingSenior-level Full TimeIndia2d ago
-
Senior-level Full TimePune, MH, IN R2d ago
-
Consultant - Databricks Azure INR 1000K-2700KAccess Control | Azure | Azure Data | Azure Data Factory | Azure Data LakeMid-level Full TimeBangalore, Karnataka, India2d ago
-
Assistant Manager - Databricks Azure INR 1500K-2000KADLS | Amazon Kinesis | Apache Kafka | Apache Spark | Azure ADMid-level Full TimeBangalore, Karnataka, India2d ago