Databricks Engineer, Data Platform & Data Science Tooling
GF Unit G01 and G02, Block C4, Brigade Tech Gardens, ITPL Main Road, Brookefield, Kundalahalli, India
INR 2000K-2800K (estimate) Senior-level Full Time
Tasks
- Apply Delta table maintenance VACUUM OPTIMIZE and compaction
- Build Databricks Workflows with task dependencies and alerts
- Build data pipelines using Databricks Delta Live Tables
- Contribute to semantic layer for Power BI dashboards
- Develop pipelines for structured and unstructured data
- Implement data governance with Databricks Unity Catalog
- Implement data models for fact dimension and data marts
- Manage CI CD with version control and automated testing
- Monitor pipeline health and resolve data issues within SLA
- Monitor troubleshoot and optimize data pipelines
- Optimize PySpark performance and cost
- Optimize SQL queries
- Write PySpark and SQL transformations
Perks/Benefits
- N/A
Skills/Tech-stack
As-a-Service | Azure DevOps | CI/CD | Databricks | Databricks SQL | Databricks Workflows | Delta Lake | Delta Live Tables | Delta Live) | GitHub Actions | Infrastructure as a Service | Power BI | PySpark | Python | SQL | Terraform | Unity Catalog
Education
N/A
Roles
Related jobs
-
Data Engineer (LBC) INR 1500K-2500KBusiness Intelligence | DAX | Data Analysis | Data Catalog | Data QualitySenior-level Full TimePune, IN1h ago
-
GCP Data Engineer INR 1500K-2000KAnsible | Cloud Bigtable | Cloud SQL | Cloud Spanner | Cloud platformProfessional growthMid-level Full TimeBengaluru, Pune3h ago
-
AI Specialist (Technical) INR 1860K-3465KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksMid-level Full TimeGurugram, HR, IN4h ago
-
Senior Robotics Engineer INR 1753K-2372KC++ | Java | Localization and mapping | MATLAB | Machine LearningFull Time Office Project Work | Relocation not provided | Travel for deployment and commissioningSenior-level Full TimeChennai, TN, IN4h ago
-
AI Specialist (ML & LLM) INR 2400K-4000KAI Search | Azure AI | Azure AI Search | Azure Functions | Azure Machine LearningMid-level Full TimeGurugram, HR, IN4h ago
-
AWS | AWS Machine Learning | Agent systems | Angular | AutogenSenior-level Full TimeChennai, TN, IN, 6000329h ago
-
AI Engineering INR 3584K-5000KAgentic Workflows | Audit Logging | Authentication | Authorization | CI/CDSenior-level Full TimeBangalore, KA, IN9h ago
-
Principal Engineer - - Generative AI Data & Analytics INR 3700K-4800KAI Observability | AIOps | Azure Data | Azure Data Engineer | Batch ProcessingSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India9h ago
-
Sr. Power BI Engineer - (SSRS & PySpark) INR 1632K-2500KPower BI | PySpark | SQL | SQL Server | SSRSSenior-level Full TimeBengaluru, Karnataka, India9h ago
-
Senior Data Engineer INR 3600K-4995KAmazon Redshift | Amazon Web Services | Apache Airflow | Batch Processing | DBTSenior-level Full TimeIndia R14h ago
-
Data Science Manager INR 1500K-2100KAWS | Adversarial Networks | Attribution Modeling | Azure | Cloud ComputingMid-level Full TimePune1d ago
-
Senior GIS Enginer INR 900K-2500KAPI Integration | ArcGIS | Coordinate systems | Data Transformation | Data cleaningSenior-level Full TimeHyderabad, TS, IN / Hyderabad, Telangana, …1d ago
-
Test Lead - Data Automation INR 1500K-2500KCase design | ETL | Manual Testing | Python | Regression testingSenior-level Full TimeIndia1d ago
-
Staff Engineer (Snowflake, Apache Kafka, Oracle, AWS Lambda) INR 1500K-2500KAWS EC2 | AWS IAM | AWS Lambda | AWS VPC | Access ManagementSenior-level Full TimeGurugram, India1d ago
-
Staff Engineer (Datadog Engineer) INR 2000K-4000KAmazon Web Services | Application Performance Monitoring | Application performance | Automation | Azure DevOpsSenior-level Full TimeHyderabad, India1d ago
-
Staff Engineer (AI Security and DevSecOps ) INR 2500K-5000KAI RMF | AWS | AWS Secrets | AWS Secrets Manager | Abuse detectionSenior-level Full TimeHyderabad, India1d ago
-
Senior Software Engineer (Universal Robots, Bangalore - India) INR 2475K-3500KAgile | C++ | CI/CD | Clean Code | Code reviewExposure to Cutting Edge Robotics Technology | Flexible working conditions | Health insurance | Inclusive work environment | Professional development opportunitiesSenior-level Full TimeBangalore, IN2d ago
-
Senior Software Engineer, Machine Learning INR 3264K-5400KA/B | A/B Testing | Aerospike | B testing | Bayesian analysisCommuter benefits | Dental insurance | Disability insurance | Financial wellness support | Flexible remote workSenior-level Full TimeBengaluru, India2d ago
-
Senior Software Engineer (Data Platform) INR 2475K-3500KAWS | Airflow | Apache Flink | Apache Hadoop | Apache HiveCommuter benefits | Dental insurance | Disability insurance | Financial wellness support | Healthcare benefitsSenior-level Full TimeBengaluru, India2d ago
-
Senior Cloud Storage Engineer – NetApp CVO on GCP, AVP INR 2755K-3500KAutomation | CI/CD | Cloud Security | Cloud platform | Cloud volumes ONTAPAccident insurance | Certification sponsorship | Childcare assistance reimbursement | Employee assistance program | Gender neutral parental leaveSenior-level Full TimePune - Business Bay, India2d ago
-
Mid-level Full TimePune, India2d ago
-
Senior Software Engineer INR 2000K-2700KAgile | Cloud services | Code review | Data Modeling | Data WarehousingSenior-level Full TimePune, India2d ago
-
Artificial intelligence Developer (Pro Code) INR 2500K-4680KAI Foundry | APIs | Asynchronous processing | Autogen | Azure AISenior-level Full TimeThane, Maharashtra, India2d ago
-
Senior Data Engineer INR 3000K-4000KApache Spark | Batch Processing | DAX | Data Ingestion | Data ModelingFinancial consultations | Language courses | Legal consultations | Medical insurance | Mental health supportSenior-level Full TimeIndia2d ago
-
Manager Data and Analytics INR 1400K-2000KAmazon Redshift | Azure | BigQuery | Business Intelligence | Cloud platformMid-level Full TimeBangalore, Karnataka, India R2d ago