Principal Data Engineer- Databricks & AI platform
3010 - Bangalore Office, India
R
INR 3715K-5400K (estimate) Senior-level Full Time
Tasks
- Adopt agentic AI tooling for pipeline workflows
- Build ETL frameworks and reusable components
- Configure clusters and optimize performance
- Create technical roadmap
- Design Delta Lake lakehouse architecture
- Implement infrastructure-as-code
- Lead Unity Catalog governance
- Lead technical escalations
- Mentor senior engineers
- Migrate legacy data platforms to Databricks
- Orchestrate data workflows
- Own data platform architecture
- Perform root cause analysis
- Set CI CD standards for data pipelines
- Standardize data quality and access control
- Troubleshoot production incidents
Perks/Benefits
- Employee assistance program
- Employee resource groups
- Health benefits
- Learning programs
- No meeting days
- Paid time off
- Tuition reimbursement
- Volunteer days
- Wellness app
- Wellness program
Skills/Tech-stack
AWS | Airflow | Apache Spark | Asset bundles | Azure | CI/CD | DBT | Databricks | Databricks (asset) | Databricks Asset Bundles | Delta Lake | GCP | GenAI | Infrastructure as Code | Kafka | LLM | Python | RAG | SQL | Unity Catalog | “as-code”
Education
N/A
Related jobs
-
Technical Architect- Remote, India INR 2500K-5000KAI Act | AI RMF | API Design | AWS | Access ControlRemote workSenior-level Full TimeIndia R11h ago
-
Software Engineer INR 1500K-2100KAWS | Agile | Bash | CI/CD | CloudWatchFamily wellbeing benefits | Health and wellbeing benefits | Hybrid work | Paid time off | Work-life balance benefitsMid-level Full TimeHyderabad, India R13h ago
-
AWS | Artificial Intelligence | Azure | CI/CD | Computer VisionCareer development | Inclusive culture | Professional learning | Remote workSenior-level Full TimeIndia R18h ago
-
Data / Retrieval Engineer INR 3200K-4720KAPIs | Access Control | Attribute-Based Access Control | Attribute-based access | ChunkingSenior-level Full TimeNoida/Gurgaon, UP, IN R20h ago
-
AI Orchestration / Platform Engineer INR 2500K-4680KAlerting | Authentication | Authorization | CI/CD | CachingSenior-level Full TimeNoida/Gurgaon, HR, IN R20h ago
-
Principal Agentic AI Engineer / Hands-on Technical Lead INR 3600K-5000KAI tracing | Agent patterns | Authentication | Authorization | AutogenSenior-level Full TimeNoida/Gurgaon, HR, IN R20h ago
-
Machine Learning Engineer 3 ( Firefly ) INR 3264K-5000KCUDA | Diffusion Models | Distributed Systems | GANs | GPU resource managementSenior-level Full TimeNoida, India R20h ago
-
AI Services | Azure AI | Azure AI Services | Azure OpenAI | Azure SpeechHybrid work | Onsite work | Travel 10 percentSenior-level Full TimeKarnataka, Bengaluru Old No 62, Plot … R20h ago
-
Databricks Data Engineer - Manager INR 1500K-2100KApache Spark | Azure Blob | Azure Blob Storage | Azure Data | Azure Data FactoryEducational support | Employee networks | Flexible work programs | Hybrid work environment | InsuranceMid-level Full TimeBangalore, India R20h ago
-
Databricks Data Engineer - Senior Manager INR 2771K-4064KApache Spark | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsHybrid work environment | Paid volunteer daysSenior-level Full TimeHyderabad, India R20h ago
-
Data Architect & Delivery Lead INR 3600K-5400KAgile | Airflow | Batch Architecture | BigQuery | Canonical ModelingHybrid workSenior-level Full TimeHyderabad, India R2d ago
-
Principal Software Engineer INR 3264K-5876KAWS | Apache Iceberg | Apache Kafka | Apache Spark | Automated testingSenior-level Full TimeHyderabad, TG, India R2d ago
-
Staff Machine Learning Engineer INR 3600K-5000KA/B | A/B Testing | AWS | Agentic Workflows | AzureHybrid work | Onsite collaborationSenior-level Full TimeIndia - Pune - Office R2d ago
-
Senior Embedded Software Engineer INR 1716K-2500KAUTOSAR | Artifactory | Automotive SPICE | C plus plus | C#BusinessBike bicycle leasing | Continuing education programs | Corporate volunteering | End-of-year bonuses | Flexible working hoursSenior-level Full TimePune, MH, IN, 411057 R2d ago
-
Mid-level Full TimeHaryana, India R3d ago
-
Continuous integration | Development Lifecycle | Git | JavaScript | LaravelCo-working space | Mentorship | Modern equipment | Training programs | Trial dayMid-level Full TimeChennai, Hybrid R3d ago
-
Principal Data Engineer Data Technology INR 3000K-4000KAPIs | AWS | Apache Spark | CI/CD | Cloud platformSenior-level Full TimePune, Maharashtra, India R3d ago
-
Data Engineer _ ALM - MTCR INR 1500K-3000KApache Hive | Apache Spark | Apache YARN | Bitbucket | CDEHybrid workSenior-level Full TimeIndia - Pune R3d ago
-
Senior Software Engineer INR 1492K-3000KAutomated testing | Azure Data | Azure Data Factory | Azure Databricks | Azure Machine LearningGrowth mindset culture | Hybrid work modelSenior-level Full TimeIndia, Telangana, Hyderabad R3d ago
-
Senior Machine Learning Engineer INR 3584K-4800KAWS | Azure | CI/CD | Cloud platform | DatabricksCoaching and mentoring | Development programs | Learning and development programs | Remote work flexibility | Work from office or client siteSenior-level Full TimeBangalore, India R3d ago
-
Senior Machine Learning Engineer INR 3584K-4800KAWS | Azure | CI/CD | Databricks | Distributed SystemsCareer Development Programs | Learning and development programs | Mentoring and coaching | Remote work flexibilitySenior-level Full TimeBangalore, India R3d ago
-
Java Big Data Developer - Experienced INR 1500K-3000KApache Hadoop | Apache Kafka | Apache Spark | Design Patterns | DockerSenior-level Full TimePune, IN R3d ago
-
Staff Software Engineer - India INR 4000K-5000KAPI Development | AWS | Agentic AI | Azure | Cloud infrastructureCareer growth | High visibility and impact | Open Source contributionSenior-level Full TimeBengaluru R3d ago
-
Mid-level Full TimePune, Maharashtra, India R3d ago
-
Java Big Data Developer - Senior INR 1200K-3000KApache Hadoop | Apache Kafka | Apache Spark | Design Patterns | DockerSenior-level Full TimePune, IN R3d ago