Azure Databricks Developer
INDIA - PUNE - BIRLASOFT OFFICE - HINJAWADI, IN
INR 1500K-2500K (estimate) Senior-level Full Time
Tasks
- Architect data warehouse and lakehouse
- Build CI/CD pipelines for deployments
- Build ELT/ETL pipelines
- Collaborate with BI, Analytics, and business teams
- Create technical documentation and operational guides
- Design data engineering solutions
- Develop PySpark transformations
- Ensure data security encryption and access control
- Implement Delta Lake features
- Implement data quality checks
- Integrate data from APIs and third party sources
- Manage Databricks clusters jobs and notebooks
- Orchestrate workflows in Azure Data Factory
- Perform performance tuning and optimization
Perks/Benefits
- N/A
Skills/Tech-stack
ACID | Access Control | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Databricks | Azure DevOps | CI/CD | Data Factory | Data Lake Storage Gen2 | Databricks | Delta Lake | ELT | ETL | Encryption | JSON | Parquet | Partitioning | PySpark | SQL | Schema evolution | Time Travel
Education
N/A
Roles
Related jobs
-
Senior Data Engineer INR 2000K-3000KAWS | AWS Batch | AWS Glue | AWS Lambda | AWS Step FunctionsHealth benefits | Paid time off | Wellbeing benefits | Work-life balanceSenior-level Full TimeHyderabad, India R3h ago
-
Data Engineer (SSIS, SQL and Azure Data Factory) INR 1000K-1700KAzure Data | Azure Data Factory | Data Bricks | Data Factory | ETLEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India4h ago
-
Senior-level Full TimeBangalore, KA, IN, 5600765h ago
-
Software Engineer (AI/ML) INR 500KAWS | Attention Mechanisms | Azure | Distributed Computing | Domain AdaptationBirthday day off | Career advancement | Employee assistance program | Gratuity | Group personal accident insuranceMid-level Full TimeBengaluru, Onsite5h ago
-
Digital Data Engineer / Plant Specialist Level 2 INR 510K-550KData Modeling | Data Quality | Data Warehousing | ETL | PythonCareer development | Inclusion programs | Multicultural environment | Training opportunitiesEntry-level Full TimePUNE R&D, MH, IN5h ago
-
Associate Consultant_AI/ML Engineer INR 1000K-2000KAI Evaluation | AI Planning | AI Planning and Orchestration | AI Safety | Agent architecturesMid-level Full TimeHyderabad, IN, 5000815h ago
-
Senior Data Engineer (Managed Services) INR 1500K-3000KAutomation | Azure | Azure Data | Azure Data Factory | Azure SynapseCareer growth and progression | Company bonus scheme | Comprehensive benefits package | Hybrid work schedule | Inclusive cultureSenior-level Full TimeHyderabad, Telangana, India R8h ago
-
Technical Lead-Data Engg INR 1500K-2700KAWS | Azure | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeINDIA - BENGALURU - HP, IN11h ago
-
Azure Databricks Developer INR 1500K-2500KACID | Access Control | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …11h ago
-
Data Engineer INR 3600K-4720KAWS Glue | AWS IAM | AWS Lambda | AWS S3 | Airbyte401k match | Catered lunches | Comprehensive healthcare | Flexible vacation | HSA contributionsSenior-level Full TimeIndia | Pune17h ago
-
Sr Software Engineer INR 1500K-2700KAgile | Cloud services | Code review | Data Modeling | Design PatternsSenior-level Full TimePune, India17h ago
-
Software Engineer INR 1500K-2000KAgile | Cloud Computing | Code review | Data Modeling | Design PatternsMid-level Full TimePune, India17h ago
-
Sr Software Engineer INR 1500K-2700KAgile | Cloud services | Code review | Data Model | Data ModelingSenior-level Full TimePune, India17h ago
-
Business Analyst – Automation & AI Solutions (m/f/d) INR 1800K-2134KAWS | Agent workflows | Azure | CI/CD | ClaudeHybrid work model | Language classes | Learning and development | Mentoring program | Travel vouchers and discountsMid-level Full TimeGurugram R19h ago
-
Data Engineer INR 1500K-2500KAWS Cloud | Amazon Web Services | Apache Spark | Databricks | PythonInsurance package | Learning and development resourcesSenior-level Full TimeCoimbatore20h ago
-
Senior-level Full TimeKochi, India21h ago
-
DevOps Engineer (AI Platform) INR 2000K-4800KAccess Control | Application Insights | Azure DevOps | Bicep | Cloud NetworkingSenior-level Full TimePune, Maharashtra, India21h ago
-
Software Developer (AIML) INR 1800K-2700KAWS | Azure | CI/CD | Computer Vision | Convolutional Neural NetworksFlexible working hours | Growth and learning | Referral bonus | Team building events | Training and booksMid-level Full TimePune, India21h ago
-
Data Science - AI ML INR 2500K-5000KAWS | Azure | Bayesian Models | Campaign Optimization | ChatbotsSenior-level Full TimeGurgaon, HR, India22h ago
-
Engineer - Generative AI INR 1860K-4000KAPI Design | API Gateway | AWS CloudWatch | AWS Lambda | Amazon APIHealth and wellness benefits | Route network access | Team collaboration | Travel opportunitiesMid-level Full TimeGurugram, Haryana, India22h ago
-
Robotic Process Automation (RPA) Professional INR 2500K-4000K.NET | AI Center | API Integration | Automation Cloud | Azure CopilotSenior-level Full TimePune - Maharashtra - India22h ago
-
Senior-level Full TimePune, Maharashtra, India1d ago
-
AI and Automation Engineer INR 2000K-4800KAI Security | BigQuery | Chain-of-Thought | Claude API | Cloud FunctionsAnnual leave | Casual leave | Public holidays | Sick leaveSenior-level Full TimeGurugram, India1d ago
-
Lead - Data Scientist INR 2500K-4720KAnomaly Detection | Cloud Computing | Data Governance | Deep learning | DevSecOpsCareer development opportunities | Inclusive workplace | Mentoring and team developmentSenior-level Full TimeNoida,Uttar Pradesh,India R1d ago
-
Sr.Data Engineering INR 1500K-2500KAzure | Azure Data | Azure Data Factory | Azure Databricks | Azure Key VaultSenior-level Full Timebengaluru, India1d ago