Azure Databricks Developer
INDIA - PUNE - BIRLASOFT OFFICE - HINJAWADI, IN
INR 1500K-2500K (estimate) Senior-level Full Time
Tasks
- Architect modern data warehouse and lakehouse
- Build ADF orchestration workflows
- Collaborate with BI and business teams
- Design data engineering solutions
- Develop Databricks transformation jobs and notebooks
- Develop ELT ETL data pipelines
- Ensure data security and access control
- Implement Delta Lake features
- Implement data quality checks and validation
- Implement data transformations with PySpark
- Integrate data from APIs and third party sources
- Maintain technical documentation
- Manage Databricks jobs and clusters
- Tune performance and cluster workloads
Perks/Benefits
- N/A
Skills/Tech-stack
ACID | Access Control | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure DevOps | CD pipelines | CI/CD | CI/CD pipelines | Data Factory | Data Governance | Data Lake Storage | Data Quality | Data encryption | Delta Lake | ELT | ETL | JSON | Parquet | PySpark | SQL | Schema Enforcement | Schema evolution | Time Travel
Education
N/A
Roles
Azure Data Engineer | Data Engineer | Databricks Developer | Developer | Engineer
Related jobs
-
Senior Data Engineer INR 2000K-3000KAWS | AWS Batch | AWS Glue | AWS Lambda | AWS Step FunctionsHealth benefits | Paid time off | Wellbeing benefits | Work-life balanceSenior-level Full TimeHyderabad, India R3h ago
-
Data Engineer (SSIS, SQL and Azure Data Factory) INR 1000K-1700KAzure Data | Azure Data Factory | Data Bricks | Data Factory | ETLEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India4h ago
-
Senior-level Full TimeBangalore, KA, IN, 5600764h ago
-
Software Engineer (AI/ML) INR 500KAWS | Attention Mechanisms | Azure | Distributed Computing | Domain AdaptationBirthday day off | Career advancement | Employee assistance program | Gratuity | Group personal accident insuranceMid-level Full TimeBengaluru, Onsite4h ago
-
Digital Data Engineer / Plant Specialist Level 2 INR 510K-550KData Modeling | Data Quality | Data Warehousing | ETL | PythonCareer development | Inclusion programs | Multicultural environment | Training opportunitiesEntry-level Full TimePUNE R&D, MH, IN5h ago
-
Associate Consultant_AI/ML Engineer INR 1000K-2000KAI Evaluation | AI Planning | AI Planning and Orchestration | AI Safety | Agent architecturesMid-level Full TimeHyderabad, IN, 5000815h ago
-
Senior Data Engineer (Managed Services) INR 1500K-3000KAutomation | Azure | Azure Data | Azure Data Factory | Azure SynapseCareer growth and progression | Company bonus scheme | Comprehensive benefits package | Hybrid work schedule | Inclusive cultureSenior-level Full TimeHyderabad, Telangana, India R7h ago
-
Technical Lead-Data Engg INR 1500K-2700KAWS | Azure | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeINDIA - BENGALURU - HP, IN10h ago
-
Azure Databricks Developer INR 1500K-2500KACID | Access Control | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …10h ago
-
Anthropic API | Asynchronous programming | CI/CD | Docker | NoSQLFlexible schedule | Performance-based bonuses | Remote workMid-level FreelanceIndia - Remote R10h ago
-
Data Engineer INR 3600K-4720KAWS Glue | AWS IAM | AWS Lambda | AWS S3 | Airbyte401k match | Catered lunches | Comprehensive healthcare | Flexible vacation | HSA contributionsSenior-level Full TimeIndia | Pune16h ago
-
Sr Software Engineer INR 1500K-2700KAgile | Cloud services | Code review | Data Modeling | Design PatternsSenior-level Full TimePune, India16h ago
-
Software Engineer INR 1500K-2000KAgile | Cloud Computing | Code review | Data Modeling | Design PatternsMid-level Full TimePune, India16h ago
-
Sr Software Engineer INR 1500K-2700KAgile | Cloud services | Code review | Data Model | Data ModelingSenior-level Full TimePune, India16h ago
-
Data Engineer INR 1500K-2500KAWS Cloud | Amazon Web Services | Apache Spark | Databricks | PythonInsurance package | Learning and development resourcesSenior-level Full TimeCoimbatore19h ago
-
Senior-level Full TimeKochi, India20h ago
-
DevOps Engineer (AI Platform) INR 2000K-4800KAccess Control | Application Insights | Azure DevOps | Bicep | Cloud NetworkingSenior-level Full TimePune, Maharashtra, India20h ago
-
Software Developer (AIML) INR 1800K-2700KAWS | Azure | CI/CD | Computer Vision | Convolutional Neural NetworksFlexible working hours | Growth and learning | Referral bonus | Team building events | Training and booksMid-level Full TimePune, India20h ago
-
Data Science - AI ML INR 2500K-5000KAWS | Azure | Bayesian Models | Campaign Optimization | ChatbotsSenior-level Full TimeGurgaon, HR, India21h ago
-
Engineer - Generative AI INR 1860K-4000KAPI Design | API Gateway | AWS CloudWatch | AWS Lambda | Amazon APIHealth and wellness benefits | Route network access | Team collaboration | Travel opportunitiesMid-level Full TimeGurugram, Haryana, India21h ago
-
Robotic Process Automation (RPA) Professional INR 2500K-4000K.NET | AI Center | API Integration | Automation Cloud | Azure CopilotSenior-level Full TimePune - Maharashtra - India21h ago
-
Senior-level Full TimePune, Maharashtra, India23h ago
-
AI and Automation Engineer INR 2000K-4800KAI Security | BigQuery | Chain-of-Thought | Claude API | Cloud FunctionsAnnual leave | Casual leave | Public holidays | Sick leaveSenior-level Full TimeGurugram, India23h ago
-
Lead - Data Scientist INR 2500K-4720KAnomaly Detection | Cloud Computing | Data Governance | Deep learning | DevSecOpsCareer development opportunities | Inclusive workplace | Mentoring and team developmentSenior-level Full TimeNoida,Uttar Pradesh,India R23h ago
-
Sr.Data Engineering INR 1500K-2500KAzure | Azure Data | Azure Data Factory | Azure Databricks | Azure Key VaultSenior-level Full Timebengaluru, India1d ago