Databricks Engineer
Hyderabad, TS, India
INR 1500K-2800K (estimate) Senior-level Full Time
Tasks
- Apply security access control and governance in Azure
- Build and manage Delta Lake tables
- Design scalable data pipelines using Azure Databricks
- Develop SQL queries and transformations
- Ensure data quality, validation, and monitoring
- Implement ETL ELT workflows using PySpark Spark SQL and Python
- Integrate Databricks with Azure Data Lake Storage Gen2
- Optimize Spark jobs for performance cost and scalability
- Process structured and semi-structured data
Perks/Benefits
- N/A
Skills/Tech-stack
ADLS Gen2 | Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Databricks | Azure DevOps | Azure RBAC | CI/CD | CSV | Data Factory | Data Lake Storage Gen2 | Delta | Delta Lake | ELT | ETL | Event Hub | Git | GitHub Actions | JSON | Kafka | Parquet | PySpark | Python | RBAC | SQL | Spark SQL | Spark Structured Streaming | Structured Streaming
Education
N/A
Related jobs
-
Senior Data Engineer INR 1500K-2700KApache Airflow | Apache Hadoop | Apache Iceberg | Apache Spark | DBTSenior-level Full TimeHyderabad, TS, India4h ago
-
Software Developer (Python, Skywise, Pyspark, AWS) INR 2000K-3500KAPI | AWS Lambda | Agile | Airbus Values | Amazon RDSSenior-level Full TimeBengaluru, Karnataka, India6h ago
-
Software Engineer III, Big Data INR 2040K-3465KApache Flink | Apache Hive | Apache Spark | Cloud Composer | Cloud StorageHybrid workSenior-level Full TimeHyderabad, Telangana 500081, India R6h ago
-
Associate Engineer INR 1500K-2500KAnalysis Services | Azure Analysis | Azure Analysis Services | Azure Blob | Azure Blob StorageMid-level Full TimeHyderabad, IN6h ago
-
Forward Deployed AI Scientist INR 2500K-4200KAWS Bedrock | Agentic Workflows | Artificial Intelligence | CI/CD | Crew AICommunity outreach programs | Employee Resource Group | Employee stock purchase program | Health and wellness incentivesSenior-level Full TimeBangalore, KA, IN, -7h ago
-
Customer Engineer INR 1436K-1820KAPI Integration | AWS | Algorithms | Cassandra | Cloud platform24/7 on-call rotation | Flexible work arrangements | Weekend shift rotation as neededMid-level Full TimeBangalore7h ago
-
Senior-level Full TimeBangalore, INDIA8h ago
-
Backend Software Engineer, AI Platform INR 2000K-3000KAPIs | AWS | Agentic AI | Authentication | Auto ScalingMid-level Full TimeBengaluru R8h ago
-
Address Parsing | Data Modeling | Data Normalization | Data Quality | Data StandardizationCareer growth | Continuous learning | Flexible internship schedule | Mentorship | Professional developmentMid-level Full TimeIndia R9h ago
-
Senior Machine Learning Engineer - Recommendations INR 3242K-5000KA/B | A/B Testing | Airflow | Amazon EMR | Amazon S3Senior-level Full TimeBengaluru, India R9h ago
-
Access Control | Agentic Workflows | Apache Airflow | Automated alerting | CI/CDComprehensive benefits | Professional growth opportunities | Remote/office flexibilitySenior-level Full TimeIndia R9h ago
-
Specialist - AI & ML INR 2500K-5000KAI Platform | API Gateway | AWS Lambda | AWS SageMaker | AWS Step FunctionsSenior-level Full TimeHyderabad, Hyderabad, IN11h ago
-
Technical Lead-Cloud & Infra Engg INR 2000K-4000KAWS CloudWatch | AWS Elastic Load Balancing | Amazon ECS | Amazon EKS | Amazon Web ServicesSenior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …13h ago
-
AI Engineer (Energy) INR 1860K-2700KAI Foundry | API Design | Alerting | Azure | Azure AICareer development | Friendly working environment | Periodic travelMid-level Full TimeAurum Q2, IN - India R13h ago
-
Data Engineer INR 2800K-4200KAWS | AWS Glue | AWS Lambda | Amazon S3 | Cause analysisCollaborative work culture | Healthcare | Paid volunteering days | Retirement planning | Wellbeing initiativesSenior-level Full TimeIND-BLR-Divyasree Technopolis, India13h ago
-
Data Platform & Integration Engineer INR 2000K-3000KAWS | Azure | Azure Data | Azure Data Factory | Data FactorySenior-level Full TimeBangalore, KA, IN, 56006613h ago
-
Senior-level Full TimeBangalore–Embassy Business Hub, India13h ago
-
Python, LLM, GenAI/Senior Consultant Specialist INR 3000K-5000KAPI Auditing | Asynchronous programming | Authentication | Authorization | CI/CDFlexible working | Inclusive workplace | Professional development opportunitiesSenior-level Full TimePune, MH, IN, 41100613h ago
-
Sr. Software Engineer - (GenAI & Node.js) INR 2000K-4500KAPI Architecture | API Security | Async/Await | Asynchronous programming | Automation TestingSenior-level Full TimeBengaluru, Karnataka, India13h ago
-
Python, LLM, GenAI/Senior Consultant Specialist INR 3000K-5000KAccuracy Metrics | Authentication | Authorization | CI/CD | CachingFlexible working | Inclusive work culture | Professional developmentSenior-level Full TimePune, MH, IN, 41100613h ago
-
Fabric Data Engineer - Senior Associate INR 1400K-3000KAPIs | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeBangalore (SDC) - Bagmane Tech Park, …13h ago
-
API Development | Asynchronous programming | CI/CD | Docker | EmbeddingsFlexible work arrangements | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeNoida, India13h ago
-
Data Analysis | Data Quality | Data Transformation | Data integration | Data workflowsFlexible work arrangements | MentorshipSenior-level Full TimeMumbai Goregaon, India13h ago
-
Amazon Web Services | Azure Data | Azure Data Engineering | BigQuery | Code reviewFlexible work arrangements | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India13h ago
-
Amazon Redshift | Amazon Web Services | Azure Data | Azure Data Engineering | BigQueryEqual employment opportunity | Flexible work arrangements | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India13h ago