Databricks T2
Mumbai, Maharashtra, India
INR 2000K-2040K (estimate) Senior-level Full Time
Tasks
- Automate cluster management and job orchestration
- Build ETL/ELT pipelines
- Design batch and streaming pipelines
- Design relational database structures
- Develop Delta Lake tables
- Ensure data integrity, security, and compliance
- Implement CI/CD pipelines
- Implement data governance and access control
- Integrate data sources
- Maintain code quality unit tests and documentation
- Monitor and optimize data workflows
- Optimize cluster configurations
- Optimize database performance
- Troubleshoot slow queries and deadlocks
- Write and optimize SQL queries
Perks/Benefits
- N/A
Skills/Tech-stack
ACID | AWS | Apache Spark | Azure | Azure DevOps | CI/CD | Databricks | Dataframes | Delta Lake | GCP | GitHub Actions | GitLab | Lakehouse | NumPy | Pandas | PySpark | Python | RDD | REST APIs | Schema evolution | Spark SQL | Spark Structured Streaming | Structured Streaming | Time Travel | Unity Catalog
Education
N/A
Related jobs
-
Senior Software Engineer, Google Distributed Cloud Appliance INR 500K-2000KArtificial Intelligence | C++ | CSS | Cloud Native | Cloud-native computingSenior-level Full TimeBengaluru, Karnataka, India2h ago
-
Senior-level Full TimeHyderabad, TS, IN3h ago
-
Assistant Manager INR 1500K-2000KAmazon Neptune | Apache Spark | Azure Cosmos | Azure Cosmos DB | CSIMid-level Full TimeIndia4h ago
-
GenAI & Python Developer INR 2500K-3000KAPI Development | Data Preprocessing | Data pipeline | Generative AI | GitAgile working environmentMid-level Full TimeNoida, Uttar Pradesh, India5h ago
-
Senior-level Full TimeIndia6h ago
-
AI Backend Engineer INR 1971K-4590KAnthropic API | Asynchronous programming | Cloud Run | Cloud platform | Compute EngineSenior-level Full TimeChennai, Tamil Nadu, India6h ago
-
Mid-level Full TimeBangalore, Karnataka, India6h ago
-
Senior - Dev-Data-Pipeline INR 2500K-4000KAWS | Azure | Cloud platform | Data Catalog | Data GovernanceSenior-level Full TimeMumbai, Maharashtra, India7h ago
-
Senior Applied AI Engineer - CPGR INR 2500K-4600KAWS Bedrock | Agent Orchestration | Azure AI | Data Engineering | Few-Shot LearningCompany equity (RSUs) | Comprehensive benefits | Counseling | Generous PTO | Gym subsidiesSenior-level Full TimeBangalore, India7h ago
-
Senior-level Full TimeBangalore7h ago
-
Mid-level Full TimeAhmedabad, Gujarat, India8h ago
-
Shiva's Replacement (AWS) INR 1800K-2000KAWS | AWS Athena | AWS Glue | AWS Lambda | AWS Step FunctionsSenior-level Full TimeMumbai, Maharashtra, India8h ago
-
Staff Engineer - Database Reliability Engineering INR 2695K-2829KAWS | Amazon Aurora | Backup/Restore | Capacity Planning | CassandraSenior-level Full TimeHyderabad, India8h ago
-
Senior Data Analyst INR 3600K-5000KAbuse detection | Algorithms | Apache Airflow | Automation | Bot DetectionFlexible work schedule | Healthcare benefits | Internet reimbursement | Paid time off | Parental leaveSenior-level Full TimeBengaluru, Karnataka, India9h ago
-
Fullstack AI Engineer - Bengaluru INR 3000K-4000KJavaScript | LLM API | Language Models | Large Language Models | Machine LearningMid-level Full TimeBengaluru, Karnātaka, India9h ago
-
Senior-level Full TimeBangalore, KA, India10h ago
-
Mid-level Full TimeBengaluru, India10h ago
-
Senior-level Full TimeBengaluru, Karnataka10h ago
-
Pyspark Developer INR 2000K-3200KAWS | Azure | CI/CD | GCP | PySparkCareer guidance | Digital learning platform | Elder care | Flexible work | Health checksMid-level Full TimeGurgaon, IN12h ago
-
Senior-level Full TimeIN: Lilly Bengaluru, India14h ago
-
Java with GCP Developer INR 1971K-2400KBigQuery | CI/CD | Cloud Functions | Cloud Run | Cloud StorageMid-level Full TimeBangalore, KA, IN14h ago
-
EY - GDS Consulting - AI And DATA - AWS Data Engineer - Senior INR 2000K-2146KAWS | AWS Glue | AWS Lambda | AWS Step Functions | Amazon CloudWatchCoaching and learning programs | Flexible work arrangements | Inclusive culture | Personalized growth planSenior-level Full TimePune, MH, IN, 41101414h ago
-
EY - GDS Consulting - AI And DATA - Data Engineer - Senior INR 2500K-3380KAWS | AWS EventBridge | AWS Glue | AWS Lambda | AWS Step FunctionsCareer growth opportunities | Coaching and feedback | Discounts and offers | Flexible working | Health and well being insuranceSenior-level Full TimeHyderabad, TG, IN, 50008114h ago
-
EY - GDS Consulting - AI And DATA - Data Engineer- Manager INR 2000K-3000KAWS | AWS DynamoDB | AWS ECS | AWS EKS | AWS GlueCareer development | Coaching and feedback | Discounts and offers | Flexible working | Health and well-being benefitsMid-level Full TimeHyderabad, TG, IN, 50008114h ago
-
EY - GDS Consulting - AI And DATA - Data Engineer - Senior INR 2520K-3380KAWS | AWS CloudFormation | AWS DynamoDB | AWS ECS | AWS EKSCareer development | Coaching and feedback | Discounts | Flexible working | InsuranceSenior-level Full TimeHyderabad, TG, IN, 50008114h ago