Senior Data Engineer (Azure Databricks)
Hyderabad, TS, India
INR 800K-1500K (estimate) Senior-level Full Time Found 5d ago
Tasks
- Build and manage Delta Lake tables
- Collaborate with data science teams
- Deploy solutions to production
- Design data pipelines
- Develop ETL/ELT workflows
- Develop SQL queries
- Ensure data quality and monitoring
- Follow security and governance best practices
- Implement data ingestion pipelines
- Integrate with Azure Data Lake Storage
- Optimize Spark jobs
- Work with structured and semi-structured data
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | CSV | Cost Optimization | Data Factory | Data Lake Storage | Data Modeling | Data Processing | Delta | Delta Lake | Distributed data | Distributed data processing | JSON | ML data considerations | Parquet | PySpark | Python | SQL | Schema evolution | Spark SQL | Version control
Education
Roles
Language: en |
Views: 2 |
Clicks: 0
Related jobs
-
Sr Software Engineer INR 2500K-3100KAgile methodology | Cloud services | Code review | Communication | Data FormatsSenior-level Full TimePune, India18h ago
-
Sr Software Engineer INR 2500K-3100KAgile methodology | Cloud services | Data Modeling | Database Management | Design PatternsSenior-level Full TimePune, India18h ago
-
Software Engineer INR 1500K-2500KAgile | Cloud services | Code review | Communication | Data ModelingMid-level Full TimePune, India18h ago
-
Mid-level Full TimeIN-TN-Chennai21h ago
-
Sr. Computer Vision & Edge AI Engineer INR 2500K-4500KComputer Vision | Deep learning | Edge Devices | Edge Hardware | GPU AccelerationSenior-level Full TimeMaharashtra, Pune, India22h ago
-
Mid-level Full TimeMaharashtra, Pune, India1d ago
-
Data Engineer INR 1500K-2500KAWS | Agile | Automation | Azure | Cloud ArchitectureCompetitive salaries | Health insurance | Office amenities | Scholarship opportunities | Volunteer programsMid-level Full TimeBengaluru, KA, India1d ago
-
Staff Software Engineer -ML/AI INR 2500K-4600KAPI Development | Algorithms | Embeddings | Hugging Face | Knowledge graphsSenior-level Full TimeBengaluru, India1d ago
-
Principal Consultant, Data Engineer ETL INR 2500K-3380KAWS | Airflow | Azure | Big Data | Cloud ComputingContinuous learning | Impact-driven environment | Innovation culture | MentorshipSenior-level Full TimeIndia-Bangalore1d ago
-
Senior Principal Consultant, RAG Engineer INR 2535K-4225KAI Tooling | AI/ML | AI/ML Tools | AWS | AirflowHands-on experience | Inclusive culture | Learning opportunities | MentorshipSenior-level Full TimeIndia-Bangalore1d ago
-
Lead Consultant-Data Engineer INR 2486K-3380KAWS | Apache Hadoop | Apache Kafka | Apache Spark | AzureAI certifications | Career growth | Hands-on experience | Innovative environment | MentorshipSenior-level Full TimeIndia-Bangalore1d ago
-
Principal Consultant-Data Engineer INR 2486K-3380KAWS | Amazon Redshift | Apache Hadoop | Apache Kafka | Apache SparkAI certifications | Career growth | Inclusive culture | MentorshipSenior-level Full TimeIndia-Bangalore1d ago
-
Senior-level Full TimeIN-AP-Hyderabad1d ago
-
Data Engineer INR 1500K-2500KAzure Data | Azure Data Factory | Azure Data Lake | Azure Functions | Azure SQLMid-level Full TimeIN-AP-Hyderabad1d ago
-
AI Engineer INR 2000K-4725KAWS | Algorithms | Azure | Cloud Architecture | CommunicationCareer progression | Diversity and inclusion initiatives | Education assistance | Employee discounts | Financial adviceSenior-level Full TimeBengaluru, KA, India2d ago
-
Software Engineer INR 1600K-2400KAgile tools | Agile tools (JIRA, Rally) | Agile tools (Jira | Angular | BigQueryMid-level Full TimeChennai, Tamil Nadu, India2d ago
-
DevOps Engineer III - Kubernetes, AWS, Terraform INR 2200K-3065KAWS | Aurora | Automation | CI/CD | CNI pluginsSenior-level Full TimeHyderabad, Telangana, India2d ago
-
Group BI Engineer I INR 2000K-2040KAgile | Azure Analysis | Azure Analysis Service | Azure Data | Azure Data LakeMid-level Full TimeBangalore, Karnataka, India2d ago
-
Senior-level Full TimeBangalore, INDIA, India2d ago
-
Senior-level Full TimeBangalore, INDIA, India2d ago
-
Senior-level Full TimeGurugram, Haryana, India2d ago
-
GCP Data Engineer - Associate Director INR 1500K-2541KBigQuery | Cloud Composer | Cloud Functions | DBT | DataflowMid-level Full TimeHyderabad, Telangana, India2d ago
-
Senior AI Applications Engineer INR 3100K-4600KAI Agents | CI/CD | Cloud AI | Cloud Native | Cloud-native ArchitecturesInclusive work environment | Life insurance | Medical benefits | Retirement options | Volunteer programsSenior-level Full TimeIndia2d ago
-
Data Engineer INR 1500K-2500KAWS | Agile | Automation | Azure | Cloud Architecture401k | Health insurance | Office amenities | Scholarship opportunities | Volunteer programsMid-level Full TimeBengaluru, KA, India2d ago
-
Senior-level Full TimeBangalore, KA, IN, 5600662d ago