Senior Data Engineer - Databricks
Vadodara, Gujarat, India - Remote
R
INR 2516K-3356K (estimate) Senior-level Full Time
Tasks
- Build ETL/ELT pipelines
- Collaborate with stakeholders on requirements
- Create Delta Lake tables
- Deploy and integrate containerized apps
- Ensure data quality governance compliance
- Implement batch streaming ingestion
- Implement version control and CI/CD
- Mentor junior engineers
- Monitor improve data system performance reliability scalability
- Orchestrate data workflows
- Transform and model data
- Write optimized SQL queries
Perks/Benefits
- N/A
Skills/Tech-stack
AKS | Agile | Airflow | Apache Spark | Avro | Azure Databricks | Azure Kubernetes | Azure Kubernetes Service | CI/CD | Data Lakehouse | Databricks Workflows | Delta Lake | Docker | ELT | ETL | Git | JSON | Kubernetes Service | Parquet | PostgreSQL | PySpark | SQL | Spark SQL | Streaming
Education
N/A
Roles
Related jobs
-
Senior-level Full TimeIndia - Remote R16h ago
-
Mid-level Full TimeHyderabad, Telangana, India; Open to Remote … R23h ago
-
NLP Engineer (Remote) INR 2000K-3000KAsynchronous programming | BERT | Batch Processing | Data Preprocessing | ETLMid-level Full TimeGurgaon, India R1d ago
-
Senior-level Full TimeHybrid, Hyderabad, Telangana, India R1d ago
-
Software Engineer, Platform & Data Infrastructure INR 3375K-4600KBenchmarking | Caching | Celery | Distributed Systems | KafkaCatered meals | Parental leave | Pre-IPO stock options | Unlimited PTO | Wellness stipendSenior-level Full TimeHybrid (Bengaluru, Karnataka, IN) R1d ago
-
Senior Data Engineer INR 600K-1500KAgile | Analysis Services | Archimate | Azure Analysis | Azure Analysis ServicesSenior-level Full TimeIndia-Hyderabad-Remote R1d ago
-
Backend Engineer, Knowledge Graph (Rust) INR 3200K-4200KAPI Development | Alerting | Change Data Capture | ClickHouse | Data CaptureFlexible paid time off | Growth and development fund | Home office support | Parental leave | Team member resource groupsSenior-level Full TimeRemote, India R3d ago
-
Staff Backend Engineer, Knowledge Graph (Rust) INR 3384K-4590KCapacity Planning | ClickHouse | Data Modeling | Graph Data | Graph Data ModelingEquity compensation | Flexible paid time off | Growth and development fund | Home office support | Parental leaveSenior-level Full TimeRemote, India R3d ago
-
Principal Engineer INR 2500K-4000KAI machine learning | ActiveMQ | Algorithms | Analytics | CachingSenior-level Full TimeRemote India R4d ago
-
Senior Software Engineer (Machine Learning) INR 4000K-6000KAutomated testing | CI/CD | Language Models | Large Language Models | Machine LearningOn-call rotationsSenior-level Full TimeMohali, Punjab, India (Hybrid) R4d ago
-
Senior Data Engineer/Data Ops (m/f/d) INR 2520K-4000KApache Airflow | Apache Hadoop | Apache Spark | ClickHouse | Data ProcessingAnnual learning and development budget | Flexible schedule | Home office setup budget | Work from homeSenior-level Full TimeRemote EMEA/ Remote India R4d ago
-
SDET II (Night Shift) INR 480K-600KAPI Testing | CI/CD | Case design | Database | Functional testingMid-level Full TimeGurugram R5d ago
-
AVP, Model Ops Engineer (L10) INR 500K-500KAWS | Agile | Amazon Redshift | Apache Airflow | Apache KafkaEmployee well-being programs | Flexible schedule | Work from homeExecutive-level Full TimeRemote Central Region IN, India R5d ago
-
Engineer - HPC Platform INR 1971K-2500KAnsible | Apptainer | Bash | Chef | Cluster architectureCareer advancement path | Professional development opportunitiesMid-level Full TimeIndia - Remote R5d ago
-
AI Testing | API Integration | Apex | Aura Components | Azure DevOpsSenior-level Full TimeRemote, India R6d ago
-
Senior DevOps Engineer (Cloud) INR 2229K-3200KADLS | AWS | Airflow | Azure | BitbucketBroadband reimbursement | Certification bonus | Certification reimbursement | Medical insurance | Professional development allowanceSenior-level Full TimeIndia - Remote R6d ago
-
Solutions Architect INR 2516K-3100KAWS | Airflow | Azure | Azure Data | Azure Data LakeBonuses for approved content | Broadband reimbursement | Medical insurance for parents | Medical insurance for self and family | Paid certificationsSenior-level Full TimeIndia - Remote R6d ago
-
Data Engineer INR 2000K-3000KADLS | AWS | Airflow | Azure | Cloud platformBonuses | Broadband reimbursement | Medical insurance | Paid certifications | Personal accident insuranceMid-level Full TimeIndia - Remote R6d ago
-
Senior Data Engineer INR 2516K-3100KADLS | AWS | Airflow | Azure | CassandraAutonomy | Casual work environment | Growth opportunities | Remote-first environmentSenior-level Full TimeIndia - Remote R6d ago
-
Senior-level Full TimeHybrid (Bangalore, Karnataka, IN); Hybrid (Pune, … R6d ago
-
Senior Data Engineer (Python & Snowflake) INR 2500K-3380KAPI Development | API Gateway | AWS Lambda | Agile | Amazon APICareer growth and development opportunities | Fitness offerings | Flexible work hours | Generous time off | Mental Health plansSenior-level Full TimeIndia R6d ago
-
Principal Software Engineer INR 3375K-5000KAirflow | Artificial Intelligence | Automation | CI/CD | DBTSenior-level Full TimePune - Tower 6, India R6d ago
-
AI Engineer INR 2500K-4725KAPI Development | AWS | Agentic AI | Azure | Cloud ComputingFully remote | Work from anywhereSenior-level Full TimeBangalore, KA, IN, 560100 R6d ago
-
Senior AI Engineer INR 3125K-4725KAPI Development | AWS | Agentic AI | Angular | AzureFully remoteSenior-level Full TimeBangalore, KA, IN, 560100 R6d ago
-
AI Engineer INR 2500K-4500KAI Agents | Amazon Web Services | Azure | Cloud platform | Deep learningSenior-level Full TimeAnywhere in India R7d ago