Senior Data Engineer (Databricks + Snowflake)
Bengaluru, Karnataka, India
INR 2040K-3100K (estimate) Senior-level Full Time
Tasks
- Build and optimize PySpark jobs
- Coordinate with cross functional teams on data platform enhancements
- Design batch data pipelines
- Design streaming data pipelines
- Develop SQL data processing
- Ensure data quality, governance, and reliability
- Implement Delta Lake pipelines
- Integrate Kafka and cloud storage sources
- Manage Databricks clusters and job orchestration
- Troubleshoot and debug Spark job performance
Perks/Benefits
Skills/Tech-stack
Apache Airflow | Apache Kafka | Asset bundles | CI/CD | Cloud Storage | Databricks | Databricks (asset) | Databricks Asset Bundles | Delta Lake | Delta Lake pipelines | Delta lake architecture | GitHub | PySpark | Python | SQL | Snowflake | Spark | Spark SQL | Spark optimization
Education
N/A
Roles
Related jobs
-
Software Engineering INR 1800K-2800KAlgorithm Design | Artificial Intelligence | C# | C++ | Data-drivenOnsite work 3 days per weekEntry-level Full TimeBengaluru, KA, IN3h ago
-
Senior Software Engineer, AI/ML, Google Cloud INR 2500K-4725KC++ | Data Processing | Debugging | ML Infrastructure | Machine LearningSenior-level Full TimeBengaluru, Karnataka, India3h ago
-
AI Strategic Cloud Engineer, Google Cloud INR 2500K-4800KApache Beam | C++ | Data Validation | Data Warehousing | DataflowSenior-level Full TimeBengaluru, Karnataka, India; Hyderabad, Telangana, India3h ago
-
Mid-level Full TimeHyderabad, TS, IN4h ago
-
Senior Lead Engineer INR 2500K-4500KAPI Integration | Agent systems | Agentic AI | Autogen | CrewAISenior-level Full TimeRemote Working, India R6h ago
-
Agile | Columnar Databases | Data Curation | Data Modeling | Data QualityEntry-level Full TimeBengaluru, Karnataka, India7h ago
-
Lead Data Engineer INR 3000K-4000KAgile | Airflow | Apache Kafka | Apache Spark | BigQueryLeadership opportunity | Monthly long weekends | Paid parental leave | Remote-first flexibility | Wellness reimbursementSenior-level Full TimeChennai, TN, India7h ago
-
Agile | Application performance | Azure | Azure AI | C++Career growth | Continuous learning | Fully remote | Inclusive global work cultureSenior-level Full TimeIndia R8h ago
-
Digital Engineering Lead Engineer INR 2520K-3380KData Science | Deep learning | Generative AI | Langchain | Language ModelsSenior-level Full TimeBangalore, KA, IN8h ago
-
Senior-level Full TimeHyderabad, India9h ago
-
Manager Azure AI Engineer INR 1000K-1250KAI Foundry | AI Services | AI Studio | Application Insights | AutomlEmployee assistance program | Employee resource groups | Flexible time off | Medical insurance plans | MentorshipMid-level Full TimePUNE, MAHARASHTRA, India10h ago
-
Technical Support Engineer INR 800K-1500KActive Directory | Azure AD | Learning Management System | Learning management | Learning management system integrationMid-level Full TimeBangalore, KA, India11h ago
-
Senior Devops Engineer INR 3000K-4000KAWS Certified | AWS Certified DevOps | AWS Certified DevOps Engineer | Agile | Amazon Web ServicesSenior-level Full TimeBangalore, KA, IN15h ago
-
Senior Software Engineer - AI/ML (GenAI, RAG) INR 2040K-3500KAWS | AWS Lambda | Amazon Bedrock | Amazon ECS | Amazon EKSHybrid work flexibilitySenior-level Full TimeGurgaon - Cyber Park, India15h ago
-
Senior AI Engineer(Python Developer) INR 2500K-4000KAWS Lambda | Agentic AI | Agile Scrum | Anthropic | Azure OpenAIHealthcare | Paid volunteering days | Retirement planning | Wellbeing initiativesSenior-level Full TimeIND-Hyderabad-CapitaLand, India15h ago
-
Senior Product Analytics Associate INR 2520K-3380KAirflow | Data Architecture | Data Modeling | Data Validation | Data profilingBook clubs | Collaborative workspaces | Commuter support | Employee assistance program | Employee resource groupsSenior-level Full TimeChennai India15h ago
-
Senior Product Analytics Associate INR 2520K-3380KAirflow | Data Modeling | Dimensional Modeling | ETL | Jupyter NotebookCollaborative workspaces | Commuter support | Employee assistance program | Employee resource groups | Flexible work optionsSenior-level Full TimeChennai India15h ago
-
Senior Product Analytics Associate INR 2520K-3380KAirflow | Data Lineage | Data Modeling | Data Quality | Data ValidationCollaborative workspaces | Commuter support | Employee assistance program | Employee resource groups | Flexible work arrangementSenior-level Full TimeChennai India15h ago
-
Senior Product Analytics Associate INR 2520K-3380KApache Airflow | Data Modeling | Data Quality | Data Validation | Data profilingBook clubs | Collaborative workspaces | Commuter support | Employee assistance program | Employee resource groupsSenior-level Full TimeChennai India15h ago
-
Manager - Procurement Automation & Analytics INR 900K-980KAPI Integration | Analytics | Automation | DAX | Data ModelingMid-level Full TimeIND-BLR-Divyasree Technopolis, India15h ago
-
Sr. Computer Scientist - I (Java, Big Data) INR 3150K-4500KApache Ignite | CI/CD | Capacity Planning | Datadog | Distributed SystemsSenior-level Full TimeBangalore, India R15h ago
-
Senior-level Full TimeNoida, India R15h ago
-
Data Engineer INR 1632K-2146KAmazon Web Services | Apache Spark | Azure | Azure Data | Azure Data FactorySenior-level Full TimeIndia - Remote R15h ago
-
Data Engineer- AWS INR 1500K-2000KAgile | Amazon Web Services | Data Processing | Distributed data | Distributed data processingMid-level Full TimePune, Gera Commerzone SEZ, India15h ago
-
Senior Engineer- Embedded Testing INR 1500K-2500KBash | C# | C++ | CAN | Embedded SystemsHybrid workSenior-level Full TimeHaryana, Gurugram International Techpark, Block I …15h ago