IN_Senior Associate_Data Engineer Databricks_Data and Analytics_Advisory_Hyderabad
Hyderabad - Salarpuria, India
INR 1500K-2800K (estimate) Senior-level Full Time
Tasks
- Build and maintain scalable data pipelines
- Design data pipelines end to end
- Develop Databricks notebooks jobs and workflows
- Document technical designs data flows and runbooks
- Ensure data quality reliability lineage and governance
- Implement batch and incremental processing
- Implement security access control and compliance
- Ingest and transform structured and semi structured datasets
- Mentor junior engineers and improve best practices
- Optimize Spark jobs for performance and cost
- Provide production support and troubleshoot pipeline issues
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Agile | Apache Spark | Auto Loader | Azure | CI/CD | Data Governance | Data Modeling | Data Warehousing | Databricks | Databricks Lakehouse | Delta Lake | Delta Lake multi hop architecture | Distributed Computing | ELT | ETL | GCP | PySpark | Python | SQL | Spark SQL | Streaming | Unity Catalog
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Senior Software Engineer (Web Scraping Gen AI Developer) INR 2829K-4500KAPIs | AWS | Azure | CI/CD | DockerEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimePune, MH, India12h ago
-
Staff Engineer, Search Intelligence INR 3000K-5000KAudio Processing | C++ | Classifiers | Data Processing | Data StructuresSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Staff Software Engineer, Search Intelligence INR 3000K-5500KData Processing | Data Structures | Data Structures and Algorithms | Distributed Computing | Fine TuningSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Senior Solutions Engineer INR 2000K-4131KApache Spark | Big Data | Big data analytics | Cloud Computing | Data EngineeringSenior-level Full TimeIndia1d ago
-
AI Agents | AI Governance | API Security | Auditability | Cloud SecurityHybrid work | Onsite supportMid-level Full TimeBengaluru, Karnataka, India R1d ago
-
Machine Learning Engineer - APAC INR 3000K-4408KA/B | A/B Testing | B testing | CI/CD | ClassificationBenefits for family | Flexible working arrangements | Learning and development resources | Sabbaticals | Study assistanceMid-level Full TimeIndia-Bengaluru (Helios Business Park)1d ago
-
26-2292: Databricks Engineer- India, Hyderabad INR 1000K-2000KAIOps | Access Control | Amazon S3 | Anonymization | Apache KafkaMid-level Full TimeHyderabad/Vijayawada1d ago
-
Lead Software Engineer - Workday INR 1800K-2600KAPI Gateway | AWS CloudWatch | AWS Elastic Load Balancing | AWS Lambda | AWS VPCSenior-level Full TimeOff Embassy Golf Links Business Park, …1d ago
-
Value Data Engineer INR 1800K-2400KAPI | AWS | Agile | Azure | Data EnrichmentCab drop | Cab pickup | Flexible working hours | Subsidized mealsMid-level Full TimeBHUBANESWAR, India2d ago
-
Software Site Reliability Engineer - AI & Data Platforms INR 2500K-4300KAWS | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkMid-level Full TimeHyderabad2d ago
-
Software Site Reliability Engineer - AI & Data Platforms INR 2500K-4300KAWS | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkMid-level Full TimeBengaluru2d ago
-
Principal Engineer, AI Architect INR 2000K-5000KAI Practices | API Integration | AWS | Agent Orchestration | AzureSenior-level Full TimeBengaluru, India2d ago
-
Senior AI Engineer (m/f/d) INR 3242K-5000KAPIs | AWS | Agents | Angular | AzureHome office setup budget | Learning and development budget | Relocation support | Visa support | Work from homeSenior-level Full TimeRemote EMEA, Remote India R2d ago
-
Senior Data Engineer INR 1500K-2500KAirflow | Apache Spark | Confluence | Data Warehousing | DatabricksSenior-level Full TimeBengaluru, KA, IN2d ago
-
Senior II Data Engineer INR 3600K-4995KData Intelligence | Data Modeling | Fusion Data Intelligence | Oracle Cloud | Oracle DatabaseFlexible workingSenior-level Full TimeIndia2d ago
-
SW Architect - AI Engineering INR 2500K-5000KAPI Development | AWS | Azure | Cloud platform | Cost OptimizationContinuous learning opportunities | Hybrid work opportunities | Supportive, inclusive work environment | Training programsSenior-level Full TimePune - Maharashtra - India2d ago
-
AI Solutions Engineer – Quality & Digitalization INR 2500K-4500KAnomaly Detection | Artificial Intelligence | Azure | Bias Mitigation | Cloud ComputingMid-level Full TimeBangalore - Karnataka - India2d ago
-
Staff Software Engineer - Multi Cloud Efficiency INR 2500K-4200KAWS | Agentic Systems | Automation | C plus plus | Cloud platformSenior-level Full TimeBengaluru, India2d ago
-
Senior-level Full TimeBengaluru, India2d ago
-
Sr. Software Engineer - Observability INR 2400K-4200KAlerting | C plus plus | Cloud Monitoring | Dashboards | Distributed SystemsSenior-level Full TimeBengaluru, India2d ago
-
Senior Software Engineer, Google Cloud INR 2000K-3300KAgentic AI | CI/CD | Cloud Computing | Code review | Distributed SystemsSenior-level Full TimeBengaluru, Karnataka, India2d ago
-
BigQuery | CI/CD | Cloud Functions | Cloud Run | Cloud StorageContinuous professional development | Flexible workingMid-level Full TimeHyderabad, Telangana, India R2d ago
-
Mid-level Full TimeIndia2d ago
-
Lead Software Engineer - (SRE principles , AI tools, AWS) INR 3000K-6000KAIOps | API Gateway | AWS ECS | AWS Lambda | Amazon APISenior-level Full TimeBengaluru, Karnataka, India2d ago
-
Senior-level Full TimeMADURAI, TAMIL NADU, India2d ago