Manager
Tasks
- Apply DevOps practices for data engineering
- Build Databricks data pipelines
- Design lakehouse medallion architecture
- Develop Spark jobs with PySpark and Spark SQL
- Enforce data quality frameworks
- Implement Delta Lake solutions
- Ingest structured and unstructured data
- Perform performance tuning
- Set up CI CD for data pipelines
- Use Git for version control
- Write SQL for large scale datasets
Perks/Benefits
Skills/Tech-stack
Apache Spark | CI/CD | Data Modeling | Data Quality | Databricks | Delta Lake | DevOps | Git | Performance Tuning | PySpark | SQL | Spark SQL
Education
Related jobs
-
Senior Engineering Manager (AI) INR 3264K-5876KAI-assisted coding | API Design | AWS | Assisted coding | CI/CDSenior-level Full TimeHyderabad, India9h ago
-
MGR I SALES OPS - Commercial Analytics and Business Intelligence INR 2516K-3380KAnalytical judgment | Business acumen | CRM | Commercial Analytics | Commercial financeComprehensive benefits | Health insurance | Hospitalization insurance | Meal vouchers | Training and growth opportunitiesSenior-level Full TimeBangalore, KA, IN, 56006611h ago
-
Senior Consultant_AWS Developer INR 1500K-3500KAWS Glue | AWS Lambda | AWS Step Functions | AWS Storage Gateway | AWS storageSenior-level Full TimeThane, IN, 40060411h ago
-
EY - GDS Consulting - AI And DATA -AI Architect - Manager INR 4000K-5572KAI Foundry | AWS Bedrock | Access Control | Agentic AI | Artificial IntelligenceCareer development opportunities | Coaching and feedback | Flexible working arrangements | Individual progression planSenior-level Full TimeBengaluru, KA, IN, 56001617h ago
-
Automation and AI Developer INR 3264K-4408KAWS Bedrock | Agent systems | Amazon AgentCore | Async Programming | Automated RegressionFlexible vacation | Headspace access | Hybrid work model | Mental health days | Paid volunteer days offMid-level Full TimeIndia, Hyderabad, Telangana R17h ago
-
Agile | Angular | Bash | CI/CD | Continuous integrationSenior-level Full TimeMumbai Goregaon, India17h ago
-
Custom Software Engineer INR 1200K-2000KApache Spark | Clustering | Data Normalization | Data Transformation | Data VisualizationMid-level Full TimeCoimbatore, CODC1A, India17h ago
-
EY - GDS Consulting - AI And DATA -SF Architect - Manager INR 2500K-4000KBatch Processing | Cloud Data | Cloud Data Warehouse | DBT | Data WarehouseCareer development opportunities | Coaching and feedback | Flexible work arrangements | Knowledge sharingSenior-level Full TimeBengaluru, KA, IN, 56001617h ago
-
Agile | Airflow | Amazon Redshift | Apache Airflow | AppDynamicsSenior-level Full TimeHyderabad-Hi-Tec City, India17h ago
-
Analytics | Business Intelligence | Consultative selling | Customer Success | Dashboard DevelopmentSenior-level Full TimeHyderabad - India17h ago
-
Spclst , Data Engineering INR 2475K-3380KAWS | Agile methodology | Amazon Redshift | Apache Iceberg | Azure DevOpsSenior-level Full TimeIND - Telangana - Hyderabad (HITEC …17h ago
-
Senior Associate, Data Manager, Clinical Data Sciences INR 1448K-2390KAnalytics | Clinical data | Clinical data management | Clinical trials | Data ManagementSenior-level Full TimeIND - Mumbai, India17h ago
-
AI Agents | Analytics reporting | Artificial Intelligence | Business Intelligence | DBTCareer growth opportunities | Collaborative & Inclusive Culture | Flexibility to work from anywhere in India | Fully remote work | Leadership opportunitiesSenior-level Full TimeIndia R17h ago
-
Senior Analyst INR 3000K-4000KAlteryx | Automation | Client Onboarding | Collibra | Data EnrichmentSenior-level Full TimeChandigarh, India1d ago
-
Senior-level Full TimeIN-KA-Bangalore1d ago
-
Product Manager, Google Cloud Dataproc INR 1000K-2200KApache Hadoop | Apache Spark | Data analytics | Go-to-market | Key ResultsCross-functional collaboration | Global customer interaction | Work with open source projectsMid-level Full TimeBengaluru, Karnataka, India1d ago
-
Mid-level Full TimeBangalore, Karnataka, India1d ago
-
Engineering Manager INR 3264K-5876KAPI Design | AWS | AWS Glue | Agile | Batch ProcessingEnhanced medical benefits | Family wellbeing benefits | Hybrid work | Paid time off | Wellness programsSenior-level Full TimeHyderabad, India1d ago
-
Senior-level Full TimeBengaluru, Karnataka, India1d ago
-
Senior AVP Enterprise Digital - Lead Data Management INR 2000K-4000KAlerting | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeNoida, Uttar Pradesh, India1d ago
-
Software Engineering Manager (StorageGrid) INR 1800K-3500KAgile | CI/CD | Cloud infrastructure | Distributed Systems | HTTPSMid-level Full TimeBangalore, India Office (BANGALORE) R1d ago
-
Senior-level Full TimePune, Maharashtra, India1d ago
-
Manager , Data and Analytics INR 700K-1200KBigQuery | Business Intelligence | Cloud platform | Confluence | DashboardingMid-level Full TimeKolkata, West Bengal, India R1d ago
-
Assistant Director, RC AI and Analytics INR 3000K-4500KAdvanced Excel | Amazon Web Services | Apache Spark | Cloud Architecture | Cloud platformExecutive-level Full TimeKolkata, West Bengal, India R1d ago
-
Software Development Engineer INR 1430K-2200KAPIs | Agile | Anonymization | Batch Job Scheduling | Batch jobMid-level Full TimeChennai, Tamil Nadu, India1d ago