Manager
Tasks
- Apply DevOps practices for data engineering
- Build Databricks data pipelines
- Design lakehouse medallion architecture
- Develop Spark jobs with PySpark and Spark SQL
- Enforce data quality frameworks
- Implement Delta Lake solutions
- Ingest structured and unstructured data
- Perform performance tuning
- Set up CI CD for data pipelines
- Use Git for version control
- Write SQL for large scale datasets
Perks/Benefits
Skills/Tech-stack
Apache Spark | CI/CD | Data Modeling | Data Quality | Databricks | Delta Lake | DevOps | Git | Performance Tuning | PySpark | SQL | Spark SQL
Education
Related jobs
-
Engineering Manager – Fullstack & AI Engineering INR 1800K-3000KAI Observability | API Design | AWS | Angular | AzureMid-level Full TimeMaharashtra, Pune, India10h ago
-
ETL Developer INR 800K-1500KAutomated testing | Data Monitoring | Data Quality | Data Validation | ETLMid-level Full TimeIN-TN-Chennai11h ago
-
Mid-level Full TimeBangalore, Karnataka, India12h ago
-
Mid-level Full TimeBangalore, Karnataka, India12h ago
-
Consultant - Python Developer with Gen AI INR 1500K-2200KAgile | Azure | Azure OpenAI | CSS | DockerMid-level Full TimeBangalore, Karnataka, India12h ago
-
Consultant - Python Developer with Gen AI INR 1500K-2200KAI Search | Agile | Azure | Azure OpenAI | CSSMid-level Full TimeBangalore, Karnataka, India12h ago
-
Consultant - Python Developer with Gen AI INR 1500K-2200KAI Search | Agile | Azure | Azure OpenAI | CSSMid-level Full TimeBangalore, Karnataka, India12h ago
-
Consultant - Python Developer with Gen AI INR 1500K-2200KAzure | Azure OpenAI | CSS | Docker | FastAPIMid-level Full TimeBangalore, Karnataka, India12h ago
-
Consultant - Python Developer with Gen AI INR 1500K-2200KAgile | Azure | Azure OpenAI | CSS | DockerMid-level Full TimeBangalore, Karnataka, India12h ago
-
Manager, YouTube Data Engineering INR 2520K-3880KAgile | Business Intelligence | Data Modeling | Data Pipelines | Dimensional ModelingSenior-level Full TimeBengaluru, Karnataka, India12h ago
-
Product Data Scientist Manager, Play Monetization INR 2000K-3000KA/B | A/B Testing | B testing | Classification | Data InfrastructureSenior-level Full TimeBengaluru, Karnataka, India12h ago
-
Mgr, Data Science INR 1000K-2500KAI machine learning | Advanced Analytics | Agile | Apache Spark | AutomationSenior-level Full TimeIN-Bangalore (3811)12h ago
-
Data Visualisation /Associate Director, Data and AnalyticsAssociate Director, Data and Analytics INR 1400K-2400KAccess Control | Business Intelligence | Data Analysis | Data Modeling | Data VisualizationMid-level Full TimeHyderabad, Telangana, India R13h ago
-
Consultant - Python Developer with Gen AI and AI Foundry INR 2000K-3300KAWS | Autogen | Azure | Azure OpenAI | CI/CDSenior-level Full TimeBangalore, Karnataka, India14h ago
-
Consultant INR 1500K-2000KAlert automation | Dashboard automation | Data Dictionary | Data Mapping | Data QualityMid-level Full TimeIndia15h ago
-
Data Analyst INR 3000K-4000KAzure | Azure Data | Azure Data Factory | DAX | Data FactoryCollaborative team environment | Leadership development programs | Training sessionsSenior-level Full TimeMumbai, Maharashtra, India16h ago
-
Senior Data Analyst INR 3000K-4000KALM | Azure | DAX | DAX Studio | Data ModelingCollaborative team environment | Leadership development programs | Opportunity to lead AI projects | Training sessionsSenior-level Full TimeMumbai, Maharashtra, India16h ago
-
Manager - Data Analyst INR 500K-1500KAWS | Azure | Data Analysis | Data Transformation | Data cleaningMid-level Full TimeBangalore, Karnataka, India16h ago
-
AI Platform Engineering Manager (Data & Insights) INR 1800K-2500KAPI | Agent Frameworks | Cloud Computing | Cloud platform | Data GovernanceMid-level Full TimeChennai, Tamil Nadu, India17h ago
-
AES - DE - Generative AI Application Developers INR 3000K-4200KAWS Secrets | AWS Secrets Manager | Asyncio | Azure AD | CI/CDFull time contract with conversion path | Hybrid work optionsSenior-level Full TimeIndia18h ago
-
Mid-level Full TimeTamil Nadu, India19h ago
-
Databricks Assistant Manager INR 1000K-2000KApache Spark | Data Modeling | Data Pipelines | Data Warehousing | DatabricksMid-level Full TimeBangalore, Karnataka, India19h ago
-
Engineering Manager, Machine Learning INR 1000K-1800KAlerting | Architectural patterns | Automated testing | Batch Data Processing | Batch dataCell phone reimbursement | Healthcare | Hybrid work | Internet reimbursement | Learning and development stipendMid-level Full TimeBengaluru, India23h ago
-
Associate Project Manager INR 1000K-2000KAgile | Asana | Business Intelligence | Data Engineering | Data WarehousingHybrid workMid-level Full TimeMumbai, India23h ago
-
Analyst – Power BI Developer INR 3000K-4000KDAX | Data Governance | Data Modeling | Data Testing | Data WarehousingSenior-level Full TimeIndia - Bangalore23h ago