Sr Data Platform Lead
Tasks
- Build governed self service portal for data engineers
- Build platform tooling and automation
- Collaborate with enterprise data architecture and governance teams
- Define platform observability KPIs metrics and telemetry
- Deliver data platform capabilities
- Design build and productionize reusable platform frameworks
- Develop Python microservices and deploy on Docker Kubernetes
- Drive engineering excellence and AI adoption
- Enable data governance metadata and data bundle capabilities
- Enforce proactive governance cost optimization and best practices
- Evaluate Databricks capabilities
- Integrate Databricks with Collibra
- Lead user enablement and adoption initiatives
- Run technical assessments and PoCs
- Translate business requirements into scalable data platform capabilities
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Agile | Apache Spark | Ataccama | CI/CD | Collibra | Collibra Integrations | Cost Optimization | Data Governance | Data Lineage | Data Modeling | Data Observability | Data Quality | Databricks | Databricks SDK | Dimensional Modeling | Docker | EC2 | EKS | EMR | Glue | Jira | Kubernetes | Lambda | Metadata Management | Monte Carlo | Python | RDS | REST APIs | Redshift | S3 | SAFe | SQL | Telemetry | Unity Catalog | Vector Databases
Education
Related jobs
-
Manager - Client services INR 2000K-4000KAgile | Amazon Web Services | Artificial Intelligence | Azure | Bias MitigationSenior-level Full TimeIN-AP-Hyderabad18h ago
-
Assistant Director,Collections Analytics Lead INR 2040K-2755KAWS | Alteryx | Audit compliance | Azure | BigQuerySenior-level Full TimeKolkata, West Bengal, India R18h ago
-
Mid-level Full TimeBangalore, Karnataka, India R18h ago
-
Senior Tech Lead - Data Engineering / Consultant Specialist INR 2040K-4000KAPI | Apache Airflow | Apache Beam | Autoscaling | BigQueryContinuous professional development | Flexible workingSenior-level Full TimeHyderabad, Telangana, India R19h ago
-
Technical Program Manager, Fleet Optimization INR 1500K-3300KBusiness case | Business case development | Case Development | Chain management | Data analyticsMid-level Full TimeBengaluru, Karnataka, India20h ago
-
Senior-level Full TimeHyderabad, Telangana, India21h ago
-
Sr Specialist, Data Engineering INR 2400K-3380KApache Airflow | CI/CD | Cloud Build | Cloud Storage | Cloud platformRelocation assistance within countrySenior-level Full TimeMumbai, MH, IN23h ago
-
Lead - Data Scientist INR 2500K-4500KAnomaly Detection | Calculus | Cross-validation | Data Preprocessing | DatabasesSenior-level Full TimeBengaluru, India1d ago
-
Databricks - Assistant Manager INR 2000K-2500KApache Spark | Data Modeling | Data Warehousing | Data pipeline | DatabricksSenior-level Full TimeBangalore, Karnataka, India1d ago
-
Associate Process Manager INR 500K-1500KCloud platform | Data Governance | Data Modeling | Data Quality | Data WarehousingMid-level Full TimePune, Maharashtra, India1d ago
-
GCP Data Engineer Lead INR 1500K-2500KApache Airflow | BigQuery | CI/CD | Cloud Composer | Cloud FunctionsSenior-level Full TimeHyderabad, TS, India1d ago
-
Data Delivery lead/ Associate Director, Data and Analytics INR 700K-1200KAgentic AI | Agile | Apache Airflow | Apache Kafka | Apache NiFiMid-level Full TimeHyderabad, Telangana, India R1d ago
-
Principal AI Engineer INR 2000K-4500KAPI Integration | AWS Bedrock | Agent Orchestration | CI/CD | Deep learningSenior-level Full TimeBangalore, KA, IN1d ago
-
Data Engineering Team Lead INR 3000K-4000KAgile | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkSenior-level Full TimeBengaluru, Karnātaka, India1d ago
-
Manager Advanced Analytics and Insights (L09) INR 850K-1250KData Mining | Data Visualization | Excel | Forecasting | PowerPointCareer advancement | Flexible work hours | Upskilling opportunities | Work from homeMid-level Full TimeHyderabad IN, India1d ago
-
Manager, Data Engineering INR 1000K-2000KData Architecture | Data Engineering | Data Governance | Data Pipelines | Data QualityMid-level Full TimePune, India1d ago
-
SAP Analytics Lead INR 3000K-4000KAnalytics Cloud | Analytics architecture | Analytics governance | BW4HANA | Business Data CloudCulture awards | Flexible schedule | Innovation autonomy | Work-life balanceSenior-level Full TimeMumbai, India1d ago
-
Data Engineering Team Lead INR 3000K-4000KAgile | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkCareer Development Programs | Flexible work-life balance | Health and wellbeing benefits | Hybrid work scheduleSenior-level Full TimeBengaluru, Karnātaka, India1d ago
-
Senior Manager, Vx Data Governance and Enablement INR 1500K-2500KAgile | Change Management | Curriculum Development | Data Governance | Data ManagementSenior-level Full TimeIND - Mumbai, India1d ago
-
Application Integration | Artificial Intelligence | Debugging | Full Stack | Full-Stack DevelopmentSenior-level Full TimeTOWER B, EON FREE ZONE II, …1d ago
-
Data Engineering & Analytics, Software Engineering MTS INR 2775K-4500KDashboard Design | Data Modeling | Data Quality | Data Transformation | Data WarehousingSenior-level Full TimeIndia - Hyderabad1d ago
-
Lead Gen AI Full Stack Developer – eCommerce INR 2500K-4995KAPI Gateway | AWS Bedrock | AWS Lambda | Amazon DynamoDB | Amazon ECSBonus program | Flexible work hours | Medical, dental & vision coverage | Paid parental leave | Paid time offSenior-level Full TimeIndia, Bengaluru1d ago
-
Global Data Analytics Lead - Internal Audit INR 900K-900KAdvanced Analytics | Audit Analytics | Automation | Continuous controls monitoring | Controls monitoringCompetitive benefits | Hybrid work | Wellness programsEntry-level Full TimeIN, BANGALORE, India1d ago
-
Quantitative Development Manager INR 1400K-2400KAutomated testing | Bitbucket | Build Automation | C++ | Continuous integrationMid-level Full TimeBengaluru, India1d ago
-
Site Reliability Engineering Front Line Manager INR 1800K-2500KAWS | Ansible | Availability Engineering | Bash | ChefGuided career tracks | Healthcare packages | Hybrid work setting | Online learning platform | Organizational growth potentialMid-level Full TimeIND-Pune-Equifax Analytics-PEC, India1d ago