Senior Lead Data Engineer- Data Platform
IN - HYDERABAD ORION, India
INR 2771K-4000K (estimate) Senior-level Full Time
Tasks
- Design lakehouse tables and publication patterns
- Enforce governed secure data access and permissions
- Follow deployment monitoring and incident management procedures
- Implement data ingestion transformation and monitoring
- Implement deployment automation and release management
- Lead small engineering team technical guidance code reviews and mentoring
- Manage metadata driven onboarding workflows
- Migrate data pipelines to Databricks
- Onboard new data assets to enterprise platform
- Perform data quality checks and reconciliation
- Perform production support and performance tuning
- Prepare validate and publish data assets
- Provide lineage and auditability controls
- Standardize data layers for bronze silver and gold
- Support cloud monitoring and operational visibility
- Support data pipeline integration with data mastering platform
- Support pipeline operations troubleshooting and optimization
- Troubleshoot data ingestion and mastering workflows
- Use infrastructure as code for cloud deployment automation
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | AWS IAM | AWS Lake | AWS Lake Formation | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatch | Amazon S3 | Apache Iceberg | Apache Spark | CI/CD | Databricks | Delta Lake | Infrastructure as Code | Lake Formation | PySpark | Python | SQL | Step Functions | Unity Catalog | “as-code”
Education
N/A
Roles
Data Engineer | Data Platform | Data Platform Lead | Engineer | Lead | Platform Lead | Senior Data Engineer
Related jobs
-
Databricks and Splunk Engineer - Senior Associate INR 3264K-4500KAmazon Web Services | Analytics | Azure | Cloud Computing | Cyber ThreatEmployee networks | Flexible work/life support | Hybrid work schedule | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeBangalore, India R6h ago
-
Senior Software Engineer INR 2771K-4064KAngular | Apache Hadoop | Apache Hive | Apache Spark | DockerSenior-level Full TimeBangalore, India7h ago
-
Senior-level Full TimeBangalore North, India13h ago
-
Senior-level Full TimeBangalore North, India13h ago
-
Senior-level Full TimeBangalore North, India13h ago
-
Data Engineer (ETL ODI) - AMS INR 1500K-2500KAPIs | Data Governance | Data Integrator | Data Modeling | Data QualityMid-level Full TimeBangalore North, India13h ago
-
Software Engineer INR 1200K-2500KAI Evaluation | Agile | Artifactory | Automated testing | Azure DevOpsEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India14h ago
-
Mid-level Full TimeGurugram - Haryana - India Pune …14h ago
-
Advanced Engineer - AI/ML with Devops(GCP,AWS) INR 2500K-4200KAWS | Airflow | Amazon Web Services | Apache Spark | Artificial IntelligenceAccess to cutting-edge technologies | Collaborative work environment | Professional development | Training opportunitiesSenior-level Full TimeBangalore - Karnataka, India - Kalyani …16h ago
-
Sr AI Solutions Engineer (Generative AI & Agentic AI) INR 3242K-4062KAI Agent Builder | Agent Builder | Agent Orchestration | BigQuery | Claude APISenior-level Full TimePune, MH, India16h ago
-
Data Engineer INR 3000K-4000KAWS | Amazon Aurora | Automation | Azure | Data ManagementBike to work | Career development program | Educational assistance | Employee assistance program | Employee discountSenior-level Full TimeBengaluru, KA, India R17h ago
-
AI Development Strategy Lead INR 2500K-5000KAgent Orchestration | BI frameworks | Business Intelligence | C++ | Cloud DataSenior-level Full TimeBengaluru, Karnataka, India17h ago
-
Data and AI Engineer, Google Cloud INR 2000K-3300KAlgorithms | Architectural frameworks | Batch Processing | Cloud platform | Data PipelinesSenior-level Full TimeBengaluru, Karnataka, India; Hyderabad, Telangana, India17h ago
-
Software Engineer INR 1200K-2500KAgentic AI | Agile | Artifactory | Azure DevOps | Backend DevelopmentEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India18h ago
-
Senior-level Full TimeGurugram, Haryana, India18h ago
-
Mid-level Full TimeBengaluru, Karnataka, India18h ago
-
Principal Software Engineer INR 2475K-4800KAPI Design | Agent Orchestration | Agentic Systems | Automation | By DesignAgile environment | Feature flags | High autonomy | Inclusive culture | Mentorship and coachingSenior-level Full TimeIndia, Telangana, Hyderabad18h ago
-
FDH Support Leader INR 2500K-3500KAlerting | CI/CD | Data Contracts | Data Lineage | Data ObservabilitySenior-level Full TimePune, Maharashtra, IND, 41101318h ago
-
Associate Engineer INR 1500K-2500KAnalysis Services | Analysis Services Tabular | Azure Analysis | Azure Analysis Services | Azure Analysis Services TabularMid-level Full TimeHyderabad, IN18h ago
-
Robotics Engineer Fresher INR 300K-400KArduino | Artificial Intelligence | Automation | C plus plus | ElectronicsCareer growth opportunities | Exposure to robotics competitions | Hands on experience with robotics and AI | Opportunity to mentor students globallyEntry-level Full TimeBangalore, Karnataka, India18h ago
-
Senior Data Engineer- Managed services INR 3000K-4000KAzure Cloud | Azure Cloud Adoption | Azure Cloud adoption framework | Azure Data | Azure Data FactoryRemote work opportunitySenior-level Full TimePune, MH, India18h ago
-
Software Engineer III - Data Engineer - Java, Spark, Databricks INR 2000K-3000KAmazon Web Services | Apache Spark | Application Programming | Application Programming Interfaces | Artificial IntelligenceSenior-level Full TimeBengaluru, Karnataka, India19h ago
-
Manager - Data Engineering INR 1500K-2600KAgile | Apache Airflow | Apache Spark | CTE | Data MonitoringSenior-level Full TimeHyderabad, TS, India19h ago
-
Software Engineer III - Python, PySpark, Databricks, Big Data INR 2000K-2700KAPI Design | AWS Bedrock | Airflow | Amazon Web Services | Apache IcebergSenior-level Full TimeHyderabad, Telangana, India19h ago
-
Senior Software Engineer - Data Platform INR 2516K-3380KApache Spark | C# | C++ | Data Pipelines | Distributed SystemsSenior-level Full TimeIndia, Karnataka, Bangalore; India, Telangana, Hyderabad19h ago