Lead, Data Engineering
IN - HYDERABAD ORION, India
INR 2771K-4064K (estimate) Senior-level Full Time
Tasks
- Automate deployments and release management
- Coordinate with governance and cloud teams
- Design lakehouse table and publication patterns
- Document onboarding procedures
- Ensure observability and monitoring
- Implement data lineage and auditability controls
- Integrate pipelines with data mastering platform
- Maintain secure and compliant platform operations
- Manage data access and permissions
- Manage production deployment monitoring and incidents
- Migrate data pipelines to Databricks
- Onboard new data assets to data platform
- Operate and troubleshoot data pipelines
- Optimize pipeline performance and reliability
- Perform data quality checks and reconciliation
- Provide technical guidance and mentor engineers
- Review code and manage delivery timelines
- Support governed metadata driven ingestion
- Tune pipeline performance in production
- Validate and publish data assets
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | AWS IAM | AWS Lake | AWS Lake Formation | AWS Lambda | Amazon Athena | Amazon CloudWatch | Amazon S3 | Apache Iceberg | CI/CD | Data Engineering | Data Lineage | Data Quality | Databricks | Delta Lake | Infrastructure as Code | Job Observability | Lake Formation | Metadata Management | Metadata catalog | PySpark | Python | SQL | Spark | Unity Catalog | Version control | “as-code”
Education
N/A
Roles
Data Engineer | Data Platform | Data Platform Lead | Engineer | Lead | Platform Lead | Senior Data Engineer
Related jobs
-
Databricks and Splunk Engineer - Senior Associate INR 3264K-4500KAmazon Web Services | Analytics | Azure | Cloud Computing | Cyber ThreatEmployee networks | Flexible work/life support | Hybrid work schedule | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeBangalore, India R6h ago
-
Senior Software Engineer INR 2771K-4064KAngular | Apache Hadoop | Apache Hive | Apache Spark | DockerSenior-level Full TimeBangalore, India7h ago
-
Senior-level Full TimeBangalore North, India13h ago
-
Senior-level Full TimeBangalore North, India13h ago
-
Senior-level Full TimeBangalore North, India13h ago
-
Data Engineer (ETL ODI) - AMS INR 1500K-2500KAPIs | Data Governance | Data Integrator | Data Modeling | Data QualityMid-level Full TimeBangalore North, India13h ago
-
Software Engineer INR 1200K-2500KAI Evaluation | Agile | Artifactory | Automated testing | Azure DevOpsEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India14h ago
-
Mid-level Full TimeGurugram - Haryana - India Pune …14h ago
-
Advanced Engineer - AI/ML with Devops(GCP,AWS) INR 2500K-4200KAWS | Airflow | Amazon Web Services | Apache Spark | Artificial IntelligenceAccess to cutting-edge technologies | Collaborative work environment | Professional development | Training opportunitiesSenior-level Full TimeBangalore - Karnataka, India - Kalyani …15h ago
-
Sr AI Solutions Engineer (Generative AI & Agentic AI) INR 3242K-4062KAI Agent Builder | Agent Builder | Agent Orchestration | BigQuery | Claude APISenior-level Full TimePune, MH, India16h ago
-
Data Engineer INR 3000K-4000KAWS | Amazon Aurora | Automation | Azure | Data ManagementBike to work | Career development program | Educational assistance | Employee assistance program | Employee discountSenior-level Full TimeBengaluru, KA, India R17h ago
-
AI Development Strategy Lead INR 2500K-5000KAgent Orchestration | BI frameworks | Business Intelligence | C++ | Cloud DataSenior-level Full TimeBengaluru, Karnataka, India17h ago
-
Data and AI Engineer, Google Cloud INR 2000K-3300KAlgorithms | Architectural frameworks | Batch Processing | Cloud platform | Data PipelinesSenior-level Full TimeBengaluru, Karnataka, India; Hyderabad, Telangana, India17h ago
-
Software Engineer INR 1200K-2500KAgentic AI | Agile | Artifactory | Azure DevOps | Backend DevelopmentEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India17h ago
-
Senior-level Full TimeGurugram, Haryana, India18h ago
-
Mid-level Full TimeBengaluru, Karnataka, India18h ago
-
Principal Software Engineer INR 2475K-4800KAPI Design | Agent Orchestration | Agentic Systems | Automation | By DesignAgile environment | Feature flags | High autonomy | Inclusive culture | Mentorship and coachingSenior-level Full TimeIndia, Telangana, Hyderabad18h ago
-
FDH Support Leader INR 2500K-3500KAlerting | CI/CD | Data Contracts | Data Lineage | Data ObservabilitySenior-level Full TimePune, Maharashtra, IND, 41101318h ago
-
Associate Engineer INR 1500K-2500KAnalysis Services | Analysis Services Tabular | Azure Analysis | Azure Analysis Services | Azure Analysis Services TabularMid-level Full TimeHyderabad, IN18h ago
-
Robotics Engineer Fresher INR 300K-400KArduino | Artificial Intelligence | Automation | C plus plus | ElectronicsCareer growth opportunities | Exposure to robotics competitions | Hands on experience with robotics and AI | Opportunity to mentor students globallyEntry-level Full TimeBangalore, Karnataka, India18h ago
-
Senior Data Engineer- Managed services INR 3000K-4000KAzure Cloud | Azure Cloud Adoption | Azure Cloud adoption framework | Azure Data | Azure Data FactoryRemote work opportunitySenior-level Full TimePune, MH, India18h ago
-
Software Engineer III - Data Engineer - Java, Spark, Databricks INR 2000K-3000KAmazon Web Services | Apache Spark | Application Programming | Application Programming Interfaces | Artificial IntelligenceSenior-level Full TimeBengaluru, Karnataka, India19h ago
-
Manager - Data Engineering INR 1500K-2600KAgile | Apache Airflow | Apache Spark | CTE | Data MonitoringSenior-level Full TimeHyderabad, TS, India19h ago
-
Software Engineer III - Python, PySpark, Databricks, Big Data INR 2000K-2700KAPI Design | AWS Bedrock | Airflow | Amazon Web Services | Apache IcebergSenior-level Full TimeHyderabad, Telangana, India19h ago
-
Senior Software Engineer - Data Platform INR 2516K-3380KApache Spark | C# | C++ | Data Pipelines | Distributed SystemsSenior-level Full TimeIndia, Karnataka, Bangalore; India, Telangana, Hyderabad19h ago