Senior Lead Data Engineer- Data Platform
IN - HYDERABAD ORION, India
INR 2771K-4000K (estimate) Senior-level Full Time
Tasks
- Design lakehouse tables and publication patterns
- Enforce governed secure data access and permissions
- Follow deployment monitoring and incident management procedures
- Implement data ingestion transformation and monitoring
- Implement deployment automation and release management
- Lead small engineering team technical guidance code reviews and mentoring
- Manage metadata driven onboarding workflows
- Migrate data pipelines to Databricks
- Onboard new data assets to enterprise platform
- Perform data quality checks and reconciliation
- Perform production support and performance tuning
- Prepare validate and publish data assets
- Provide lineage and auditability controls
- Standardize data layers for bronze silver and gold
- Support cloud monitoring and operational visibility
- Support data pipeline integration with data mastering platform
- Support pipeline operations troubleshooting and optimization
- Troubleshoot data ingestion and mastering workflows
- Use infrastructure as code for cloud deployment automation
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | AWS IAM | AWS Lake | AWS Lake Formation | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatch | Amazon S3 | Apache Iceberg | Apache Spark | CI/CD | Databricks | Delta Lake | Infrastructure as Code | Lake Formation | PySpark | Python | SQL | Step Functions | Unity Catalog | “as-code”
Education
N/A
Roles
Data Engineer | Data Platform | Data Platform Lead | Engineer | Lead | Platform Lead | Senior Data Engineer
Related jobs
-
AI Engineer INR 2475K-4200KAgentic Systems | Azure OpenAI | Azure OpenAI APIs | Azure OpenAI SDK | Cloud IntegrationEntry-level Full TimeBengaluru, KA, IN3h ago
-
AI/ML Expert INR 2500K-5000KAgent systems | Edge Computing | Embedded Systems | Entity Extraction | Fine TuningSenior-level Full Timepune, India3h ago
-
Associate Distinguished Engineer (Agentic AI Architect) INR 1500K-3000KAI Governance | AI architecture | AI orchestration | APIs | AWSMid-level Full TimeIndia, India4h ago
-
AWS SageMaker | Airflow | Amazon EC2 | Amazon EKS | Computer VisionContinuous learning and development | Flexible schedule | Fully remote | Mentorship opportunitiesMid-level Full TimeIndia R4h ago
-
Data Scientist INR 3000K-4000K3D Perception | Active Learning | Computer Vision | Container Orchestration | Data AnnotationSenior-level Full TimeBengaluru, KA, India4h ago
-
Senior-level Full Timecoimbatore, India4h ago
-
Senior Data Engineer (Python, PySpark, Kafka) INR 1500K-2700KApache Kafka | Data Warehousing | Dimensional Modeling | Git | GitHubSenior-level Full TimeBangalore, India4h ago
-
Data Engineer_Sr_Python Specialist INR 1500K-2500KAPIs | Alerting | Data Augmentation | Data Lineage | Data ModelingSenior-level Full Timebangalore, India4h ago
-
Senior-level Full Timebangalore, India4h ago
-
MLOps Engineer III INR 2500K-3465KAWS Bedrock | AWS SageMaker | CI/CD | Docker | KubernetesComprehensive insurance | Education assistance program | Fitness benefits | Flexible working hours | Health checkupsSenior-level Full TimeBengaluru, Karnataka, India5h ago
-
Senior Software Engineer INR 2475K-3465KCI/CD | Data Modeling | Exception Handling | FastAPI | GitHubEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India5h ago
-
Senior-level Full TimeHyderabad - Phoenix Equinox Tower 2, …10h ago
-
Data Modeler INR 2520K-4000KAWS | Access Control | Azure | Cloud Data | Cloud data platformFlexible work arrangementsMid-level Full TimeNoida / Gurgaon, DL, IN10h ago
-
Mid-level Full TimeBengaluru, KA, IN10h ago
-
AI workflows | API Integration | Big Data | Big Data Technologies | Cloud ComputingFlexible work environment | Hybrid work | Professional development opportunities | Supportive leadershipSenior-level Full TimeMumbai - Hiranandani, India R10h ago
-
Test Lead – Embedded Systems & Test Automation INR 2000K-3000KBuildroot | CI Pipeline | CI/CD | Embedded Linux | Embedded RTOSSenior-level Full Timebangalore, India15h ago
-
Associate AI-ML Engineer INR 3200K-4500KCI/CD | CrewAI | Databases | Docker | Generative AILearning and growth | Mentorship | Mentorship from technology leadersMid-level Full TimeBengaluru East, Karnataka, India R17h ago
-
AI Engineer II (Remote) USD 39K-72KAPIs | AWS | CI/CD | Data workflows | Distributed SystemsFull-time employment | Remote workMid-level Full TimeIndia, Remote R17h ago
-
Mid-level Full TimeShaikpet, India19h ago
-
Data Warehouse, ETL, Cloud / Consultant Specialist INR 3000K-4000KAWS | Agile | Ansible | Cloud platform | Confluent KafkaFlexible working | Inclusive work environment | Professional developmentSenior-level Full TimePune, Maharashtra, India R20h ago
-
Analyst, Business Intelligence INR 3242K-5000KAgile | Anomaly Detection | Azure OpenAI | CI/CD | Data ValidationEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India21h ago
-
Data Engineer INR 1500K-2500KAPI Development | AWS | Amazon Kinesis | Amazon Redshift | Apache KafkaDiscounted gym memberships | Flexible working | Life assurance | Medical insurance | Pension schemeMid-level Full TimeHyderabad, India21h ago
-
Senior-level Full TimeIN-TN-Chennai21h ago
-
Databricks Data Engineer INR 1500K-2200KApache Spark | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksMid-level Full TimeIN-KA-Bangalore21h ago
-
Senior-level Full TimeIN-AP-Hyderabad21h ago