Senior Lead Data Engineer- Data Platform
IN - HYDERABAD ORION, India
INR 2771K-4000K (estimate) Senior-level Full Time
Tasks
- Automate deployments and manage releases
- Ensure governed access with IAM and Lake Formation
- Implement metadata driven onboarding workflows
- Lead offshore team delivery and quality
- Maintain Delta Lake and Iceberg table interoperability
- Maintain secure and compliant platform operations
- Migrate data pipelines to Databricks
- Monitor production pipelines and manage incidents
- Onboard new data assets to enterprise platform
- Optimize data ingestion and transformations
- Perform data quality checks and reconciliation
- Prepare validate and publish data assets
- Provide auditability and lineage controls
- Provide technical guidance code reviews and mentoring
- Support data mastering platform integrations
- Support pipeline operations and troubleshooting
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Data | AWS Data Catalog | AWS Glue | AWS IAM | AWS Kinesis | AWS Lake | AWS Lake Formation | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatch | Amazon S3 | Apache Iceberg | CI/CD | Data Catalog | Data Governance | Data Lineage | Data Quality | Databricks | Delta Lake | Infrastructure as Code | Lake Formation | PySpark | Python | SQL | Spark | Step Functions | Unity Catalog | “as-code”
Education
N/A
Roles
Data Engineer | Data Platform | Data Platform Lead | Engineer | Lead | Platform Lead | Senior Data Engineer
Related jobs
-
Mid-level Full TimeSaidapet17h ago
-
Senior Software Engineer - Optimization Topics INR 2200K-3465KAWS | AWS QuickSight | Agile | Amazon CloudWatch | AngularSenior-level Full TimePune - Maharashtra - India18h ago
-
Data Engineer(Snowflake + DBT) - Sub-Contractor INR 2040K-3880KDBT | Data Modeling | Data Pipelines | ETL | SQLPaid Holidays | Paid time offSenior-level Contract Full TimeBangalore, KARNATAKA, India18h ago
-
Senior-level Full TimeNoida, Uttar Pradesh, India18h ago
-
Software Engineer INR 346K-346KAPI Testing | Agile | Airflow | Azure | CI/CDEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimePune, MH, India19h ago
-
Staff Software Engineer, AI/ML GenAI, Google Ads INR 2500K-5000KC++ | Computer Vision | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeBengaluru, Karnataka, India19h ago
-
Entry-level Full TimePune, ASIA, India19h ago
-
Mid-level Full TimePune, Maharashtra, India20h ago
-
Senior-level Part TimeGurugram, Haryana, India20h ago
-
Lead Data Scientist INR 3000K-4000KBias reduction | Data Aggregation | Indirect estimation | Model Validation | Multivariate statisticsEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeVadodara, GJ, India20h ago
-
AES - DE - Generative AI Application Developers INR 2500K-5000K.NET | AI Agents | AI Foundry | AI guardrails | ASP.Net CoreSenior-level Full TimePune, Maharashtra, India21h ago
-
Data Integration Specialist INR 1500K-2600KAPI Integration | AWS | Apache Kafka | Azure | Azure DataSenior-level Full TimeBengaluru, IN, 56010321h ago
-
Lead Technical Consultant - Power BI Developer INR 2000K-4512KAI ethics | BI Data modeling | Conversational Analytics | Copilot | DAXHolidays | Paid time offSenior-level Full TimeIndia23h ago
-
Senior Cloud Engineer - AI-ML Platform INR 2500K-5000KAccess Control | Amazon Web Services | Apache Kafka | Azure DevOps | CloudFormationInclusion and belongingSenior-level Full TimeBangalore, Karnataka, IN, 5601001d ago
-
Software Engineer INR 2500K-4200KAI Large Language Models | AWS Glue | Access Management | Amazon Web Services | CloudFormationSenior-level Full TimeBangalore, Karnataka, IN, 5601001d ago
-
Agentic AI Platform Engineer INR 1900K-4000KA2A | API Security | Agent to Agent | Authentication | Azure DevOpsMid-level Full TimeBangalore, Karnataka, IN, 5601001d ago
-
Software Technician (Robotics Software Operations) INR 3000K-4000KBash | Git | Linux | Python | SSHSenior-level Full TimePune, Maharashtra, India1d ago
-
Data Quality Engineer INR 3000K-4000KAlerting | Apache Airflow | Apache Spark | Automated testing | Cause analysisChildcare services | Employee assistance program | Medical insurance | Paid time offSenior-level Full TimeBangalore, Karnataka, India1d ago
-
AI Assisted Development | Algorithms | Amazon S3 | Apache Iceberg | Cloud ComputingFlexible work schedule | Remote work optionsSenior-level Full TimeHyderabad, India R1d ago
-
Senior Consultant_Python, Java AI / ML Engineer INR 2500K-4500KAPI Gateway | AWS | AgentCore) | Amazon Bedrock | AngularSenior-level Full TimeHyderabad, IN, 500081 R1d ago
-
ML Engineer INR 2400K-3000KClassification | Clustering | Computer Vision | Deep learning | DevOpsAnnual leave | Digital learning platforms | Employee assistance program | Flexible working arrangements | Learning & development opportunitiesMid-level Full TimeBangalore, IN1d ago
-
Senior Technical Specialist - AWS/AWS Lambda/AWS Glue/AWS SNS INR 1400K-2600KAWS Glue | AWS Lambda | AWS Redshift | AWS SNS | AgileSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
AWS | Agile | Azure | CI/CD | Cloud platformFully remote | Professional growthSenior-level Full TimeIndia R1d ago
-
Lead Software Engineer - Machine Learning INR 5000K-6000KAPI Design | Data pipeline | Distributed Systems | MLOps | Machine LearningSenior-level Full TimeChennai, TN, India1d ago
-
Senior-level Full TimePune, Maharashtra, India1d ago