Lead Data Engineer
Tasks
- Build and maintain CI CD pipelines and automation frameworks
- Build scalable data pipelines and analytics frameworks
- Configure governed access using RBAC and service principals
- Design and develop cloud native data and business intelligence solutions
- Ensure interoperability across compute engines and cloud providers
- Implement infrastructure as code for data platform provisioning
- Implement multi cloud architecture across AWS and Azure
- Integrate Databricks Snowflake and cloud services
- Lead technical design and mentor engineers
Perks/Benefits
- N/A
Skills/Tech-stack
ADLS Gen2 | AWS Glue | AWS IAM | AWS S3 | Access Control | Amazon EMR | Apache Iceberg | Automation | Azure AKS | Azure Databricks | CI/CD | Cloud Architecture | Cost Optimization | Data Access Control | Data Governance | Data Processing | Data access | Databricks | Delta Lake | Distributed Systems | FinOps | Infrastructure as Code | Multi-cloud | Multi-cloud architecture | Platform Observability | RBAC | Scalable Architecture | Service principals | Snowflake | “as-code”
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Staff Software Engineer, AI/ML and Moma Agentic INR 2500K-5000KArtificial Intelligence | C# | C++ | Database technologies | Distributed SystemsMentorshipSenior-level Full TimeHyderabad, Telangana, India7h ago
-
Senior Manager of Software Engineering Analytics Platform INR 3000K-5000KAgile | Artificial Intelligence | CI/CD | Cloud Native | DatabricksSenior-level Full TimeHyderabad, Telangana, India8h ago
-
Software Engineer II - UI + Python Developer + AI / ML INR 2500K-4000KAWS | Agile | CI/CD | CSS | HTMLMid-level Full TimeMumbai, Maharashtra, India10h ago
-
Data Engineer Advisor INR 3200K-4200KAlerting | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeHyderabad, TG, IN11h ago
-
Associate Distinguished Engineer (Agentic AI Architect) INR 1500K-3000KAI Governance | AI architecture | AI orchestration | APIs | AWSMid-level Full TimeIndia, India12h ago
-
Senior-level Full Timecoimbatore, India12h ago
-
Senior-level Full Timebangalore, India12h ago
-
Senior-level Full TimeMumbai, Maharashtra, India13h ago
-
AI ML Data Engineer for ADAS Sr Backend Developer INR 2000K-4000KAWS | Apache Kafka | CI/CD | Cloud platform | DockerSenior-level Full Timebangalore, India13h ago
-
MLOps Engineer III INR 2500K-3465KAWS Bedrock | AWS SageMaker | CI/CD | Docker | KubernetesComprehensive insurance | Education assistance program | Fitness benefits | Flexible working hours | Health checkupsSenior-level Full TimeBengaluru, Karnataka, India13h ago
-
Senior Software Engineer INR 2475K-3465KCI/CD | Data Modeling | Exception Handling | FastAPI | GitHubEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India13h ago
-
Data Modeler INR 2520K-4000KAWS | Access Control | Azure | Cloud Data | Cloud data platformFlexible work arrangementsMid-level Full TimeNoida / Gurgaon, DL, IN18h ago
-
Mid-level Full TimeBengaluru, KA, IN18h ago
-
Senior AI/Data Science Engineer INR 3520K-5400KA/B | A/B Testing | APIs | Agentic Workflows | Artificial IntelligenceFlexible benefits | Short-term incentive planSenior-level Full TimeIND-TS Hyderabad Nanakramguda, India18h ago
-
Senior-level Full TimeBangalore, KA, IN18h ago
-
API Development | Agent Orchestration | Async Programming | Autogen | Best practicesSenior-level Full TimeNoida, India18h ago
-
SEI - Data Migration Engineer (IMS) (Expanded Resources) INR 2520K-3880KAirflow | Bulk Insert | CI/CD | Cx Oracle | DBT CoreSenior-level Full TimeBangalore, KA, IN18h ago
-
Senior Database Consultant INR 3000K-4000KAPI Gateway | AVI Load Balancer | Always On Availability Groups | Apache Kafka | ApigeeSenior-level Full TimeBangalore, KA, IN18h ago
-
Sr. Data Science Consultant - Machine Learning,Python INR 2520K-4500KAPI Integration | Apache Airflow | Dask | Data Visualization | Hypothesis TestingSenior-level Full TimeBangalore, India18h ago
-
Sr. Data Science Consultant - Machine Learning,Python INR 3000K-5000KAPI Integration | Apache Airflow | Applied statistics | Classifier | DaskClient onboarding support | Mentorship | Ongoing operational supportSenior-level Full TimeBangalore, India18h ago
-
Databricks Engineer INR 2040K-3000KCloud Data | Cloud Data Engineering | Data Engineering | Data Pipeline Development | Data ReconciliationSenior-level Full TimeBangalore, KA, IN18h ago
-
AI Engineer INR 2000K-4000KAI Agents | AWS | Agent systems | Autogen | AzureEquity | Flexible work options | Wellness benefitsMid-level Full TimeBengaluru, Karnataka, India18h ago
-
Senior Specialist, GSF DnA Data Engineer INR 2475K-3465KAWS Fargate | AWS Glue | AWS Lambda | AWS S3 | AWS Step FunctionsSenior-level Full TimeIND - Telangana - Hyderabad (HITEC …18h ago
-
Tech Lead - Data INR 2040K-3000KAI/ML | AWS | Access Control | Alerting | Batch ProcessingEmployee assistance programme | Flexible schedules | Health insurance | Holiday purchase scheme | Parental leaveSenior-level Full TimeBuilding No 12D, Floor 5, Raheja …18h ago
-
API Development | Agent Orchestration | Agent safety | Async Programming | AutogenSenior-level Full TimeNoida, India18h ago