Data Engineering Lead
Tasks
- Architect data pipelines for batch streaming and real time ingestion
- Build data quality frameworks for reliable data
- Collaborate with ML RAG MLOps security and product teams
- Define data modeling best practices for analytical and AI datasets
- Design scalable data platform architecture decisions
- Evaluate and adopt new data platform technologies
- Implement data governance access control classification and compliance
- Mentor and grow data engineering team
- Optimize data pipeline performance for ingestion transformation and storage
Perks/Benefits
Skills/Tech-stack
AWS | AWS Bedrock | AWS Bedrock model inference | AWS Glue | AWS IAM | AWS KMS | AWS Lambda | AWS Step Functions | Access Control | Amazon Athena | Amazon Bedrock | Amazon Bedrock Agents | Amazon Bedrock Guardrails | Amazon Bedrock Knowledge Bases | Amazon CloudWatch | Amazon DynamoDB | Amazon Redshift | Amazon S3 | Anomaly Detection | Audit Logging | Bedrock Agents | Bedrock Guardrails | Bedrock Knowledge Bases | Data Catalog | Data Governance | Data Quality | Deduplication | ELT | ETL | Encryption | Glue Data Catalog | Knowledge bases | Model Inference | OpenSearch | PostgreSQL | Python | RAG | SQL | Schema Validation | Step Functions | Vector Databases
Education
N/A
Roles
Data Engineering | Data Engineering Lead | Engineering Lead | Lead
Related jobs
-
Alteryx | Azure | Business Intelligence | Dashboarding | Data ModelingFlexible remote work | Professional growthMid-level Full TimeIndia4h ago
-
Data / Machine Learning Engineer (India) INR 2500K-4500KAWS | Azure | Code review | GCP | JavaCollaborative culture | Flat organizational hierarchy | Flexible learning and development | Global team collaboration | High visibility leadership accessSenior-level Full TimePune, Maharashtra, India18h ago
-
Senior-level Full TimeIN-KA-Bangalore21h ago
-
Data Integration Lead INR 1500K-2800KAgile | Oracle Database | Oracle Forms | Oracle Reports | Oracle SQLSenior-level Full TimeIndia23h ago
-
Big Data Lead INR 1200K-2000KAzure Data | Azure Data Lake | Azure Data Lake Storage | CI/CD | Cloud StorageSenior-level Full TimeIndia23h ago
-
Big Data Lead INR 1500K-2000KABAC | AWS | Airflow | Amazon Kinesis | AzureCross-team collaboration | MentoringSenior-level Full TimeIndia23h ago
-
Information Delivery & Visualization Lead INR 800K-1500KData Aggregation | Data Blending | Data Cleansing | Data Modeling | Database queryingSenior-level Full TimeIndia23h ago
-
Test Lead - Data Automation INR 1500K-2209KData Lineage | Data Pipelines | Data Validation | ETL | PythonSenior-level Full TimeIndia23h ago
-
Data Integration Lead INR 1500K-2000KCI/CD | Control-M | DataStage | Deployment | ETLClient facing communication | Written and verbal communicationSenior-level Full TimeIndia23h ago
-
Databricks COE Lead INR 2000K-3900KActive Directory | Amazon Web Services | Apache Airflow | Apache Spark | AzureSenior-level Full TimeHyderabad, Telangana, India1d ago
-
Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | BI semantic modelsCollaborative cross-functional environment | Employee well-being support | Flexible work arrangements | Healthcare benefits | MentorshipSenior-level Full TimeIndia1d ago
-
Senior Manager - SAP Analytics Cloud & Datasphere INR 2500K-3380KAnalytics Cloud | CI/CD | Cross-calculations | Data Blending | Data GovernanceSenior-level Full TimeIndia - Chennai1d ago
-
IN_Manager_Data Engineer_D&A_Advisory_Nagpur INR 1500K-2000KCI/CD | Data Modeling | Databricks | Delta Lake | DockerFlexibility programmes | Inclusive benefits | Mentorship | Support for wellbeingMid-level Full TimeNagpur, India1d ago
-
IN_Manager_Data Engineer_D&A_Advisory_Nagpur INR 1500K-2000KAzure | CI/CD | Databricks | Delta Lake | DockerMid-level Full TimeNagpur, India1d ago
-
Senior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India1d ago
-
Azure | Azure Data | Azure Data Factory | Azure Data Lake | Azure DevOpsFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeMumbai Shivaji Park, India1d ago
-
Apache Airflow SME INR 2400K-3500KAWS | Apache Airflow | Azure | CI/CD | DBTFlexible work arrangements | Internal mobility | Learning and development | MentoringSenior-level Full TimeBengaluru - BCIT, India1d ago
-
Applied AI ML Engineers - SMTS/LMTS INR 2211K-3465KCI/CD | Data Pipelines | Distributed Systems | Event Driven | Event-driven architecture1-on-1 coaching | Adoption Assistance | Fertility benefits | On-demand training | Parental leaveSenior-level Full TimeIndia - Bangalore1d ago
-
Custom Software Engineer INR 1000K-1700KAgile methodologies | Cloud Platforms | Data Processing | Data Processing Frameworks | Distributed ComputingMid-level Full TimeBengaluru, BDC11A, India1d ago
-
Custom Software Engineer INR 1000K-1700KApplication Architecture | Cloud Computing | Data Processing | Distributed Computing | PySparkMid-level Full TimeBengaluru, BDC11A, India1d ago
-
Lead Data Platform Engineer INR 2000K-3000KCloud Composer | DBT | Data Compliance | Data Governance | Data SecuritySenior-level Full TimeIndia - Bangalore IT Capability Centre1d ago
-
Data Analytics Operations Lead Engineer -HIH- Evernorth INR 1960K-2800KAnomaly Detection | Collibra | Data Governance | Data Lineage | Data ObservabilitySenior-level Full TimeHIH - Hyderabad, India1d ago
-
Senior-level Full TimePune, Gera Commerzone SEZ, India1d ago
-
Team Lead , Data Analytics INR 2800K-4000KAI machine learning | Anomaly Detection | Data Anomaly | Data Anomaly Detection | Data GovernanceHealthcare | Hybrid working | Paid volunteering days | Retirement planning | Wellbeing initiativesSenior-level Full TimeIND-Bangalore-TowerE,RMZ Infin, India1d ago
-
Lead Data Scientist INR 2500K-3380KAzure Data | Azure Data Lake | Dashboarding | Data Lake | Data VisualizationSenior-level Full TimeBangalore–Embassy Business Hub, India1d ago