Digital R&D Data Engineering Lead
Tasks
- Collaborate in agile product delivery pod
- Collaborate with product owner and scrum master on delivery progress
- Design develop and deploy APIs and data feeds
- Design, build and maintain ETL/ELT pipelines
- Filter tag join parse and normalize data
- Ingest transform clean and load data
- Optimize data workflows for performance and reliability
- Oversee junior engineers data testing and execution
- Provide input on data and AI product feasibility
- Stay current on data engineering trends and best practices
- Structure and provision data for modeling and discovery
- Support product planning and capacity estimates
Perks/Benefits
- N/A
Skills/Tech-stack
API Gateway | API Integration | AWS Glue | AWS IAM | AWS Lambda | Amazon API | Amazon API Gateway | Amazon Bedrock | Amazon EC2 | Amazon EMR | Amazon EventBridge | Amazon Managed Workflows for Apache Airflow | Amazon S3 | Amazon SQS | Apache Airflow | Batch Processing | CI/CD | Cloud Native | Cloud Native Architecture | Cloud services | DBT | Data Governance | Data Lake | Data Modeling | Data Processing | Data Transformation | Data Warehouse | ELT | ETL | Informatica Intelligent Cloud | Informatica Intelligent Cloud Services | Intelligent Cloud Services | OpenSearch Vector | OpenSearch Vector Engine | Performance Tuning | Python | Query Optimization | SQL | Snowflake | Snowflake Cortex | Snowflake Schema | Star Schema | Streaming Data | Streaming data processing | Streamlit | Terraform | Vector Databases | Vector Engine
Education
Related jobs
-
Azure Databricks | Azure DevOps | Data Quality | Data Warehousing | DatabricksCollaborative Agile environment | Fully remote | Hands on cloud data platform exposureMid-level Full TimeIndia R1h ago
-
AWS | Autogen | Azure | BERT | Computer VisionCollaborative team environment | Continuous learning | Professional growthMid-level Full TimeIndia15h ago
-
Member of Technical Staff - AI/ML Engineer INR 2500K-4500KAnomaly Detection | BM25 | Computer Vision | Document Understanding | Entity ResolutionEquity | Professional developmentSenior-level Full TimeHyderabad, TS, IN16h ago
-
AI-Native Software Developer INR 2500K-4000K.NET | AI Evaluation | AI Orchestration Framework | AI guardrails | AI orchestrationMid-level Full TimeBangalore - Karnataka - India16h ago
-
Senior-level Full TimeMaharashtra, Pune, India17h ago
-
Mid-level Full TimeIN-AP-Hyderabad17h ago
-
Senior-level Full TimeIN-AP-Hyderabad17h ago
-
Senior-level Full TimeIN-AP-Hyderabad17h ago
-
Senior-level Full TimeIN-AP-Hyderabad17h ago
-
Senior-level Full TimeIN-TN-Chennai17h ago
-
Senior-level Full TimeIN-HR-Gurgaon17h ago
-
Mid-level Full TimeBangalore, Karnataka, India18h ago
-
AI Data Engineer III INR 3000K-4000KAgile | Amazon Web Services | Apache Airflow | CI/CD | DBTComprehensive insurance | Education assistance program | Fitness benefits | Flexible working hours | Health checkupsSenior-level Full TimeBengaluru, Karnataka, India18h ago
-
Staff Engineer_SAP Analytics Data Management INR 1500K-2700KABAP | ADSO | Analytics Cloud | CompositeProvider | Data ModelingOnsite 5 days per week | Production rollout support | UAT supportSenior-level Full TimeNoida, India18h ago
-
Staff Data Engineer INR 3000K-4132KAWS | Agile | Amazon Redshift | Amazon S3 | Apache AirflowEducation assistance | Fitness benefits | Flexible working hours | Health checkups | Health insuranceSenior-level Full TimeBengaluru, Karnataka, India18h ago
-
Mid-level Full TimeBangalore, Karnataka, India19h ago
-
Power BI Fabric Engineer INR 2000K-2700KAzure Data | Azure Data Factory | CI/CD | DAX | Data FactoryAnnual excellence awards | Bike to work | Career mentorship | Educational assistance | Employee assistance programmeMid-level Full TimeBengaluru, KA, India19h ago
-
Mid-level Full TimeBangalore, Karnataka, India19h ago
-
Mid-level Full TimeBangalore, Karnataka, India19h ago
-
Big Data Lead INR 1500K-2500KAWS S3 | Amazon ECS | Amazon IAM | Apache Airflow | CI/CDClient facing communication | Team collaborationSenior-level Full TimeIndia19h ago
-
Big Data Lead INR 1500K-2500KData Architecture | Data Governance | Data Management | Data Management Cloud | Data WarehouseSenior-level Full TimeIndia20h ago
-
Lead Software Engineer -Python or Java, big data INR 3000K-4500KAWS | AWS Lambda | Agile | Amazon EMR | Amazon Elastic Compute ServiceSenior-level Full TimeBengaluru, Karnataka, India20h ago
-
LAM-MTS-AWS+PySparks INR 1200K-2000KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatchMid-level Full TimeNoida, Uttar Pradesh, India20h ago
-
Senior-level Full TimeBengaluru, KA, India20h ago
-
Senior-level Full TimeBengaluru, KA, India20h ago