Digital R&D Data Engineering Lead
Tasks
- Collaborate in agile product delivery pod
- Collaborate with product owner and scrum master on delivery progress
- Design develop and deploy APIs and data feeds
- Design, build and maintain ETL/ELT pipelines
- Filter tag join parse and normalize data
- Ingest transform clean and load data
- Optimize data workflows for performance and reliability
- Oversee junior engineers data testing and execution
- Provide input on data and AI product feasibility
- Stay current on data engineering trends and best practices
- Structure and provision data for modeling and discovery
- Support product planning and capacity estimates
Perks/Benefits
- N/A
Skills/Tech-stack
API Gateway | API Integration | AWS Glue | AWS IAM | AWS Lambda | Amazon API | Amazon API Gateway | Amazon Bedrock | Amazon EC2 | Amazon EMR | Amazon EventBridge | Amazon Managed Workflows for Apache Airflow | Amazon S3 | Amazon SQS | Apache Airflow | Batch Processing | CI/CD | Cloud Native | Cloud Native Architecture | Cloud services | DBT | Data Governance | Data Lake | Data Modeling | Data Processing | Data Transformation | Data Warehouse | ELT | ETL | Informatica Intelligent Cloud | Informatica Intelligent Cloud Services | Intelligent Cloud Services | OpenSearch Vector | OpenSearch Vector Engine | Performance Tuning | Python | Query Optimization | SQL | Snowflake | Snowflake Cortex | Snowflake Schema | Star Schema | Streaming Data | Streaming data processing | Streamlit | Terraform | Vector Databases | Vector Engine
Education
Related jobs
-
Mid-level Full TimeBangalore, Karnataka, India; Hyderabad, Telangana, India3h ago
-
Partner Forward Deployed Engineer, Generative AI, Google Cloud INR 2000K-5000KAPIs | Agent Development | Agent Development Kit | Agent systems | Cloud platformSenior-level Full TimeMumbai, Maharashtra, India3h ago
-
AI Customer Engineer, Manufacturing, Google Cloud USD 207K-301KAI Agent Development Kit | Agent Development Kit | As-a-Service | Audit Logging | Cloud NetworkingConference attendance | Travel opportunitiesSenior-level Full TimeMumbai, Maharashtra, India3h ago
-
Lead AI/ML Engineer – Security AI & LLMs INR 3000K-5000KAPI Design | AWS SageMaker | Azure ML | Deep learning | DockerSenior-level Full TimePune, Maharashtra, India6h ago
-
Senior-level Full TimeMitratech India8h ago
-
Genetics Data Engineer 1 INR 3000K-4600KAPI Development | AWS | Agentic AI | Azure | BcftoolsCareer development opportunities | Flexible work culture | Inclusive workplaceSenior-level Full TimeBangalore, Karnataka, IN, 5600378h ago
-
APIs | Airflow | Apache Iceberg | Apache Kafka | Apache SparkSenior-level Full TimeBengaluru8h ago
-
Actors | Async/Await | CI/CD | Combine | Computer VisionSenior-level Full TimeBengaluru8h ago
-
Ecommerce Analytics Engineer INR 2500K-4400KAlteryx | Cloud Data | Cloud Data Platforms | DBT | Data GovernanceSenior-level Full TimeBengaluru, Karnataka, India8h ago
-
Software Engineer II INR 2475K-4000KAWS | Alerting | Asynchronous workloads | Azure | Backend ServicesHybrid work environment | Work from homeMid-level Full TimeIndia, Karnataka, Bangalore; India, Telangana, Hyderabad9h ago
-
Senior-level Full TimeHyderabad9h ago
-
Node JS Developer - Senior Consultant INR 2200K-3500KAWS OpenSearch | Agile | Apache Kafka | Bull queue | CI/CDSenior-level Full TimeBangalore, IN, 5600669h ago
-
Tech Lead - Java (Java, React, Kong) INR 1500K-3000KAPI Development | API Gateway | API Management | API Security | AgileSenior-level Full TimePune, IN, 4110579h ago
-
Senior-level Full TimeHyderabad, IN, 5000819h ago
-
Senior AI Engineer INR 2500K-5000KA2A | AI Foundry | AI Search | AI guardrailing | Agent architectureCollaboration | Documentation | Startup mindsetSenior-level Full TimeHyderabad9h ago
-
Senior Director, Panel Applications - Data Engineering INR 2520K-3380KAWS | Agile | Azure | Big Data | Cloud ComputingEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India9h ago
-
Azure Databricks | Azure DevOps | Data Quality | Data Warehousing | DatabricksCollaborative Agile environment | Fully remote | Hands on cloud data platform exposureMid-level Full TimeIndia R9h ago
-
Data Analytics/Engineer (Python and MS Fabric exp) INR 2500K-4720KAWS | Apache Airflow | Azure Data | Azure Data Factory | Azure SynapseCross-functional collaboration | Mentorship | Professional developmentSenior-level Full TimeIND-Pune-Smartworks, India14h ago
-
AWS S3 | Amazon Redshift | Amazon Web Services | Apache Spark | Azure DataSenior-level Full TimeBengaluru Millenia, India14h ago
-
API | Agentic AI | Anthropic | Bagging | BoostingFlexibility programmes | Hybrid work | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeNoida, India14h ago
-
Technical Lead-Azure Databricks INR 1500K-2700KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Senior-level Full TimeINDIA - BENGALURU - HP, IN14h ago
-
Software Engineer - Python Expert, API Frameworks, RAG, Gen AI, Devops, Frontend Frameworks (5+ Years) INR 2500K-5000KAgentic AI | Alerting | Angular | CI/CD | Cause analysisSenior-level Full TimeIND-BANGALORE, India14h ago
-
Snowflake Data Engineer INR 2000K-2600KAmazon Web Services | Apache Spark | Bitbucket | CI/CD | Cloud platformSenior-level Full TimeBangalore, KA, IN14h ago
-
Senior-level Full TimeBangalore, KA, IN14h ago
-
Senior-level Full TimeBangalore, KA, IN14h ago