Data Engineer E2E Trial Management - Pharma R&D
Tasks
- Build ETL and ELT processes
- Collaborate with data scientists and analysts on data requirements
- Communicate with technical and non-technical stakeholders
- Ensure data quality and reliability
- Implement anomaly detection
- Implement automated data profiling and data lineage tracking
- Implement retrieval-augmented generation pipelines
- Implement vector database solutions
- Lead data pipeline design build and maintenance
- Monitor data systems
- Optimize data storage solutions
Perks/Benefits
- N/A
Skills/Tech-stack
Agile | Anomaly Detection | Apache Spark | Automated Data Profiling | Chroma | DBT | Data Lakes | Data Lineage | Data Modeling | Data Pipelines | Data Product Management | Data Quality | Data Warehousing | Data mesh | Data product | Data profiling | ELT | ETL | GxP | Knowledge graphs | Langchain | Milvus | Ontologies | Pinecone | Product Management | Python | RAG | Retrieval-Augmented Generation | SQL | Scala | Semantic data | Semantic data modeling | Vector Databases
Education
N/A
Roles
Related jobs
-
Advanced Engineer - Data Engineer INR 2475K-3465KAWS | Amazon Redshift | Apache Hadoop | Apache Spark | AzureAccess to cutting-edge technologies | Collaborative work environment | Professional growth and developmentSenior-level Full TimeBangalore - Karnataka, India - Kalyani …4h ago
-
Data Engineer INR 302K-480KAgile | Apache Airflow | Cloud Composer | Cloud Storage | Cloud platformEntry-level Full TimeIN-MH-Pune4h ago
-
Senior-level Full TimeIN-TN-Chennai4h ago
-
AI & ML Development Lead INR 2500K-5000KAPI Development | AWS | Agent systems | Azure | Cloud PlatformsSenior-level Full TimeGurugram, Haryana, India5h ago
-
Senior Data Management Professional – Process Automation & Data Operations, Company Financials Data , Pune INR 2800K-4000KCI/CD | Cause analysis | Data Governance | Data Monitoring | Data ObservabilityPlatinum customer supportSenior-level Full TimePune5h ago
-
CDP,Snowflake,SQL,Java, API, AWS - (6-9 Yrs) - CHN INR 2000K-3000KAPI Integration | AWS | Audience Management | Customer Data | Customer Data PlatformSenior-level Full TimeIndia5h ago
-
Data Engineer ((SSIS, SQL and Azure Data Factory) INR 1000K-1700KAzure Data | Azure Data Factory | Data Factory | Databricks | ETLEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India6h ago
-
API Integration | AWS | Anomaly Detection | Azure | Data LineageSenior-level Full TimeBengaluru, Karnataka, India6h ago
-
Data Engineer INR 1500K-2500KAmazon Web Services | Data Governance | Data Modeling | Data Quality | Data ResiliencyDiversity inclusion and respectMid-level Full TimeHyderabad, Telangana, India7h ago
-
Robotics Engineer Fresher INR 240K-360KArduino | Automation | C plus plus | C# | ElectronicsCareer growth in EdTech and robotics | Exposure to robotics competitions | Opportunity to mentor students globallyEntry-level Full TimeBangalore, Karnataka, India7h ago
-
Lead - Agentic AI Engineer INR 2500K-5000KAgent Development Kit | Anomaly Detection | CI/CD | Cloud Computing | Data PreprocessingSenior-level Full TimeChennai, Tamil Nadu, India7h ago
-
Mid-level Full TimePune, Maharashtra, India R7h ago
-
Senior Software Engineer, Data Engineering INR 2000K-3000K.Net Core | ASP.NET MVC | ASP.Net Core | Agile | Automated testingSenior-level Full TimePune, Maharashtra, India8h ago
-
Data Engineer (.NET Specialist) INR 2400K-3465K.Net Core | ASP.NET | Angular | App Service | Azure AppSenior-level Full TimePune, MH, India9h ago
-
Bitbucket | C# | Clock | DMA | DebuggingEntry-level Full TimeBengaluru, KA, India10h ago
-
Technical Solutions Engineer INR 500K-700KAPI Integration | Agentic AI | Automation Anywhere | Excel | Incident ManagementEntry-level Full TimeHyderabad, India11h ago
-
Data Engineer - Databricks & Microsoft FabricData Engineer - Databricks & Microsoft Fabric INR 1500K-2800KAgile | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsSenior-level Full TimeChennai, IN, 60003212h ago
-
Mid-level Full TimeBengaluru, Karnataka, India12h ago
-
Lead Data Engineer INR 1500K-2700KApache Kafka | Apache Spark | Automated testing | CI/CD | Data ModelingSenior-level Full TimeBengaluru, KA, India13h ago
-
ASR | AWS | Audio Processing | Cloud platform | ContainerizationFlexible working hours | Fully remote | Mentorship | Professional growthSenior-level Full TimeIndia R13h ago
-
GenAI LLM Python/Senior Associate Director, Software Engineering INR 2000K-4000KAWS | Agent systems | Azure | Docker | Function CallingFlexible working | Professional developmentMid-level Full TimePune, MH, IN, 41100615h ago
-
Software Engineer - Data Engineering INR 1500K-2541KAWS | AWS Glue | AWS Lambda | AWS Step Functions | AgileOnsite 5 days per week | Relocation assistance | Visa sponsorshipMid-level Full TimeChennai, Tamil Nadu, India17h ago
-
Software Engineer - Data Engineering INR 1500K-2500KAWS | AWS Glue | AWS Lambda | AWS Step Functions | AgileOnsite work | Relocation assistanceMid-level Full TimeChennai, Tamil Nadu, India17h ago
-
Lead Software Engineer- Data Engineer INR 2000K-3000KAWS | AWS CloudFormation | Agile | Azure DevOps | CI/CDOnsite work five days per week | Relocation availableSenior-level Full TimeChennai, Tamil Nadu, India17h ago
-
Senior-level Full TimeBangalore, KA, IN17h ago