Enterprise Data & Generative AI Engineer
Tasks
- Automate documentation and testing
- Build data ingestion pipelines
- Build document processing chunking and embedding pipelines
- Collaborate on model training evaluation and monitoring
- Deploy and manage pipelines with infrastructure as code
- Develop ELT/ETL workflows
- Ensure data security, privacy, and regulatory compliance
- Implement data quality rules lineage tracking and metadata management
- Implement real time or near real time data flows
- Implement retrieval-augmented generation pipelines
- Integrate SAP and non SAP data in lakehouse platforms
- Maintain vector databases or embedding stores
- Model and harmonize SAP data structures
- Monitor data drift and AI data quality indicators
- Optimize pipeline performance and cost
- Prepare curated datasets for machine learning and generative AI
- Provide technical guidance on data architecture decisions
- Support synthetic data generation
Perks/Benefits
- 401k matching
- Employee resource groups
- Profit sharing plan
- RRSP matching
- RRSP or 401k matching
- Tuition reimbursement
- Tuition reimbursement program
Skills/Tech-stack
AWS | Airflow | Amazon SageMaker | Azure | CDS Views | DBT | Data Intelligence | Databricks | Databricks ML | Delta Lake | Embeddings | Faiss | GCP | IoT | Kafka | Kinesis | LLM | MLflow | Pinecone | Python | Retrieval-Augmented Generation | SAP BTP | SAP Data Intelligence | SAP Datasphere | SAP ODP | SAP S4HANA | SAP data | SQL | Snowflake | Snowpark | Spark | Streams & Tasks | Vector Databases | Vertex AI | Weaviate
Related jobs
-
AI Engineer, Solna SEK 660K-804KAPIs | Azure | Azure Compute | Azure Data | Azure Data StorageHybrid work environment | Insurance | Occupational pension | Office gym access | Swimming pool accessSenior-level Full TimeSolna3h ago
-
DevOps Engineer (Senior) ZAR 700K-840KAutomation | Cloud Architecture | Cloud platform | Database Administration | DevOpsHybrid work | Renewable contractSenior-level ContractJohannesburg, South Africa4h ago
-
SOL-1634 Senior Data Engineer INR 3750K-6250KAWS Glue | AWS Lambda | AWS S3 | Amazon EC2 | Amazon EMRRemote workSenior-level Full TimeRemote R4h ago
-
API Integration | Asynchronous processing | Containerization | Data Pipelines | Deep learningSenior-level ContractAnnapolis, United States R4h ago
-
Senior Data Platform Engineer INR 1500K-2400KAWS Glue | AWS IAM | AWS Lake Formation | AWS Lambda | AWS S3Senior-level Full TimeBangalore, India4h ago
-
Data Platform Engineer INR 1400K-2000KAPI Integration | AWS CloudWatch | AWS CodePipeline | AWS Glue | AWS IAMMid-level Full TimeBangalore, India4h ago
-
AWS Glue | AWS Lambda | Amazon Kinesis | Amazon Redshift | Amazon S3Remote workSenior-level Full TimeRemote R4h ago
-
Agile | Azure Data | Azure Data Factory | Azure DevOps | CI/CDHybrid workMid-level Full TimeCape Town, South Africa4h ago
-
AI INTEGRATION MANAGER -Dayshift, WFH-Philippines AED 120K-120KAPI Integration | Data Pipelines | Data reporting | Database Design | JavaScriptGlobal collaboration | Growth opportunities | Remote-friendlyMid-level Full TimeRemote R4h ago
-
BigQuery | Cloud Data Catalog | Cloud Functions | Cloud Storage | Cloud platformMid-level Full TimeSingapore, Singapore4h ago
-
Azure Data | Azure Data Explorer | Azure Data Factory | Azure DevOps | Azure SynapseOnsite work environmentMid-level Full TimeSingapore, Singapore4h ago
-
Agentic Interface Lead, Applied AI GBP 78K-109KAI SDK | Active Learning | Annotation tooling | Application development | CoPilotKitSenior-level Full TimeLONDON, United Kingdom4h ago
-
AI Search | AKS | API Management | App Service | Azure AISenior-level Full TimeIndia-Noida5h ago
-
Mid-level Full TimeLahore, Pakistan5h ago
-
Senior-level Full TimeMaharashtra, Pune, India5h ago
-
Senior-level Full TimeIndia, West Bengal, Kolkata5h ago
-
Mid-level Full TimeIndia, West Bengal, Kolkata5h ago
-
Data Engineer INR 1500K-2000KAmazon Web Services | Apache Airflow | Apache Kafka | Apache Spark | Azure DataMid-level Full TimeIndia, West Bengal, Kolkata5h ago
-
Application & Data Engineer GBP 44K-44KCloud systems | Data integration | Integration Services | Microsoft SQL | Microsoft SQL ServerFlexible working | Hybrid workMid-level Full TimeGB-ENG-LAN-Samlesbury5h ago
-
Lead MLOps Engineer GBP 54K-54KCI/CD | GitLab CI | GitLab CI/CD | Grafana | KubernetesEmployee share plans | Flexible working | Hybrid working | Pension scheme | Private health plansSenior-level Full TimeGB-ENG-LAN-Preston5h ago
-
Lead Data Engineer (Cloud) GBP 55K-55KAirflow | Apache Spark | Azure | CosmosDB | Data GovernanceAnnual incentive | Employee share plans | Flexible working arrangements | Green Car Scheme | Health wellbeing and lifestyle benefitsSenior-level Full TimeGB-ENG-LAN-Preston5h ago
-
Experienced AI Engineer EUR 43K-66KAI Search | API Development | Amazon Web Services | Autogen | AzureMid-level Full TimeAthens5h ago
-
Senior Software Engineer - Data License Analytics, Pune INR 3000K-4512KAWS | Apache Airflow | Apache Iceberg | Databricks | Distributed SystemsSenior-level Full TimePune6h ago
-
APIs | Algorithms | Apache Solr | Boosted Decision Trees | Data StructuresSenior-level Full TimeLondon6h ago
-
Data Engineer III - PySpark, Databricks, AWS INR 2000K-2400KAmazon Web Services | Apache Spark | Data Modeling | Data Warehousing | DatabricksSenior-level Full TimeBengaluru, Karnataka, India6h ago