Enterprise Data & Generative AI Engineer
Tasks
- Automate documentation and testing
- Build data ingestion pipelines
- Build document processing chunking and embedding pipelines
- Collaborate on model training evaluation and monitoring
- Deploy and manage pipelines with infrastructure as code
- Develop ELT/ETL workflows
- Ensure data security, privacy, and regulatory compliance
- Implement data quality rules lineage tracking and metadata management
- Implement real time or near real time data flows
- Implement retrieval-augmented generation pipelines
- Integrate SAP and non SAP data in lakehouse platforms
- Maintain vector databases or embedding stores
- Model and harmonize SAP data structures
- Monitor data drift and AI data quality indicators
- Optimize pipeline performance and cost
- Prepare curated datasets for machine learning and generative AI
- Provide technical guidance on data architecture decisions
- Support synthetic data generation
Perks/Benefits
- 401k matching
- Employee resource groups
- Profit sharing plan
- RRSP matching
- RRSP or 401k matching
- Tuition reimbursement
- Tuition reimbursement program
Skills/Tech-stack
AWS | Airflow | Amazon SageMaker | Azure | CDS Views | DBT | Data Intelligence | Databricks | Databricks ML | Delta Lake | Embeddings | Faiss | GCP | IoT | Kafka | Kinesis | LLM | MLflow | Pinecone | Python | Retrieval-Augmented Generation | SAP BTP | SAP Data Intelligence | SAP Datasphere | SAP ODP | SAP S4HANA | SAP data | SQL | Snowflake | Snowpark | Spark | Streams & Tasks | Vector Databases | Vertex AI | Weaviate
Related jobs
-
Featured Feat. AI Engineer (MTS) USD 160K-300KAPI Development | AWS | Amazon Web Services | Deep learning | FastAPIMentoring | Open source contributions | Remote workMid-levelRemote R12d ago
-
Featured Feat. Data Engineer USD 80K-150KData Monitoring | Data Quality | Data Validation | ELT | ETLRemote workEntry-levelRemote R12d ago
-
Data Engineer INR 1500K-2000KData Modeling | Data Pipelines | Data Warehousing | ETL | Schema DesignMid-level Full TimeHyderabad, HDC4A, India5h ago
-
Data Engineer INR 1500K-2000KCloud Data | Cloud Data Storage | Data Modeling | Data Pipelines | Data QualityMid-level Full TimeBengaluru, BDC11A, India5h ago
-
Data Engineer NZD 129K-143KApache Airflow | CI/CD | HDFS | Hadoop | Integration TestingAdditional purchased leave | Banking benefits | Insurance discounts | Internal mobility | Paid time offSenior-level Full TimeWestpac on Takutai Square, New Zealand5h ago
-
AI Engineer USD 103K-140KAI Agents | AI Studio | Access Control | Anthropic Claude | AuthenticationBonus eligibleSenior-level Full TimeDenver, CO, United States7h ago
-
【集团】数据库运维工程师 CNY 240K-360KAutomation | Backup and Recovery | Data synchronization | Database Migration | Database monitoringMid-level Full Time Temporary上海8h ago
-
AWS | Athena | CI/CD | CloudFormation | DBTCareer development plans | Company-provided equipment | English lessons | Flexible working options | Learning opportunitiesSenior-level Full TimeBogotá, Bogota, Colombia8h ago
-
Senior-level Full TimeCincinnati, OH, United States9h ago
-
Bill of Materials | Change Management | Data Cleansing | Data Governance | Data Migration401k | Collaborative team environment | Cross training | Dental insurance | Medical insuranceMid-level Full TimeWichita, KS, United States9h ago
-
Software Engineer INR 1068K-1910KAgile | Angular | Azure | CI/CD | DatabricksCareer development opportunities | Employee Assistance Program (EAP) | Financial wellness tools | Flexible working environment | LinkedIn LearningMid-level Full TimePune, MH, India9h ago
-
Mid-level Full Time北京 R10h ago
-
Data Analytics & Engineering Opportunities USD 65K-105KHive | Microstrategy | MySQL | Oracle | Python401k with firm profit share | Dental insurance | Disability insurance | Firm paid holidays | Flexible spending accountEntry-level Full TimeWashington, DC, United States11h ago
-
Senior AI Engineer GBP 75K-75KAWS | Agent systems | Artificial Intelligence | Azure | CI/CDAnnual bonus | Discounted gym membership | Electric vehicle leasing | Experience days | Hybrid workSenior-level Full TimeLondon, United Kingdom R13h ago
-
Mid-Level Data Engineer USD 90K-98KAPI Development | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageRemote workMid-level Full TimeWork from home, VA, United States R13h ago
-
Senior Data Engineer USD 165K-180KAPIs | Anomaly Detection | Azure | Azure Data | Azure Data FactorySenior-level Full TimeWork from home, VA, United States R13h ago
-
Data Engineer - Python GBP 60K-80KAgile | Data Architecture | Data Engineering | Data Pipelines | Data ScienceSenior-level Full TimeBelfast, Northern Ireland, United Kingdom13h ago
-
Applied AI Analytics Lead 14 Months FTC GBP 70K-90KAzure Foundry | Copilot Studio | DBT | Data Modeling | Microsoft FabricHybrid work modelSenior-level ContractLondon, England, United Kingdom R13h ago
-
AWS | AWS CloudFormation | AWS Glue | AWS Lambda | Amazon AthenaEducation budget | Fitness budget | Flexible schedule | Mentorship | Remote and office optionsMid-level Full TimeCampinas, Brazil14h ago
-
Cloud Operations Engineer ID59491 COP 23000K-23000KAWS | AWS Glue | AWS Lambda | AWS Systems Manager | AWS systemsEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsMid-level Full TimeBarranquilla, Colombia14h ago
-
Cloud Operations Engineer ID59491 INR 1400K-1700KAWS | AWS CloudFormation | AWS Glue | AWS Lambda | AWS ServerlessEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsMid-level Full TimeMENDOZA, Argentina14h ago
-
Cloud Operations Engineer ID59491 INR 1400K-1700KAWS | AWS CloudFormation | AWS Glue | AWS Lambda | Amazon AthenaEducation budget | Fitness budget | Flexible schedule | Mentorship | Office optionsMid-level Full TimeQUETZALTENANGO, Guatemala14h ago
-
AWS | AWS Systems Manager | AWS systems | Amazon RDS | AthenaEducation budget | Exciting projects | Fitness budget | Flextime | MentorshipMid-level Full TimeGuadalajara, Mexico14h ago
-
AWS | AWS Systems Manager | AWS systems | Amazon RDS | AthenaEducation budget | Fitness budget | Flextime | Mentorship | Office work optionsMid-level Full TimeCuritiba, Brazil14h ago
-
Cloud Operations Engineer ID59491 INR 1400K-1700KAWS | AWS CloudFormation | AWS Glue | AWS Lambda | AWS SAMEducation budget | Fitness budget | Flextime | Growth roadmaps | MentorshipMid-level Full TimeBARILOCHE, Argentina14h ago