Pflichtpraktikum mit MA: Continued Pre-Training von Large Language Models zur KI-Domänenadaption
Tasks
- Analyze and extend tokenizer for domain vocabulary coverage
- Build domain specific text corpus
- Conduct literature research on continued pre training and domain adaptive pre training
- Develop production domain specialized AI language model
- Evaluate adapted model using perplexity and downstream performance
- Perform continued pre training on open source language model
Perks/Benefits
- Access to modern technologies
- Collaborative team
- Flexible working hours
- Opportunity to work on research projects
- Subsequent master thesis
Skills/Tech-stack
Continued Pretraining | DeepSpeed | Domain Adaptation | Hugging Face | Hugging Face Transformers | Language Models | Language Processing | Large Language Models | Natural Language | Natural Language Processing | Open Source | Python | Retrieval-Augmented Generation | Tokenization
Education
Bachelor of Science | Master of Engineering | Master of Science
Related jobs
-
C# | C++ | Computer Vision | Embedded Systems | Machine LearningBike leasing | Canteen and cafeteria | Company pension scheme | Corporate discounts | Flexible working hoursSenior-level Full TimeManching, Germany13h ago
-
AI Software Engineer – Python (m/f/x) EUR 56K-84KAWS | Anthropic | CI/CD | Docker | GoogleCompany pension scheme | Discounted sports activities | Education budget | German language classes | International relocation supportSenior-level Full TimeBerlin, BE, Germany21h ago
-
AI Software Engineer – Python (m/f/x) EUR 56K-84KAPI | AWS | Anthropic | CI/CD | DockerCompany pension scheme | Complimentary subscription | Education budget | German language classes | International relocation supportSenior-level Full TimeMünchen, BY, Germany21h ago
-
(Senior) Data Engineer (m/f/x) EUR 54K-70KAWS | AWS Glue | AWS IAM | Amazon Athena | Amazon DMSCompany pension scheme | Education budget | Flexible work options | German language classes | Jobticket subsidySenior-level Full TimeBerlin, BE, Germany21h ago
-
(Senior) Data Engineer (m/f/x) EUR 54K-70KAWS | AWS DMS | AWS Glue | AWS IAM | Amazon AthenaCompany pension scheme | Deutschland Jobticket | Education budget | German language classes | International relocation supportSenior-level Full TimeMünchen, BY, Germany21h ago
-
(Senior) Analytics Engineer (m/f/x) EUR 57K-72KAmazon Web Services | Athena | CI/CD | DBT | Data LakeCompany pension scheme | Deutschland Jobticket contribution | Discounted sports activities | Education budget | German language classesSenior-level Full TimeBerlin, BE, Germany21h ago
-
(Senior) Analytics Engineer (m/f/x) EUR 57K-72KAWS | Amazon Athena | CI/CD | DBT | Data ModelingCompany pension scheme | Complimentary broker subscription | Education budget | Flexible benefits | German language classesSenior-level Full TimeMünchen, BY, Germany21h ago
-
AWS | Access Control | Azure | CI/CD | ContainerizationFlexible-hybrid work | Health programs | Laptop for private use | Smartphone for private use | Team eventsSenior-level Full TimeRegensburg, BY, Germany22h ago
-
AWS | Access Control | Azure | CI/CD | Data GovernanceFlexible-hybrid work | Health programs | Laptop for private use | Professional growth | Smartphone for private useSenior-level Full TimeBerlin, BE, Germany22h ago
-
Data Engineer - Tracking Infrastructure (m/f/d) EUR 56K-56KAWS S3 | Amazon Web Services | Apache Airflow | Application Programming | Application Programming InterfacesCareer & training opportunities | Fitness wellness options | Flex Time | Free access to Langdock | Hybrid workSenior-level Full TimeHamburg or Berlin23h ago
-
AI Engineering | Artificial Intelligence | Competency Mapping | Content Review | Curriculum DevelopmentCross-cultural experience | In-house training | Networking opportunities | Remote workSenior-level Part TimeBerlin, DE1d ago
-
AWS | GCP | Hugging Face | Kafka | KubeflowBicycle subsidy | Corporate discounts | Corporate pension plan | Digital meal vouchers | Educational budgetSenior-level Full TimeBerlin, Germany1d ago
-
Chatbot LLM Engineer (all genders) EUR 42K-66KAgile | Dialog design | LLM Operations | Language Models | Large Language Models30 days vacation | E-learning reimbursement | Flexible work hours | International clients | Part-time optionMid-level Full TimeBremen, Munich, Mannheim, Mainz, Berlin, Remote R1d ago
-
(Senior) AI Engineer (all genders) EUR 65K-85KCI/CD | Cloud Platforms | Containerization | Docker | LLM EvaluationCompany participation | E-learning support | Family-friendly support | Fitness benefits | Flexible working hoursMid-level Full TimeBremen, Munich, Mannheim, Mainz, Berlin, Remote R1d ago
-
Senior Data Engineer (f/m/d) EUR 75K-90KAmazon S3 | Amazon Web Services | Apache Airflow | Apache Flink | Apache Kafka30 vacation days | Company hackathons and events | Employee assistance program | Flexible working hours | Hybrid work setupSenior-level Full TimeHamburg R1d ago
-
Senior Data Engineer (w/m/d) - Personalization EUR 53K-54KBatch Processing | BigQuery | Data Processing | Data Quality | DataflowHybrid work | Unrestricted contractSenior-level Full TimeKöln, NW, DE, 506791d ago
-
.NET | ARM Cortex | ARM Cortex-M | C# | CANopenCompany bike | Company events | Deutschlandticket | Drinks | Flexible working hoursMid-level Full TimeWedel, Germany1d ago
-
Amazon Web Services | Chatbot Development | Cloud Computing | Cloud platform | Data AnnotationDiscounts in company restaurants | Flextime | Mobile working | Student networkEntry-level Full Time InternshipSchwieberdingen, BW, Germany1d ago
-
APIs | Airbyte | Apache Airflow | DBT | Data ModelingFully remote work | Home office setup budget | Language learning sessions | Paid sick days | Paid time offSenior-level Full TimeGermany R1d ago
-
Amazon Redshift | Data Modeling | Data Pipelines | Data Warehousing | DjangoSenior-level Full TimeGermany R1d ago
-
Data Engineer USD 110K-149KAWS CloudFormation | Amazon Web Services | Apache NiFi | CI/CD | Cloud platformMid-level Full TimeDEU Wiesbaden - Wiesbaden Army Airfield …1d ago
-
Working Student for Data Analytics and AI within Aviation Safety and Process Excellence (d/f/m) EUR 36K-36KBusiness Process | Business Process Management | Dashboard Development | Data analytics | EnglishFinal thesis opportunity | Flexitime | International environment | Mobile working | Training opportunitiesEntry-level Part TimeHamburg - Finkenwerder, Germany1d ago
-
CI/CD | Computer Vision | Data Lake | Data Processing | Data QualityCareer development opportunities | Flexible working hours | Inclusive workplace | Workplace diversitySenior-level Full TimeBacknang, Germany1d ago
-
C# | CCSDS | Circuit design | Digital circuit | Digital circuit designChildcare placement | Company pension plan | Deutschland-Ticket subsidy | Family services homecare | Flexible working hoursEntry-level Full TimeFreiburg, DE, 791041d ago
-
Pflichtpraktikum mit anschl. MA zum Thema Integration von Wissensgraphen in RAG-basierte KI-Systeme EUR 16K-16KInformation Retrieval | Knowledge graphs | Langchain | Langgraph | Language ModelsCollaborative team environment | Flexible working hours | Modern technology exposure | Opportunity to contribute to research projectsEntry-level InternshipBerlin, DE, 105871d ago