nlp

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

huggingface.co/transformers https://github.com/huggingface/transformers

🔧🔗https://github.com/modelscope/data-juicer Making data higher-quality, juicier, and more digestible for foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷为大模型提供更高质量、更丰富、更易”消化“的数据！

🔧🔗https://github.com/modelscope/modelscope

ModelScope: bring the notion of Model-as-a-Service to life.

🔧🔗https://github.com/yandexdataschool/nlp_course

YSDA course in Natural Language Processing

🔧🔗https://github.com/modelscope/AdaSeq

An All-in-One Library for Developing State-of-the-Art Sequence Understanding Models

🔧🔗https://github.com/yohasebe/monadic-chat-cli Highly configurable CLI app for OpenAI's chat/text completion API

🔧🔗https://github.com/yohasebe/wp2txt

A command-line toolkit to extract text content and category data from Wikipedia dump files

🔧🔗https://github.com/getzep/zep-nlp-server

Zep NLP Server, a micro-service component of Zep

https://github.com/LibreTranslate/Locomotive Toolkit for training/converting LibreTranslate compatible language models 🚂

🔧🔗https://github.com/HumanSignal/label-studio-transformers

Label data using HuggingFace's transformers and automatically get a prediction service

https://github.com/princeton-nlp/WebShop [NeurIPS 2022] 🛒WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agents