context-length · GitHub Topics

#大语言模型#Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"

人工智能 attention attention-is-all-you-need attention-mechanisms ChatGPT gpt3 gpt4 机器学习 transformer context-length

Python 708

2 年前

#大语言模型#This repository is not intended to serve as the next 'library' for text summarization. Instead, it is designed to be an educational resource, providing insights into the inner workings of text summari...

人工智能 Azure context-length 大语言模型 map-reduce openai parallel-computing parallel-processing Python summarization summarizer

Python 0

1 年前

bhanmrinal / LLMs-See-Further

#大语言模型#Computing algorithms to increase the context windows of LLMs at a smaller scale

context-length gemma 大语言模型 llm-inference llm-training mistral-7b token

Python 0

1 年前