akoksal
/

LongForm-OPT-6.7B

Text2Text Generation

text-generation

instruction-tuning

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

akoksal commited on Apr 26, 2023

Commit

1fc27eb

·

1 Parent(s): 6d3f295

Update README.md

Files changed (1) hide show

README.md +5 -5

README.md CHANGED Viewed

@@ -80,12 +80,12 @@ We provide in-depth evaluation of LongForm models and baselines in the paper. We
 | **Flan-T5**           | 10.6    | 20.9* | 3.5      | 7.4                 |
 | **Alpaca-LLaMA-7B**   | 14.6    | 19.5                              | 12.5     | 11.8                |
 | **OPT-30B**           | 11.1    | 18.6                              | 12.2     | 2.6                 |
-| **[LongForm-T5-XL](https://huggingface.co/akoksal/LongForm-T5-XL)**    | 16.3    | 20.2                              | 18.3     | 10.6                |
-| **[LongForm-OPT-2.7B](https://huggingface.co/akoksal/LongForm-OPT-2.7B)**   | 17.8    | 15.5                              | 17.9     | **19.9**                |
-| **[LongForm-OPT-6.7B](https://huggingface.co/akoksal/LongForm-OPT-6.7B)** | 17.7    | 16.9                              | 17.2     | 19.0                |
-| **LongForm-LLaMA-7B**‡ | **19.7**    | **21.7**                              | **18.6**     | 18.9                |
-‡: We cannot release LongForm-LLaMA-7B publicly due to restrictions of LLaMA models.
 ## Limitations
 The LongForm dataset and models mainly focus on long text generation and have limitations regarding structured prediction tasks in NLP. Additionally, we observe that LongForm models may present hallucination problems similar to those found in LLMs.

 | **Flan-T5**           | 10.6    | 20.9* | 3.5      | 7.4                 |
 | **Alpaca-LLaMA-7B**   | 14.6    | 19.5                              | 12.5     | 11.8                |
 | **OPT-30B**           | 11.1    | 18.6                              | 12.2     | 2.6                 |
+| [**LongForm-T5-XL**](https://huggingface.co/akoksal/LongForm-T5-XL)    | 16.3    | 20.2                              | 18.3     | 10.6                |
+| [**LongForm-OPT-2.7B**](https://huggingface.co/akoksal/LongForm-OPT-2.7B)   | 17.8    | 15.5                              | 17.9     | **19.9**                |
+| [**LongForm-OPT-6.7B**](https://huggingface.co/akoksal/LongForm-OPT-6.7B) | 17.7    | 16.9                              | 17.2     | 19.0                |
+| [**LongForm-LLaMA-7B**](https://huggingface.co/akoksal/LongForm-LLaMA-7B-diff)‡ | **19.7**    | **21.7**                              | **18.6**     | 18.9                |
+‡: We can just release the difference between LongForm-LLaMA-7B and pretrained LLaMA-7B publicly due to restrictions of LLaMA models.
 ## Limitations
 The LongForm dataset and models mainly focus on long text generation and have limitations regarding structured prediction tasks in NLP. Additionally, we observe that LongForm models may present hallucination problems similar to those found in LLMs.