README.md

---
base_model: CrabfishAI/InstructWise-462M
datasets:
- timdettmers/openassistant-guanaco
inference: false
language:
- en
license: llama2
model_creator: CrabfishAI
model_name: InstructWise-462M
pipeline_tag: text-generation
quantized_by: afrideva
tags:
- autotrain
- text-generation
- gguf
- ggml
- quantized
- q2_k
- q3_k_m
- q4_k_m
- q5_k_m
- q6_k
- q8_0
widget:
- text: '### Instruction:

    Find me a list of some nice places to visit around the world.


    ### Response:'
- text: '### Instruction:

    Tell me a story about some magical place.


    ### Response:'
- text: '### Instruction:

    Write a python code to print numbers from 1 to 100 in sequence.


    ### Response:'
- text: '### Instruction:

    What is biology?


    ### Response:'
- text: '### Instruction:

    I love taking photos of nature. Can you come up with a 3-day itinerary visiting
    the most photogenic places in Iceland?


    ### Response:'
---
# CrabfishAI/InstructWise-462M-GGUF

Quantized GGUF model files for [InstructWise-462M](https://huggingface.co./CrabfishAI/InstructWise-462M) from [CrabfishAI](https://huggingface.co./CrabfishAI)


| Name | Quant method | Size |
| ---- | ---- | ---- |
| [instructwise-462m.fp16.gguf](https://huggingface.co./afrideva/InstructWise-462M-GGUF/resolve/main/instructwise-462m.fp16.gguf) | fp16 | 925.45 MB  |
| [instructwise-462m.q2_k.gguf](https://huggingface.co./afrideva/InstructWise-462M-GGUF/resolve/main/instructwise-462m.q2_k.gguf) | q2_k | 212.56 MB  |
| [instructwise-462m.q3_k_m.gguf](https://huggingface.co./afrideva/InstructWise-462M-GGUF/resolve/main/instructwise-462m.q3_k_m.gguf) | q3_k_m | 238.87 MB  |
| [instructwise-462m.q4_k_m.gguf](https://huggingface.co./afrideva/InstructWise-462M-GGUF/resolve/main/instructwise-462m.q4_k_m.gguf) | q4_k_m | 288.52 MB  |
| [instructwise-462m.q5_k_m.gguf](https://huggingface.co./afrideva/InstructWise-462M-GGUF/resolve/main/instructwise-462m.q5_k_m.gguf) | q5_k_m | 333.29 MB  |
| [instructwise-462m.q6_k.gguf](https://huggingface.co./afrideva/InstructWise-462M-GGUF/resolve/main/instructwise-462m.q6_k.gguf) | q6_k | 380.87 MB  |
| [instructwise-462m.q8_0.gguf](https://huggingface.co./afrideva/InstructWise-462M-GGUF/resolve/main/instructwise-462m.q8_0.gguf) | q8_0 | 492.67 MB  |



## Original Model Card:
# InstructWise 470M - A virtual assistant.
Note- we,ll be releasing more versions of InstructWise soon, with the goal of making memory-efficent models while maintaining the performance, Thank you!
Introduction- InstructWise is a model created to act as helpful virtual assistant while maintaing the memory efficiency.
# Credits
- **Base Model:** ahxt/llama2_xs_460M_experimental
- **Dataset used:** timdettmers/openassistant-guanaco
 - **License:** llama2

## Features
- **Maintaining performance while being memory efficient:** Ram usage- 7.1GB Vram usage- 0.6GB (approximately)
- **Act as helpful virtual assistant:** InstructWise serves as a versatile and helpful assistant, offering a range of features that cater to various user needs. Its key strength lies in providing instructive responses to user prompts, offering detailed and insightful information. 
- **Coding:** Model can perform coding as well.
- **Assisting capabilities:** can assist with wide rang of taskes.

## Uses

InstructWise finds application in various domains, including:

- **Assistance in Writing:** Aid authors, bloggers, and students in drafting articles and essays.
- **Chatbot Development:** Power conversational agents with human-like responses.
- **Prototyping and Idea Generation:** Facilitate brainstorming sessions for product development.
- **Personal Assistant Applications:** Assist users in drafting emails and messages.
and many more.

## Direct Use Cases

InstructWise can be directly employed for:

1. **Educational Support:**
   - Assist users in learning new topics with detailed explanations and step-by-step instructions.

2. **Content Creation:**
   - Generate creative content based on prompts, aiding content creators in the writing process.

3. **Code Assistance:**
   - Provide guidance on coding queries, improve code documentation, and generate code snippets for developers.

4. **Interactive Conversations:**
   - Enhance chatbots or virtual assistants with informative and helpful responses for users.

5. **Q&A Platforms:**
   - Power question and answer platforms, offering detailed and insightful answers on various topics.

6. **Technical Writing Support:**
   - Assist writers and technical communicators with suggestions for clarity and informativeness.

7. **Idea Expansion:**
   - Facilitate the expansion and development of ideas by providing detailed insights and suggestions.


## Limitation

1. **Content Quality**: The model's output may vary in quality, and there's a possibility it might generate content that is nonsensical, irrelevant, or grammatically incorrect.

2. **Bias and Sensitivity**: The model is trained on diverse data, but it may inadvertently exhibit biases or generate content that is sensitive or inappropriate. Exercise caution and review generated text before use.

3. **Inappropriate Language**: The model might generate text that includes offensive language or inappropriate content. Be mindful of this, especially in applications where maintaining a respectful and inclusive tone is essential.



## Disclaimer

- **Use with Caution**: This model is a tool that should be used with caution. Always review and validate the generated text before incorporating it into any application or publication.

- **Not for Critical Applications**: Avoid using the model for critical applications where accuracy and reliability are paramount. The model is intended for creative and exploratory purposes.

- **Ongoing Improvement**: The model may be updated or fine-tuned for better performance. Stay informed about updates and consider using the latest version for improved results.

## Recommended Prompt Format to use:
```
### Instruction:
<instruction>

### Response:
```