README.md

metadata

base_model: CrabfishAI/InstructWise-462M
datasets:
  - timdettmers/openassistant-guanaco
inference: false
language:
  - en
license: llama2
model_creator: CrabfishAI
model_name: InstructWise-462M
pipeline_tag: text-generation
quantized_by: afrideva
tags:
  - autotrain
  - text-generation
  - gguf
  - ggml
  - quantized
  - q2_k
  - q3_k_m
  - q4_k_m
  - q5_k_m
  - q6_k
  - q8_0
widget:
  - text: |-
      ### Instruction:
      Find me a list of some nice places to visit around the world.

      ### Response:
  - text: |-
      ### Instruction:
      Tell me a story about some magical place.

      ### Response:
  - text: |-
      ### Instruction:
      Write a python code to print numbers from 1 to 100 in sequence.

      ### Response:
  - text: |-
      ### Instruction:
      What is biology?

      ### Response:
  - text: >-
      ### Instruction:

      I love taking photos of nature. Can you come up with a 3-day itinerary
      visiting the most photogenic places in Iceland?


      ### Response:

CrabfishAI/InstructWise-462M-GGUF

Quantized GGUF model files for InstructWise-462M from CrabfishAI

Name	Quant method	Size
instructwise-462m.fp16.gguf	fp16	925.45 MB
instructwise-462m.q2_k.gguf	q2_k	212.56 MB
instructwise-462m.q3_k_m.gguf	q3_k_m	238.87 MB
instructwise-462m.q4_k_m.gguf	q4_k_m	288.52 MB
instructwise-462m.q5_k_m.gguf	q5_k_m	333.29 MB
instructwise-462m.q6_k.gguf	q6_k	380.87 MB
instructwise-462m.q8_0.gguf	q8_0	492.67 MB

Original Model Card:

InstructWise 470M - A virtual assistant.

Note- we,ll be releasing more versions of InstructWise soon, with the goal of making memory-efficent models while maintaining the performance, Thank you! Introduction- InstructWise is a model created to act as helpful virtual assistant while maintaing the memory efficiency.

Credits

• Base Model: ahxt/llama2_xs_460M_experimental
• Dataset used: timdettmers/openassistant-guanaco
• License: llama2

Features

• Maintaining performance while being memory efficient: Ram usage- 7.1GB Vram usage- 0.6GB (approximately)
• Act as helpful virtual assistant: InstructWise serves as a versatile and helpful assistant, offering a range of features that cater to various user needs. Its key strength lies in providing instructive responses to user prompts, offering detailed and insightful information.
• Coding: Model can perform coding as well.
• Assisting capabilities: can assist with wide rang of taskes.

Uses

InstructWise finds application in various domains, including:

• Assistance in Writing: Aid authors, bloggers, and students in drafting articles and essays.
• Chatbot Development: Power conversational agents with human-like responses.
• Prototyping and Idea Generation: Facilitate brainstorming sessions for product development.
• Personal Assistant Applications: Assist users in drafting emails and messages. and many more.

Direct Use Cases

InstructWise can be directly employed for:

1. Educational Support:

   • Assist users in learning new topics with detailed explanations and step-by-step instructions.

2. Content Creation:

   • Generate creative content based on prompts, aiding content creators in the writing process.

3. Code Assistance:

   • Provide guidance on coding queries, improve code documentation, and generate code snippets for developers.

4. Interactive Conversations:

   • Enhance chatbots or virtual assistants with informative and helpful responses for users.

5. Q&A Platforms:

   • Power question and answer platforms, offering detailed and insightful answers on various topics.

6. Technical Writing Support:

   • Assist writers and technical communicators with suggestions for clarity and informativeness.

7. Idea Expansion:

   • Facilitate the expansion and development of ideas by providing detailed insights and suggestions.

Limitation

1. Content Quality: The model's output may vary in quality, and there's a possibility it might generate content that is nonsensical, irrelevant, or grammatically incorrect.

2. Bias and Sensitivity: The model is trained on diverse data, but it may inadvertently exhibit biases or generate content that is sensitive or inappropriate. Exercise caution and review generated text before use.

3. Inappropriate Language: The model might generate text that includes offensive language or inappropriate content. Be mindful of this, especially in applications where maintaining a respectful and inclusive tone is essential.

Disclaimer

• Use with Caution: This model is a tool that should be used with caution. Always review and validate the generated text before incorporating it into any application or publication.

• Not for Critical Applications: Avoid using the model for critical applications where accuracy and reliability are paramount. The model is intended for creative and exploratory purposes.

• Ongoing Improvement: The model may be updated or fine-tuned for better performance. Stay informed about updates and consider using the latest version for improved results.

Recommended Prompt Format to use:

### Instruction:
<instruction>

### Response: