|
--- |
|
base_model: cerebras/Cerebras-GPT-6.7B |
|
language: en |
|
license: apache-2.0 |
|
tags: |
|
- Prox |
|
- Cybersecurity |
|
- Penetration Testing |
|
- Uncensored |
|
- Synthetic Data |
|
model-index: |
|
- name: Prox-1.0-GPT-6.7B |
|
results: [] |
|
datasets: |
|
- teknium/openhermes |
|
- cognitivecomputations/dolphin |
|
- LDJnr/Capybara |
|
- garage-bAInd/Open-Platypus |
|
--- |
|
# Prox-1.0-GPT-6.7B |
|
|
|
![Prox Model Logo](https://data.openvoid.ai/images/prox.png) |
|
|
|
## Model Description |
|
Prox-1.0-GPT-6.7B is a fine-tuned version of Cerebras-GPT-6.7B, specifically tailored for cybersecurity. It has been trained on the Prox V1 dataset and incorporates high-quality open datasets from various sources within the AI community. Additionally, it has been equipped with basic chat abilities through training on the Dolphin and OpenHermes datasets. |
|
|
|
## Training |
|
Prox-1.0-GPT-6.7B was trained over 12 hours for 4 epochs on 8x A100 GPUs using Qlora. |
|
|
|
Prompt format: |
|
This model uses ChatML prompt format. |
|
``` |
|
<|im_start|>system |
|
You are Prox, a helpful AI assistant.<|im_end|> |
|
<|im_start|>user |
|
{prompt}<|im_end|> |
|
<|im_start|>assistant |
|
|
|
``` |
|
|
|
Example: |
|
``` |
|
<|im_start|>system |
|
You are Prox, a helpful AI assistant. |
|
<|im_start|>user |
|
What is SQL Injection?<|im_end|> |
|
<|im_start|>assistant |
|
``` |
|
|
|
## Misuse, Malicious Use, and Out-of-Scope Use |
|
Users are responsible for their applications of this model. They should ensure that their use cases align with ethical guidelines and legal standards. Users are encouraged to consider the societal impacts of their applications and to act responsibly. |
|
|
|
## License |
|
The weights of Prox-1.0-GPT-6.7B are licensed under version 2.0 of the Apache License. |