Add Modeling for Jais Architecture to the Transformers repo

#2
by beratcmn - opened

Adding modelling for Jais similar to LLama models (https://github.com/huggingface/transformers/blob/main/src/transformers/models/llama/modeling_llama.py) would be very beneficial for custom engine integrations. By adding a modelling we can use engines such as VLLM and Text Generation Inference much more efficiently.

beratcmn changed discussion title from Add Modeling for Jais Architecture to Add Modeling for Jais Architecture to the Transformers repo
Inception org

It is in plans. Will update next month.

Sign up or log in to comment