Fatih C. Akyon's picture

Fatih C. Akyon

fcakyon

AI & ML interests

multi-modal learning, video understanding

Recent Activity

liked a Space 1 day ago
WalidBouss/LeGrad
reacted to joaogante's post with πŸ€— 1 day ago
New sampling strategy dropped in πŸ€— transformers -- Min P sampling πŸ”₯ Are you tired of having `top_k` arbitrarily discarding high-quality continuations? Or `top_p` forgetting to exclude low-probability tokens, derailing your generation? Try out the new `min_p` flag in `generate`, fresh from a PR merged today! πŸ₯¬ Min P consists of a dynamic token filter -- as opposed to Top K, which keeps the K most likely tokens, and Top P, which keeps the most likely tokens up to a fixed cumulative probability, both static filters. Min P takes a base probability (defined in the `min_p` flag) and multiplies it by the probability of the most likely token in the distribution for the next token. All tokens less likely than the resulting value are filtered. What happens with this strategy? πŸ‘‰ High probability token present -> aggressive filter (we don't want to miss on that high-probability case and risk derailing generation) πŸ‘‰ No high probability token present -> relaxed filter (there are many continuation possibilities that the model finds plausible) You should set `min_p` to a low value, between 0.05 and 0.1. It behaves particularly well for creative text generation when paired up with temperature > 1. Kudos to @kalomaze and @menhguin for creating this technique πŸ”₯ Read their discussion in the original issue for benchmarks (https://github.com/huggingface/transformers/issues/27670) Copy-pasteable version of the example in the image below here: https://pastebin.com/VqXNtuxd Have fun experimenting! 😎
View all activity

Organizations

Deprem Yapay Zeka's profile picture Yapay ZekÒ Araştırma İnisiyatifi's profile picture Radiology-ai's profile picture OBSS's profile picture fixit's profile picture Gradio-Blocks-Party's profile picture ultralytics+'s profile picture Video Transformers's profile picture Viddexa AI's profile picture Ultralytics's profile picture

fcakyon's activity

New activity in WalidBouss/LeGrad 1 day ago
New activity in microsoft/Florence-2-large 1 day ago

add_confidence_score

3
#56 opened 6 months ago by
haipingwu
New activity in Ultralytics/YOLOv5 1 day ago

Enable download stats

1
#2 opened 3 days ago by
merve
New activity in Ultralytics/YOLOv8 1 day ago

Enable download stats

1
#1 opened 3 days ago by
merve
New activity in Ultralytics/YOLO11 1 day ago

Update library name

1
#1 opened 3 days ago by
merve
New activity in thwri/CogFlorence-2 9 days ago
New activity in BAAI/bge-m3 12 days ago

broken link in the model card

1
#99 opened 12 days ago by
fcakyon
New activity in microsoft/Florence-2-base 2 months ago

Inherit from GenerationMixin

#22 opened 2 months ago by
fcakyon
New activity in microsoft/Florence-2-large 2 months ago

Inherit from GenerationMixin

3
#80 opened 3 months ago by
Link161
New activity in merve/idefics3llama-vqav2 5 months ago
New activity in gsarti/gradio_highlightedtextbox 5 months ago

🚩 Report: Not working

#3 opened 5 months ago by
fcakyon
New activity in dawood/gradio_videogallery 5 months ago

🚩 Report: Not working

#3 opened 5 months ago by
fcakyon
New activity in evaluate-metric/bertscore 5 months ago

🚩 Report: Not working

4
#10 opened 5 months ago by
fcakyon
New activity in probing-vits/attention-rollout 6 months ago

🚩 Report: Not working

#1 opened 6 months ago by
fcakyon