view article Article Universal Assisted Generation: Faster Decoding with Any Assistant Model Oct 29, 2024 โข 52
view article Article Blazing Fast SetFit Inference with ๐ค Optimum Intel on Xeon Apr 3, 2024 โข 11
view article Article Accelerate StarCoder with ๐ค Optimum Intel on Xeon: Q8/Q4 and Speculative Decoding Jan 30, 2024 โข 9
view article Article SetFitABSA: Few-Shot Aspect Based Sentiment Analysis using SetFit Dec 6, 2023 โข 7