AI & ML interests

LLMs Evaluation

Recent Activity

The benchmark for LLMs designed to tackle one of the most knowledge-intensive tasks in data science: writing feature engineering code, which requires domain knowledge in addition to a deep understanding of the underlying problem and data structure. The method can cheaply and efficiently assess the broad capabilities of LLMs in contrast to the existing methods.

See: https://arxiv.org/abs/2410.23331

models

None public yet