Search results

Expected all tensors to be on the same device

Status: Open.

#654 In EvolvingLMMs-Lab/lmms-eval;

· Cuzyoung opened on Apr 26, 2025

Coco caption evaluation error

Status: Open.

#653 In EvolvingLMMs-Lab/lmms-eval;

· lanyuki opened on Apr 26, 2025

Bug: The images blending within the same batch leads to the performance degradation of Qwen2.5_VL when the batch size increases

Status: Open.

#648 In EvolvingLMMs-Lab/lmms-eval;

· ashun989 opened on Apr 22, 2025

How can I become the contributor？

Status: Open.

#646 In EvolvingLMMs-Lab/lmms-eval;

· Hoantrbl opened on Apr 22, 2025

Big results gap for qwenvl2.5-7b

Status: Open.

#645 In EvolvingLMMs-Lab/lmms-eval;

· Blissy-32 opened on Apr 21, 2025

API calls are Sync

Status: Open.

#636 In EvolvingLMMs-Lab/lmms-eval;

· CLARKBENHAM opened on Apr 17, 2025

Is batch inference enabled now?

Status: Open.

#635 In EvolvingLMMs-Lab/lmms-eval;

· Cola-any opened on Apr 15, 2025

How to eval llava by pruned

Status: Open.

#634 In EvolvingLMMs-Lab/lmms-eval;

· Darryl-lilin opened on Apr 15, 2025

Evaluating llava Qwen

Status: Open.

#627 In EvolvingLMMs-Lab/lmms-eval;

· mzamini92 opened on Apr 11, 2025

openai_compatible model not complatible with chat/completions endpoint due to max_output_tokens

Status: Open.

#625 In EvolvingLMMs-Lab/lmms-eval;

· dtrawins opened on Apr 9, 2025

about llava-interleave model inconsistent performance

Status: Open.

#623 In EvolvingLMMs-Lab/lmms-eval;

· lllxxzzzzz opened on Apr 8, 2025

Can't debug with only one process on one GPU.

Status: Open.

#619 In EvolvingLMMs-Lab/lmms-eval;

· Creator404 opened on Apr 7, 2025