CodeBERTScore: an automatic metric for code generation, based on BERTScore
-
Updated
Mar 1, 2024 - Jupyter Notebook
#
bertscore
Here are 50 public repositories matching this topic...
EMNLP'2022: BERTScore is Unfair: On Social Bias in Language Model-Based Metrics for Text Generation
natural-language-processing deep-learning text-generation fairness-ai fairness-ml pretrained-language-model bertscore metric-bias
-
Updated
Oct 19, 2022 - Jupyter Notebook
LLM Evaluation and Observability System for Football Content
python mongodb pre-commit openai cosine-similarity evaluation-metrics comet-ml hallucination huggingface-transformers zenml bertscore
-
Updated
Jun 19, 2025 - Python
MAchine Translation Evaluation Online (MATEO)
machine-translation comet ter bleu clarin machine-translation-metrics streamlit bertscore bleurt machine-translation-evaluation chrf
-
Updated
May 8, 2026 - Python
Domain-specialized Gemma 2 27B + Gemma 4 31B for SEC filings — fine-tuned on TPU v6e-8 with PyTorch/XLA FSDPv2, plus a Vertex AI Vector Search RAG demo (69 tickers × 381 filings). Same LoRA recipe, +3.5% / +5.8% BERTScore F1.
finance lora knowledge-distillation gemma tpu peft sec-filings rag streamlit pytorch-xla vertex-ai bertscore gemma-2 gemma-4
-
Updated
Apr 26, 2026 - Python
Fine-tuning GPT-3.5 and Llama3 LLMs for enhanced persona consistency in chatbots using Google's Synthetic Persona Chat dataset
-
Updated
May 3, 2025 - Jupyter Notebook
ViAG: A Novel Framework for Fine-tuning Answer Generation models ultilizing Encoder-Decoder and Decoder-only Transformers's architecture
meteor question-answering bart llama rouge bleu-score encoder-decoder fine-tuning answer-generation t5 plms bartpho llm bertscore instruction-tuning qlora qwen decoder-only vit5
-
Updated
May 26, 2025 - Python
Agent Orchestration - LLM for Legal Metadata Extraction: A Comparative Analysis of Efficiency and Precision (paper 161 PROPOR)
-
Updated
Jul 26, 2026 - Python
Medical Question Answering System using on PubMed dataset.
-
Updated
May 29, 2025 - Jupyter Notebook
Benchmarking Vector RAG vs Graph RAG for cybersecurity question answering on Australian SMBs using LLaMA 3.1, Mistral 7B, and Qwen3 with ChromaDB and Neo4j
nlp neo4j evaluation transformers knowledge-graph cybersecurity rag vector-search huggingface bertscore chromadb mistral-7b graph-rag llama3 qwen3 australian-smes
-
Updated
Apr 9, 2026 - Python
The work presented was developed during the internship, as researchers in the field of Natural Language Generation, at the Insid&s Lab laboratory in Milan-Bicocca. The work carried out deals with the creation of a framework for the correct assessment of the impact of the quality of the input datasets on the quality of the text generated by the N…
python natural-language-processing deep-learning torch artificial-intelligence lstm rdf-triples natural-language-generation nlg rouge-metric bleu-score transformer-architecture bertscore
-
Updated
Mar 30, 2026 - Jupyter Notebook
Implementation of a task-specific QLoRA supervised fine-tuning pipeline for LLaMA-2-7B-Chat, developed for an independent study on structured cover letter generation.
nlp natural-language-processing transformers text-generation pytorch rouge lora model-evaluation fine-tuning peft huggingface llm bertscore supervised-finetuning qlora llama2 parameter-efficient-fine-tuning structured-generation
-
Updated
Aug 6, 2026 - Python
Model-agnostic toolkit to evaluate text-summarization models — ROUGE/BLEU/BERTScore + perplexity + LLM-as-judge, MLflow tracking, CLI + library with unit-tested metrics.
python nlp cli evaluation transformers text-summarization rouge bleu perplexity mlflow huggingface bertscore llm-evaluation llm-as-judge
-
Updated
Jul 25, 2026 - Python
Hallucination-resistant multi-hop QA using hybrid BM25+FAISS retrieval, cross-encoder reranking, citation selection, and NLI-based verification. Evaluated on HotpotQA (7,405 examples), zero-shot.
nlp question-answering bm25 zero-shot-learning reranking nli faiss rag multi-hop-reasoning hotpotqa cross-encoder llm bertscore ollama hallucination-detection gemma-4
-
Updated
May 26, 2026 - Python
[radscore] Evaluation metrics for radiology report generation — BLEU, ROUGE, BERTScore, F1-RadGraph, CheXbert F1 & GREEN in one `pip install`.
machine-learning tutorial deep-learning medical-imaging rouge radiology evaluation-metrics bleu-score multilabel-classification medical-natural-language-processing chexpert report-generation healthcare-ai bertscore radiology-report-generation vision-language-model chexbert radgraph green-metric
-
Updated
Jun 16, 2026 - Python
An LLM-powered application that summarizes scientific research papers, extracts tables, and provides real-time evaluation using BERTScore (F1) and ROUGE. Built using Meta’s LLaMA 3–8B via Groq, with table extraction powered by pdfplumber and pandas.
-
Updated
Jul 23, 2025 - Python
AI-powered research paper summarizer built with Streamlit and Google Gemini. Supports customizable summaries, paper Q&A, ROUGE/BERTScore evaluation, and latency benchmarking.
python nlp artificial-intelligence summarization rouge research-paper gemini-api streamlit llm bertscore prompt-engineering generative-ai
-
Updated
Jun 24, 2026 - Python
Role-aware crisis tweet summarization using transformer baselines, automated reward scoring, and preference optimization.
natural-language-processing transformers text-summarization rouge disaster-response emergency-management crisis-informatics openai-api bertscore t5-small reward-modeling crisis-summarization tweet-summarization role-aware-summarization frecs-dataset
-
Updated
Jul 1, 2026 - Jupyter Notebook
Add this topic to your repo
To associate your repository with the bertscore topic, visit your repo's landing page and select "manage topics."