ELO-GRAG@EvalLLM 2026: Vers un système HybridRAG combinant graphes de connaissances et texte, évalué sur un corpus de défense en français

Ehrhart, Thibault; Meli Songuon, Carmelle; Plu, Julien; Troncy, Raphaël; Chabot, Yoan; Trouillez, Edouard; Moreno Escobar., Oscar
EvalLLM 2026, Atelier sur l'évaluation des modèles génératifs (LLM), le RAG et challenges, 29 Juin-3 Juillet, Nantes, France

We describe ELO-GRAG, our system submitted to the EvalLLM 2026 RAG Challenge. The official corpus contains 375 documents, for a total of 10741 pages. We convert this corpus into annotated Markdown in order to extract the textual content while preserving the document structure, and page level provenance. For Task 1, we compare a RAG system combining dense and lexical retrieval, Microsoft GraphRAG, and two hybrid variants that use an automatically extracted RDF knowledge graph. For Task 2, we formulate source attribution as a controlled LLM-as-a-judge task, with or without additional verbalized triples from the knowledge graph. Preliminary results show that our vector RAG system is the strongest evidence retrieval method, while the best source attribution trade-off is obtained by a Gemma judge using only the textual content of candidate pages.


Type:
Conférence
City:
Nantes
Date:
2026-06-29
Department:
Data Science
Eurecom Ref:
8934
Copyright:
© EURECOM. Personal use of this material is permitted. The definitive version of this paper was published in EvalLLM 2026, Atelier sur l'évaluation des modèles génératifs (LLM), le RAG et challenges, 29 Juin-3 Juillet, Nantes, France and is available at :

PERMALINK : https://www.eurecom.fr/publication/8934