Shows
Daily Paper CastChain-of-Retrieval Augmented Generation
🤗 Upvotes: 26 | cs.IR, cs.CL
Authors:
Liang Wang, Haonan Chen, Nan Yang, Xiaolong Huang, Zhicheng Dou, Furu Wei
Title:
Chain-of-Retrieval Augmented Generation
Arxiv:
http://arxiv.org/abs/2501.14342v1
Abstract:
This paper introduces an approach for training o1-like RAG models that retrieve and reason over relevant information step by step before generating the final answer. Conventional RAG methods usually perform a single retrieval step before the generation process, which limits their effectiveness in addressing complex queries due to imperfect retrieval results. In contrast, our proposed method, CoRAG (Cha...2025-01-2823 minDaily Paper CastDeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning
🤗 Upvotes: 109 | cs.CL, cs.AI, cs.LG
Authors:
DeepSeek-AI, Daya Guo, Dejian Yang, Haowei Zhang, Junxiao Song, Ruoyu Zhang, Runxin Xu, Qihao Zhu, Shirong Ma, Peiyi Wang, Xiao Bi, Xiaokang Zhang, Xingkai Yu, Yu Wu, Z. F. Wu, Zhibin Gou, Zhihong Shao, Zhuoshu Li, Ziyi Gao, Aixin Liu, Bing Xue, Bingxuan Wang, Bochao Wu, Bei Feng, Chengda Lu, Chenggang Zhao, Chengqi Deng, Chenyu Zhang, Chong Ruan, Damai Dai, Deli Chen, Dongjie Ji, Erhang Li, Fangyun Lin, Fucong Dai, Fuli Luo, Guangbo Hao, Guanting Chen, Guowei Li, H. Zhang, Han Bao, Hanwei Xu, Haocheng Wang, Honghui Ding, Hua...2025-01-2421 minDaily Paper CastA Silver Bullet or a Compromise for Full Attention? A Comprehensive Study of Gist Token-based Context Compression
🤗 Upvotes: 17 | cs.CL
Authors:
Chenlong Deng, Zhisong Zhang, Kelong Mao, Shuaiyi Li, Xinting Huang, Dong Yu, Zhicheng Dou
Title:
A Silver Bullet or a Compromise for Full Attention? A Comprehensive Study of Gist Token-based Context Compression
Arxiv:
http://arxiv.org/abs/2412.17483v1
Abstract:
In this work, we provide a thorough investigation of gist-based context compression methods to improve long-context processing in large language models. We focus on two key questions: (1) How well can these methods replace full attention models? and (2) What potential failure patterns arise due to com...2024-12-2821 min
All means all! - all-means-all.educationUnderstanding Yourself as an Inclusive Teacher – Teacher Professional Identity Development
Join us for a deep dive into Teacher Professional Identity Development (TPID) and the evolving journey of becoming an inclusive educator. We discuss how personal experiences, ever-changing social contexts, and reflective practices shape a teacher’s identity. Learn how to align beliefs, values, and actions to respond to diverse classrooms, adapt to new technologies, and ultimately build a teaching practice centered on empathy, equity, and inclusive excellence.
Ann-Kathrin Arndt
Beausetha Juhetha Bruwer
Sarah Volknant
Zhicheng Huang
2024-12-2600 min