๋ชฉ๋ก
Vol.232026.02.02

๐Ÿ“‘Anthropic: "AIแ„€แ…ก แ„ƒแ…กแ†ผแ„‰แ…ตแ†ซแ„‹แ…ด แ„‰แ…ตแ†ฏแ„…แ…งแ†จแ„‹แ…ณแ†ฏ แ„ˆแ…ขแ„‹แ…กแ†บแ„€แ…ฉ แ„‹แ…ตแ†ปแ„‹แ…ฅแ†ปแ„ƒแ…ก!"

26.02.1แ„Œแ…ฎแ„Žแ…ก | Anthropic, ByteDance, DeepSeek, Alibaba, Tencent, Meta, MIT, CMU

2,090๋ช… ์ˆ˜์‹ ์˜คํ”ˆ์œจ 57.87%ํด๋ฆญ๋ฅ  11.15%

๐Ÿ“‘Anthropic: "AIแ„€แ…ก แ„ƒแ…กแ†ผแ„‰แ…ตแ†ซแ„‹แ…ด แ„‰แ…ตแ†ฏแ„…แ…งแ†จแ„‹แ…ณแ†ฏ แ„ˆแ…ขแ„‹แ…กแ†บแ„€แ…ฉ แ„‹แ…ตแ†ปแ„‹แ…ฅแ†ปแ„ƒแ…ก!"

26.02.1แ„Œแ…ฎแ„Žแ…ก | Anthropic, ByteDance, DeepSeek, Alibaba, Tencent, Meta, MIT, CMU

๊ธˆ์ฃผ ์บ์น˜ํŽ˜์ดํผ๋Š” Anthropic, ByteDance, DeepSeek, Alibaba, Tencent, Meta, MIT, CMU, ETH Zurich ์™€ ํ•จ๊ป˜ํ•ฉ๋‹ˆ๋‹ค.
3๋ถ„๋งŒ ํˆฌ์žํ•ด ์“ฑ ๋‘˜๋Ÿฌ๋ณด๊ณ , ๋น ๋ฅด๊ฒŒ ๋ฐ”๋€Œ๋Š” ๊ธฐ์ˆ ์˜ ๋ฐฉํ–ฅ์„ฑ์„ ๋†“์น˜์ง€ ๋งˆ์„ธ์š”!

๐Ÿ“ˆ ์ตœ์‹  AI ํŠธ๋ Œ๋“œ 3์ค„ ์š”์•ฝ

๐ŸŒŸ AI ์—ฐ๊ตฌ์˜ ์ดˆ์ ์ด '๋‹จ์ˆœํžˆ ๋” ํฐ ๋ชจ๋ธ'์—์„œ '๋” ๋˜‘๋˜‘ํ•˜๊ฒŒ ํ›ˆ๋ จํ•˜๊ณ , ๋” ์ •๋ฐ€ํ•˜๊ฒŒ ์ œ์–ดํ•˜๊ณ , ๋” ํšจ์œจ์ ์œผ๋กœ ์••์ถ•ํ•˜๋Š”' ๋ฐฉํ–ฅ์œผ๋กœ ๊ธ‰๊ฒฉํžˆ ์ „ํ™˜๋˜๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค.

๐Ÿš€ ํŠนํžˆ AI ์•ˆ์ „์„ฑ๊ณผ ์Šคํ‚ฌ ํ˜•์„ฑ์— ๋Œ€ํ•œ ์—ฐ๊ตฌ๊ฐ€ ๋ถ€์ƒํ•˜๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค.

๐Ÿ”Ž ์‚ฌ์ „ํ›ˆ๋ จ ํŒจ๋Ÿฌ๋‹ค์ž„์˜ ๊ทผ๋ณธ์  ๋ณ€ํ™”์™€ ๋ฉ€ํ‹ฐ๋ชจ๋‹ฌยท๋‹ค๊ตญ์–ด ๋ชจ๋ธ์˜ ์‹ค์šฉ์  ํ˜์‹ ์ด ๋™์‹œ์— ์ง„ํ–‰๋˜๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค.

๐Ÿ’ฅ AI๊ฐ€ ๋‹น์‹ ์˜ ์‹ค๋ ฅ์„ ๋นผ์•—๊ณ  ์žˆ์—ˆ๋‹ค๋ฉด? ํŽธ๋ฆฌํ•จ ๋’ค์— ์ˆจ๊ฒจ์ง„ ์‹คํ—˜ ๊ฒฐ๊ณผ!

How AI Impacts Skill Formation

๐Ÿ›๏ธ ์†Œ์†: Anthropic
๐Ÿท๏ธ ํ•ต์‹ฌ ํ‚ค์›Œ๋“œ: AI Assistance, Skill Acquisition, Debugging, Learning Outcomes

๐Ÿ’ญ ์ด๋Ÿฐ ์งˆ๋ฌธ์„ ํ•ด๋ณธ ์  ์žˆ๋‚˜์š”?

  • "AI๋ฅผ ์“ฐ๋ฉด ์“ธ์ˆ˜๋ก ๋‚ด ์‹ค๋ ฅ์ด ๋Š˜์–ด๋‚˜๋Š” ๊ฑธ๊นŒ, ์ค„์–ด๋“œ๋Š” ๊ฑธ๊นŒ?"

  • "AI์—๊ฒŒ ๋งก๊ธฐ๋ฉด ํŽธํ•œ๋ฐ, ์™œ ์˜คํžˆ๋ ค ๋””๋ฒ„๊น… ๋Šฅ๋ ฅ์ด ํ‡ด๋ณดํ• ๊นŒ?"

  • "ํ•™์Šต์—์„œ AI์˜ ์˜ฌ๋ฐ”๋ฅธ ํ™œ์šฉ๋ฒ•๊ณผ ์ž˜๋ชป๋œ ํ™œ์šฉ๋ฒ•์˜ ์ฐจ์ด๋Š”?"

์ž์ „๊ฑฐ ๋ณด์กฐ๋ฐ”ํ€ด๋ฅผ ๋„ˆ๋ฌด ์˜ค๋ž˜ ์“ฐ๋ฉด ๊ท ํ˜• ๊ฐ๊ฐ์ด ๋ฐœ๋‹ฌํ•˜์ง€ ์•Š๋“ฏ, AI์— ์ˆ˜๋™์ ์œผ๋กœ ์˜์กดํ•˜๋ฉด ๋””๋ฒ„๊น…๊ณผ ๊ฐœ๋… ์ดํ•ด ๊ฐ™์€ ํ•ต์‹ฌ ์Šคํ‚ฌ์ด ์˜คํžˆ๋ ค ํ‡ด๋ณดํ•œ๋‹ค๋Š” ์‹คํ—˜ ๊ฒฐ๊ณผ๊ฐ€ ๋‚˜์™”์Šต๋‹ˆ๋‹ค. AI ์ƒํ˜ธ์ž‘์šฉ์˜ ๋ฐฉ์‹์ด ํ•™์Šต ์„ฑ๊ณผ๋ฅผ ๊ฒฐ์ •ํ•˜๋ฉฐ, ์ˆ˜๋™์  ์œ„์ž„์ด ๊ฐ€์žฅ ๋‚˜์œ ๊ฒฐ๊ณผ๋ฅผ ๋ƒ…๋‹ˆ๋‹ค. ํŠนํžˆ ์ฃผ๋ชฉํ•  ์ :

  • AI ์˜์กด๋„์™€ ์Šคํ‚ฌ ํ˜•์„ฑ ๊ฐ„์˜ ์ธ๊ณผ๊ด€๊ณ„๋ฅผ ์‹คํ—˜์ ์œผ๋กœ ์ž…์ฆ

  • ๋‹จ์ˆœ ์ƒ์‚ฐ์„ฑ ์ธก์ •์„ ๋„˜์–ด ๊ทผ๋ณธ์  ๋Šฅ๋ ฅ ๋ณ€ํ™”๋ฅผ ์ถ”์ 

  • ๊ต์œก๊ณผ AI ํ™œ์šฉ ์ •์ฑ… ์ˆ˜๋ฆฝ์— ์ง์ ‘์  ์‹œ์‚ฌ์  ์ œ๊ณต

๐ŸŽฏ ์™œ ์ด๊ฒƒ์ด ๊ฒŒ์ž„ ์ฒด์ธ์ €์ธ๊ฐ€? : AI = ์ƒ์‚ฐ์„ฑ ํ–ฅ์ƒ ๋„๊ตฌ๋ผ๋Š” ํ†ต๋… โ†’ AI ํ™œ์šฉ ๋ฐฉ์‹์— ๋”ฐ๋ผ ์Šคํ‚ฌ์ด ํ‡ด๋ณดํ•  ์ˆ˜ ์žˆ๋‹ค๋Š” ๊ฒฝ๊ณ ์˜ ์ „ํ™˜์  ๊ฐ•์กฐ
๐Ÿ”— ๋” ์ž์„ธํ•œ ๋‚ด์šฉ์ด ๊ถ๊ธˆํ•˜๋‹ค๋ฉด : https://arxiv.org/abs/2601.20245

๐Ÿง  ByteDance๊ฐ€ ํ† ํฐ์„ '๊ฐœ๋…'์œผ๋กœ ์••์ถ•ํ–ˆ๋”๋‹ˆ, MoE ๋ชจ๋ธ์ด ๋” ๋นจ๋ผ์กŒ๋‹ค!

ConceptMoE: Adaptive Token-to-Concept Compression for Implicit Compute Allocation

๐Ÿ›๏ธ ์†Œ์†: ByteDance
๐Ÿท๏ธ ํ•ต์‹ฌ ํ‚ค์›Œ๋“œ: Mixture-of-Experts, Token Compression, Concept Abstraction, Inference Speed

๐Ÿ’ญ ์ด๋Ÿฐ ์งˆ๋ฌธ์„ ํ•ด๋ณธ ์  ์žˆ๋‚˜์š”? "์ˆ˜๋ฐฑ ๊ฐœ์˜ ํ† ํฐ์„ ํ•œ ์ค„์˜ '๊ฐœ๋…'์œผ๋กœ ์••์ถ•ํ•  ์ˆ˜ ์žˆ๋‹ค๋ฉด?"

"MoE ๋ชจ๋ธ์˜ ์ถ”๋ก  ์†๋„๋ฅผ ์„ฑ๋Šฅ ์†์‹ค ์—†์ด ๋Œ์–ด์˜ฌ๋ฆด ์ˆ˜ ์žˆ์„๊นŒ?"

"KV ์บ์‹œ์˜ ๋ณ‘๋ชฉ ํ˜„์ƒ์„ ๊ทผ๋ณธ์ ์œผ๋กœ ํ•ด๊ฒฐํ•  ๋ฐฉ๋ฒ•์€?"

์ˆ˜์ฒœ ๊ฐœ์˜ ํผ์ฆ ์กฐ๊ฐ์„ ๋ช‡ ๊ฐœ์˜ ํ•ต์‹ฌ ๊ทธ๋ฃน์œผ๋กœ ๋ฌถ์–ด ํ•œ๋ˆˆ์— ํŒŒ์•…ํ•˜๋Š” ๊ฒƒ์ฒ˜๋Ÿผ, ConceptMoE๋Š” ์˜๋ฏธ์ ์œผ๋กœ ์œ ์‚ฌํ•œ ํ† ํฐ๋“ค์„ ๋™์ ์œผ๋กœ ์ถ”์ƒ ๊ฐœ๋…์œผ๋กœ ๋ณ‘ํ•ฉํ•ฉ๋‹ˆ๋‹ค. ์ด๋ฅผ ํ†ตํ•ด ์–ดํ…์…˜ ๋งต ๊ณ„์‚ฐ๊ณผ KV ์บ์‹œ ์‚ฌ์šฉ๋Ÿ‰์„ ๋Œ€ํญ ์ค„์ด๋ฉด์„œ๋„ ๋‹ค์–‘ํ•œ ๋ฒค์น˜๋งˆํฌ์—์„œ ์„ฑ๋Šฅ์„ ํ–ฅ์ƒ์‹œ์ผฐ์Šต๋‹ˆ๋‹ค. ํŠนํžˆ ์ฃผ๋ชฉํ•  ์ :

  • ํ† ํฐ ๋‹จ์œ„ ์ฒ˜๋ฆฌ์˜ ๋น„ํšจ์œจ์„ ๊ฐœ๋… ๋‹จ์œ„ ์••์ถ•์œผ๋กœ ํ•ด๊ฒฐ

  • ์ถ”๋ก  ์†๋„ ๋Œ€ํญ ๊ฐœ์„ ๊ณผ ๋™์‹œ์— ๋ฒค์น˜๋งˆํฌ ์„ฑ๋Šฅ ํ–ฅ์ƒ

  • MoE ์•„ํ‚คํ…์ฒ˜ ์ „๋ฐ˜์— ์ ์šฉ ๊ฐ€๋Šฅํ•œ ๋ฒ”์šฉ ํ”„๋ ˆ์ž„์›Œํฌ

๐ŸŽฏ ์™œ ์ด๊ฒƒ์ด ๊ฒŒ์ž„ ์ฒด์ธ์ €์ธ๊ฐ€? : ํ† ํฐ ๋‹จ์œ„์˜ ์ˆœ์ฐจ์  ์ฒ˜๋ฆฌ โ†’ ์˜๋ฏธ ๊ธฐ๋ฐ˜ ๊ฐœ๋… ์••์ถ•์„ ํ†ตํ•œ ์ ์‘์  ์ปดํ“จํŒ… ํ• ๋‹น์˜ ์ „ํ™˜์  ๊ฐ•์กฐ
๐Ÿ”— ๋” ์ž์„ธํ•œ ๋‚ด์šฉ์ด ๊ถ๊ธˆํ•˜๋‹ค๋ฉด : https://arxiv.org/abs/2601.21420

๐Ÿ›ก๏ธ '์˜๋ฃŒ ์ง€์‹'๋งŒ ์„ ํƒ์ ์œผ๋กœ ์ง€์šฐ๋Š” ๊ฒƒ์ด ๊ฐ€๋Šฅํ•ด์กŒ๋‹ค!

Shaping Capabilities with Token-Level Data Filtering

๐Ÿ›๏ธ ์†Œ์†: Anthropic, OpenAI
๐Ÿท๏ธ ํ•ต์‹ฌ ํ‚ค์›Œ๋“œ: Token-Level Filtering, Capability Shaping, Adversarial Robustness, Safety

๐Ÿ’ญ ์ด๋Ÿฐ ์งˆ๋ฌธ์„ ํ•ด๋ณธ ์  ์žˆ๋‚˜์š”?

  • "LLM์—์„œ ์›์น˜ ์•Š๋Š” ๋Šฅ๋ ฅ๋งŒ ๊ณจ๋ผ์„œ ์ œ๊ฑฐํ•  ์ˆ˜ ์žˆ์„๊นŒ?"

  • "AI ์•ˆ์ „์„ฑ์„ ํ›ˆ๋ จ ๋‹จ๊ณ„๋ถ€ํ„ฐ ๊ทผ๋ณธ์ ์œผ๋กœ ํ•ด๊ฒฐํ•  ์ˆ˜ ์žˆ๋‹ค๋ฉด?"

  • "์ ๋Œ€์  ํŒŒ์ธํŠœ๋‹์—๋„ ๋ฌด๋„ˆ์ง€์ง€ ์•Š๋Š” ๋ชจ๋ธ์„ ๋งŒ๋“ค ์ˆ˜ ์žˆ์„๊นŒ?"

์‹๋‹จ์—์„œ ํŠน์ • ์„ฑ๋ถ„๋งŒ ์ •๋ฐ€ํ•˜๊ฒŒ ๊ฑธ๋Ÿฌ๋‚ด๋Š” ๊ฒƒ์ฒ˜๋Ÿผ, ์ด ์—ฐ๊ตฌ๋Š” ํ† ํฐ ๋‹จ์œ„๋กœ ์‚ฌ์ „ํ›ˆ๋ จ ๋ฐ์ดํ„ฐ๋ฅผ ํ•„ํ„ฐ๋งํ•ด ์˜๋ฃŒ ์ง€์‹ ๊ฐ™์€ ํŠน์ • ๋Šฅ๋ ฅ์„ ์„ ํƒ์ ์œผ๋กœ ์ œ๊ฑฐํ•ฉ๋‹ˆ๋‹ค. ์ ๋Œ€์  ํŒŒ์ธํŠœ๋‹์— ๋Œ€ํ•œ ๊ฐ•๊ฑด์„ฑ์ด ์ตœ๋Œ€ 13๋ฐฐ ํ–ฅ์ƒ๋˜๊ณ , ๋ฏผ๊ฐํ•œ ์ฟผ๋ฆฌ์— ๋Œ€ํ•œ ๊ฑฐ๋ถ€์œจ์€ 2๋ฐฐ ์ฆ๊ฐ€ํ–ˆ์Šต๋‹ˆ๋‹ค. ํŠนํžˆ ์ฃผ๋ชฉํ•  ์ :

  • ๋ฌธ์„œ ๋‹จ์œ„๊ฐ€ ์•„๋‹Œ ํ† ํฐ ๋‹จ์œ„ ํ•„ํ„ฐ๋ง์œผ๋กœ ํ›จ์”ฌ ์ •๋ฐ€ํ•œ ๋Šฅ๋ ฅ ์ œ์–ด

  • ์ ๋Œ€์  ํŒŒ์ธํŠœ๋‹ ๊ฐ•๊ฑด์„ฑ 13๋ฐฐ, ๊ฑฐ๋ถ€์œจ 2๋ฐฐ ํ–ฅ์ƒ

  • ๋ชจ๋ธ ๊ทœ๋ชจ๊ฐ€ ์ปค์งˆ์ˆ˜๋ก ํšจ๊ณผ๊ฐ€ ์ปค์ง€๋Š” ํ™•์žฅ์„ฑ ํ™•์ธ

๐ŸŽฏ ์™œ ์ด๊ฒƒ์ด ๊ฒŒ์ž„ ์ฒด์ธ์ €์ธ๊ฐ€? : ํ›ˆ๋ จ ํ›„ ์•ˆ์ „์„ฑ ํŒจ์น˜ โ†’ ์‚ฌ์ „ํ›ˆ๋ จ ๋‹จ๊ณ„๋ถ€ํ„ฐ ๋Šฅ๋ ฅ์„ ๊ทผ๋ณธ์ ์œผ๋กœ ์„ค๊ณ„ํ•˜๋Š” ์ „ํ™˜์  ๊ฐ•์กฐ
๐Ÿ”— ๋” ์ž์„ธํ•œ ๋‚ด์šฉ์ด ๊ถ๊ธˆํ•˜๋‹ค๋ฉด : https://arxiv.org/abs/2601.21571

๐Ÿ‘๏ธ DeepSeek๊ฐ€ OCR์˜ '์ฝ๋Š” ์ˆœ์„œ'๊นŒ์ง€ AI์—๊ฒŒ ๊ฐ€๋ฅด์ณค๋”๋‹ˆ, ์„ฑ๋Šฅ์ด ํญ๋ฐœํ–ˆ๋‹ค!

DeepSeek-OCR 2: Visual Causal Flow

๐Ÿ›๏ธ ์†Œ์†: DeepSeek
๐Ÿท๏ธ ํ•ต์‹ฌ ํ‚ค์›Œ๋“œ: DeepEncoder V2, Visual Causal Flow, OCR, Reading Order Optimization

๐Ÿ’ญ ์ด๋Ÿฐ ์งˆ๋ฌธ์„ ํ•ด๋ณธ ์  ์žˆ๋‚˜์š”?

  • "๋ฌธ์„œ๋ฅผ ์ฝ๋Š” ์ˆœ์„œ๊ฐ€ OCR ์„ฑ๋Šฅ์„ ๊ทผ๋ณธ์ ์œผ๋กœ ๋ฐ”๊ฟ€ ์ˆ˜ ์žˆ๋‹ค๋ฉด?"

  • "๋น„์ „ ํ† ํฐ์„ ์˜๋ฏธ ๊ธฐ๋ฐ˜์œผ๋กœ ์žฌ๋ฐฐ์น˜ํ•˜๋ฉด ๋ฌด์Šจ ์ผ์ด ๋ฒŒ์–ด์งˆ๊นŒ?"

  • "91%๋ฅผ ๋„˜๋Š” OCR ์ •ํ™•๋„๋Š” ์‹ค๋ฌด์—์„œ ์–ด๋–ค ๋ณ€ํ™”๋ฅผ ๊ฐ€์ ธ์˜ฌ๊นŒ?"

์ฑ…์„ ๋ฌด์ž‘์œ„๋กœ ํŽผ์น˜์ง€ ์•Š๊ณ  ๋ชฉ์ฐจ๋ฅผ ๋ณด๊ณ  ์ค‘์š”ํ•œ ์ˆœ์„œ๋Œ€๋กœ ์ฝ๋Š” ๊ฒƒ์ฒ˜๋Ÿผ, DeepSeek-OCR 2๋Š” 'Visual Causal Flow' ๋ฉ”์ปค๋‹ˆ์ฆ˜์œผ๋กœ ์‹œ๊ฐ ํ† ํฐ์„ ์˜๋ฏธ์  ์ค‘์š”๋„์— ๋”ฐ๋ผ ๋™์ ์œผ๋กœ ์žฌ์ •๋ ฌํ•ฉ๋‹ˆ๋‹ค. OmniDocBench v1.5์—์„œ 91.09%์˜ ์„ฑ๋Šฅ์„ ๋‹ฌ์„ฑํ•˜๋ฉฐ, ์ฝ๊ธฐ ์ˆœ์„œ Edit Distance๋ฅผ 0.057๊นŒ์ง€ ๋‚ฎ์ท„์Šต๋‹ˆ๋‹ค. ํŠนํžˆ ์ฃผ๋ชฉํ•  ์ :

  • ์ „์ž‘ ๋Œ€๋น„ 3.73% ์„ฑ๋Šฅ ํ–ฅ์ƒ, ์ฝ๊ธฐ ์ˆœ์„œ ์ •ํ™•๋„ ๊ทน์  ๊ฐœ์„ 

  • ๋‹ค๋ฅธ VLM ๊ธฐ๋ฐ˜ OCR ๋ชจ๋ธ๋“ค์„ ์••๋„ํ•˜๋Š” ์„ฑ๋Šฅ

  • ๋ณต์žกํ•œ ๋ ˆ์ด์•„์›ƒ์˜ ๋ฌธ์„œ๋ถ€ํ„ฐ ํ‘œ, ์ฐจํŠธ๊นŒ์ง€ ํญ๋„“๊ฒŒ ์ ์šฉ

๐ŸŽฏ ์™œ ์ด๊ฒƒ์ด ๊ฒŒ์ž„ ์ฒด์ธ์ €์ธ๊ฐ€? : ๊ณ ์ •๋œ ์ˆœ์„œ์˜ ์‹œ๊ฐ ํ† ํฐ ์ฒ˜๋ฆฌ โ†’ ์˜๋ฏธ ๊ธฐ๋ฐ˜ ๋™์  ์žฌ์ •๋ ฌ์„ ํ†ตํ•œ OCR ํ˜์‹ ์˜ ์ „ํ™˜์  ๊ฐ•์กฐ
๐Ÿ”— ๋” ์ž์„ธํ•œ ๋‚ด์šฉ์ด ๊ถ๊ธˆํ•˜๋‹ค๋ฉด : https://arxiv.org/abs/2601.20552

๐ŸŒ Alibaba๊ฐ€ 52๊ฐœ ์–ธ์–ด๋ฅผ ๋‹จ๋ฒˆ์— ์•Œ์•„๋“ฃ๋Š” ์˜คํ”ˆ์†Œ์Šค ASR์„ ํ’€์—ˆ๋‹ค!

Qwen3-ASR Technical Report

๐Ÿ›๏ธ ์†Œ์†: Alibaba (Tongyi Lab, Qwen Team)
๐Ÿท๏ธ ํ•ต์‹ฌ ํ‚ค์›Œ๋“œ: Automatic Speech Recognition, Multilingual, Non-Autoregressive Aligner, Qwen3-Omni

๐Ÿ’ญ ์ด๋Ÿฐ ์งˆ๋ฌธ์„ ํ•ด๋ณธ ์  ์žˆ๋‚˜์š”?

  • "52๊ฐœ ์–ธ์–ด์™€ ๋ฐฉ์–ธ์„ ํ•˜๋‚˜์˜ ๋ชจ๋ธ๋กœ ์ธ์‹ํ•  ์ˆ˜ ์žˆ๋‹ค๋ฉด?"

  • "์˜คํ”ˆ์†Œ์Šค ASR์ด ์ƒ์šฉ ์„œ๋น„์Šค ์ˆ˜์ค€์„ ๋”ฐ๋ผ์žก์„ ์ˆ˜ ์žˆ์„๊นŒ?"

  • "์Œ์„ฑ ์ธ์‹๊ณผ ํƒ€์ž„์Šคํƒฌํ”„ ์ •ํ™•๋„๋ฅผ ๋™์‹œ์— ํ•ด๊ฒฐํ•˜๋Š” ๋ฐฉ๋ฒ•์€?"

๋™์‹œํ†ต์—ญ๊ฐ€๊ฐ€ ์ˆ˜์‹ญ ๊ฐœ์˜ ์–ธ์–ด๋ฅผ ์ž์œ ์ž์žฌ๋กœ ๋„˜๋‚˜๋“œ๋Š” ๊ฒƒ์ฒ˜๋Ÿผ, Qwen3-ASR์€ Qwen3-Omni ๋Œ€ํ˜• ์˜ค๋””์˜ค-์–ธ์–ด ๋ชจ๋ธ์„ ๊ธฐ๋ฐ˜์œผ๋กœ 52๊ฐœ ์–ธ์–ดยท๋ฐฉ์–ธ์—์„œ SOTA ์˜คํ”ˆ์†Œ์Šค ์„ฑ๋Šฅ์„ ๋‹ฌ์„ฑํ–ˆ์Šต๋‹ˆ๋‹ค. ๋น„์ž๊ธฐํšŒ๊ท€์  ๋‹ค๊ตญ์–ด ๊ฐ•์ œ ์ •๋ ฌ๊ธฐ๋กœ ํƒ€์ž„์Šคํƒฌํ”„ ์ •ํ™•๋„์™€ ํšจ์œจ์„ฑ๋„ ํ•จ๊ป˜ ํ™•๋ณดํ–ˆ์Šต๋‹ˆ๋‹ค. ํŠนํžˆ ์ฃผ๋ชฉํ•  ์ :

  • ์˜คํ”ˆ์†Œ์Šค ASR ์˜์—ญ์—์„œ ์ƒˆ๋กœ์šด SOTA ๋‹ฌ์„ฑ

  • ๋น„์ž๊ธฐํšŒ๊ท€ ๊ฐ•์ œ ์ •๋ ฌ๊ธฐ๋กœ ์ •ํ™•ํ•˜๊ณ  ๋น ๋ฅธ ํƒ€์ž„์Šคํƒฌํ”„ ์ œ๊ณต

  • 52๊ฐœ ์–ธ์–ด ๋ฐ ๋ฐฉ์–ธ ์ง€์›์œผ๋กœ ๊ธ€๋กœ๋ฒŒ ์ ์šฉ ๊ฐ€๋Šฅ

๐ŸŽฏ ์™œ ์ด๊ฒƒ์ด ๊ฒŒ์ž„ ์ฒด์ธ์ €์ธ๊ฐ€? : ์–ธ์–ด๋ณ„ ๊ฐœ๋ณ„ ASR ๋ชจ๋ธ โ†’ ๋‹จ์ผ ๋ชจ๋ธ๋กœ 52๊ฐœ ์–ธ์–ด ํ†ตํ•ฉ ์ธ์‹์˜ ์ „ํ™˜์  ๊ฐ•์กฐ
๐Ÿ”— ๋” ์ž์„ธํ•œ ๋‚ด์šฉ์ด ๊ถ๊ธˆํ•˜๋‹ค๋ฉด : https://arxiv.org/abs/2601.21337

๐Ÿ‘ป Tencent: "AI๊ฐ€ ๋ณด๋Š” ํ™˜๊ฐ, ์šฐ๋ฆฌ๊ฐ€ ์žก์•˜์Šต๋‹ˆ๋‹ค" โ€” 75๊ฐœ ๋ฒค์น˜๋งˆํฌ ๊ฒ€์ฆ!

Youtu-VL: Unleashing Visual Potential via Unified Vision-Language Supervision

๐Ÿ›๏ธ ์†Œ์†: Tencent
๐Ÿท๏ธ ํ•ต์‹ฌ ํ‚ค์›Œ๋“œ: Vision-Language Model, Vision-as-Target, Hallucination Reduction, Multimodal

๐Ÿ’ญ ์ด๋Ÿฐ ์งˆ๋ฌธ์„ ํ•ด๋ณธ ์  ์žˆ๋‚˜์š”?

  • "AI๊ฐ€ ์ด๋ฏธ์ง€๋ฅผ ์ดํ•ดํ•  ๋•Œ ์„ธ๋ถ€ ์ •๋ณด๋ฅผ ์žƒ์–ด๋ฒ„๋ฆฌ๋Š” ๋ฌธ์ œ, ํ•ด๊ฒฐ ๊ฐ€๋Šฅํ• ๊นŒ?"

  • "๋น„์ „-์–ธ์–ด ๋ชจ๋ธ์˜ ํ™˜๊ฐ(hallucination)์„ ๊ทผ๋ณธ์ ์œผ๋กœ ์ค„์ผ ์ˆ˜ ์žˆ๋‹ค๋ฉด?"

  • "ํ•˜๋‚˜์˜ ์•„ํ‚คํ…์ฒ˜๋กœ ๋น„์ „ ์ค‘์‹ฌ + ๋ฒ”์šฉ ๋ฉ€ํ‹ฐ๋ชจ๋‹ฌ ํƒœ์Šคํฌ๋ฅผ ํ†ตํ•ฉํ•  ์ˆ˜ ์žˆ์„๊นŒ?"

ํ™”๊ฐ€๊ฐ€ ํ’๊ฒฝ์„ ๊ธฐ์–ต์—๋งŒ ์˜์กดํ•ด ๊ทธ๋ฆฌ๋ฉด ๋””ํ…Œ์ผ์ด ์‚ฌ๋ผ์ง€์ง€๋งŒ, ์‹ค๋ฌผ์„ ๋ณด๋ฉฐ ๊ทธ๋ฆฌ๋ฉด ์ •ํ™•ํ•ด์ง€๋“ฏ, Youtu-VL์€ 'vision-as-target' ํŒจ๋Ÿฌ๋‹ค์ž„์œผ๋กœ ์‹œ๊ฐ ์ •๋ณด ์†์‹ค์„ ๋ฐฉ์ง€ํ•ฉ๋‹ˆ๋‹ค. 75๊ฐœ ๋ฒค์น˜๋งˆํฌ์—์„œ ๊ฒฝ์Ÿ๋ ฅ ์žˆ๋Š” ์„ฑ๋Šฅ์„ ๋‹ฌ์„ฑํ•˜๋ฉฐ ํ™˜๊ฐ์„ ํ˜„์ €ํžˆ ์ค„์˜€์Šต๋‹ˆ๋‹ค. ํŠนํžˆ ์ฃผ๋ชฉํ•  ์ :

  • ์„ธ๋ถ€ ์‹œ๊ฐ ์ •๋ณด ๋ณด์กด์œผ๋กœ ํ™˜๊ฐ ๋ฌธ์ œ ๊ทผ๋ณธ์  ํ•ด๊ฒฐ

  • 75๊ฐœ ๋ฒค์น˜๋งˆํฌ ๊ด‘๋ฒ”์œ„ ๊ฒ€์ฆ์„ ํ†ตํ•œ ์ผ๊ด€๋œ ์„ฑ๋Šฅ

  • ๋น„์ „ ์ค‘์‹ฌ๋ถ€ํ„ฐ ๋ฒ”์šฉ ๋ฉ€ํ‹ฐ๋ชจ๋‹ฌ๊นŒ์ง€ ํ†ตํ•ฉ ์•„ํ‚คํ…์ฒ˜

๐ŸŽฏ ์™œ ์ด๊ฒƒ์ด ๊ฒŒ์ž„ ์ฒด์ธ์ €์ธ๊ฐ€? : ํ…์ŠคํŠธ ์ค‘์‹ฌ์˜ ๋น„์ „-์–ธ์–ด ํ•™์Šต โ†’ ์‹œ๊ฐ ์ •๋ณด ์ž์ฒด๋ฅผ ๋ชฉํ‘œ๋กœ ํ•˜๋Š” ํ•™์Šต ํŒจ๋Ÿฌ๋‹ค์ž„์˜ ์ „ํ™˜์  ๊ฐ•์กฐ
๐Ÿ”— ๋” ์ž์„ธํ•œ ๋‚ด์šฉ์ด ๊ถ๊ธˆํ•˜๋‹ค๋ฉด : https://arxiv.org/abs/2601.19798

๐ŸŽจ Alibaba: "์ด๋ฏธ์ง€ ์ƒ์„ฑ AI์—๊ฒŒ ๋งค ์Šคํ…๋งˆ๋‹ค ๋ณด์ƒ์„ ์ฃผ๋‹ˆ๊นŒ, ์ธ๊ฐ„ ์ทจํ–ฅ์„ ์™„๋ฒฝํžˆ ํ•™์Šตํ–ˆ๋‹ค!"

DenseGRPO: From Sparse to Dense Reward for Flow Matching Model Alignment

๐Ÿ›๏ธ ์†Œ์†: Alibaba Group, Huazhong University of Science and Technology
๐Ÿท๏ธ ํ•ต์‹ฌ ํ‚ค์›Œ๋“œ: Dense Reward, Flow Matching, Human Preference Alignment, Text-to-Image

๐Ÿ’ญ ์ด๋Ÿฐ ์งˆ๋ฌธ์„ ํ•ด๋ณธ ์  ์žˆ๋‚˜์š”?

  • "์ด๋ฏธ์ง€ ์ƒ์„ฑ ๊ณผ์ •์˜ ๋งค ์Šคํ…์— ๋ณด์ƒ์„ ์ค„ ์ˆ˜ ์žˆ๋‹ค๋ฉด?"

  • "ํ…์ŠคํŠธโ†’์ด๋ฏธ์ง€ ๋ชจ๋ธ์ด ์ธ๊ฐ„์˜ ๋ฏธ์  ์ทจํ–ฅ์„ ์ •๋ฐ€ํ•˜๊ฒŒ ๋ฐ˜์˜ํ•  ์ˆ˜ ์žˆ์„๊นŒ?"

  • "๊ธฐ์กด ํฌ์†Œ ๋ณด์ƒ์˜ ํ•œ๊ณ„๋ฅผ ๊ทผ๋ณธ์ ์œผ๋กœ ํ•ด๊ฒฐํ•  ๋ฐฉ๋ฒ•์€?"

์š”๋ฆฌ์‚ฌ์—๊ฒŒ ์™„์„ฑ๋œ ์š”๋ฆฌ๋งŒ ํ‰๊ฐ€ํ•˜๋Š” ๋Œ€์‹  ์กฐ๋ฆฌ ๊ณผ์ •์˜ ๋งค ๋‹จ๊ณ„๋ฅผ ํ”ผ๋“œ๋ฐฑํ•˜๋Š” ๊ฒƒ์ฒ˜๋Ÿผ, DenseGRPO๋Š” ๋””๋…ธ์ด์ง• ์Šคํ…๋งˆ๋‹ค ๋ฐ€์ง‘ ๋ณด์ƒ์„ ์ œ๊ณตํ•ฉ๋‹ˆ๋‹ค. PickScore ๊ธฐ์ค€ ๊ธฐ์กด ๋ฐฉ๋ฒ• ๋Œ€๋น„ ์ตœ์†Œ 1.01์  ์ด์ƒ ํ–ฅ์ƒ๋˜๋ฉฐ, ํƒ์ƒ‰ ๊ณต๊ฐ„์˜ ์ ์‘์  ๋ณด์ •์„ ํ†ตํ•ด ๋‹ค์–‘ํ•œ T2I ํƒœ์Šคํฌ์—์„œ ์ผ๊ด€๋œ ์šฐ์ˆ˜์„ฑ์„ ๋ณด์ž…๋‹ˆ๋‹ค. ํŠนํžˆ ์ฃผ๋ชฉํ•  ์ :

  • ํฌ์†Œ ๋ณด์ƒ์˜ ํ•œ๊ณ„๋ฅผ ๋””๋…ธ์ด์ง• ์Šคํ…๋ณ„ ๋ฐ€์ง‘ ๋ณด์ƒ์œผ๋กœ ๊ทน๋ณต

  • PickScore +1.01์  ์ด์ƒ์œผ๋กœ ์ธ๊ฐ„ ์„ ํ˜ธ๋„ ์ •๋ ฌ ์„ฑ๋Šฅ ์••๋„

  • ๋‹ค์–‘ํ•œ T2I ํƒœ์Šคํฌ์—์„œ ์ผ๊ด€๋œ ์„ฑ๋Šฅ ํ–ฅ์ƒ

๐ŸŽฏ ์™œ ์ด๊ฒƒ์ด ๊ฒŒ์ž„ ์ฒด์ธ์ €์ธ๊ฐ€? : ์ตœ์ข… ๊ฒฐ๊ณผ๋ฌผ์—๋งŒ ๋ณด์ƒํ•˜๋Š” ํฌ์†Œ ๋ณด์ƒ โ†’ ์ƒ์„ฑ ๊ณผ์ • ์ „์ฒด์— ๋ฐ€์ง‘ ๋ณด์ƒ์„ ์ œ๊ณตํ•˜๋Š” ์ „ํ™˜์  ๊ฐ•์กฐ ๐Ÿ”— ๋” ์ž์„ธํ•œ ๋‚ด์šฉ์ด ๊ถ๊ธˆํ•˜๋‹ค๋ฉด : https://arxiv.org/abs/2601.20218

๐Ÿ”„ LLM์ด ์ž๊ธฐ ์‹ค์ˆ˜๋ฅผ '์Šค์Šค๋กœ ์„ค๋ช…'ํ•˜๊ณ  ๋ฐฐ์šฐ๋‹ˆ๊นŒ, ์„ฑ๋Šฅ์ด ํญ๋ฐœํ–ˆ๋‹ค!

Reinforcement Learning via Self-Distillation (SDPO)

๐Ÿ›๏ธ ์†Œ์†: ETH Zurich
๐Ÿท๏ธ ํ•ต์‹ฌ ํ‚ค์›Œ๋“œ: Self-Distillation, On-Policy RL, Token-level Feedback, Sample Efficiency

๐Ÿ’ญ ์ด๋Ÿฐ ์งˆ๋ฌธ์„ ํ•ด๋ณธ ์  ์žˆ๋‚˜์š”?

  • "AI๊ฐ€ ์ž์‹ ์˜ ์‹ค์ˆ˜๋ฅผ ์Šค์Šค๋กœ ๋ถ„์„ํ•˜๊ณ  ๊ฐœ์„ ํ•  ์ˆ˜ ์žˆ๋‹ค๋ฉด?"

  • "ํ™˜๊ฒฝ์ด ์ œ๊ณตํ•˜๋Š” ํ’๋ถ€ํ•œ ํ”ผ๋“œ๋ฐฑ์„ ๊ทธ๋Œ€๋กœ ํ™œ์šฉํ•˜๋Š” RL์ด ๊ฐ€๋Šฅํ• ๊นŒ?"

  • "์ƒ˜ํ”Œ ํšจ์œจ์„ฑ๊ณผ ์ตœ์ข… ์ •ํ™•๋„๋ฅผ ๋™์‹œ์— ๋†’์ด๋Š” ๋ฐฉ๋ฒ•์€?"

์‹œํ—˜์„ ํ‹€๋ฆฐ ํ›„ ๋‹ต์ง€๋งŒ ๋ณด๋Š” ๊ฒŒ ์•„๋‹ˆ๋ผ ์ž์‹ ์˜ ํ’€์ด ๊ณผ์ •์„ ์„ค๋ช…ํ•˜๋ฉฐ ๋ณต์Šตํ•˜๋Š” ๊ฒƒ์ฒ˜๋Ÿผ, SDPO๋Š” LLM์ด ์ž์‹ ์˜ ์‹ค์ˆ˜๋ฅผ ํ† ํฐํ™”๋œ ํ”ผ๋“œ๋ฐฑ์œผ๋กœ ์„ค๋ช…๋ฐ›๊ณ  ํ•™์Šตํ•ฉ๋‹ˆ๋‹ค. ์ด๋ฅผ ํ†ตํ•ด ๋ณต์žกํ•œ ์ถ”๋ก ๊ณผ ์ฝ”๋”ฉ ํƒœ์Šคํฌ์—์„œ ์ƒ˜ํ”Œ ํšจ์œจ์„ฑ๊ณผ ์ตœ์ข… ์ •ํ™•๋„๊ฐ€ ๋ชจ๋‘ ๋Œ€ํญ ํ–ฅ์ƒ๋˜์—ˆ์Šต๋‹ˆ๋‹ค. ํŠนํžˆ ์ฃผ๋ชฉํ•  ์ :

  • ์ž๊ธฐ ์‹ค์ˆ˜ ์„ค๋ช… ๊ธฐ๋ฐ˜์œผ๋กœ ์ƒ˜ํ”Œ ํšจ์œจ์„ฑ ๊ทน์  ๊ฐœ์„ 

  • ๋ณต์žกํ•œ ์ถ”๋ก ยท์ฝ”๋”ฉ ํƒœ์Šคํฌ์—์„œ ๋†’์€ ์ตœ์ข… ์ •ํ™•๋„ ๋‹ฌ์„ฑ

  • on-policy RL ํ”„๋ ˆ์ž„์›Œํฌ๋กœ ๋‹ค์–‘ํ•œ LLM์— ์ ์šฉ ๊ฐ€๋Šฅ

๐ŸŽฏ ์™œ ์ด๊ฒƒ์ด ๊ฒŒ์ž„ ์ฒด์ธ์ €์ธ๊ฐ€? : ๊ฒฐ๊ณผ ๊ธฐ๋ฐ˜ ํฌ์†Œ ํ”ผ๋“œ๋ฐฑ RL โ†’ ์ž๊ธฐ ์‹ค์ˆ˜ ์„ค๋ช…์„ ํ†ตํ•œ ํ’๋ถ€ํ•œ ํ† ํฐ ๋‹จ์œ„ ํ”ผ๋“œ๋ฐฑ RL์˜ ์ „ํ™˜์  ๊ฐ•์กฐ
๐Ÿ”— ๋” ์ž์„ธํ•œ ๋‚ด์šฉ์ด ๊ถ๊ธˆํ•˜๋‹ค๋ฉด : https://arxiv.org/abs/2601.20802

โšก MIT+CMU: "๋””์ฝ”๋” ํ•„์š” ์—†์Šต๋‹ˆ๋‹ค. ๋…ธ์ด์ฆˆ์—์„œ ๋ฐ”๋กœ ์ด๋ฏธ์ง€๋ฅผ!" โ€” FID 2.22 ๋‹ฌ์„ฑ

One-step Latent-free Image Generation with Pixel Mean Flows (pMF)

๐Ÿ›๏ธ ์†Œ์†: MIT, CMU
๐Ÿท๏ธ ํ•ต์‹ฌ ํ‚ค์›Œ๋“œ: Pixel MeanFlow, Single-Step Generation, Latent-Free, FID Score

๐Ÿ’ญ ์ด๋Ÿฐ ์งˆ๋ฌธ์„ ํ•ด๋ณธ ์  ์žˆ๋‚˜์š”?

  • "์ธ์ฝ”๋”/๋””์ฝ”๋” ์—†์ด ํ”ฝ์…€ ๊ณต๊ฐ„์—์„œ ๋ฐ”๋กœ ์ด๋ฏธ์ง€๋ฅผ ์ƒ์„ฑํ•  ์ˆ˜ ์žˆ๋‹ค๋ฉด?"

  • "๋‹จ ํ•œ ๋ฒˆ์˜ ๋„คํŠธ์›Œํฌ ํ‰๊ฐ€๋กœ ๊ณ ํ’ˆ์งˆ ์ด๋ฏธ์ง€๊ฐ€ ๊ฐ€๋Šฅํ• ๊นŒ?"

  • "๊ธฐ์กด ์ƒ์„ฑ ๋ชจ๋ธ์˜ ๊ณ„์‚ฐ ๋น„์šฉ์„ ๊ทผ๋ณธ์ ์œผ๋กœ ์ค„์ผ ์ˆ˜ ์žˆ์„๊นŒ?"

๋ณต์žกํ•œ ๋ฒˆ์—ญ ๊ณผ์ • ์—†์ด ๋ชจ๊ตญ์–ด๋กœ ๋ฐ”๋กœ ๊ธ€์„ ์“ฐ๋Š” ๊ฒƒ์ฒ˜๋Ÿผ, Pixel MeanFlow(pMF)๋Š” ์ž ์žฌ ์ธ์ฝ”๋”/๋””์ฝ”๋” ์—†์ด ๋…ธ์ด์ฆˆ์—์„œ ํ”ฝ์…€ ๊ณต๊ฐ„์œผ๋กœ ๋‹จ์ผ ํ‰๊ฐ€๋งŒ์œผ๋กœ ๊ณ ํ’ˆ์งˆ ์ด๋ฏธ์ง€๋ฅผ ์ƒ์„ฑํ•ฉ๋‹ˆ๋‹ค. ImageNet 256ร—256์—์„œ FID 2.22, 512ร—512์—์„œ 2.48์„ ๋‹ฌ์„ฑํ•˜๋ฉฐ ๊ธฐ์กด ๋ฐฉ๋ฒ• ๋Œ€๋น„ ๋‚ฎ์€ ๊ณ„์‚ฐ ๋น„์šฉ์„ ๋ณด์˜€์Šต๋‹ˆ๋‹ค. ํŠนํžˆ ์ฃผ๋ชฉํ•  ์ :

  • ์ž ์žฌ ๊ณต๊ฐ„ ์—†์ด ํ”ฝ์…€ ๊ณต๊ฐ„์—์„œ ์ง์ ‘ ์ƒ์„ฑํ•˜๋Š” ํ˜์‹ ์  ์ ‘๊ทผ

  • FID 2.22๋กœ ๊ฒฝ์Ÿ๋ ฅ ์žˆ๋Š” ์„ฑ๋Šฅ + ๋‚ฎ์€ ๊ณ„์‚ฐ ๋น„์šฉ

  • 256ร—256๋ถ€ํ„ฐ 512ร—512๊นŒ์ง€ ์ผ๊ด€๋œ ๊ณ ํ’ˆ์งˆ ์œ ์ง€

๐ŸŽฏ ์™œ ์ด๊ฒƒ์ด ๊ฒŒ์ž„ ์ฒด์ธ์ €์ธ๊ฐ€? : ๋ณต์žกํ•œ ์ž ์žฌ ๊ณต๊ฐ„ ๊ธฐ๋ฐ˜ ๋‹ค๋‹จ๊ณ„ ์ƒ์„ฑ โ†’ ํ”ฝ์…€ ๊ณต๊ฐ„์—์„œ ๋‹จ์ผ ์Šคํ… ์ƒ์„ฑ์˜ ์ „ํ™˜์  ๊ฐ•์กฐ
๐Ÿ”— ๋” ์ž์„ธํ•œ ๋‚ด์šฉ์ด ๊ถ๊ธˆํ•˜๋‹ค๋ฉด : https://arxiv.org/abs/2601.22158

๐Ÿš€ Meta: "ํ›ˆ๋ จ๋œ AI๊ฐ€ ๋‹ค์Œ AI๋ฅผ ๊ฐ€๋ฅด์นœ๋‹ค" โ€” ์‚ฌ์‹ค์„ฑ 36% ํ–ฅ์ƒ, ์ž๊ธฐ ์ง„ํ™”์˜ ์‹œ๋Œ€!

Self-Improving Pretraining

๐Ÿ›๏ธ ์†Œ์†: Meta (FAIR)
๐Ÿท๏ธ ํ•ต์‹ฌ ํ‚ค์›Œ๋“œ: Self-Improving, Pretraining, Alignment, Factuality, Safety

  • ๐Ÿ’ญ ์ด๋Ÿฐ ์งˆ๋ฌธ์„ ํ•ด๋ณธ ์  ์žˆ๋‚˜์š”?
    "์‚ฌ์ „ํ›ˆ๋ จ ๋‹จ๊ณ„๋ถ€ํ„ฐ ์•ˆ์ „์„ฑ๊ณผ ์‚ฌ์‹ค์„ฑ์„ ๋‚ด์žฌํ™”ํ•  ์ˆ˜ ์žˆ๋‹ค๋ฉด?"

  • "ํ›ˆ๋ จ๋œ ๋ชจ๋ธ์ด ๋‹ค์Œ ์„ธ๋Œ€ ๋ชจ๋ธ์˜ ์„ ์ƒ๋‹˜์ด ๋  ์ˆ˜ ์žˆ์„๊นŒ?"

  • "LLM ์‚ฌ์ „ํ›ˆ๋ จ์˜ ๊ทผ๋ณธ์  ํŒจ๋Ÿฌ๋‹ค์ž„์„ ๋ฐ”๊ฟ€ ์ˆ˜ ์žˆ๋Š” ๋ฐฉ๋ฒ•์€?"

์„ ๋ฐฐ ์š”๋ฆฌ์‚ฌ๊ฐ€ ํ›„๋ฐฐ์˜ ์‹์žฌ๋ฃŒ ์„ ๋ณ„๋ถ€ํ„ฐ ์ง์ ‘ ์ง€๋„ํ•˜๋Š” ๊ฒƒ์ฒ˜๋Ÿผ, Self-Improving Pretraining์€ ํ›„ํ›ˆ๋ จ๋œ ๊ณ ์„ฑ๋Šฅ ๋ชจ๋ธ์ด ์‚ฌ์ „ํ›ˆ๋ จ ๋ฐ์ดํ„ฐ๋ฅผ ๋™์ ์œผ๋กœ ๋ฆฌ๋ผ์ดํŒ…ํ•˜๊ณ  ํŒ์ •ํ•ฉ๋‹ˆ๋‹ค. ์ƒ์„ฑ ์ผ๊ด€์„ฑ 87.9% ์Šน๋ฅ , ์‚ฌ์‹ค์„ฑ 36.2% ์ƒ๋Œ€ ํ–ฅ์ƒ์œผ๋กœ ๊ธฐ์กด ์‚ฌ์ „ํ›ˆ๋ จ์„ ์••๋„ํ•ฉ๋‹ˆ๋‹ค. ํŠนํžˆ ์ฃผ๋ชฉํ•  ์ :

  • ์‚ฌ์ „ํ›ˆ๋ จ ๋‹จ๊ณ„์—์„œ๋ถ€ํ„ฐ ์•ˆ์ „์„ฑยท์‚ฌ์‹ค์„ฑยทํ’ˆ์งˆ์„ ํ†ตํ•ฉ ๋ฐ˜์˜

  • ์ƒ์„ฑ ์ผ๊ด€์„ฑ 87.9%, ์‚ฌ์‹ค์„ฑ 36.2% ์ƒ๋Œ€ ํ–ฅ์ƒ

  • ์‚ฌ์ „ํ›ˆ๋ จ - ํ›„ ํ›ˆ๋ จ ๋ฐ˜๋ณต ๋ฃจํ”„๋กœ ์ง€์†์  ์ž๊ธฐ ๊ฐœ์„  ๊ฐ€๋Šฅ

๐ŸŽฏ ์™œ ์ด๊ฒƒ์ด ๊ฒŒ์ž„ ์ฒด์ธ์ €์ธ๊ฐ€? : ์‚ฌ์ „ ํ›ˆ๋ จ โ†’ ํ›„ ํ›ˆ๋ จ์˜ ๋‹จ๋ฐฉํ–ฅ ํŒŒ์ดํ”„๋ผ์ธ โ†’ ํ›„ํ›ˆ๋ จ ๋ชจ๋ธ์ด ์‚ฌ์ „ํ›ˆ๋ จ์„ ๊ฐœ์„ ํ•˜๋Š” ์ˆœํ™˜ ๊ตฌ์กฐ์˜ ์ „ํ™˜์  ๊ฐ•์กฐ
๐Ÿ”— ๋” ์ž์„ธํ•œ ๋‚ด์šฉ์ด ๊ถ๊ธˆํ•˜๋‹ค๋ฉด : https://arxiv.org/abs/2601.21343

๋งค์ผ ํ™”์š”์ผ ์˜ค์ „ 8์‹œ, ๋ฐ”์œ ๋‹น์‹ ์„ ๊ธฐ์ˆ  ๋ฐœ์ „์— ๋’ค์ณ์ง€์ง€ ์•Š๊ฒŒ ๋งŒ๋“ค์–ด์ค„ ์ตœ์‹  AI ํŠธ๋ Œ๋“œ๊ฐ€ ์š”์•ฝ ์ •๋ฆฌ๋ณธ์œผ๋กœ ์ „๋‹ฌ๋ฉ๋‹ˆ๋‹ค!