cmpatino HF Staff commited on
Commit
7dbe2c3
·
verified ·
1 Parent(s): 12ea8e3

Text: line counts of the pinned commit; link ELIZA and SmolTalkBench

Browse files
Files changed (1) hide show
  1. site/index.html +4 -3
site/index.html CHANGED
@@ -18,6 +18,7 @@
18
  .sub { font:400 clamp(18px,2.4vw,24px)/1.3 var(--lead); color:var(--mute); margin:0 0 28px; }
19
  .text { max-width:680px; }
20
  .text p { margin:0 0 16px; }
 
21
  code { font:16px var(--mono); }
22
  .app { margin-top:32px; border:1px solid var(--ink); }
23
  #log { height:220px; overflow-y:auto; display:flex; flex-direction:column; gap:10px; padding:14px; }
@@ -48,13 +49,13 @@
48
  <h1>PyBot</h1>
49
  <p class="sub">a conversational bot without LLMs</p>
50
  <div class="text">
51
- <p>LLMs drive today's chatbots and agents, but conversational programs are much older than LLMs. Sixty years ago, ELIZA held
52
  conversations by matching patterns in what the user typed and answering with predefined templates.</p>
53
  <p>We wanted to revisit that idea at a much larger scale, so we gave a swarm of LLM agents the mission of building a chatbot out of
54
  plain Python rules (if-else branches, regex patterns and lookup tables), with no model inside. The agents wrote and evaluated over
55
- 5,000 versions of the bot, and its win rate on SmolTalkBench, where an LLM judge compares each reply with a reference answer,
56
  climbed from almost 0% to 26%.</p>
57
- <p>The result is PyBot: about 430k lines of Python that answer everyday questions, plus 500k lines of tests the agents wrote to keep
58
  it working. On SmolTalkBench it's on par with SmolLM-360M-Instruct (26.0% vs 26.6%), without a single neural network inside. You can
59
  try it below, where you can see which of PyBot's modules produced the reply, and you can click any file to read the code behind the answer.</p>
60
  </div>
 
18
  .sub { font:400 clamp(18px,2.4vw,24px)/1.3 var(--lead); color:var(--mute); margin:0 0 28px; }
19
  .text { max-width:680px; }
20
  .text p { margin:0 0 16px; }
21
+ .text a { color:inherit; text-decoration:underline; text-underline-offset:3px; }
22
  code { font:16px var(--mono); }
23
  .app { margin-top:32px; border:1px solid var(--ink); }
24
  #log { height:220px; overflow-y:auto; display:flex; flex-direction:column; gap:10px; padding:14px; }
 
49
  <h1>PyBot</h1>
50
  <p class="sub">a conversational bot without LLMs</p>
51
  <div class="text">
52
+ <p>LLMs drive today's chatbots and agents, but conversational programs are much older than LLMs. Sixty years ago, <a href="https://en.wikipedia.org/wiki/ELIZA" target="_blank" rel="noopener">ELIZA</a> held
53
  conversations by matching patterns in what the user typed and answering with predefined templates.</p>
54
  <p>We wanted to revisit that idea at a much larger scale, so we gave a swarm of LLM agents the mission of building a chatbot out of
55
  plain Python rules (if-else branches, regex patterns and lookup tables), with no model inside. The agents wrote and evaluated over
56
+ 5,000 versions of the bot, and its win rate on <a href="https://huggingface.co/datasets/HuggingFaceSwarms/SmolTalkBench" target="_blank" rel="noopener">SmolTalkBench</a>, where an LLM judge compares each reply with a reference answer,
57
  climbed from almost 0% to 26%.</p>
58
+ <p>The result is PyBot: about 470k lines of Python that answer everyday questions, plus 550k lines of tests the agents wrote to keep
59
  it working. On SmolTalkBench it's on par with SmolLM-360M-Instruct (26.0% vs 26.6%), without a single neural network inside. You can
60
  try it below, where you can see which of PyBot's modules produced the reply, and you can click any file to read the code behind the answer.</p>
61
  </div>