Spaces:
Running
Running
Text: line counts of the pinned commit; link ELIZA and SmolTalkBench
Browse files- site/index.html +4 -3
site/index.html
CHANGED
|
@@ -18,6 +18,7 @@
|
|
| 18 |
.sub { font:400 clamp(18px,2.4vw,24px)/1.3 var(--lead); color:var(--mute); margin:0 0 28px; }
|
| 19 |
.text { max-width:680px; }
|
| 20 |
.text p { margin:0 0 16px; }
|
|
|
|
| 21 |
code { font:16px var(--mono); }
|
| 22 |
.app { margin-top:32px; border:1px solid var(--ink); }
|
| 23 |
#log { height:220px; overflow-y:auto; display:flex; flex-direction:column; gap:10px; padding:14px; }
|
|
@@ -48,13 +49,13 @@
|
|
| 48 |
<h1>PyBot</h1>
|
| 49 |
<p class="sub">a conversational bot without LLMs</p>
|
| 50 |
<div class="text">
|
| 51 |
-
<p>LLMs drive today's chatbots and agents, but conversational programs are much older than LLMs. Sixty years ago, ELIZA held
|
| 52 |
conversations by matching patterns in what the user typed and answering with predefined templates.</p>
|
| 53 |
<p>We wanted to revisit that idea at a much larger scale, so we gave a swarm of LLM agents the mission of building a chatbot out of
|
| 54 |
plain Python rules (if-else branches, regex patterns and lookup tables), with no model inside. The agents wrote and evaluated over
|
| 55 |
-
5,000 versions of the bot, and its win rate on SmolTalkBench, where an LLM judge compares each reply with a reference answer,
|
| 56 |
climbed from almost 0% to 26%.</p>
|
| 57 |
-
<p>The result is PyBot: about
|
| 58 |
it working. On SmolTalkBench it's on par with SmolLM-360M-Instruct (26.0% vs 26.6%), without a single neural network inside. You can
|
| 59 |
try it below, where you can see which of PyBot's modules produced the reply, and you can click any file to read the code behind the answer.</p>
|
| 60 |
</div>
|
|
|
|
| 18 |
.sub { font:400 clamp(18px,2.4vw,24px)/1.3 var(--lead); color:var(--mute); margin:0 0 28px; }
|
| 19 |
.text { max-width:680px; }
|
| 20 |
.text p { margin:0 0 16px; }
|
| 21 |
+
.text a { color:inherit; text-decoration:underline; text-underline-offset:3px; }
|
| 22 |
code { font:16px var(--mono); }
|
| 23 |
.app { margin-top:32px; border:1px solid var(--ink); }
|
| 24 |
#log { height:220px; overflow-y:auto; display:flex; flex-direction:column; gap:10px; padding:14px; }
|
|
|
|
| 49 |
<h1>PyBot</h1>
|
| 50 |
<p class="sub">a conversational bot without LLMs</p>
|
| 51 |
<div class="text">
|
| 52 |
+
<p>LLMs drive today's chatbots and agents, but conversational programs are much older than LLMs. Sixty years ago, <a href="https://en.wikipedia.org/wiki/ELIZA" target="_blank" rel="noopener">ELIZA</a> held
|
| 53 |
conversations by matching patterns in what the user typed and answering with predefined templates.</p>
|
| 54 |
<p>We wanted to revisit that idea at a much larger scale, so we gave a swarm of LLM agents the mission of building a chatbot out of
|
| 55 |
plain Python rules (if-else branches, regex patterns and lookup tables), with no model inside. The agents wrote and evaluated over
|
| 56 |
+
5,000 versions of the bot, and its win rate on <a href="https://huggingface.co/datasets/HuggingFaceSwarms/SmolTalkBench" target="_blank" rel="noopener">SmolTalkBench</a>, where an LLM judge compares each reply with a reference answer,
|
| 57 |
climbed from almost 0% to 26%.</p>
|
| 58 |
+
<p>The result is PyBot: about 470k lines of Python that answer everyday questions, plus 550k lines of tests the agents wrote to keep
|
| 59 |
it working. On SmolTalkBench it's on par with SmolLM-360M-Instruct (26.0% vs 26.6%), without a single neural network inside. You can
|
| 60 |
try it below, where you can see which of PyBot's modules produced the reply, and you can click any file to read the code behind the answer.</p>
|
| 61 |
</div>
|