Spaces:
Running
Running
Text: a swarm of 1k agents
Browse files- site/index.html +1 -1
site/index.html
CHANGED
|
@@ -51,7 +51,7 @@
|
|
| 51 |
<div class="text">
|
| 52 |
<p>LLMs drive today's chatbots and agents, but conversational programs are much older than LLMs. Sixty years ago, <a href="https://en.wikipedia.org/wiki/ELIZA" target="_blank" rel="noopener">ELIZA</a> held
|
| 53 |
conversations by matching patterns in what the user typed and answering with predefined templates.</p>
|
| 54 |
-
<p>We wanted to revisit that idea at a much larger scale, so we gave a swarm of
|
| 55 |
plain Python rules (if-else branches, regex patterns and lookup tables). The agents wrote and evaluated over
|
| 56 |
5,000 versions of the bot, and its win rate on <a href="https://huggingface.co/datasets/HuggingFaceSwarms/SmolTalkBench" target="_blank" rel="noopener">SmolTalkBench</a>, where an LLM judge compares each reply with a reference answer,
|
| 57 |
climbed from almost 0% to 26%.</p>
|
|
|
|
| 51 |
<div class="text">
|
| 52 |
<p>LLMs drive today's chatbots and agents, but conversational programs are much older than LLMs. Sixty years ago, <a href="https://en.wikipedia.org/wiki/ELIZA" target="_blank" rel="noopener">ELIZA</a> held
|
| 53 |
conversations by matching patterns in what the user typed and answering with predefined templates.</p>
|
| 54 |
+
<p>We wanted to revisit that idea at a much larger scale, so we gave a swarm of 1k agents the mission of building a chatbot out of
|
| 55 |
plain Python rules (if-else branches, regex patterns and lookup tables). The agents wrote and evaluated over
|
| 56 |
5,000 versions of the bot, and its win rate on <a href="https://huggingface.co/datasets/HuggingFaceSwarms/SmolTalkBench" target="_blank" rel="noopener">SmolTalkBench</a>, where an LLM judge compares each reply with a reference answer,
|
| 57 |
climbed from almost 0% to 26%.</p>
|