Article
Luth-2: Pushing the French Capabilities of SLMs with MOPD
MaxLSB
• • 5
SelimAI
SelimAI
·
AI & ML interests
None yet
Recent Activity
upvoted an article 2 days ago
Luth-2: Pushing the French Capabilities of SLMs with MOPD liked a model 18 days ago
Trelis/tiron liked a model 19 days ago
ProCreations/grug-27bOrganizations
upvoted an article 2 days ago
liked a
model 18 days ago
liked a
model 19 days ago
upvoted a paper 5 months ago
liked a
model 5 months ago
Training loss is too high
1
#17 opened 6 months ago
by 
mrigankr
reacted to umarbutler's post with 🔥 6 months ago
Post
5102
What happens when you annotate, extract, and disambiguate every entity mentioned in the longest U.S. Supreme Court decision in history? What if you then linked those entities to each other and visualized it as a network?
This is the result of enriching all 241 pages and 111,267 words of Dred Scott v. Sandford (1857) with Kanon 2 Enricher in less than ten seconds at the cost of 47 cents.
Dred Scott v. Sandford is the longest U.S. Supreme Court decision by far, and has variously been called "the worst Supreme Court decision ever" and "the Court's greatest self-inflicted wound" due to its denial of the rights of African Americans.
Thanks to Kanon 2 Enricher, we now also know that the case contains 950 numbered paragraphs, 6 footnotes, 178 people mentioned 1,340 times, 99 locations mentioned 1,294 times, and 298 external documents referenced 940 times.
For an American case, there are a decent number of references to British precedents (27 to be exact), including the Magna Carta (¶ 928).
Surprisingly though, the Magna Carta is not the oldest citation referenced. That would be the Institutes of Justinian (¶ 315), dated around 533 CE.
The oldest city mentioned is Rome (founded 753 BCE) (¶ 311), the oldest person is Justinian (born 527 CE) (¶ 314), and the oldest year referenced is 1371, when 'Charles V of France exempted all the inhabitants of Paris from serfdom' (¶ 370).
All this information and more was extracted in 9 seconds. That's how powerful Kanon 2 Enricher, my latest LLM for document enrichment and hierarchical graphitization, is. If you'd like to play with it yourself now that it's available in closed beta, you can apply to the Isaacus Beta Program here: https://isaacus.com/beta.
This is the result of enriching all 241 pages and 111,267 words of Dred Scott v. Sandford (1857) with Kanon 2 Enricher in less than ten seconds at the cost of 47 cents.
Dred Scott v. Sandford is the longest U.S. Supreme Court decision by far, and has variously been called "the worst Supreme Court decision ever" and "the Court's greatest self-inflicted wound" due to its denial of the rights of African Americans.
Thanks to Kanon 2 Enricher, we now also know that the case contains 950 numbered paragraphs, 6 footnotes, 178 people mentioned 1,340 times, 99 locations mentioned 1,294 times, and 298 external documents referenced 940 times.
For an American case, there are a decent number of references to British precedents (27 to be exact), including the Magna Carta (¶ 928).
Surprisingly though, the Magna Carta is not the oldest citation referenced. That would be the Institutes of Justinian (¶ 315), dated around 533 CE.
The oldest city mentioned is Rome (founded 753 BCE) (¶ 311), the oldest person is Justinian (born 527 CE) (¶ 314), and the oldest year referenced is 1371, when 'Charles V of France exempted all the inhabitants of Paris from serfdom' (¶ 370).
All this information and more was extracted in 9 seconds. That's how powerful Kanon 2 Enricher, my latest LLM for document enrichment and hierarchical graphitization, is. If you'd like to play with it yourself now that it's available in closed beta, you can apply to the Isaacus Beta Program here: https://isaacus.com/beta.
reacted to paulpham157's post with 🧠 7 months ago
Post
1276
Two things to know right before starting:
- Learn Git. Git is a great versioning tool, even when working alone. It's also essential when working in a team. Don't make excuses that you only do DL and can't do software development.
😞 Don't create files like:
main_backup_1.py
main_backup_2.py
main_backup_3.py
anymore...
(It sounds ridiculous, but I've actually seen some people do that... weren't students.)
- Try to keep everything stable. Imagine encountering errors during a demo. Keep the code clean so it runs smoothly and is maintainable. Always minimize DevOps steps to ensure quick reboot (this can be covered by some platforms; thanks to Hugging Face for making it easy and providing a basic infrastructure that most people can access almost for free). 🤤
- Learn Git. Git is a great versioning tool, even when working alone. It's also essential when working in a team. Don't make excuses that you only do DL and can't do software development.
😞 Don't create files like:
main_backup_1.py
main_backup_2.py
main_backup_3.py
anymore...
(It sounds ridiculous, but I've actually seen some people do that... weren't students.)
- Try to keep everything stable. Imagine encountering errors during a demo. Keep the code clean so it runs smoothly and is maintainable. Always minimize DevOps steps to ensure quick reboot (this can be covered by some platforms; thanks to Hugging Face for making it easy and providing a basic infrastructure that most people can access almost for free). 🤤
upvoted an article 7 months ago
Article
The Optimal Architecture for Small Language Models
codelion
• • 122 published 3
Spaces 8 months ago
It feels like the model has overfitted the training dataset...
👍 2
#2 opened 8 months ago
by SelimAI