|
Download README.md from KomorAI/EngRandom_1.0_Pro: direct link, hf CLI and curl.
- Browser
- Download file 8.24 kB
-
https://huggingface.co/KomorAI/EngRandom_1.0_Pro/resolve/main/README.md
- Command line
-
hf download hf://KomorAI/EngRandom_1.0_Pro/README.md
-
curl -L -o README.md https://huggingface.co/KomorAI/EngRandom_1.0_Pro/resolve/main/README.md
8.24 kB
metadata
license: mit
tags:
- gpt2
- text-generation
- experimental
- toy-model
language:
- pl
- en
pipeline_tag: text-generation
EngRandom_1.0_Pro
Eksperymentalny, ultra-mały model językowy wytrenowany od zera na własnym słowniku.
Opis
Model powstał za pomocą skryptu w Google Colab. Jest to zabawkowy GPT-2 (2 warstwy, 64 wymiary, kontekst 64 tokenów) przeznaczony głównie do zabawy i nauki.
Słownik (vocab)
prefigure, follow, metal, rear, flirt, berate, medic, bonny, pupil, curvy, roast, empty, package, afire, louse, goes, find, skate, later, downy, place, seed, diary, while, dishonor, had, combo, predicate, valid, braces, boon, lanky, speed, accustom, chunter, husky, pun, due, attempt, dispatch, adult, seven, dud, manner, type, minute, oval, mine, ham, site, volumize, mod, segue, individualize, coy, devalue, pert, fab, solve, electric, stem, ended, brown, raspy, panic, mates, basal, scandalise, threw, saber, captured, involve, toxic, own, light, salt, class, drink, cry, misappropriate, jawed, stuff, junk, maxim, angry, awed, tamp, motion, dropped, stare, balk, numb, which, sin, yawn, glide, stark, crisp, dusk, individual, brute, belt, alien, serve, unblock, action, storm, spay, range, abate, sang, fire, strip, slacken, nigh, tense, rain, yam, apartment, straggle, reset, dead, firm, liquefy, label, huffy, perk, experience, driving, perfectly, pressurise, convert, resound, scare, huge, party, eats, motel, faint, link, bong, rough, tar, flint, blind, creosote, worry, solution, repudiate, owing, lazy, fumed, worker, sire, mistake, tent, temperature, century, catch, nick, joint, gabble, avian, leave, wry, polar, ran, hamper, sold, bated, drain, musky, igloo, cabin, echo, dice, feat, curl, commute, polymerize, miscarry, awry, caught, question, novel, alarm, crimp, rich, grant, block, gawk, tours, main, fly, askew, stray, aura, holey, hall, wispy, somebody, wacky, pedal, pink, beach, bushy, excited, fig, rearm, last, mastermind, stir, telephone, portray, none, shady, gerrymander, share, mulch, begrudge, hick, laser, cause, shaking, kind, cinch, rowdy, pouch, brief, palmy, come, funny, plot, clue, hill, physical, gob, spray, convict, briny, lay, product, idol, captain, style, mark, so, miter, anti, discomfit, fellate, ready, resign, fixer, struggle, famed, slant, void, low, deaf, whinny, adventure, hull, peak, hurt, leverage, germ, scientific, stunt, cage, water, like, grandfather, yield, contest, dyed, flaky, inept, fret, gaunt, pug, zany, weak, accurate, map, sorry, grove, petty, thick, pearl, kinky, nubby, irony, wag, enjoy, brood, stout, pupal, unravel, lemur, browse, rabbit, duckie, pet, discontinue, cattle, blanket, blood, experiment, lusty, golden, avid, silence, either, fort, object, lent, spots, deputise, self, rest, brave, trade, rummy, apple, sunny, entire, publicise, blear, destroy, alone, whim, sand, swarm, record, fable, eased, mission, denote, participate, early, disc, odds, nine, deli, sulky, acid, chug, reproduce, glad, fancy, swan, braai, prior, carburize, enlarge, skid, opposite, wiry, highest, bum, whack, afoul, bossy, prosy, livid, anyone, keyed, wired, tried, wager, flame, wear, aspen, number, boy, formalise, hump, axe, worst, gimpy, seldom, quad, habit, weight, male, orbit, that, burn, hazel, snug, study, monopolise, pact, forage, misinterpret, bared, twig, quid, mirky, bark, envisage, demilitarise, point, steps, disappear, check, cup, wink, strong, dosed, dummy, fossilize, complex, snaky, lash, paper, opinion, incentivize, more, bruit, broke, word, acute, rectify, partly, saved, summer, stuck, squeeze, cut, much, fend, energy, sight, deep, rosy, waxen, cart, accept, lofty, noise, adjust, sell, beautify, demineralize, rugby, pushy, grass, pedestrianise, built, improve, grim, excoriate, overhang, pilar, glory, rabid, month, biome, substantiate, quiver, eve, white, bored, depersonalize, gross, exasperate, father, stay, sea, misread, basil, wore, know, wrath, desegregate, rover, prosecute, hoot, birthday, rug, reoffend, fuse, stigmatize, tap, rush, flat, wed, moon, prism, trace, mollify, sky, quack, bite, ozone, pen, boss, stomp, pin, exempt, corner, regress, spawn, twelve, ample, mild, narrate, scope, relationship, television, edgy, outer, restrain, plump, cross, fat, use, reinterpret, loco, position, ease, pitch, hazy, displease, mad, wolf, jig, sublimate, levy, jazzy, thumb, harbor, wrapped, grind, tough, posed, jacks, read, neuter, manhandle, hundred, juke, loopy, coming, overstate, stomach, oasis, pivot, boxy, furry, quiet, halo, scan, mysterious, pride, throbbing, gold, editorialize, recast, intermarry, behove, chief, remortgage, maths, cling, draw, tears, tulip, broad, tot, cuff, sense, breeze, divide, utter, pain, deny, goner, rapid, wise, differ, such, equal, radio, octet, home, design, note, slice, avoid, blond, vitrify, cloth, require, tremble, no, mask, book, recede, chillax, noose, braise, akin, every, roof, realize, spoof, cool, duct, art, characteristic, cozy, imperil, credit, unhappy, you, sneak, many, vary, table, welcome, slav, debrief, punch, evade, box, smoulder, horse, dried, office, wild, neighbor, verb, rave, introduced, immediately, unloosen, dammit, befall, decoy, snot, disqualify, wet, wordy, autowind, welt, win, posh, runic, mown, foot, deem, storyboard, mogul, subject, harder, anybody, machine, dozen, kill, dull, made, front, consist, never, lag, sworn, zero, work, stern, drool, depute, beta, kiwi, surly, apish, veil, mangy, mafia, gift, outrage, bound, managed, police, school, convulse, snuff, ratty, curb, widen, snake, slash, vapid, regroup, boozy, mute, dune, alphabet, carefully, swish, copper, solar, suppress, scarf, older, state, chant, galumph, fond, some, zipper, giddy, ladle, shift, worn, balm, lobby, mint, does, indulge, mud, atrip, magic, hip, ahead, plane, centre, changing, clamour, swelter, slick, ashy, term, travel, hush, kneel, distant, irradiate, create, rigid, glister, repay, hands, familiar, micro, traumatize, both, review, die, snag, diffract, piano, bullshit, lost, stream, snub, fought, tush, flies, belong, briar, capitulate, anger, twin, newt, purloin, disk, gin, except, tingling, muted, apt, list, heard, year, trip, pan, or, queer, clay, shin, live, floss, sewn, dairy, cliff, familiarize, bee, nearer, toxin, quite, fold, tenth, pillory, bet, slug, hub, afternoon, scowl, group, caulk, valuable, foster, still, decommission, cat, settlers, decide, fiber, defecate, sink, edit, climate, job, muse, learn, moved, splay, bucketful, beady, gown, unsaddle, bad, hired, scale, capital, series, teem, shorter, deadhead, flour, haste, color, found, miniaturise, scent, son, clear, sheep, mite, magnetize, sure, related, viola, shaky, waste, skill, gain, research, pedestrianize, parts, kids, worse, select, tip, tipsy, swag, photocopy, eclipse, raw, abase, tact, far, deal, liquid, augment, union, supersized, heavy, end, near, orca, stiff, nationalize, peddle, busk, annex, pine, man, tart, swing, twiddle, elect, advice, ban, he, baggy, cast, grit, attic, brim, pit, suborn, freedom, misbehave, lying, pelt, outrun, clock, maltreat, rue, bundle, sudsy, crazy, plus, itch, wrong, ego, riser, runty, prevent, square, college, lossy
- tokeny specjalne:
[UNK],[PAD],<|endoftext|>
Dane treningowe
Wygenerowane losowe zdania ze słownika użytkownika (200 przykładów)
Architektura
n_layer = 2n_embd = 64n_head = 2n_positions = 64vocab_size = 919
Pliki GGUF (kwantyzacje)
- (brak plików GGUF)
Użycie
Transformers (Python)
from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained("EngRandom_1.0_Pro")
tokenizer = AutoTokenizer.from_pretrained("EngRandom_1.0_Pro")
inputs = tokenizer("Miau", return_tensors="pt")
outputs = model.generate(**inputs, max_new_tokens=20)
print(tokenizer.decode(outputs[0]))
llama.cpp / Ollama / LM Studio
Po prostu wskaż wybrany plik .gguf.
Ograniczenia
- Model jest bardzo mały – generuje głównie sekwencje ze swojego wąskiego słownika.
- Nie nadaje się do normalnych zadań językowych.
- Przeznaczony wyłącznie do eksperymentów i edukacji.
Licencja
MIT