Evan

evdcush

3 188 814

AI & ML interests

None yet

Recent Activity

posted an update about 1 hour ago

𝗬𝘂𝗘𝟮 𝗴𝗲𝗻𝗲𝗿𝗮𝘁𝗶𝗼𝗻 𝘀𝗮𝗺𝗽𝗹𝗲𝘀 Some YuE2 samples from my experiments. All songs are: JA or EN/JA 5️⃣ 𝐎𝐑𝐈𝐆𝐈𝐍𝐀𝐋 (synth-pop) This song started as a melody SheetSage2 cover of M83 - Midnight City. Extended for my lyrics, and chords added. 𝘧𝘶𝘭𝘭 𝘴𝘰𝘯𝘨: https://youtu.be/9RX3OLFqV5M 1️⃣ 𝑪𝑶𝑽𝑬𝑹 : BTS - FAKE LOVE (ja version) 𝙛𝙪𝙡𝙡 𝙨𝙤𝙣𝙜: https://youtu.be/fBVmTeSScNg cleanest sheetsage2-derived song I've gotten. something that's quite rare about this one is that it's mixed EN and JA. (this has not worked for me in other songs) 4️⃣ 𝐎𝐑𝐈𝐆𝐈𝐍𝐀𝐋 (alt Rock) 𝘧𝘶𝘭𝘭 𝘴𝘰𝘯𝘨: https://youtu.be/D-HXWWCdqNs Generated from style + lyrics (no user-defined ABC). Good result, but it is afflicted with the whizz, buzzing artifacting/degeneration on the singing voice, which I get not infrequently. the singer's pitch and timbre change in a few spots too. 2️⃣ 𝐎𝐑𝐈𝐆𝐈𝐍𝐀𝐋 (synthwave J-Pop) 𝘧𝘶𝘭𝘭 𝘴𝘰𝘯𝘨: https://youtu.be/PYGtp0VLjS8 This one was made without ABC, just letting YuE2 compose a plan before generation. a few dropped words, odd emphases in certain places, but mostly coherent 3️⃣ 𝑪𝑶𝑽𝑬𝑹 (*attempted*) German 進撃の巨人, vogel im kamfig YouSeeBigGirl:TT (Reference: https://youtu.be/2o5H8wIR8Go) I didn't get a decent generation for the song. but, there was *one* this one section of the song 👏🏻 This happens; you'll have a killer track and *suddenly* some dude starts whispering pidgin language in a weird hermaphroditic AI voice for 2-3 sec, and then the song continues fine, no more cursed artifacts 😕 or, gen is a total trainwreck, but suddenly becomes coherent and makes something cool, like this thing 😌 Samples from other models: - minimax-music3: https://huggingface.co/posts/evdcush/304645800764284 - ACE-Step-1.5: https://huggingface.co/posts/evdcush/646521189747912

liked a dataset 3 days ago

m-a-p/WildSongBench

liked a model 13 days ago

Qwen/Qwen-Image-2.1

View all activity

Organizations

posted an update about 1 hour ago

Post

𝗬𝘂𝗘𝟮 𝗴𝗲𝗻𝗲𝗿𝗮𝘁𝗶𝗼𝗻 𝘀𝗮𝗺𝗽𝗹𝗲𝘀

Some YuE2 samples from my experiments.
All songs are: JA or EN/JA

5️⃣ 𝐎𝐑𝐈𝐆𝐈𝐍𝐀𝐋 (synth-pop)
This song started as a melody SheetSage2 cover of M83 - Midnight City.
Extended for my lyrics, and chords added.

𝘧𝘶𝘭𝘭 𝘴𝘰𝘯𝘨: https://youtu.be/9RX3OLFqV5M

1️⃣ 𝑪𝑶𝑽𝑬𝑹 : BTS - FAKE LOVE (ja version)

𝙛𝙪𝙡𝙡 𝙨𝙤𝙣𝙜: https://youtu.be/fBVmTeSScNg
cleanest sheetsage2-derived song I've gotten.
something that's quite rare about this one is that it's mixed EN and JA. (this has not worked for me in other songs)

4️⃣ 𝐎𝐑𝐈𝐆𝐈𝐍𝐀𝐋 (alt Rock)
𝘧𝘶𝘭𝘭 𝘴𝘰𝘯𝘨: https://youtu.be/D-HXWWCdqNs
Generated from style + lyrics (no user-defined ABC).

Good result, but it is afflicted with the whizz, buzzing artifacting/degeneration on the singing voice, which I get not infrequently.
the singer's pitch and timbre change in a few spots too.

2️⃣ 𝐎𝐑𝐈𝐆𝐈𝐍𝐀𝐋 (synthwave J-Pop)
𝘧𝘶𝘭𝘭 𝘴𝘰𝘯𝘨: https://youtu.be/PYGtp0VLjS8
This one was made without ABC, just letting YuE2 compose a plan before generation.
a few dropped words, odd emphases in certain places, but mostly coherent

3️⃣ 𝑪𝑶𝑽𝑬𝑹 (*attempted*) German
進撃の巨人, vogel im kamfig YouSeeBigGirl:TT
(Reference: https://youtu.be/2o5H8wIR8Go)

I didn't get a decent generation for the song.

but, there was *one* this one section of the song 👏🏻

This happens; you'll have a killer track and *suddenly* some dude starts whispering pidgin language in a weird hermaphroditic AI voice for 2-3 sec, and then the song continues fine, no more cursed artifacts 😕

or, gen is a total trainwreck, but suddenly becomes coherent and makes something cool, like this thing 😌

Samples from other models:
- minimax-music3: https://huggingface.co/posts/evdcush/304645800764284
- ACE-Step-1.5: https://huggingface.co/posts/evdcush/646521189747912

posted an update 25 days ago

Post

𝐌𝐢𝐧𝐢𝐌𝐚𝐱 𝐌𝐮𝐬𝐢𝐜 𝟑 𝐬𝐚𝐦𝐩𝐥𝐞𝐬

# ミニマックスミュージック３　サンプル

サンプルの歌は：
- https://youtu.be/krF3NGRmwGY
- https://youtu.be/LoYAkJRcuqU

もっと歌はYTに聞けます。

この音楽は
MiniMaxAI/MiniMax-Music3
のモデルで作ってしました。

歌詞は日本語。

キャプションは英語。
（英語の方がうまく行けました）

ヴォーカルの質はとてもいいと思う。

ミニマックスミュージック３の
一つの注意するところは：
このモデルが中華風の音楽にオーバーフィットされてあるかもしれません。
（二胡が勝手に入っちゃうがちがあります）

Stack:
- interface: https://github.com/evdcush/minimax-music3-jukebox
- caption writer: https://github.com/evdcush/minimax-music3-skill-erhu-purge

試してみて〜

posted an update about 1 month ago

Post

Sample output from ACE-Step/acestep-v15-xl-sft

I had issues with the upstream ACE-Step1.5 pipeline, and seeing there were other reports of issues with the python pipeline, but not the Comfy implementation, I used the Comfy audio_ace_step1_5_xl_sft workflow.

Inference params:

"TextEncodeAceStepAudio1.5": {
    "bpm": 96,
    "duration": 260,
    "timesignature": "4",
    "language": "ja",
    "keyscale": "F# minor",
    "cfg_scale": 2,
    "temperature": 0.85,
    "top_p": 1,
    "top_k": 0,
    "min_p": 0
}



"KSampler": {
    "steps": 50,
    "cfg": 1,
    "denoise": 1
}

Both "lyrics" and "tags" were defined, but the the vocals in the output were not properly generated (perhaps due to the low sampler cfg).

https://youtu.be/lFiOUvSCv3w

reacted to mlabonne's post with 🤗 5 months ago

Post

5009

Big update to llm-datasets, my curated list of datasets and tools for post-training LLMs.

> Added many new datasets
> New "thinking" column
> Refreshed recommended tools.

Thanks to everyone who told me they used it for their research at ICLR, you motivated this update!

2 replies

reacted to codelion's post with 🔥 10 months ago

Post

2029

Introducing OpenEvolve Prompt Optimizer - a Space that automatically evolves and optimizes your prompts using OpenEvolve!

This tool uses OpenEvolve to iteratively improve prompts by testing them on real datasets and evolving better versions. No more manual prompt engineering guesswork - let OpenEvolve find the optimal prompts for you.

How it works:
- Enter your initial prompt using {input} as a placeholder for dataset inputs
- Input any HuggingFace dataset name you want to use for optimization
- Specify the dataset split and field names for your use case
- Click Optimize Prompt and the system will validate everything first
- Compare your initial prompt vs the evolved best prompt side-by-side

Try it here: algorithmicsuperintelligence/prompt-optimizer

OpenEvolve GitHub: https://github.com/algorithmicsuperintelligence/openevolve

reacted to sergiopaniego's post with 🚀 11 months ago

Post

3271

Meet OpenEnv 👋, an open ecosystem of environments for intelligent agents. Build, share, and test agents safely and consistently.

Ideal for training with TRL (we include examples🤓), deployment, and community collaboration via the HF Hub

Blog: https://huggingface.co/blog/openenv
Hub for Environments:

openenv
OpenEnv repo: https://github.com/meta-pytorch/OpenEnv
Try it out using TRL: https://huggingface.co/docs/trl/main/en/openenv

1 reply

reacted to m-ric's post with 🔥 over 1 year ago

Post

4561

I've made an open version of Google's NotebookLM, and it shows the superiority of the open source tech task! 💪

The app's workflow is simple. Given a source PDF or URL, it extracts the content from it, then tasks Meta's Llama 3.3-70B with writing the podcast script, with a good prompt crafted by @gabrielchua ("two hosts, with lively discussion, fun notes, insightful question etc.")
Then it hands off the text-to-speech conversion to Kokoro-82M, and there you go, you have two hosts discussion any article.

The generation is nearly instant, because:
> Llama 3.3 70B is running at 1,000 tokens/seconds with Cerebras inference
> The audio is generated in streaming mode by the tiny (yet powerful) Kokoro, generating voices faster than real-time.

And the audio generation runs for free on Zero GPUs, hosted by HF on H200s.

Overall, open source solutions rival the quality of closed-source solutions at close to no cost!

Try it here 👉👉 m-ric/open-notebooklm

3 replies

reacted to burtenshaw's post with 🔥👍❤️ almost 2 years ago

Post

2876

For anyone looking to boost their LLM fine-tuning and alignment skills this decemeber. We're running this free and open course called smol course. It’s not big like Li Yin and @mlabonne , it’s just smol.

👷 It focuses on practical use cases, so if you’re working on something, bring it along.

👯‍♀️ It’s peer reviewed and open so you can discuss and get feedback.

🤘 If you’re already a smol pro, feel free to drop a star or issue.

> > Part 1 starts now, and it’s on instruction tuning!

https://github.com/huggingface/smol-course

reacted to rwightman's post with 🚀❤️ over 2 years ago

Post

1891

timm 1.0 is finally out. The big feature that I wanted to complete before doing this? Having the unified feature map extraciton interface (features_only=True) supporting almost all models (97%) 🎉 See docs at https://huggingface.co/docs/timm/en/feature_extraction

Also in this release, the new set of SBB (searching for better baselins) ViT models, covering new architectures and hparam exploration between tiny and base. See timm/searching-for-better-vit-baselines-663eb74f64f847d2f35a9c19

I also snuck in image-tower loading for PaliGemma (via jax weights on Hub) google/paligemma-release-6643a9ffbf57de2ae0448dda

reacted to radames's post with 🚀🤯🧠❤️🔥 over 2 years ago

Post

2233

AI-town now runs on Hugging Face Spaces with our API for LLMs and embeddings, including the open-source Convex backend, all in one container. Easy to duplicate and config on your own

Demo: radames/ai-town
Instructions: https://github.com/radames/ai-town-huggingface

9 replies

reacted to chiphuyen's post with ❤️ over 2 years ago

Post

Huggingface is carrying the AI open source ecosystem https://huyenchip.com/2024/03/14/ai-oss.html

4 replies

reacted to akhaliq's post with 👍 over 2 years ago

Post

Stealing Part of a Production Language Model

Stealing Part of a Production Language Model (2403.06634)

We introduce the first model-stealing attack that extracts precise, nontrivial information from black-box production language models like OpenAI's ChatGPT or Google's PaLM-2. Specifically, our attack recovers the embedding projection layer (up to symmetries) of a transformer model, given typical API access. For under \20 USD, our attack extracts the entire projection matrix of OpenAI's Ada and Babbage language models. We thereby confirm, for the first time, that these black-box models have a hidden dimension of 1024 and 2048, respectively. We also recover the exact hidden dimension size of the gpt-3.5-turbo model, and estimate it would cost under 2,000 in queries to recover the entire projection matrix. We conclude with potential defenses and mitigations, and discuss the implications of possible future work that could extend our attack.

2 replies

reacted to yjernite's post with 🤗 over 2 years ago

Post

👷🏽‍♀️📚🔨 Announcing the Foundation Model Development Cheatsheet!

My first 🤗Post🤗 ever to announce the release of a fantastic collaborative resource to support model developers across the full development stack: The FM Development Cheatsheet available here: https://fmcheatsheet.org/

The cheatsheet is a growing database of the many crucial resources coming from open research and development efforts to support the responsible development of models. This new resource highlights essential yet often underutilized tools in order to make it as easy as possible for developers to adopt best practices, covering among other aspects:
🧑🏼‍🤝‍🧑🏼 data selection, curation, and governance;
📖 accurate and limitations-aware documentation;
⚡ energy efficiency throughout the training phase;
📊 thorough capability assessments and risk evaluations;
🌏 environmentally and socially conscious deployment strategies.

We strongly encourage developers working on creating and improving models to make full use of the tools listed here, and to help keep the resource up to date by adding the resources that you yourself have developed or found useful in your own practice 🤗

Congrats to all the participants in this effort for the release! Read more about it from:
@Shayne - https://twitter.com/ShayneRedford/status/1763215814860186005
@hails and @stellaathena - https://blog.eleuther.ai/fm-dev-cheatsheet/
@alon-albalak - http://nlp.cs.ucsb.edu/blog/a-new-guide-for-the-responsible-development-of-foundation-models.html

And also to @gabrielilharco @sayashk @kklyman @kylel @mbrauh @fauxneticien @avi-skowron @Bertievidgen Laura Weidinger, Arvind Narayanan, @VictorSanh @Davlan @percyliang Rishi Bommasani, @breakend @sasha 🔥

1 reply

Evan

AI & ML interests

Recent Activity

Organizations

evdcush's activity