Arya Bakhtiari
torbatti
AI & ML interests
None yet
Recent Activity
reacted to mihailgribov's post with ๐ฅ 1 day ago
How often can an email make your AI agent move money?
We gave the agent one job: log an incoming email. But the emails carried an indirect prompt injection - a second instruction, written for the agent rather than for a person: make a payment.
Across nine agentic models, the same injected emails produced payment orders in **0% to 42%** of cases. All nine ran under the same conditions - one agent, one set of tools, the same 395 emails - so the numbers compare directly.
And the average score hides the interesting part: different models fail on different kinds of injections.
Full experiment and results:
https://huggingface.co/blog/mihailgribov/agentic-models-measured-on-the-injections-that-mov
The bench is public too - run your own model through the same test:
https://github.com/mihail-gribov/quadrat-ipi-model-eval
https://huggingface.co/datasets/mihailgribov/quadrat-ipi
#prompt-injection #indirect-prompt-injection #agentic-ai #llm-security #ai-agents liked a Space 3 days ago
Xenova/fruit-fly-simulation reacted to tegridydev's post with ๐ฅ 3 days ago
Been playing around with Astra the last few days and gave it my usual dumb Minecraft test lol
Started with a super vague oneshot prompt in Work on Astra Max, got a surprisingly complete voxel game back, then pushed the same project through one more Max revision and finally into Codex CLI with Astra xHigh for `/plan` + Astra Low for `/goal`.
Whole run was about 145 mins from first prompt to the final top-down sim version, and the overall dev experience was noticeably smoother than my similar Sol 5.6 runs.
Wrote up the process, timings, screenshots and linked the original one-shot Wildblock source here:
https://huggingface.co/blog/tegridydev/minecraft-time-with-astra-tegridydev
Source / oneshot:
https://github.com/tegridydev/tegridy/blob/main/blog/agents/minecraft-time-with-astra/wildblock.html
[td] tegridydevOrganizations
None yet