Claude 3D Animation - HPMOR Chapter 1
https://www.youtube.com/watch?v=jycXe3797ZcI asked Opus to make an animation for chapter 1 and it made this which I think is nice?.
I probably won't ask it to make the full thing cause it would take too many tokens and I have other projects but could be nice if someone did something like that now that its possible.
6
u/LucidFir 18d ago
terrible voices. why is it always terrible voices? am I one of the rare few with ears?
1
u/crivtox 17d ago
I just told Claude to do the animation and it picked the voices I think the constrain was that It had to use something that would run on my pc. And Claude also probably is not aware of whatever the most current free voice stuff is. Can check later what it used exactly if you are curious.
1
u/LucidFir 17d ago
claude did this? amazing. do you know how? i never see body text on mobile
2
u/crivtox 17d ago edited 17d ago
If you have a Claude sub you can just ask it to make an animation for chapter 1 of hpmor on max effort and get something like this after like 1h of Claude working on it(or well probably in another style if you don't specify). Do tell it to download the chapter otherwise it might try doing it from memory(thou that might be interesting too). Took significantly longer than that to render (6h) I just told Claude to make the animation on Claude code and it like did all of the elements in blender(and Claude decided to do that I just told it to make something different from the stuff it does by default and Claude came up with this style, trying to imitate the look of handcrafted stop motion animations apparently).
Animation is also done in blender. There's a script where Claude planned all the scenes too. Faces are drawn with a bunch of code on python using cairo to draw lines and dots. I can eleborate more on the details of that if you want, looking at the code rn.
Also ok so for the voices it used sonething called Kokoro TTS, aparently cause license being open?. It used Whisper to check if the voices were working ok wich I found interesting. Unfortunately this means it can't really tell if the voices sound good or bad, just that they are saying the correct words.
Part of why it's better at animations now I think is because it has better vision and does screenshots to check things look ok and iterates that way. Where previously it was worse at this kind of thing than at making code because unlike code it couldn't debug visual bugs without human help. You'll see it doing that a bunch of you try it yourself.
I expect Claude to get better at making games as it becomes better at playing games, for the same reason.
2
u/LucidFir 17d ago
if you have a semi decent pc (8gb vram) minimax h3 will run locally. i think comfyui has got mcp now. you should compare animate in blender and do minimax v2v vs just doing t2v with pure minimax
1
u/LucidFir 17d ago
oh if you don't want to think just use elevenlabs, but i enjoy using local open when i can
0
u/MacrosInHisSleep Chaos Legion 17d ago
Because the better voices cost a lot more money.
2
u/LucidFir 17d ago
mininax h3 with reference and proper instruction sounds amazing. Google big voice uncensored was amazing. i did better voice than op 3 years ago with tortoise. it's not a money issue
1
u/MacrosInHisSleep Chaos Legion 17d ago
Good to know, thanks for sharing. Do you know of any local models that are good?
1
u/LucidFir 17d ago
you'll want to Google the names mentioned in my comment, and check out r/comfyui
1
u/MacrosInHisSleep Chaos Legion 17d ago
These are all local? Neat!
1
u/LucidFir 17d ago
Google big isn't called that but you could probably ask chatgpt what i mean minimax is a video model that does great sound everything is converging
3
u/DvDCover 17d ago
"Here, have an 11-minute long thing that means jack-shit to everyone".
My dude, why even share this? We know its doable already, so its not a "proof of concept". It has no real entertainment value, and its just ...a stylized thing with a bunch of talking heads.
Typing this comment took more effort into what was put into this. Just get rid of this crap.
2
u/MacrosInHisSleep Chaos Legion 17d ago
Why does it say no one owns methods of rationality at the end?
2
u/Mad-Oxy 17d ago
It's a disclaimer from the Chapter 1. As for why it's in the end – probably for artistic purposes not to have a disclaimer in the very beginning.
1
u/MacrosInHisSleep Chaos Legion 17d ago
Doesn't the author own it?
2
u/archpawn 18d ago
The voices are not great. Why not just use the audiobook?
2
1
u/crivtox 17d ago edited 17d ago
This is the result of asking Claude to make the animation, it just decided to use the AI voices. I do agree the audiobook would be better, I just left it as it is cause I was testing what Claude did when just instructed to make the animation without me giving it a lot of direction on how to do things, and the voices are part of that .
The thing about this is that like its trivially easy if you have a claude sub, if you want a version with the audiobook you can just ask for it(thou I would ask the audiobook authors if it's ok before posting and definitely link to them in video description) I just wanted to show how good Claude is getting at this kind of thing oneshot now and so people know this is a thing that can be done easily now, and maybe someone's will expend more effort colabing with Claude to make a much better version with the audiobook as audio and al the chapters, more time put on polishing everything etc.
3
2
1
u/StrongZeroSinger 15d ago
I think you would have gotten a better result with H3 Minmax and using Opus for generating the scene by scene timeline instead.
0
u/Roger44477 18d ago
or... you could learn real 3D animation and make something that is genuine
2
-2
u/iknotri Chaos Legion 18d ago
being anti ai in hpmor subreddit 🥀🥀🥀
1
u/taxes-or-death 18d ago
Eliezer Yukowsky famously a huge fan of AI.
3
u/jstewman 17d ago
I thought rats were supposed to be logical, everyone competent is using models now
yud uses LLMS more than me probably!
2
0
2
1
1
u/Ryuubu 17d ago
Yo, this... this aint bad.
Of course, the voices need doing, but... it's pretty damned fun. I don't know how the art style will hold up when stuff gets darker, though.
1
u/crivtox 17d ago
You know I'm unlikely to ask Claude to make the whole thing as I said elsewhere, cause it would take too many tokens but this makes me wonder how it would handle later episodes especially some of the more action-y ones. I might like tell Claude to make a much later chapter in the same style just to see what it comes up with actually. Like how is it going to do spells fe. This chapter if anything is pretty easy cause it happens in a normal house and is mostly talking. Already spend most of my weekly usage on this and on "effective altruism Yu-Gi-Oh" thou and I need it for other stuff so won't try until it resets on Thursday.
0
u/crazunggoy47 Sunshine Regiment 17d ago
It is a fascinating benchmark of current capabilities. How much prompting did you do to direct the art style, or the shadows in the lampshade?
Also my understanding is that Claude cannot produce videos. Do you mean you used Claude to code up an animation program from scratch?
0
u/crivtox 17d ago
Literally just told Claude to make an animation for the chapter on Claude code. Prompt is on the video description. Took my 5h limit of tokens twice to make it(just told it continue when it ran out). Just told it to do something very different from some other videos it had already made earlier. You can try it out yourself of you have Claude code. Claude used blender to make it mostly.
I think it's not really accurate to say I did something here, was literally 100% Claude my only input was asking Claude to do it. I could get a lot more quality by expending a lot of effort collaborating with Claude probably but mostly wanted to see what it could do oneshot.
6
u/plantsnlionstho Chaos Legion 18d ago
I know this will get a lot of hate because it's AI but other than the voices it's pretty cool. I think these Claude animations are a big step up artistically from the video gen diffusion models people have tried using for this sort of stuff previously. Using the audiobook instead of AI voices would be much better though.