r/OpenAI • • 11h ago

News We got a rest today

Post image

Go use you tokens

42 Upvotes

28 comments sorted by

14

u/tat_tvam_asshole 11h ago

TS is so slow it doesn't even matter

13

u/prophet-dot-exe 11h ago

Fun fact, if it says "thinking" it's not even thinking, the request is just waiting at the front door of the server

4

u/tat_tvam_asshole 11h ago

"Pacing the frontier [access]"

3

u/Ormusn2o 10h ago

This is true, time to first token went from about 15 seconds on 5.6 Sol to about 45 seconds (the actual times vary a lot) on 6.1 Sol. There have been some improvements, but it is still not even close enough to how it was in the past.

I actually don't think this is that much of a problem though, if token speed was like 4x of what it is now. I think it's a reasonable thing to expect as agentic tasks take longer and longer, to expect token speed to increase, at least a little bit. A regression feels awful, although I do fully realize this is strictly because of the massive worldwide compute shortage, and there is pretty much no way to deal with it besides people just using less AI.

3

u/Huge-Cartoonist2900 11h ago

tibo been at it 10 days already, rest well deserved

7

u/Ormusn2o 11h ago

Damn, so many resets one after each other. After I got cough off guard last time, I was running AI to make sure to use it up as fast as possible. I got only 17% left right now.

2

u/arc432 11h ago

Im at 5% myself. They got me last time when I was only at 32% left so I’m on guard now. Haha

6

u/recallingmemories 8h ago

Such a weird way to operate, I don’t want to keep up with random resets

1

u/New_World_2050 3h ago

People love surprises

5

u/cern0 11h ago

I still at 86%. What should I do

6

u/Amaldevhari 11h ago edited 11h ago

Ask it: “Based on your knowledge about me, what are some of the most highest value tasks you can do right now?”.
Then run all of them in parallel.

3

u/lolman1312 11h ago

its gotten to a point im bottlenecked by my own RAM, i want to do more in parallel but my work laptop physically can't. then everything slows down, my disk drive gets fully used up, etc.

2

u/Ormusn2o 10h ago

I know it's not a solution, but I have heard people installing Linux or even spinning up VMs of Linux for Codex work, because apparently it works much better on Linux, to the point where you can sometimes do 10x more tasks at the same time.

2

u/lolman1312 9h ago

is that true though? is that specific to codex or other LLMs? because i know codex is infamous for its terrible memory usage, i heard its mostly because of electron that's used for all the in-app browser windows and whatnot but tbh it's probably more than that. and there's also issues where the ram doesn't free even upon terminating codex tasks you need to restart as well

2

u/Ormusn2o 8h ago

I have not like investigated this myself, so this is 3rd party report, but from what I understand, the operating systems (especially on a Mac) is constantly trying to investigate operations that it deems to be dangerous, which is causing a lot of the hardware churn, and not actually Codex using up your PC's resources to do stuff.

Even running Python or other programs on your PC generally should not require that much performance, and it's obviously not running them all the time. So it's a genuine bug, or basically an artifact of how older, pre-agentic bots systems are used today to do things those systems were not designed for. Those things don't matter when a normal program or a user is doing stuff so fast, but it matters when an agent is doing it fast.

Anthropic has been working on MPC as well to make it faster and more lean, but making MCP faster by itself is not enough.

And yes, this is universal for all agentic agents, not just Codex.

1

u/FreeChickenDinner 10h ago

Ask it to write a business case to justify the purchase of more ram. 😄

1

u/snug-crackle-policy 5h ago

I have a 64GB macbook Pro M5, and that heats up like hell, it often goes to swap if I am using multiple chats in ChatGPT. And I remember that with Claude Code desktop app, it was going to 90GB Swap and then everything froze up :D

1

u/snug-crackle-policy 5h ago

I think much of the work is being done on our machines and then we are still paying for the APIs :D

2

u/UziMcUsername 11h ago

Change the cap in config.toml to 100 subagents and do a week of work in 30 minutes

1

u/Loltoor 10h ago

“Build everything, no mistakes”

3

u/dreamofantasy 11h ago

uh oh. i just used my banked reset like 5 minutes ago before i saw this 😭 better burn as much as i can!!!

4

u/meshla2ibsnfsi 10h ago

So much for "locking in" and them shipping "one thing that is a clear improvement" each day, they are really grasping at straws here lmao.

Resets this close together don't even count because most people can't even spend them this fast. OpenAI is spiraling

2

u/me_myself_ai 11h ago

:( I think it bounced cause I already had one. RIP

2

u/Dark_Fire_12 10h ago

So is the unofficial cycle, every 2 days or is that a risky bet to make?

2

u/BitterAd6419 10h ago

Already landed

1

u/185EDRIVER 4h ago

I love that I literally used my bank reset 5 minutes before this they should have a way to deal with that man