r/codex • u/Usernamealready94 • 0m ago
Complaint Sad realization that even Astra doesnt compare | Benchmarks arent everything
I used to be a big Codex fanboy
I started on the $20 Codex plan and moved up to the 5x plan. Every new frontier model felt like an event. So when Opus 5.5 came out, I didn't care much.
When Astra launched I was just as hyped. But a few weeks later I was drowning in work on a big project, and I gave in and bought Claude 5x for Opus 5.5. It cleared a huge amount of that backlog in two days.At hackathons I kept using both.
Recently, I was in another week-long hackathon, and it was more of a research/optimisation task than a coding task. Basically it involved loading some geospatial data in GeoTIFF formats and trying to see if we can gain any performance improvements on the underlying necessary memory that we need to store.
I was thinking, at least, that a bigger model like Astra, probably bigger than Opus, so I was assuming that maybe the big model might be more relevant here
It's not a simple coding task, It involves coding, but it involves a lot of research and stuff as well
I couldn't watch it during the start , had some other work etc.I'm big on context engineering, so I gave the agent everything up front: the brief, the company's guidance, the datasets, the evaluation rules and the constraints. Then I left it alone.
I had Astra run for 2 days, and it gave me basically meaningless improvements, like less than 5% improvements
I gave opus the same stuff, and it resulted in 5x total perf improvements and 98% less memory.
These are not novel inventions; the hackathon is set up in a way that the starting points are obviously very inefficient, and we had to do some improvements, but it still completely changed my mind on OpenAI stuff: it just completely did not work as compared to opus
For the entire run, I used Astra, not even 6.1 sol, subagents, and stuff like that, whereas Opus was allowed to delegate to Sonnet 5.5
It's not even like a subagent, or like the orchestration issue.
Its just completely baffling to me.
End of My rant

