r/pcmasterrace • u/Wargulf • 28d ago

News/Article PS5 Linux lead quits as open-source projects have become “a bunch of noobs using LLMs” that “they don’t even understand”

https://frvr.com/blog/news/ps5-linux-lead-quits-as-open-source-projects-have-become-a-bunch-of-noobs-using-llms-that-they-dont-even-understand/
13.4k Upvotes

97% Upvoted

1.0k comments sorted by

View all comments

Show parent comments

6

u/Sorry-Committee2069 Debian Sid + Bedrock | R7 5700X/RX 7800XT 28d ago

The context window required to load the entire Linux kernel and whatever other text is in the system prompt and your desires and a PR or two is so large that it probably won't ever happen unless they can make RAM sticks as small as a grain of sand but at the same capacity. Context window growth requires exponential RAM, not linear RAM.

2

u/BitGladius 3700x/1070/16GB/1440p/Index 28d ago

I haven't done much open source stuff, but I haven't understood large portions of the systems I've worked on. Good architecture will reduce the number of implementation details any individual needs to know, I've got a few areas I'm an expert in, I know my integration points and the high level architecture, and I can track down more as needed.

1

u/nanotree 28d ago

Yup. It's the same problem as ML model training. Any model is subject to exponentially growing resources needed to produce equivalent advancements in performance.

One of the major things that have given LLMs a boost is novel approaches to usages, such as agentic AI, context windows, and session memory. Session memory may be linear, multiple agents performing different roles may be linear in resource requirements assuming context is the same for all agents.

But context is exponential in some cases, but factorial in others. Factorial exploding way faster than exponential even.