In the latest nvidia app update they added MCP server to the app, but why this is enabled by default? It added an http MCP server listening on background without any authentication.

So I was reading some reviews of people comparing the 256GB Mac Studio vs 2 of the Nvidia spark workstations. They mentioned costs of between $10k and $15k and posted some numbers. A few guys mentioned a video that ran the two machines head to head on various models. One of the models was qwen flash which I have and can run. You guys may have seen my post a few weeks back about getting my 5090 working on my Mac. Well the thing that stuck out to me was that the Mac was quicker in some things but was much slower on prefill and multi user. That is specifically what my shim can accomplish so I ran some tests.

These are the numbers I got from the video:

┌────────────────────┬──────┬──────────┬──────────────┐
│                    │  Us  │ M5 Ultra │ 2× DGX Spark │
├────────────────────┼──────┼──────────┼──────────────┤
│ Single-user decode │ 68.4 │ 45       │ 38           │
├────────────────────┼──────┼──────────┼──────────────┤
│ 8 users, total     │ 155  │ 66–70    │ 120          │
├────────────────────┼──────┼──────────┼──────────────┤
│ 32k cold prefill   │ 27 s │ 26 s     │ 11.2 s       │
└────────────────────┴──────┴──────────┴──────────────┘

And these are numbers I get with llamacpp with my m4 128gb laptop and 5090

As you can see I'm still working on cold prefill but for a $6k investment for the M4 and the 5090 box you get better performance on the split system. The 5090 probably blows both systems out of the water on a smaller model that fits fully in the cards Vram too.

I don't have these other systems but these are the numbers I've found. feel free to correct me if my numbers are not what you are seeing in real world testing. If you want to test this yourself I'm updating the macuda project tonight with the changes that enabled these results. I've go the driver and shim working on 3060 and 5090. I haven't tested the 3060 on these latest features yet but it's shim work mostly so it should carry over.

edited 8 user to 155 from 133 after retest

I´ve been considering this for a while now and it seems its not really worth it if you dont go at least to an RTX 5080.

Im not in the US so it is not that easy to sell the RTX 3090 for what it is worth now and Getting a RTX5080 is even more expensive than it should.

So, has any of you guys upgraded from an RTX 3090 to any Series 5000 GPU?

If you did, which GPU did you get and how much did your FPS in different scenarios improve?

I think im mainly trying to figure out if going to a 5070Ti or even 5070 or if it is worth it to sell a kidney to get a 5080.

Is there an official webpage about the presets?

I want to protect my GPU as best as possible. I guess I made a good choice getting an astral since it has its own warning LED for a bad current/connection. But I feel I want to go further in protection.

I ordered a WVP2 but I get people saying it’s bad idea due to adding an additional point of failure, but I love the idea of live monitoring and auto shutdown.

Then I get told there’s GPU tweak 3 (exclusive to some cards) which I guess isn’t as fast as WPV2 but also I get feedback that it’s a bloated application and can cause issues with my MSI afterburner.

Then I’m told about HWinfo which again isn’t as fast or something with WVP2 and there’s a lot that goes into making it work correctly.

I’ve also been told about PSU, which right now I’m running a super flower VII leadex platinum pro and don’t know if there’s like a better option out there.

All in all it seems I try and focus on one thing I get conflicting feedback. It’s sucks this is such a issue with GPUs in the first place but I just wanna know do I leave my PC as is and keep an eye on the LED light or do I commit to one of the previous options?

Looking for a gpu that wont bottleneck my old processor 😁

or should i wait for next generation
my idea is that path tracing and even ultra rau tracing has not been solved for most gpus bar the 5090/80. looked to me like a hardware limitation where the compute is just not present to push respectable actual frames for that technology. however i still believe that next generation of gpu hardware and cores might actually be a lot closer to solving ray tracing so i was betting on it. i mean ideally this should have been done probably in the 50xx series but here we are

The Lenovo Pro model has a second m.2 slot for a hood rich eGPU set up. I’m strongly considering it but want to know what other ML workload folks are taking the plunge.

I could use more Vram gaming and rendering.

i found one used for 2200$ it is the suprim liquid cooled 4090 too.

is it worth it?