r/LocalLLaMA • u/Express_Quail_1493 • 14h ago
Question | Help Does strata on multi-gpu without nvlink worth it?
GPU- i have asymetric architectures - Titan RTX(a 2018 card released same time as 2080ti) and i have a RTX 3090. Both of these cards are 24gb the TitanRTX does not have flashAttention-2 only standard flash attention
SystemRam - i have about 48gb of Free SystemRam to spare. the rest is used up by my chrome VsCode and docker instances. 6000mhz ramspeed.
Im getting 32tok/s on qwen3.8-27b running on a single 3090 at 300k context the Titan Rtx is pretty much empty and just sitting there.
but im wondering is strata designed for multigpu will it massively decrease my prefill speed on multigpu? Anyone tested?
is it faster on a single 3090 and the rest in system ram or would it be faster on dual cards even with my specific caveats?
EDIT: thank you all for replies I will add another £30 add-on to my metered 4g connection to download the ggufs now. im more confident that it won't be a waste :)
Duplicates
LocalLLM • u/Express_Quail_1493 • 13h ago