Mixed
The models struggled to make prompt processing compute-bound on strix halo when the graph is complex
throwdbaaway on Hacker News
In the thread “CUDA for AMD on Windows”, replying to this comment
Helped: Adapting existing CUDA and CPU kernels to non-NVIDIA devices.
Got in the way: Making prompt processing compute-bound on complex graphs.
… * However, the standard API is also lacking. The models struggled to make prompt processing compute-bound on strix halo when the graph is complex. Upfront standard API might just be an evolution dead end.