|
duck monster posted:I'm seeing some scuttlebut around the net about AMDs new Instinct GPUs being actually...... good for AI? Aparently the A100s kick them to the curb a lot of the tensorflow metrics, but a lot of that uses 32bit operation, and AMDs offering thrashes the A100 on 64bit ops. At about $14K. Thus if the models can be adapted to be optimized for 64bit math rather than 32bit math (I'm not sure what it'd gain out that but hey) the Instincts might be a real contender at a significantly lower price. Why would you need 64bit for Machine Learning? 16bit and 8bit are the metrics that matter imo. Edit: Also, AMDs problem isn't hardware. It's that their software stack is absolute garbage and has been for years - and there is no drive at AMD to fix it.
|
#
¿
Sep 30, 2023 09:28
|
|
|
|
| # ¿ May 17, 2024 01:43 |
|