• Endmaker@lemmy.world
    link
    fedilink
    English
    arrow-up
    4
    ·
    1 month ago

    How are AMD GPUs useful though? Last time I’ve heard, CUDA (and CuDNN) is still an Nvidia-only thing.

    • ichbinjasokreativ@lemmy.world
      cake
      link
      fedilink
      English
      arrow-up
      7
      ·
      1 month ago

      There are compatibility layers for cuda to run on AMD, and everything AI can also natively run on ROCm. It’s a choice to use nvidia, not mandatory.

      • notfromhere@lemmy.ml
        link
        fedilink
        English
        arrow-up
        2
        ·
        30 days ago

        What is the best working compatibility layer to run cuda on AMD? ROCm seems to drop support pretty quickly after release though so it’s hard for it to get a foothold. As Karparhy has shown, doing low level C++ has some amazing results…