Please enable JavaScript.

Coggle requires JavaScript to display documents.

AI (Intro, Data Center Level Consider, Rack level consider) - Coggle…

- - - - Data gravity
      - Deployment stategy
    - - Compute Optimized: A100 vs A30
      - Graphics & mixed workloads: A40 & A16
    - - For experiment and dev
      - For analytics and training
      - For training at scale
      - For Inference
    - - ???
- - - - not shared storage
      - shared storage
  - - - 5 Key factor for Performance?
    - - InfiniBand
        
        RDMA
        
        High throughput, low latency, CPU offloads
      - Ethernet
      - RoCE?
    - - OOBM allow what?
      - Baseboard management controller (BMC)
      - Key characteristic of IPMI
  - - - NVIDIA Base Command Manager: manager DGX SuperPOD