• NousTheta
  • Multiple Steps:
    • CPU Usage: 244.3% (3.05x capacity)
    • Memory Usage: 58.9% (9.42 GB)
  • Long Context:
    • CPU Usage: 232.3% (2.90x capacity)
    • Memory Usage: 59.5% (9.52 GB)
• Phi3Medium
  • Multiple Steps:
    • CPU Usage: 330.9% (4.14x capacity)
    • Memory Usage: 64.5% (10.32 GB)
  • Long Context:
    • CPU Usage: 334.9% (4.19x capacity)
    • Memory Usage: 64.4% (10.30 GB)
• Phi3Medium128k
  • Multiple Steps:
    • CPU Usage: 155.8% (1.95x capacity)
    • Memory Usage: 63.3% (10.13 GB)
  • Long Context:
    • CPU Usage: 320.7% (4.01x capacity)
    • Memory Usage: 64.4% (10.30 GB)
• Phi3Mini
  • Multiple Steps:
    • CPU Usage: 307.7% (3.85x capacity)
    • Memory Usage: 33.5% (5.36 GB)
  • Long Context:
    • CPU Usage: 280.7% (3.51x capacity)
    • Memory Usage: 33.4% (5.34 GB)
• Llama3_1_8B
  • Multiple Steps:
    • CPU Usage: 447.6% (5.59x capacity)
    • Memory Usage: 68.6% (11.02 GB)
  • Long Context:
    • CPU Usage: 450.6% (5.63x capacity)
    • Memory Usage: 69.4% (11.10 GB)