• NousTheta
  • Multiple Steps:
    • CPU Usage: 618.8% (7.7x capacity)
    • Memory Usage: 59.8% (9.57 GB)
  • Long Context:
    • CPU Usage: 631.9% (7.9x capacity)
    • Memory Usage: 59.8% (9.57 GB)
• Phi3Medium
  • Multiple Steps:
    • CPU Usage: 646.5% (8.1x capacity)
    • Memory Usage: 67.4% (10.78 GB)
  • Long Context:
    • CPU Usage: 647.6% (8.1x capacity)
    • Memory Usage: 67.4% (10.78 GB)
• Phi3Medium128k
  • Multiple Steps:
    • CPU Usage: 652.2% (8.2x capacity)
    • Memory Usage: 67.4% (10.78 GB)
  • Long Context:
    • CPU Usage: 647.5% (8.1x capacity)
    • Memory Usage: 67.4% (10.78 GB)
• Phi3Mini
  • Multiple Steps:
    • CPU Usage: 542.4% (6.8x capacity)
    • Memory Usage: 36.3% (5.81 GB)
  • Long Context:
    • CPU Usage: 704.9% (8.8x capacity)
    • Memory Usage: 72.3% (11.57 GB)
• Llama3_1_8B
  • Multiple Steps:
    • CPU Usage: 341.5% (4.3x capacity)
    • Memory Usage: 38.7% (6.19 GB)
  • Long Context:
    • CPU Usage: 415.5% (5.2x capacity)
    • Memory Usage: 38.7% (6.19 GB)