• NousTheta
  • Multiple Steps:
    • CPU Usage: 278.6% (3.5x capacity)
    • Memory Usage: 59.6% (9.54 GB)
  • Long Context:
    • CPU Usage: 230.8% (2.9x capacity)
    • Memory Usage: 59.7% (9.55 GB)
• Phi3Medium
  • Multiple Steps:
    • CPU Usage: 307.0% (3.8x capacity)
    • Memory Usage: 64.7% (10.35 GB)
  • Long Context:
    • CPU Usage: 333.4% (4.2x capacity)
    • Memory Usage: 64.8% (10.37 GB)
• Phi3Medium128k
  • Multiple Steps:
    • CPU Usage: 317.2% (4.0x capacity)
    • Memory Usage: 64.7% (10.35 GB)
  • Long Context:
    • CPU Usage: 334.6% (4.2x capacity)
    • Memory Usage: 64.7% (10.35 GB)
• Phi3Mini
  • Multiple Steps:
    • CPU Usage: 275.3% (3.4x capacity)
    • Memory Usage: 33.6% (5.38 GB)
  • Long Context:
    • CPU Usage: 413.0% (5.2x capacity)
    • Memory Usage: 69.0% (11.04 GB)
• Llama3_1_8B
  • Multiple Steps:
    • CPU Usage: 393.7% (4.9x capacity)
    • Memory Usage: 35.6% (5.69 GB)
  • Long Context:
    • CPU Usage: 297.8% (3.7x capacity)
    • Memory Usage: 36.3% (5.81 GB)