• NousTheta
  • Multiple Steps:
    • CPU Usage: 304.4% (7.6x capacity)
    • Memory Usage: 59.7% (9.55 GB)
  • Long Context:
    • CPU Usage: 350.5% (8.8x capacity)
    • Memory Usage: 59.7% (9.55 GB)
• Phi3Medium
  • Multiple Steps:
    • CPU Usage: 370.9% (9.3x capacity)
    • Memory Usage: 64.8% (10.37 GB)
  • Long Context:
    • CPU Usage: 377.9% (9.4x capacity)
    • Memory Usage: 64.8% (10.37 GB)
• Phi3Medium128k
  • Multiple Steps:
    • CPU Usage: 374.8% (9.4x capacity)
    • Memory Usage: 64.7% (10.35 GB)
  • Long Context:
    • CPU Usage: 377.0% (9.4x capacity)
    • Memory Usage: 64.7% (10.35 GB)
• Phi3Mini
  • Multiple Steps:
    • CPU Usage: 324.1% (8.1x capacity)
    • Memory Usage: 35.3% (5.64 GB)
  • Long Context:
    • CPU Usage: 612.2% (15.3x capacity)
    • Memory Usage: 71.1% (11.38 GB)
• Llama3_1_8B
  • Multiple Steps:
    • CPU Usage: 336.3% (8.4x capacity)
    • Memory Usage: 38.0% (6.08 GB)
  • Long Context:
    • CPU Usage: 369.1% (9.2x capacity)
    • Memory Usage: 38.0% (6.08 GB)