• NousTheta
  • Long Context:
    • Total CPU Usage: 290.6%
    • Total Memory Usage: 60.5%
  • Multiple Steps:
    • Total CPU Usage: 237.5%
    • Total Memory Usage: 60.5%
• Phi3Medium
  • Long Context:
    • Total CPU Usage: 345.9%
    • Total Memory Usage: 65.5%
  • Multiple Steps:
    • Total CPU Usage: 343.7%
    • Total Memory Usage: 65.6%
• Phi3Medium128k
  • Long Context:
    • Total CPU Usage: 320.9%
    • Total Memory Usage: 65.6%
  • Multiple Steps:
    • Total CPU Usage: 223.3%
    • Total Memory Usage: 64.5%
• Phi3Mini
  • Long Context:
    • Total CPU Usage: 303.8%
    • Total Memory Usage: 34.1%
  • Multiple Steps:
    • Total CPU Usage: 264.5%
    • Total Memory Usage: 34.0%
• Llama3_1_8B
  • Long Context:
    • Total CPU Usage: 473.4%
    • Total Memory Usage: 70.6%
  • Multiple Steps:
    • Total CPU Usage: 463.3%
    • Total Memory Usage: 70.6%