NousTheta

• Multiple Steps & Long Context:
  • Error: Model requires more system memory (9.3 GiB) than is available (5.8 GiB).

Phi3Medium

• Multiple Steps & Long Context:
  • Error: Model requires more system memory (10.9 GiB) than is available (5.8 GiB).

Phi3Medium128k

• Multiple Steps & Long Context:
  • Error: Model requires more system memory (10.9 GiB) than is available (5.8 GiB).

Llama3_1_8B

• General Error:
  • Error: Model requires more system memory (5.9 GiB) than is available (5.8 GiB).

Phi3Mini

• Long Context:
  • Total CPU Usage: 6.968 vCPUs (174.2% of 4 vCPUs)
  • Total Memory Usage: 5.416 GiB (67.7% of 8 GiB)
• Multiple Steps:
  • Total CPU Usage: 6.676 vCPUs (166.9% of 4 vCPUs)
  • Total Memory Usage: 5.352 GiB (66.9% of 8 GiB)