LANBench

is a free, portable network benchmarking utility designed to test the performance of a local area network (LAN). It specifically measures TCP performance between two computers using the Winsock 2.2 API. Key Features

for setting up a LANBench test between two of your own computers?

Use Case 3: Streaming vs. Non-Streaming

1. Network Realism: It measures TCP socket latency, HTTP/2 overhead, and packet loss effects.
2. Multi-Client Simulation: Spin up 10, 50, or 100 virtual users querying your LLM simultaneously to find breaking points.
3. Cross-Platform: The client can run on Windows/Mac/Linux while the server runs on a Linux GPU rig.
4. Framework Agnostic: It works with OpenAI-compatible APIs (vLLM, TensorRT-LLM, TGI), Ollama, and custom FastAPI endpoints.

No Installation Required:

It’s a portable .exe , making it easy to run on multiple machines.

• Server Mode: Listens on a specified port for incoming test connections.
• Client Mode: Connects to the server and initiates a bidirectional or unidirectional data transfer test.

Rating:

⭐⭐⭐⭐ (4/5)

• No GUI – Command-line only, which may be intimidating for non-technical users.
• No automatic test discovery – Requires manual IP entry for the server.
• Limited metrics – Doesn’t measure latency, jitter, or packet loss; focused solely on throughput.
• No logging or graphing – Results are printed to console; you’ll need to redirect output for analysis.