Hello, I have 2 root servers in USA and several in Germany. I have noticed bad performance on the USA servers and it seems to be due to disk performance. Using a simple crystaldiskmark I can see that the write performance is quite bad on both the US servers. Around 500MB/s compared to Germany based servers that give similar write performance as read, somewhere around 4000MB/s. Is this is due to a problem, or is this the expected performance? If so I will have to move back the servers.
Poor disk performance in the new servers in USA
- Zulan
- Thread is Unresolved
-
-
Did you compare yabs on both locations?
-
"500MB/s" are "bad disk performance"?
-
-
-
If I have 4000-7000 on one server and 500 on another, then that is the issue rather then what you find to be good performance.
Seems something is wrong with your test. Or there is the MB/s<>MBit/s misunderstanding here.
500MB/s is a good value.
>1G you get probably only on real hardware with NVME. -
TBT your comment just makes me sick. If I have 4000-7000 on one server and 500 on another, then that is the issue rather then what you find to be good performance.
The last generation didn't really go over 250 Mbytes/s, no matter where. So 500 Mbytes/s are already a big improvement and by no way "poor". Get other VServers and experience "poor disk performance".
Apart from that: no shown test results, no credibility.
-
My opinion on this: If you consider that the vServer RS 1000 G11 costs less than 10 euros per month as a special edition and only has a contract period of 31 days, I consider the following values to be appropriate for such a small vServer:
Code
Display More# ## ## ## ## ## ## ## ## ## ## ## ## ## ## ## ## ## # # Yet-Another-Bench-Script # # v2024-03-05 # # https://github.com/masonr/yet-another-bench-script # # ## ## ## ## ## ## ## ## ## ## ## ## ## ## ## ## ## # Sa 10. Aug 11:40:45 CEST 2024 Basic System Information: --------------------------------- Uptime : 6 days, 11 hours, 28 minutes Processor : AMD EPYC 9634 84-Core Processor CPU cores : 4 @ 2246.624 MHz AES-NI : ✔ Enabled VM-x/AMD-V : ❌ Disabled RAM : 7.7 GiB Swap : 0.0 KiB Disk : 251.8 GiB Distro : Debian GNU/Linux 12 (bookworm) Kernel : 6.1.0-23-amd64 VM Type : KVM IPv4/IPv6 : ✔ Online / ✔ Online IPv6 Network Information: --------------------------------- ISP : netcup GmbH ASN : AS214996 netcup GmbH Host : Netcup KVM MNZ Location : Vienna, Vienna (9) Country : Austria fio Disk Speed Tests (Mixed R/W 50/50) (Partition /dev/vda3): --------------------------------- Block Size | 4k (IOPS) | 64k (IOPS) ------ | --- ---- | ---- ---- Read | 77.83 MB/s (19.4k) | 198.97 MB/s (3.1k) Write | 78.04 MB/s (19.5k) | 200.02 MB/s (3.1k) Total | 155.87 MB/s (38.9k) | 399.00 MB/s (6.2k) | | Block Size | 512k (IOPS) | 1m (IOPS) ------ | --- ---- | ---- ---- Read | 335.00 MB/s (654) | 578.71 MB/s (565) Write | 352.80 MB/s (689) | 617.26 MB/s (602) Total | 687.81 MB/s (1.3k) | 1.19 GB/s (1.1k)
-
If you really put a vServer RS 1000 G11 under load, you will see a significantly better IO:nc_stress_test_rs1000g11.png
uptime
12:19:07 up 6 days, 12:06, 2 users, load average: 1024,11, 888,34, 489,63
Code
Display More# ## ## ## ## ## ## ## ## ## ## ## ## ## ## ## ## ## # # Yet-Another-Bench-Script # # v2024-03-05 # # https://github.com/masonr/yet-another-bench-script # # ## ## ## ## ## ## ## ## ## ## ## ## ## ## ## ## ## # Sa 10. Aug 12:19:15 CEST 2024 Basic System Information: --------------------------------- Uptime : 6 days, 12 hours, 6 minutes Processor : AMD EPYC 9634 84-Core Processor CPU cores : 4 @ 2246.624 MHz AES-NI : ✔ Enabled VM-x/AMD-V : ❌ Disabled RAM : 7.7 GiB Swap : 0.0 KiB Disk : 251.8 GiB Distro : Debian GNU/Linux 12 (bookworm) Kernel : 6.1.0-23-amd64 VM Type : KVM IPv4/IPv6 : ✔ Online / ✔ Online IPv6 Network Information: --------------------------------- ISP : netcup GmbH ASN : AS214996 netcup GmbH Host : Netcup KVM MNZ Location : Vienna, Vienna (9) Country : Austria fio Disk Speed Tests (Mixed R/W 50/50) (Partition /dev/vda3): --------------------------------- Block Size | 4k (IOPS) | 64k (IOPS) ------ | --- ---- | ---- ---- Read | 732.55 MB/s (183.1k) | 1.68 GB/s (26.2k) Write | 734.49 MB/s (183.6k) | 1.69 GB/s (26.4k) Total | 1.46 GB/s (366.7k) | 3.37 GB/s (52.7k) | | Block Size | 512k (IOPS) | 1m (IOPS) ------ | --- ---- | ---- ---- Read | 2.07 GB/s (4.0k) | 1.89 GB/s (1.8k) Write | 2.18 GB/s (4.2k) | 2.02 GB/s (1.9k) Total | 4.26 GB/s (8.3k) | 3.91 GB/s (3.8k)
-
Well, if the question simply is: "Is IO for big block sizes on RS G11 worse than on RS G9.5?", i would say the answer is "Yes, definitely, and by a big margin". For answering this question, prices and considerations what is "good enough" are irrelevant. The test below also shows, that more than 500 MB/s have been reality for all but the lowest block sizes.
I agree, that the values of G11 are still ok, especially for the price. vServers from competitors in this price range are often worse. So I won't complain. But that's a completely different story.
My old RS 2000 G9.5 showed (tested with YABS)
Code
Display Morefio Disk Speed Tests (Mixed R/W 50/50): --------------------------------- Block Size | 4k (IOPS) | 64k (IOPS) ------ | --- ---- | ---- ---- Read | 153.40 MB/s (38.3k) | 1.82 GB/s (28.4k) Write | 153.80 MB/s (38.4k) | 1.82 GB/s (28.5k) Total | 307.20 MB/s (76.8k) | 3.65 GB/s (57.0k) | | Block Size | 512k (IOPS) | 1m (IOPS) ------ | --- ---- | ---- ---- Read | 3.48 GB/s (6.8k) | 3.60 GB/s (3.5k) Write | 3.67 GB/s (7.1k) | 3.84 GB/s (3.7k) Total | 7.15 GB/s (13.9k) | 7.44 GB/s (7.2k)
-
Thanks for all your answers guys! It was crystaldiskmark that gave me the numbers. I am not sure how they have calculated the MB but it looks like this:
CrystalDiskMark test US server RS2000 G11
And my older G9 RS2000 server gives me the highest numbers of 4000 both read/write.
Anyone has any idea how to get yabs to run on windows? Virtualization is not enabled in bios and I'm not sure how to edit bios settings. I would think crystal diskmark shows my point anyway?
-
-
Thank you Andreas, I did that, but I get no confirmation it's running, has completed or anything. I went to All Yab Runs | VPSBenchmarks but I can't see anything from netcup there today. It's my understanding it will run the benchmark and upload the results to vpsbenchmarks? I then tried running curl -sL yabs.sh | bash to see if that changed anything but got the exactly same, nothing, prompt just goes to next level with no output.
-
I found the solution, there was no name servers in the rescue os.
-
I also played through it again and you can get it to work like this:
Code
Display Morecd /mnt/ mkdir hdd1 mount -tauto /dev/vdb1 /mnt/hdd1 # for example cd /mnt/hdd1 echo "nameserver 1.1.1.1" >> /etc/resolv.conf wget -4 https://github.com/masonr/yet-another-bench-script/archive/refs/heads/master.zip unzip master.zip cd yet-another-bench-script-master/ bash yabs.sh -ign
-
I also played through it again and you can get it to work like this:
Code
Display Morecd /mnt/ mkdir hdd1 mount -tauto /dev/vdb1 /mnt/hdd1 # for example cd /mnt/hdd1 echo "nameserver 1.1.1.1" >> /etc/resolv.conf wget -4 https://github.com/masonr/yet-another-bench-script/archive/refs/heads/master.zip unzip master.zip cd yet-another-bench-script-master/ bash yabs.sh -ign
Now the tests run, but the disk tests only gives out 0:s.
io Disk Speed Tests (Mixed R/W 50/50) (Partition overlay):
---------------------------------
Block Size | 4k (IOPS) | 64k (IOPS)
------ | --- ---- | ---- ----
Read | 0.00 KB/s (0) | 0.00 KB/s (0)
Write | 0.00 KB/s (0) | 0.00 KB/s (0)
Total | 0.00 KB/s (0) | 0.00 KB/s (0)
| |
Block Size | 512k (IOPS) | 1m (IOPS)
------ | --- ---- | ---- ----
Read | 0.00 KB/s (0) | 0.00 KB/s (0)
Write | 0.00 KB/s (0) | 0.00 KB/s (0)
Total | 0.00 KB/s (0) | 0.00 KB/s (0)
-
I had to mount the /dev/vdb3 disk instead and now it works. Now there is no longer any difference between read/write. I am not sure what conclusions I can actually draw from this.
Code
Display More# ## ## ## ## ## ## ## ## ## ## ## ## ## ## ## ## ## # # Yet-Another-Bench-Script # # v2024-06-09 # # https://github.com/masonr/yet-another-bench-script # # ## ## ## ## ## ## ## ## ## ## ## ## ## ## ## ## ## # Sat Aug 10 01:09:21 PM UTC 2024 Basic System Information: --------------------------------- Uptime : 0 days, 1 hours, 29 minutes Processor : AMD EPYC 9634 84-Core Processor CPU cores : 8 @ 2246.624 MHz AES-NI : ✔ Enabled VM-x/AMD-V : ❌ Disabled RAM : 15.6 GiB Swap : 0.0 KiB Disk : 511.1 GiB Distro : Debian GNU/Linux bookworm/sid Kernel : 6.0.0-4-amd64 VM Type : MICROSOFT IPv4/IPv6 : ✔ Online / ❌ Offline IPv4 Network Information: --------------------------------- ISP : netcup GmbH ASN : AS214996 netcup GmbH Host : netcup GmbH Location : Manassas, Virginia (VA) Country : United States fio Disk Speed Tests (Mixed R/W 50/50) (Partition /dev/vdb3): --------------------------------- Block Size | 4k (IOPS) | 64k (IOPS) ------ | --- ---- | ---- ---- Read | 69.11 MB/s (17.2k) | 662.75 MB/s (10.3k) Write | 69.32 MB/s (17.3k) | 666.24 MB/s (10.4k) Total | 138.43 MB/s (34.6k) | 1.32 GB/s (20.7k) | | Block Size | 512k (IOPS) | 1m (IOPS) ------ | --- ---- | ---- ---- Read | 1.25 GB/s (2.4k) | 1.21 GB/s (1.1k) Write | 1.31 GB/s (2.5k) | 1.30 GB/s (1.2k) Total | 2.56 GB/s (5.0k) | 2.52 GB/s (2.4k) iperf3 Network Speed Tests (IPv4): --------------------------------- Provider | Location (Link) | Send Speed | Recv Speed | Ping ----- | ----- | ---- | ---- | ---- Clouvider | London, UK (10G) | 1.58 Gbits/sec | 1.13 Gbits/sec | 78.4 ms Eranium | Amsterdam, NL (100G) | 1.87 Gbits/sec | 2.01 Gbits/sec | 94.6 ms Uztelecom | Tashkent, UZ (10G) | 891 Mbits/sec | 413 Mbits/sec | 174 ms Leaseweb | Singapore, SG (10G) | busy | 620 Mbits/sec | 238 ms Clouvider | Los Angeles, CA, US (10G) | 1.95 Gbits/sec | 2.14 Gbits/sec | 55.7 ms Leaseweb | NYC, NY, US (10G) | 2.74 Gbits/sec | 2.33 Gbits/sec | 7.43 ms Edgoo | Sao Paulo, BR (1G) | 1.44 Gbits/sec | 922 Mbits/sec | 140 ms Geekbench 6 Benchmark Test: --------------------------------- Test | Value | Single Core | 1508 Multi Core | 7415 Full Test | https://browser.geekbench.com/v6/cpu/7274490 YABS completed in 10 min 36 sec
-
I tested it using Atto Disk benchmark as well. Here you really see the difference. The operating system is a default Windows standard 2022.
First image is the US server.
I have a second US RS2000 G11 server with the same operatingsystem and the same performance difference in read/write.
I also have a small vps 1000 G10 based in nurnberg de and it also has similar disk performance both read/write.
This is not a problem only visible in benchmarks. I can clearly see how sluggish the US servers are compared to the DE. -
So to sum up the problem. I have 1 RS2000 G9.5 based in Germany and two RS2000 G11 based in US.
All three servers have about the same performance when benchmarking with yabs.But in windows the US servers have considerably lower performance tested using two different benchmarks, not only visible in benchmarks but also noticeable when the servers are under load.
All three servers use windows 2022 standard.
One theory I have is it might be something with caching since the write speeds I get in windows is similar to what I get with linux and the read speeds are just insanely high compared to the linux tests. So I guess linux does not use caching. I have not changed any caching settings on either of the machines so it's still confusing.
I can now see what you meant TBT and I'm sorry barked at you.
-
Have you selected the same drivers in SCP at Media > Local Disks?