Severe Disk I/O Performance Issues on RS 2000 G12 iv Pro

  • Hello Netcup Community,

    I am experiencing severe and persistent disk I/O performance issues on one of my Netcup Root Servers for the past 2 days.

    Affected Server: v2202510306504393820 - RS 2000 G12 iv Pro

    I currently have 5 Root Servers with Netcup, and only this server is experiencing these issues.

    The server hosts our main Enhance Control Panel for a multi-server cluster, along with multiple production websites. While websites on the other servers are working normally, customers cannot reliably manage their websites because the central control panel frequently becomes unresponsive or completely inaccessible.

    Technical Issues:

    • Disk write latency (w_await) exceeding 1,500 ms, even shortly after reboot.
    • Disk utilization reaching 96%, with significant I/O wait.
    • Performance deteriorates further over time, causing repeated website and control panel outages.
    • Even small disk writes experience extreme delays.

    Troubleshooting Already Performed:

    • Multiple server reboots.
    • Various server-level optimizations and configuration changes.
    • Applied Netcup's Storage Optimization feature.
    • Verified disk space, RAM, CPU, and running services.
    • No snapshots are present on the server.

    Despite all these attempts, the issue persists. The measurements above were taken shortly after reboot, and performance becomes considerably worse as the server continues running.

    Support Concern:

    I submitted a support request through the Netcup Helpdesk after being redirected from the CCP. It has been 2 days without even an acknowledgement or confirmation that the issue is being investigated.

    This ongoing downtime is severely affecting our business operations, customer trust, and reputation.

    Could Netcup urgently investigate the underlying storage infrastructure, check for host-level I/O problems, and consider migrating this server to another host node if necessary?

    I would appreciate an urgent response or escalation, as this situation has become unacceptable for production hosting.

    Thank you.

  • the same thing happens to me

    Code
     wget -qO- yabs.sh | bash                                                                                                                          # ## ## ## ## ## ## ## ## ## ## ## ## ## ## ## ## ## #                                                                                                                         #              Yet-Another-Bench-Script              #                                                                                                                         #                     v2026-10-07                    #                                                                                                                         # https://github.com/masonr/yet-another-bench-script #                                                                                                                         # ## ## ## ## ## ## ## ## ## ## ## ## ## ## ## ## ## #                                                                                                                                                                                                                                                                                                        Sat Oct 10 10:36:00 PM AST 2026                                                                                                                                                                                                                                                                                                                               Basic System Information:                                                                                                                                                      ---------------------------------                                                                                                                                              Uptime     : 0 days, 13 hours, 6 minutes                                                                                                                                       Processor  : AMD EPYC 9645 96-Core Processor                                                                                                                                   CPU cores  : 12 @ 2296.548 MHz                                                                                                                                                 AES-NI     : ✔ Enabled                                                                                                                                                         VM-x/AMD-V : ❌ Disabled                                                                                                                                                       RAM        : 31.3 GiB                                                                                                                                                          Swap       : 0.0 KiB                                                                                                                                                           Disk       : 1007.8 GiB                                                                                                                                                        Distro     : Ubuntu 24.04.5 LTS                                                                                                                                                Kernel     : 6.8.0-146-generic                                                                                                                                                 VM Type    : KVM                                                                                                                                                               IPv4/IPv6  : ✔ Online / ✔ Online                                                                                                                                                                                                                                                                                                                              IPv6 Network Information:                                                                                                                                                      ---------------------------------                                                                                                                                              ISP        : netcup GmbH                                                                                                                                                       ASN        : AS197540 netcup GmbH                                                                                                                                              Host       : NETCUP-GMBH                                                                                                                                                       Location   : Nuremberg, Bavaria (BY)                                                                                                                                           Country    : Germany                                                                                                                                                                                                                                                                                                                                          fio Disk Speed Tests (Mixed R/W 50/50) (Partition /dev/vda3):                                                                                                                  ---------------------------------                                                                                                                                              Block Size | 4k            (IOPS) | 64k           (IOPS)                                                                                                                         ------   | ---            ----  | ----           ----                                                                                                                        Read       | 380.92 KB/s     (93) | 932.86 KB/s     (14)                                                                                                                       Write      | 401.40 KB/s     (98) | 1.00 MB/s       (15)                                                                                                                       Total      | 782.33 KB/s    (191) | 1.93 MB/s       (29)                                                                                                                                  |                      |                                                                                                                                            Block Size | 512k          (IOPS) | 1m            (IOPS)                                                                                                                         ------   | ---            ----  | ----           ----                                                                                                                        Read       | 973.82 KB/s      (1) | 985.08 KB/s      (0)                                                                                                                       Write      | 1.03 MB/s        (1) | 1.04 MB/s        (1)                                                                                                                       Total      | 2.01 MB/s        (2) | 2.03 MB/s        (1)                                                                                                                                                                                                                                                                                                                                                                                                                                                
  • Same.

    Cant create any backups. Once the load of the server climb past the 4, the disk i/o simply stalls. The ony resolution is to reboot the server.
    I have submitted a ticket on friday, without any confirmation:

    Ticket:
    - The stall only occurs under sustained disk I/O load (e.g. our backup job). With backups disabled, the server has been stable since the last reset (09-10 22:27), and /sys/block/vda/inflight stays at 0 0.
    - The issue is reproducible: as soon as moderate sustained I/O starts, throughput drops to zero within minutes and write requests remain stuck in flight ("0 2" at 22:05 on 09-10).
    - This server ran the exact same workload, including the same nightly backup, for 6 months without any problems. Nothing has changed on our side.

    This strongly points to an issue with the host or storage backend.

    At the moment we cannot run backups on this server, so this is urgent.

  • This forum is a "Customer helping Customer" forum mainly. So you won't find any support staff here especially on not business hours. Use the emergency hotline: https://www.netcup.com/de/helpcenter/support

    Falls nicht, erreichen Sie einen unserer Techniker außerhalb der regulären Hotline-Zeiten (17:00 – 09:00 Uhr - Europa/Berlin) direkt unter folgender Telefonnummer: +49 721 754 0 755 5

    ~ RS4000 9.5G ; VPS 200 G10s ; 1 x ; VPS nano G11s ;
    ~ 3x R640 (32 Cores, 192 GIB, 12 TiB Storage)