Upload using cURL

Hi everyone,

I’m currently re-uploading a snapshot using the example pre-signed URL provided by Netcup. However, the transfer from within my VPS/server is quite slow, and it looks like it will take hours to complete.

I’ve been using curl -T <file> <URL> for the upload. If anyone has experience with faster methods or alternatives for transferring large snapshot files within Netcup’s infrastructure, I’d really appreciate some guidance.

Thanks in advance for your help!

Quote from aRaphael

What format has the image?

snapshot5.raw.zst

Quote from aRaphael

As far as i know, you can technically upload .zst compressed images, but you can't reinstall them to your server.

You need raw or qcow2 Images

Thats odd, because the download is a zst-Image, but you can not restore the same image.

(unless they have changed this in the meantime)

right but i can unzstd and then move to upload raw. transferring around 128gb unzstd file for each server takes a lot of time.

Quote from aRaphael

qemu-img convert -p -f raw -O qcow2 image.raw image.qcow2

Thanks a bunch! Just in case it doesn’t work with the .raw.zst format?

Quote from aRaphael

Perhaps you can unpack .zst and convert to qcow in one step, but I don't know how, cause I never tried.

Thanks!

Quote from aRaphael

Perhaps you can unpack .zst and convert to qcow in one step, but I don't know how, cause I never tried.

It works great! I also recovered with qcow2. However, it took almost 13 hours to complete. Isn’t Rclone, Rsync, or SCP possible so that I can transfer Speedy to the S3 signed URL?

Quote from aRaphael

Thats weird and not the normal behaviour. My last snapshot-upload (qcow2) was done in about 15 minutes. (Upload from a RS with 2.5 GBis/s bandwith)

Am using interservers as a backup machine (as a external network (—aside storage for emergency protection). it might be taking a lot of time .. i think so this slow speed won't be running for so long with me. it is much much slower then expected.