1

start rsync download before upload completes

view story
linux-howto

http://unix.stackexchange.com – I'm uploading a file via rsync from my local machine to a server so that a colleague can download it to his machine. Normally I would notify him to start downloading when the upload is complete, but is there some combination of commands that would allow him to begin downloading while I am still uploading, and then resume after my upload is finished to get the complete file? I'd like to do this for individual files and for directories if possible. (HowTos)

Danial's picture
Submitted by Danial on 09/10/2012

Stories similar to start rsync download before upload completes

I have a script which will upload files from a specific directory (with rsync) to the server, but in the mean time another script will pull files from the server (also with rsync and with the --delete flag).

This means, that when I add a lot of files to it and rsync is in the process of uploading files and the download script is also being run, some files (which are not yet uploaded to the server

I have a Red Hat Enterprise Linux 6 (with SELinux) which shows significant differences of speed between download and upload (the latter significantly slower) of files shared over the LAN.

The bottleneck seems to be the output of the linux machine since I have a rate around 1Mb/s

when WinXP machines download files shared (using samba) by the RHEL machine uploading files from the RHEL to a WinXP'

I am using Windows 2008 R2 with IIS 7.5, the webpage loads very slowly around 5-10 second to open.

User can upload file on my website, after it finished uploading (file around 300MB), my server will create a new thread and using that thread to upload the file to another server.

When using filezilla I can upload and download files quicker than using FTP with Nautilus but since Nautilus helps me a lot I am looking for a configuration option or options that I can use to tweak and tune how the FTP in Nautilus behaves. For example while downloading from an external server to my PC, the max download speed is somehow capped in 5KB/Sec.

Be gentle, I'm new to chef, trying to get my environment set up and have some new recipes to upload to my new chef server. I'm able to do some commands, and I was able to knife bootstrap the new node, so I'm pretty sure my configuration is correct.

It appears that it's trying to upload to localhost when I turn on verbose logging.

Upload of file failed 30 weeks 15 hours ago

Hi,

I have been trying to upload either JPG or PNG to a post but when I was uploading the JPG I keep getting Upload of file failed, no explanation as to why.

When I try and upload a PNG, I get The Dimension limits for this filetype are 750 x 750. We were unable to resize your file so you will need to do so manually and upload it again. Your file is currently 720 x 1280.

I have recently developed an iPhone application which involves media (Images, Audio and video) sync. operation with my web server.

I need to upload file on a specific interface. This cannot be set-up via iptables, because my script output on several interfaces.

this is working fine :

scp -oBindAddress=192.168.100.1 ...

but

rsync --address=192.168.100.1

is still sending on eth0 (192.168.10.1)

how could I force rsync to use 192.168.100.1 ?

any idea ?

I had the google drive sdk quick start for android up and running.

What I am trying to do is to expand the application to be able to upload a file on the drive new 'App Data' folder and be able to download this file back again (Sync config files between android devies)

Uploading a file works fine.