Re: Over 24 hrs to perform a 10 gig back up?
philhu
Contributor - Level 2

What you are seeing is Windows overhead to create files.

Since it is so busy making new files, it slows it all down tremendously.

You need a client/server that will do multiple streams of network at the same time, so when process 1 stalls making a file, process 2 is still doing internet traffic, process 3, etc.

Upload/dl managers do this and the speed is greatly increased because multiple processes are hitting the bandwidth.

0 Likes
Re: Over 24 hrs to perform a 10 gig back up?
Techman28
Master - Level 1

dtmfman wrote:
I've done everything I can think of. Also use the verizon "optimize" tool...nothing seems to work. It appears to be throttling.
I can 10000000000000000% say its not throttling. We at verizon will never throttle your internet traffic
0 Likes
Re: Over 24 hrs to perform a 10 gig back up?
jefe
Newbie

I feel safe in saying the OP's problem is not a FIOS issue.  I've always seen the same problem downloading from my server, previously with a cable 30/5 connection and now with FIOS 20/5.

There are numerous issues at play here and they've all been mentioned in this thread.  But  here's what I've found when downloading (or uploading) lots of files to my web server.

I use ftp client SecureFX on a WinXP SP3 machine.  I've tried numerous other ftp clients with the same results.   When I download/upload a single file to my server I max out at ~170 KB/s.  But I can run another session of the ftp client and start another file transfer going simultaneously and get another 170 KB/s. And then another and another, until my upload or download pipe is saturated.

So what I do when I have a lot of files to move is run multiple sessions of SecureFX.   If I wanted to back up the entire drive on my server I'd start the first session going to transfer folders A through D.  Another session E-H.  Another J-L, and so on.  I'd run enough sessions that my download pipe (now 20 mb/s) is saturated.

Admittedly this is a PITA compared to just starting one transfer session and walking away. But assuming you're getting your full advertised download/upload speed from a speed test, this method will allow you to max out your connecton and dramatically reduce the amount of time a large transfer takes.  If nothing else, do it once to prove to yourself the problem isn't with Verizon.

0 Likes
Re: Over 24 hrs to perform a 10 gig back up?
CharlesH
Specialist - Level 1
Yeah, if you have remote desktop access, just zip up the directory and download. I know CMS's will create a zip for you aswell.
0 Likes
Re: Over 24 hrs to perform a 10 gig back up?
jefe
Newbie

The problem I see with creating one giant .zip file is you still only get the limit downloading that one ftp connection allows.  I my server that would be ~170 kB/s.  A 10 gig file would still take a loooong time to transfer.

But if creating a single .zip file is practical, then my next suggestion would be to use a file manager, like FlashGet, to download that single file.  Using FlashGet for a single big file also always saturates my download pipe. 

0 Likes
Re: Over 24 hrs to perform a 10 gig back up?
CharlesH
Specialist - Level 1
Couldnt you just http download the file?
0 Likes
Re: Over 24 hrs to perform a 10 gig back up?
cjacobs001
Contributor - Level 3

Good day:

I do not have 'the' answer here, as we all know that each situation can be 100% different -even when it seems all things are the same;  but I would like to mention that it never hurts to remember the basics (which I haven't seen mention of here).  The original poster mentions running the Verizon optimizer, but nothing about any improvements to his computer, or to the server (which I realize he may not have access to).     If the computer is Windows Vista, using the Verizon optimizer for your connectivity is a waste of time.  There is a windows fix for Vista to receive full benefit of fios.  Go to microsoftdotcom and search for "vista full benefit of fios".

I also like to use the tcpOptimizer at speedguidedotnet for everything under Vista, although most optimizers other than the Verizon optimizer do nothing for upload speeds.  Verizon optimizer does.

 What about the basics on the computer? What process are running?  What is your NIC's transfer settings\speed?  What settings are changeable on the program you are using to manage the transfer and what are the settings?  When that program 'comes on' does it change any thing on your computer for the time period it is running?

What about firewall and settings?

Are you using another computer in same house while you are trying to do this transfer?  What might it be doing to your bandwidth?

Have you tried running traceroute to see what may be happening between you and that server?

There are lots and lots and lots of possibilities.  What about the cabling in your house between the computer and the router, or from the router to the optical network terminal? For that matter, what is going on with your ONT?  Have you called tech support and had them test\reset?  have you done the hard reset to the router?  Which router are you using?  When was the last time you rebooted the computer you are using?

Just some basics.

0 Likes
Re: Over 24 hrs to perform a 10 gig back up?
cjacobs001
Contributor - Level 3
Oh, and all of the basics also need to be considered on the other end, at the server, too.
0 Likes
Re: Over 24 hrs to perform a 10 gig back up?
jefe
Newbie

I suggest a few simple steps will test whether the problem is in any of the basics, or something else limiting?

Does your connection show what it should on any of the reliable speed tests available?  If so.....

Start one file transfer from your server.  Note it's throughput.

Start a second and maybe a third and forth transfer simulanteously.  Does the throughput of each of those transfers equal that of the first one, until you've maxed out your connection?

That's how I determined that the limitation between my server and me isn't at the server's end, nor because of any tweaking/cpu/NIC/etc limiations on the PC I'm using.

I can always get my advertised max up or download speed from my web server, just not with a single connection.  (My server is in San Francisco, btw, and I'm in NY.)  Thus my original suspision is the OP's problem is not a Verizon issue.

I've been told that using an scp client in a command window may eliminate the single connection limitation.  I'll get around to trying that some time.  Until then...my work around does the trick here.

0 Likes