Page 2 of 2 FirstFirst 12
Results 11 to 12 of 12

Thread: Slow File transfer

  1. #11
    Join Date
    Apr 2016
    Location
    Melbourne
    Posts
    4,517
    Total Downloaded
    0
    OK, so if it can read at that speed, then it's not the SATA chip hardware or drivers at fault.

    ** I avoid any motherboard that uses JMicron or Marvel SATA hardware, of which there are many(coz they're a cheap way to add SATA ports).
    Basically rubbish, and usually cause that kind of slowdown for both red and writes. Sometimes drivers help, but cheap crappy hardware is still cheap crappy hardware.

    File sizes can affect transfer speeds.

    A note on the snapshot image of Crystal Disk Mark, the thread refers to disk D/:, whereas you've posted a snapshot of disk E/:
    Anyhow that E/: drive is fairly quick too.

    from the windows explorer transfer snapshot window tho, I'd say the issue is the 300K small files causing the slowdown.

    As a test, do you have any large(eg. video) files to transfer to see what kind of rate they move along at.
    Usually, a single large (eg.) 4.5Gig file will transfer at a quicker rate, than 300K 150kb files will do.

    I'm not an IT expert, but I remember it has to do with serial transferring or something like that(an expert will correct me on the terminology), where each file is transferred one at a time.

    FastCopy and RichCopy4(Hoffman Spotlight Utility) can do multiple file transfers at the same time, so smaller files are transferred concurrently. (maybe called parallel .. expert may correct me on this again)
    I don't remember if FreeFileSync can tho.

    If your curious:
    Try RichCopy4(which may also be known as Hoffman Spotlight Utility). it's actually a Microsoft file transfer addon tool from many years ago.
    It has the ability to set the number of concurrent file transfers at any one time.
    I used to use it for my Photo archive backups. Usually many large raw files, but also many small jpg files as well. it sped up, then slowed down, and sped up .. and on and on.
    if you have 300K files totalling 900Mb, I'd try it, get into the settings area and change to a concurrent transfer number of something like 20-50(I remember it depended on how much RAM you had available).

    After a bit more searching, for fast file transfers, with error checking and integrity checking, I found that FastCopy was faster, and simpler(to set up) too.

    So at this point, I'm just thinking that your issue is simply the vast number of small files, and Windows Explorer's inability to move them all quickly at the same time.
    It starts off quickly as it fills the buffer and or RAM, but then once those two temp spaces are filled, the real movement of data is slow.

    if it seems that I'm some kind of super geeky file transferring madman, it's because I am!
    I use each of those software(but not RichCopy any more) for different purposes.
    lets say I do photography, and I have one HDD for the images(A I take today. That drive holds images for the entire year.
    And I have one HDD for the images I've taken over the past 11years(B .. But also need a backup of that second drive of the 11year historical data(C.

    A is different to B, and B and C are basically the same.
    Everything on A goes to B, ie the new stuff goes to the main storage drive. the backup of the main storage(C) may not be exactly the same as B tho.
    Reason is, I may go back to B or C(doesn't matter) and unedit or re edit an old image.

    But A is always backed up to B no questions asked.
    So for that I use FastCopy. I don't care if files on A are already on B(which there will always be). FastCopy see those files on A that are already on B, so simply copies the new files only. Not only is it quick, it's also perfect for the primary backup(
    But I don't always want all files on B to be backed up again to C, as I unedited or reedited some files and want to maintain some differences(to refer back and forth to .. to see which I like best, etc).
    So to backup ( to (C) using FastCopy may update files I don't want it too .. so I use FFS. I see which are different, and if I want to make the change(usually not) so I filter those images using sync.

    FastCopy and RichCopy do the same thing basically in the same way. I think RichCopy is more advanced in some of the arcane tweaks it allows(most over my head) .. but it does show you how much faster you can get your transfers of small files with the ability to set a number of concurrent file transfers(FastCopy just does it).
    I reckon I've seen more than 10x speed increases for small files(eg,. jpgs and thousands of those annoying settings files for some edited images) .. but that setting is useless if you have very large files.
    I can't remember exactly, but I think I've set a maximum of about 20-30 files for concurrent transfer.

    ps. if that E drive called black, is a WD black, they're a very nice drive, I have the 2Tb version and it also flies(given it's engineering age!) .. faster than my 4Tb Red.

  2. #12
    Join Date
    Apr 2002
    Location
    Godwin Beach 4511
    Posts
    20,688
    Total Downloaded
    32.38 MB
    Try turning your av software off and see where speeds go...
    2007 Discovery 3 SE7 TDV6 2.7
    2012 SZ Territory TX 2.7 TDCi

    "Make the lie big, make it simple, keep saying it, and eventually they will believe it." -- a warning from Adolf Hitler
    "If you don't have a sense of humour, you probably don't have any sense at all!" -- a wise observation by someone else
    'If everyone colludes in believing that war is the norm, nobody will recognize the imperative of peace." -- Anne Deveson
    “What you leave behind is not what is engraved in stone monuments, but what is woven into the lives of others.” - Pericles
    "We can ignore reality, but we cannot ignore the consequences of ignoring reality.” – Ayn Rand
    "The happiness of your life depends upon the quality of your thoughts." Marcus Aurelius

Page 2 of 2 FirstFirst 12

Tags for this Thread

Bookmarks

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
Search AULRO.com ONLY!
Search All the Web!