Python Forum
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
file transfer
#1
Hi,
My business is converting legacy files,lists,databases,images,pdfs,cards... etc.
into a format that can be searched by (genalogy) enthousiasts.
In doing this I create a lot of small files that need to be transferred to the server. (millions)
We are talking win 10/11 environment.
It is becoming a bottleneck, even using robocopy (in windows command mode)
My transfer speed is +/- 30.000-50.000 files /hour.
Note: the files are mostly very small like 25 kb. (small png images)
Any suggestions to speed up the process, given that I cannot change the hardware config.?
thx,
Paul
It is more important to do the right thing, than to do the thing right.(P.Drucker)
Better is the enemy of good. (Montesquieu) = French version for 'kiss'.
Reply


Messages In This Thread
file transfer - by DPaul - Feb-15-2024, 08:55 AM
RE: file transfer - by DeaD_EyE - Feb-15-2024, 10:55 AM
RE: file transfer - by Gribouillis - Feb-15-2024, 11:01 AM
RE: file transfer - by DPaul - Feb-15-2024, 06:24 PM
RE: file transfer - by Gribouillis - Feb-15-2024, 08:28 PM
RE: file transfer - by DPaul - Feb-16-2024, 07:01 AM
RE: file transfer - by DPaul - Feb-16-2024, 07:48 AM
RE: file transfer - by buran - Feb-18-2024, 06:42 AM
RE: file transfer - by DPaul - Feb-18-2024, 07:10 AM
RE: file transfer - by buran - Feb-18-2024, 07:53 AM
RE: file transfer - by DPaul - Feb-18-2024, 03:55 PM

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020