file transfer

[DeaD_EyE]

My first idea was to put everything in a database to get a single big file. But this will add overhead.

You could make on both sides a database only with metadata like path, mtime, size and hash. Before you transfer files, you update the database and after it, you transfer only the changed and new files. On the other side, you must delete files, which are removed from the source.