C
C
centur2010-12-06 18:04:24
CVS
centur, 2010-12-06 18:04:24

How to organize synchronization of very different data?

What you want:
Have automatic / semi-automatic file synchronization with the following characteristics:

  • Synchronization is both automatic (via the Internet) and manually (via a flash drive) \ semi-automatically (via LAN).
  • A copy of part of the data is stored in the Internet storage (free, at least 3 gigs), the full copy is stored on a flash drive (16 gigs).
  • Synchronized directories can be located in any place (except for nesting into each other).
  • Good work with directories containing projects under SVN and Mercurial.
  • 3-4 machines with different synchronization capabilities - a machine with anlim Internet, with expensive Internet (i.e., large volumes are preferable through a USB flash drive), a laptop that is on the same network as the first one. In some cases, not all folders are needed on every machine.
  • Enough only under Win
  • It would be ideal if we could synchronize the history of SVN and Hg
  • If somewhere something breaks or is updated incorrectly, you can roll back from the working / backup flash drive by saying forcibly - “when comparing such a directory, the files on the flash drive have priority.”

What is now:
Synchronization through 2 utilities: LiveMesh and SyncToy
LiveMesh can - synchronization via Internet storage (5 gigs) and via LAN \ wifi (no restrictions). Everything is more or less automatic.
What makes it bad - conflicts are removed to the basket, variations are not given. Works poorly with SVN (breaks the repository), HG + SVN is even scary to try. Synchronization only in its entirety, not diffs, i.e. traffic eats strongly.
SyncToy: Manual railcar - we set all directories by hand, synchronization is started by hand.
What does badly - not the most thoughtful deletion algorithm - before deleting a directory - will delete individually each file in it. Filters to ignore are configured by an individual absolute path and there is no mask. Breaks SVN. A lot of files cause a stupor or crash (apparently either memory is leaking or suboptimal use - everything is clogged)
Tried dropbox - little space on the Internet (free), storage in only one directory (MyDropbox), does not know how to network (from goodies - history as SVN ).
I considered the issue with RSync, I didn’t like that I had to write a lot of things manually.
There are strong doubts that all this will work well with SVN\Hg with such stupid synchronization.
I studied the issue of mercurial <-> Svn a little - the console instead of automatic gui is not yet satisfied and there is too much manual work for writing batches (maybe I'm not aware and there are already normal solutions?).
Actually the question:
Can anyone advise a complete or partial replacement of this circuit. or at least a normal working circuit with snv \ hg synchronization, without an abundance of manual work.
I’m even ready to do a separate file synchronization (here SyncToy works quite normally) and project synchronization (commit to 2 different systems, a copy on the internet (bitbucket) on a flash drive) to spread.

Answer the question

In order to leave comments, you need to log in

3 answer(s)
A
Alexey Varfolomeev, 2010-12-06
@jellyfish

1) for files I would use rsync
2) for mercurial - mercurial itself. it also works with svn repositories via the hgsubversion extension (included but not included by default

R
rPman, 2010-12-06
@rPman

The task is described too chaotically, but I have been trying to implement something similar for a long time in full for myself.
1. If it is possible to clearly allocate a centralized storage that is always available (more precisely, before and immediately after any changes on any 'nodes' / places / computers), for example, a flash drive or a server on the network, then it is enough to use rsync or applications based on it (for example rdiffbackup is the most traffic-efficient directory synchronization tool.
You can also use more obscure tools like tar --incremental or diff/patch if it's just about creating offline patches.
2. if there is no clear repository, then I did not find ready-made tools, but almost always in a particular case the task can be reduced to the first option.
In general, I’m slowly developing something monstrous and cool in my spare time, perhaps it will be a set of tools for several platforms at once (pc / mobile), at least I’m tired of waiting for this from dropbox and analogues.

A
Alexander Lozovyuk, 2010-12-07
@aleks_raiden

Dropbox knows how to LAN, there is even such an option in the settings. And it's quite cheap.

Didn't find what you were looking for?

Ask your question

Ask a Question

731 491 924 answers to any question