Max's Cool Beans
Comment
Max the Magnificent
Hmmm -- call me "Mr. Suspicious" if you will, but why does this seem like an ...
barneydurant
Dropbox – the best way to backup and synchronize your data
Clive Maxfield
3/2/2011 4:17 PM EST
In an earlier blog, following my computer crashing, I asked What is the best way to backup and secure the data on my computer? A lot of folks responded and you really should check out the comments associated with that blog. One reader responded to me directly with regard to my mention of Carbonite; his response was as follows:
I share your pain. Last year my Dell XP laptop with all my business data on it had a hard drive failure. Thank God for Carbonite. I requisitioned my wife’s HP Vista laptop, restored all my files from Carbonite onto her machine, and continued on. Dell supplied me with a replacement hard drive for the XP machine since I had an extended warranty with them, I reloaded XP, downloaded all the updates, transferred all the wife’s files to the new hard drive, and kept the Vista laptop for my business use. I am writing you from that machine now. I found Carbonite’s restore process easy to understand and use. I now use it for both computers. Regards, Richard
Well, it's good to hear that Carbonite does work. Anyway, I’ve explored a variety of solutions and made my decisions, and – on the basis that everyone has their own unique requirements – I think some of the alternatives I considered may be of interest to you.
The way I was doing things
Before we leap into the fray, let’s remind ourselves as to the way I was doing things, which was to have a 1 terabyte external USB hard drive sitting on my desk. At the end of each day, I took a backup of my working data files (about 1.2 gigabytes) by simply copying them over to the external drive.
The problem with this strategy became apparent when my computer crashed. At that time I was using a Windows 7 notebook computer and carrying it back and forth between my home and my office. The thing was that I’d been working at home for a few days and I didn’t have my external drive with me so I hadn’t been taking backups. I nearly lost all of my data. It was a close thing. I was not wearing my happy face.
Two (or more) computers
One thing I have to do is to protect myself against a catastrophic loss of my main notepad computer. For example, suppose I left it in my office overnight and there was a fire (which would also take out my backup drive, now that I come to think about it). That would not be good news. The solution here is to keep my notepad for use at home and while I’m on the road, and to get a second system for use in the office.
Since I won’t be carrying it around with me, the system in my office can be an affordable tower computer. You wouldn’t believe the deals that are out there. For only about $350 I ended up ordering something of a beast, which is winging its way to me as I pen these words. This is refurbished Xeon-based machine with 4GB RAM (a friend has a couple of extra memory sticks that match this machine, so I’m going to boost the memory up to 8GB), a 500GB hard drive, all the usual “stuff” like DVD, Sound, Ethernet, etc., along with a mega-powerful dual DVI video card. (Actually, my plan is to end up with three displays in my office – I’ll be writing more about this later – so I also purchased an identical refurbished video card from eBay for around $35.)
The next thing is to secure my data. In addition to backing it up, I also need some way to ensure that everything is synchronized between my home and work computers such that they always have identical copies of my data files.
Just to remind ourselves, in my case we’re talking about my working data – ongoing projects and “stuff” I like to keep around because it’s useful – so we’re only talking about 1.2 gigabytes (my bulk data is backed up on DVDs and I have copies at work and at home).
A rugged external hard drive
My first idea was not particularly elegant, but it was simple (I like simple). The first step was to purchase a rugged external drive. I had thought about a rugged solid state drive (SSD), but these are incredibly expensive. Also I’ve heard from folks in the know that they’ve seen almost as many problems with SSDs as they have with regular hard drives.
One regular hard drive that looked quite tasty was the LaCie Rugged All-Terrain Drive as shown below, the 320 GB version of which is available from Amazon for around $90 (actually, you can get a USB-only version for around $70 from some stores).
My original plan was at the end of each day to simply copy all of my working data from my office machine to the external drive, to bring the external drive home with me, and to then copy the data from the drive onto my notepad computer. Similarly, if I did any work at home, I would reverse the process.
One problem here is that it actually takes quite a few minutes to copy 1.2GB of data. Another issue is that it involves me doing all of the work … how long would it be before I said “not tonight” (soon to be followed, undoubtedly, by another system crash).
Zinstall and zPOD
Another very interesting option would be the Zinstall and zPOD applications from Zinstall (www.zinstall.com). The idea is that you use Zinstall to create a virtual machine (VM) that includes all of your data, along with your operating system and application software, and you use zPOD to install this virtual machine on your external drive (HDD, SSD, or even a large USB memory stick).
This has a number of advantages, including the fact that you can literally “Put your Windows 7 machine in your pocket." That is, you can connect the external drive containing your virtual machine into any computer and instantly be “at home” with your own files, applications, preferences, settings and so forth.
You can also connect to your office's Exchange Server and work exactly the same way as on your home PC/Office PC – no installations or network settings changes are needed.
Most importantly (for me), zPOD also synchronizes itself with your base computer each and every time you plug it in. The end result is that zPOD is actually backup copy on VM, but not just backup, it’s a live backup, which is "bootable" and "workable" from everywhere.
Synchronization software
Returning to my original idea of manually copying all of my working data onto my external drive every day, this would obviously be horribly inefficient, because – in reality – only a relatively small number of files would actually change each day.
Thus, my next thought was to track down some software application that would automatically synchronize the data on my computer with the data on the external drive. Assuming I had this software, what I would like would be that when I first plug the drive into the computer, the software should automatically go through a certain folder or folders (I want to be able to specify which ones) on my computer and corresponding folders on the external drive comparing them.
If the software discovers new folders or files on the computer that don’t exist on the external drive it should replicate them on the external drive, and vice versa. Also, if the software discovers a later version of an existing file on the computer it should copy that version over to the external drive, and vice versa.
Similarly, upon returning home, I would perform an identical synchronization operation between the external drive and my home computer.
While bouncing around the Internet, I ran across a really good product comparison of different Synchronization Software packages on the Top Ten Reviews website. One problem was that all of the ones I looked at would only run on start up and then when you told them to … that is, they wouldn’t backup any files as you created or modified them.
According to this review, two of the best packages are Syncables 360 (www.syncables.com) and GoodSync (www.goodsync.com). Although I eventually decided that they are not for me, I absolutely believe that these synchronization utilities will work really well for some users’ requirements – especially for those who are working with humongous amounts of data. The Syncables 360 application, for example, can even synchronize your email across Windows, MAC, and other systems.
Dropbox is my new best friend
Fortunately, I was introduced to something called Dropbox (www.dropbox.com). This is absolutely fantastic, and it’s also FREE so long as you have less than 2GB of data to worry about (there’s a small monthly cost for up to 50GB and a larger cost for up to 100GB, but as I mentioned at the beginning of this piece, I’m primarily worried about maintaining the integrity of my working data, which is only around 1.2GB).
So how does this work? Well, first of all you click the Download button on the Dropbox website and download and install the small Dropbox application. This creates a special Dropbox folder on your system (I told it to put this folder under my existing My Documents folder) as illustrated in the screenshot below:
As you can see, the Dropbox folder icon looks like a regular folder icon except for a small green circle with a tick-mark in the bottom left-hand corner. Next, you drag-and-drop any of your existing files and folders that you wish to backup into your Dropbox folder. At this point, the green circle on the folder icon turns blue, which indicates that the Dropbox application is copying your files into “The Cloud,” by which I mean extremely secure servers. As part of this, all of your data is encrypted using the AES-256 standard.
This is where things start to get really cool and exciting. Whenever you edit a file and save it, that file is immediately backed up into the cloud. But wait, there’s more, because you can now go to another system and install the Dropbox application on that machine. This time, instead of saying you are a new user, you say that you are an existing user and give your username and password. What happens now is that Dropbox synchronizes the Dropbox folder on this new machine with your Dropbox folder in the cloud, so all of the files you saved from your other machine are now replicated on this new machine. And, of course, if you create any files in the Dropbox folder on this new machine, a copy is automatically pushed up into the cloud to eventually be synchronized with your other machine(s).
You can do this for as many machines as you wish. The end result is that you have a Dropbox folder on each of your computers (for me this involves my tower at work [as soon as it arrives] and my notepad at home and also my spare notebook in case of emergencies) – along with a Dropbox folder in The Cloud – and all of these folders are automatically synchronized together.
You have no idea how easy to use this is until you try it (and there’s much more to this application than I’ve discussed here, such as the ability to right-click on a file in your Dropbox folder and immediately share the version in the cloud with selected friends and colleagues without having to FTP it or email it or anything).
For me, Dropbox has proved to be a perfect solution. As soon as I create a new file or modify an existing file, that file is immediately backed up into the cloud. And the fact that my data files are automatically synchronized across all of my machines is worth its weight in gold!
I share your pain. Last year my Dell XP laptop with all my business data on it had a hard drive failure. Thank God for Carbonite. I requisitioned my wife’s HP Vista laptop, restored all my files from Carbonite onto her machine, and continued on. Dell supplied me with a replacement hard drive for the XP machine since I had an extended warranty with them, I reloaded XP, downloaded all the updates, transferred all the wife’s files to the new hard drive, and kept the Vista laptop for my business use. I am writing you from that machine now. I found Carbonite’s restore process easy to understand and use. I now use it for both computers. Regards, Richard
Well, it's good to hear that Carbonite does work. Anyway, I’ve explored a variety of solutions and made my decisions, and – on the basis that everyone has their own unique requirements – I think some of the alternatives I considered may be of interest to you.
The way I was doing things
Before we leap into the fray, let’s remind ourselves as to the way I was doing things, which was to have a 1 terabyte external USB hard drive sitting on my desk. At the end of each day, I took a backup of my working data files (about 1.2 gigabytes) by simply copying them over to the external drive.
The problem with this strategy became apparent when my computer crashed. At that time I was using a Windows 7 notebook computer and carrying it back and forth between my home and my office. The thing was that I’d been working at home for a few days and I didn’t have my external drive with me so I hadn’t been taking backups. I nearly lost all of my data. It was a close thing. I was not wearing my happy face.
Two (or more) computers
One thing I have to do is to protect myself against a catastrophic loss of my main notepad computer. For example, suppose I left it in my office overnight and there was a fire (which would also take out my backup drive, now that I come to think about it). That would not be good news. The solution here is to keep my notepad for use at home and while I’m on the road, and to get a second system for use in the office.
Since I won’t be carrying it around with me, the system in my office can be an affordable tower computer. You wouldn’t believe the deals that are out there. For only about $350 I ended up ordering something of a beast, which is winging its way to me as I pen these words. This is refurbished Xeon-based machine with 4GB RAM (a friend has a couple of extra memory sticks that match this machine, so I’m going to boost the memory up to 8GB), a 500GB hard drive, all the usual “stuff” like DVD, Sound, Ethernet, etc., along with a mega-powerful dual DVI video card. (Actually, my plan is to end up with three displays in my office – I’ll be writing more about this later – so I also purchased an identical refurbished video card from eBay for around $35.)
The next thing is to secure my data. In addition to backing it up, I also need some way to ensure that everything is synchronized between my home and work computers such that they always have identical copies of my data files.
Just to remind ourselves, in my case we’re talking about my working data – ongoing projects and “stuff” I like to keep around because it’s useful – so we’re only talking about 1.2 gigabytes (my bulk data is backed up on DVDs and I have copies at work and at home).
A rugged external hard drive
My first idea was not particularly elegant, but it was simple (I like simple). The first step was to purchase a rugged external drive. I had thought about a rugged solid state drive (SSD), but these are incredibly expensive. Also I’ve heard from folks in the know that they’ve seen almost as many problems with SSDs as they have with regular hard drives.
One regular hard drive that looked quite tasty was the LaCie Rugged All-Terrain Drive as shown below, the 320 GB version of which is available from Amazon for around $90 (actually, you can get a USB-only version for around $70 from some stores).
My original plan was at the end of each day to simply copy all of my working data from my office machine to the external drive, to bring the external drive home with me, and to then copy the data from the drive onto my notepad computer. Similarly, if I did any work at home, I would reverse the process.
One problem here is that it actually takes quite a few minutes to copy 1.2GB of data. Another issue is that it involves me doing all of the work … how long would it be before I said “not tonight” (soon to be followed, undoubtedly, by another system crash).
Zinstall and zPOD
Another very interesting option would be the Zinstall and zPOD applications from Zinstall (www.zinstall.com). The idea is that you use Zinstall to create a virtual machine (VM) that includes all of your data, along with your operating system and application software, and you use zPOD to install this virtual machine on your external drive (HDD, SSD, or even a large USB memory stick).
This has a number of advantages, including the fact that you can literally “Put your Windows 7 machine in your pocket." That is, you can connect the external drive containing your virtual machine into any computer and instantly be “at home” with your own files, applications, preferences, settings and so forth.
You can also connect to your office's Exchange Server and work exactly the same way as on your home PC/Office PC – no installations or network settings changes are needed.
Most importantly (for me), zPOD also synchronizes itself with your base computer each and every time you plug it in. The end result is that zPOD is actually backup copy on VM, but not just backup, it’s a live backup, which is "bootable" and "workable" from everywhere.
Synchronization software
Returning to my original idea of manually copying all of my working data onto my external drive every day, this would obviously be horribly inefficient, because – in reality – only a relatively small number of files would actually change each day.
Thus, my next thought was to track down some software application that would automatically synchronize the data on my computer with the data on the external drive. Assuming I had this software, what I would like would be that when I first plug the drive into the computer, the software should automatically go through a certain folder or folders (I want to be able to specify which ones) on my computer and corresponding folders on the external drive comparing them.
If the software discovers new folders or files on the computer that don’t exist on the external drive it should replicate them on the external drive, and vice versa. Also, if the software discovers a later version of an existing file on the computer it should copy that version over to the external drive, and vice versa.
Similarly, upon returning home, I would perform an identical synchronization operation between the external drive and my home computer.
While bouncing around the Internet, I ran across a really good product comparison of different Synchronization Software packages on the Top Ten Reviews website. One problem was that all of the ones I looked at would only run on start up and then when you told them to … that is, they wouldn’t backup any files as you created or modified them.
According to this review, two of the best packages are Syncables 360 (www.syncables.com) and GoodSync (www.goodsync.com). Although I eventually decided that they are not for me, I absolutely believe that these synchronization utilities will work really well for some users’ requirements – especially for those who are working with humongous amounts of data. The Syncables 360 application, for example, can even synchronize your email across Windows, MAC, and other systems.
Dropbox is my new best friend
Fortunately, I was introduced to something called Dropbox (www.dropbox.com). This is absolutely fantastic, and it’s also FREE so long as you have less than 2GB of data to worry about (there’s a small monthly cost for up to 50GB and a larger cost for up to 100GB, but as I mentioned at the beginning of this piece, I’m primarily worried about maintaining the integrity of my working data, which is only around 1.2GB).
So how does this work? Well, first of all you click the Download button on the Dropbox website and download and install the small Dropbox application. This creates a special Dropbox folder on your system (I told it to put this folder under my existing My Documents folder) as illustrated in the screenshot below:
As you can see, the Dropbox folder icon looks like a regular folder icon except for a small green circle with a tick-mark in the bottom left-hand corner. Next, you drag-and-drop any of your existing files and folders that you wish to backup into your Dropbox folder. At this point, the green circle on the folder icon turns blue, which indicates that the Dropbox application is copying your files into “The Cloud,” by which I mean extremely secure servers. As part of this, all of your data is encrypted using the AES-256 standard.
This is where things start to get really cool and exciting. Whenever you edit a file and save it, that file is immediately backed up into the cloud. But wait, there’s more, because you can now go to another system and install the Dropbox application on that machine. This time, instead of saying you are a new user, you say that you are an existing user and give your username and password. What happens now is that Dropbox synchronizes the Dropbox folder on this new machine with your Dropbox folder in the cloud, so all of the files you saved from your other machine are now replicated on this new machine. And, of course, if you create any files in the Dropbox folder on this new machine, a copy is automatically pushed up into the cloud to eventually be synchronized with your other machine(s).
You can do this for as many machines as you wish. The end result is that you have a Dropbox folder on each of your computers (for me this involves my tower at work [as soon as it arrives] and my notepad at home and also my spare notebook in case of emergencies) – along with a Dropbox folder in The Cloud – and all of these folders are automatically synchronized together.
You have no idea how easy to use this is until you try it (and there’s much more to this application than I’ve discussed here, such as the ability to right-click on a file in your Dropbox folder and immediately share the version in the cloud with selected friends and colleagues without having to FTP it or email it or anything).
For me, Dropbox has proved to be a perfect solution. As soon as I create a new file or modify an existing file, that file is immediately backed up into the cloud. And the fact that my data files are automatically synchronized across all of my machines is worth its weight in gold!
Navigate to related information


Max the Magnificent
3/2/2011 4:36 PM EST
If you are aware of any other interesting tools and techniques pertaining to data backup and synchronization across multiple computers, please add a comment here to let other folks know about them.
Sign in to Reply
Lethean
3/3/2011 5:11 PM EST
A nice bonus to using Dropbox is that they provide clients for mobile devices (iPhone, iPad, Android and BlackBerry). It turns out that this is one of the fastest ways to transfer a file to your smart phone from your computer (and back). It's as convenient as emailing it to yourself, but without the drawbacks (binary file filters, multiple copies hanging around in your account, etc.).
Sign in to Reply
hm
3/2/2011 5:36 PM EST
I use Dropbox since few months. This was imposed on me so all my work data is available to head office for review. I like it but I am afraid of data security.
Sign in to Reply
Max the Magnificent
3/2/2011 5:51 PM EST
They talk about data security on their site. The data is actually stored on Amazon's servers, and you don't get much more secure than that (they even have armed guards). Plus everything is military-grade encrypted...
Sign in to Reply
hm
3/2/2011 5:41 PM EST
CM, Have you experimented with Jing from TechSmith for taking picture and short video of what you see on your monitor? This is also good utility.
Sign in to Reply
Max the Magnificent
3/2/2011 5:51 PM EST
I'd never even heard of it -- I will take a look as soon as I get a free moment -- thanks for the "heads up"
Sign in to Reply
Robotics Developer
3/2/2011 7:25 PM EST
What a great (free) way to protect important files as it is both simple and reasonable. I wonder if there would be any issues with firewalls (at work)? Currently, I backup even week to another on-site machine (server) and also at home onto an external 1TB USB drive. The only drawbacks are the time. Thanks for the pointer to this service!
Sign in to Reply
Max the Magnificent
3/2/2011 7:44 PM EST
I've been using this service for the last week or so and I have to say that I am tremendously impressed -- I only wish I'd thought of something like this myself.
Sign in to Reply
Muz
3/3/2011 3:37 AM EST
As a (former) Dropbox user I'd like to recommend SugarSync as an alternative way to backup and sync your data in the cloud. Free accounts provide 5GB of disk space and you can choose which folders to sync in your hard drive, not only one single dropbox.
If anyone wants to register for an account, feel free to use my referral link that will add 500 MB further bonus to both mine and your account :)
https://www.sugarsync.com/referral?rf=do5qm2rpjareh
Thanks!
Sign in to Reply
Max the Magnificent
3/3/2011 9:57 AM EST
What amazes me is that all of this stuff is out there and I'd never heard about any of it. I'd love to see a comparison between SugarSync and Dropbox (maybe I'll have to write one :-)
Sign in to Reply
phoenixdave
3/3/2011 10:54 AM EST
Thanks for the information Max. I too have been looking for something for similar reasons, but based upon bad experiences in the past had pretty much put it on the back burner. I will be downloading Dropbox as soon as possible!
Sign in to Reply
Max the Magnificent
3/3/2011 11:03 AM EST
Hi Dave -- I personally am delighted with Dropbox -- someone else (see comments above) recommended SugarSync, but I don't know about that. I might try downloading it onto another machine to see how easy it is to use, but not today because I'm up to my ears in alligators fighting fires without a paddle (if you see what I mean)
Sign in to Reply
hm
3/4/2011 5:47 AM EST
I have query about Dropbox. I share my desktop with my wife. But I do not want to share my Dropbox with her. Can we have two Dropboxes, one for me and one for my wife, on one PC?
Sign in to Reply
Max the Magnificent
3/4/2011 11:28 AM EST
I don't know, but if you visit the Dropbox site they have a good forum with questions and answers. Another thought would be if you had two user accounts on your system -- one for you and one for your wife, then I would think that you could each have your own Dropbox accounts/folders in your personal accounts.
Sign in to Reply
hm
3/4/2011 5:52 AM EST
Dropbox Public Folder:
I wanted to share 14 pictures in public folder. However, Dropbox do not allow to share folder or subfolder in public folder. For each file/picture we have to have seprate link sent. This is not friendly. Is there better way to share mutliple pictures in public folder with only one link and slideshow, like it is done with other utilities?
Should Dropbox enhance this feature?
Sign in to Reply
Max the Magnificent
3/4/2011 11:30 AM EST
For myself I'm more interested in sharing single big project files, so I hadn't run into this -- again it's probably a question for you to pose in the forums/support section of the Dropbox site.
Sign in to Reply
Max the Magnificent
3/12/2011 4:18 PM EST
I haven't tried SugarSync, which someone said they prefer to Dropbox -- has anyone else used SugarSync? If so, how would you compare it to Dropbox and what has been your user experience.
Sign in to Reply
DLH
3/30/2011 7:18 PM EDT
How do you manage the amount of "stuff" in the cloud end? If you're only allowed 2G, and you keep copying stuff back and forth, won't it fill up, or are older files automagicly purged?
Dave
Sign in to Reply
Max the Magnificent
3/30/2011 8:08 PM EDT
My understanding is that they only keep previous versions of the same file for 1 month before automatically purging -- I also believe you can go up there and delete by hand.
I haven't had any problems so far -- but I have an advantage in that anytime someone joins from clicking on a link in my article I get another 250MB (as does the person joining) up to some limit like 10GB I think
Sign in to Reply
eewiz
4/15/2011 10:00 PM EDT
Yes . and if you have an edu email account, you can get 500 mb referral bonus for each referrals.
https://www.dropbox.com/edu
Sign in to Reply
barneydurant
6/23/2011 6:12 PM EDT
Did you hear about DropBox password bug?
After this fail i've started to use 4shared Sync instead of dropbox. Moreover, 4shared sync is more cheaper and provide a 15 gb space instead of 2gb of Dropbox app.
Sign in to Reply
Max the Magnificent
6/24/2011 9:52 AM EDT
Hmmm -- call me "Mr. Suspicious" if you will, but why does this seem like an advert from someone who works for "4shared sync"?
Can you give more details (like links to articles) on the "Password Bug" to which you refer?
In the meantime I will take a look at "4shared sync" (on whose servers do they store their data -- what form of encryption is used -- etc.)
Sign in to Reply