data storage

[da]

I appreciate reading about peoples' computer setups, even if they're not like mine. Occasionally I even comment. This time I'd like some advice.

I have a 700mhz PC running linux, which currently has a 200gb and a 320gb disk (*). I currently have about 160gb data. I'm probably not adding more than 50gb a year, at least as a guess.

I'd like to end up with a fileserver, since my laptop only has 100gb (**). I'm not mastering video or anything that needs top speeds; probably just serving music and video over ethernet or wifi b/g.

I want need some sort of built-in backup. rsync is an option, as is software raid. I like raid, it's super-easy. ...I could mount them both in the PC with software raid1 (limiting the raid size to 200gb). I would be happy with 200gb space for a while.

Or, I could buy another 320gb disk and mount the three disks raid5, with better redundency. Which is probably overkill.

Or, I could buy a non-pc-based enclosure, and turn off the PC, which would use less power. An openWRT router with USB hacked in would be ~$100 and sort of fun to put together. 5 watts instead of ~200. Then I could replace my ancient server with the 700mhz PC.

I don't like this answer because I've also been using the PC as linux development, stuff I don't want to expose on the public server. So that leans me back toward the current setup; slow server, faster dev box and file-server. (either off or idle a lot of the time).

Or, this might be the most elegent solution: put the PC in the closet and run virtual machines (vmware or xen). One vm would be a firewall/web-server/mail-host, with access to a smallish hardware partition. Another vm would be my file-server, using one of the above options, probably raid1.

My understanding is that IO, CPU, and disk are 95% as fast under modern virtualization. At lesat if I use dedicated disk partitions. This needs testing or verification by someone who's tried it.

With the vm answer, as a bonus, I don't need to mix the dev work on the file-server vm- I can clone and spawn new dev machines whenever I like. (er, which will chew lots of disk. Time for that terabyte?)

Thoughts?

(*) big thanks to bats22 who pointed out the absurdly cheap disk prices in a post last week. I had a disk failure yesterday (luckily, raid1) and I bought a new 320g disk for... $132 CAD including tax. Not too shabby, $0.41 a gb. Almost makes me happy the old drive died (though not really, since yesterday evening one of my tasks was swapping around disks and trying to find out why the server kept dying precipitously). I did my first-ever reiserfsck --rebuild-tree, which was only sort of scary. But it worked.

(**) Before this year did I ever expect I'd say "my laptop only has 100gb?" no I did not.

Comments

[catbear.livejournal.com]

In the basement we have last year's dell el-cheapo Pentium 4 system crammed with its original 160G drive as boot, swap, and application store, and three 320G drives in a raid 5 configuration as "house data" which it seems I'm the only one using. It's attached to an old hacked battery backup system insulating it from spikes and dips. There's a hub in the basement going to a wire on the outside of the house up to the attic where my office is, where the dsl router is. We have 802.11, but i won't run a server through wireless, so went through the grief of running cable.

Cables from this machine run up the wall through the intervening floor onto an old sewing table in the living room where the UI components sit, so we have a terminal with full-speed web in the common area with no fan/hard drive whine (very nice).

I run a nightly backup job from my work machine's key directories to the raid 5 array.

[da-lj.livejournal.com]

Interesting. The public terminal sounds like it might be useful, though in my house there tend to be two computer-users and two wireless laptops. But a spare thin-client could be pretty neat.

On cabling: as it turns out, our house is small enough that the room with the DSL modem is just one or zero closet-holes away from nearly anywhere we'd want cat5. Unfortunately, melted_snowball's laptop wifi doesn't seem to like the range of my base station, though my laptop is fine. We've put a second wifi upstairs (a mac airport) which is wired through the hole in the closet.

I suppose I should do some more tests of serving music to my laptop via wifi. That would be a real non-starter. I"m OK with copying video before watching it; but I want my audio to Just Work. Seems to me it should, at least for itunes. famous last words.

And yeah, I should also be backing up from my laptop to the fileserver; that was a design element I didn't mention, because I forgot about it. :)