From travis+ml-hdb at subspacefield.org Sun Aug 22 14:22:19 2010 From: travis+ml-hdb at subspacefield.org (travis+ml-hdb at subspacefield.org) Date: Sun, 22 Aug 2010 12:22:19 -0700 Subject: [HDB] working out some performance issues in HDB Message-ID: <20100822192219.GJ26714@subspacefield.org> Ran into some performance issues described here: http://www.subspacefield.org/~travis/hdb_history.html By my calculation, metadata lookup was so slow, looking up 700,000 files was going to take 13 days! On the other hand, I'm up to 4 backup volumes (mostly 1TB disks). I need to rethink how I handle multi-disk archives; right now I take a volser# on the command line, but if we don't know how many disks it will take, that won't work. You'll note that I've added profiling code into the codebase until I get this sorted out. I don't think anyone else is using it yet so NBD. -- HUMAN My emails do not have attachments; it's a digital signature that your mail program doesn't understand. | http://www.subspacefield.org/~travis/ If you are a spammer, please email john at subspacefield.org to get blacklisted. -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 833 bytes Desc: not available URL: