Re: [SLUG] transparently-decompressing filesystem

From: Eben King (eben01@verizon.net)
Date: Thu Dec 04 2008 - 09:45:29 EST


On Wed, 3 Dec 2008, draeath wrote:

>> On Wed, Dec 03, 2008 at 07:04:06PM -0500, Eben King wrote:
>>
>>> I downloaded a bunch of PDBs (3D chemical models) from the nice folks at
>>> wwdb.com and their rsync script. It's around 7.3 GiB when broken into
>>> subdirectories and each subdir is tarred and bzipped, but around 40-45
>>> GiB decompressed. That's the sort of thing I can't justify keeping
>>> around uncompressed, but the viewer doesn't dive into archives
>>> automatically.

>>> Is there any sort of filesystem that stores data compressed then
>>> uncompresses it automatically, sort of like Stacker for Linux? I guess
>>> if there were software which enabled random access on a compressed file
>>> and I loopback-mounted that file, that would work.

> If the data won't be changed, look into squashfs. Note that with the right
> patches, that can use lzma on the fly (which is slow, but beats the pants off
> bzip and gzip)

Thanks, that looks like it'll do the trick. Now I just have to find (or
make) a filesystem with 8-10 GiB of free space.

-- 
-eben   QebWenE01R@vTerYizUonI.nOetP   http://royalty.mine.nu:81
               "God does not play dice" -- Einstein
        "Not only does God play dice, he sometimes throws
        them where they can't be seen." -- Stephen Hawking
-----------------------------------------------------------------------
This list is provided as an unmoderated internet service by Networked
Knowledge Systems (NKS).  Views and opinions expressed in messages
posted are those of the author and do not necessarily reflect the
official policy or position of NKS or any of its employees.



This archive was generated by hypermail 2.1.3 : Fri Aug 01 2014 - 17:51:28 EDT