sys-fs/dwarfs (guru)

Search

Install

Install this package:

emerge -a sys-fs/dwarfs

Package Information

Description:
DwarFS is a read-only file system with a focus on achieving very high compression ratios in particular for very redundant data. This probably doesn't sound very exciting, because if it's redundant, it should compress well. However, I found that other read-only, compressed file systems don't do a very good job at making use of this redundancy. See here for a comparison with other compressed file systems. DwarFS also doesn't compromise on speed and for my use cases I've found it to be on par with or perform better than SquashFS. For my primary use case, DwarFS compression is an order of magnitude better than SquashFS compression, it's 4 times faster to build the file system, it's typically faster to access files on DwarFS and it uses less CPU resources. Distinct features of DwarFS are: * Clustering of files by similarity using a similarity hash function. This makes it easier to exploit the redundancy across file boundaries. * Segmentation analysis across file system blocks in order to reduce the size of the uncompressed file system. This saves memory when using the compressed file system and thus potentially allows for higher cache hit rates as more data can be kept in the cache. * Highly multi-threaded implementation. Both the file system creation tool as well as the FUSE driver are able to make good use of the many cores of your system. * Optional experimental Lua support to provide custom filtering and ordering functionality.
Homepage:
https://github.com/mhx/dwarfs
License:
GPL-3 MIT

Versions

Version EAPI Keywords Slot
0.15.3 8 ~amd64 ~arm64 0

Metadata

Description

Maintainers

Upstream

Raw Metadata XML
<pkgmetadata>
	<maintainer type="person">
		<email>denis7774@gmail.com</email>
		<name>Denis Reva</name>
		<description>rarogcmex</description>
	</maintainer>
	<maintainer type="person">
		<email>zhuyifei1999@gmail.com</email>
		<name>YiFei Zhu</name>
	</maintainer>
	<longdescription lang="en">
		DwarFS is a read-only file system with a focus on achieving very high compression ratios in particular for very redundant data.
		This probably doesn't sound very exciting, because if it's redundant, it should compress well. However, I found that other read-only, compressed file systems don't do a very good job at making use of this redundancy. See here for a comparison with other compressed file systems.
		DwarFS also doesn't compromise on speed and for my use cases I've found it to be on par with or perform better than SquashFS. For my primary use case, DwarFS compression is an order of magnitude better than SquashFS compression, it's 4 times faster to build the file system, it's typically faster to access files on DwarFS and it uses less CPU resources.
		Distinct features of DwarFS are:
		* Clustering of files by similarity using a similarity hash function. This makes it easier to exploit the redundancy across file boundaries.
		* Segmentation analysis across file system blocks in order to reduce the size of the uncompressed file system. This saves memory when using the compressed file system and thus potentially allows for higher cache hit rates as more data can be kept in the cache.
		* Highly multi-threaded implementation. Both the file system creation tool as well as the FUSE driver are able to make good use of the many cores of your system.
		* Optional experimental Lua support to provide custom filtering and ordering functionality.
	</longdescription>
	<use>
		<flag name="perfmon">Simple dwarfs performance monitoring. See https://github.com/mhx/dwarfs?tab=readme-ov-file#performance-monitoring . It has no impact on performance</flag>
		<flag name="ricepp">Enable ricepp compression algorithm, which builds on the basic idea of Rice compression (see the https://en.wikipedia.org/wiki/Golomb_coding ) with a few enhancements.</flag>
		<flag name="fuse">Build dwarfs Fuse driver for image mounting</flag>
		<flag name="tools">Build dwarfs tools for creating and extracting images</flag>
		<flag name="stacktrace">Enable support for debug build with stacktracing</flag>
		<flag name="flac">Add support for FLAC: Free Lossless Audio Codec as compression algorithm</flag>
	</use>
	<upstream>
		<bugs-to>https://github.com/mhx/dwarfs/issues</bugs-to>
		<remote-id type="github">mhx/dwarfs</remote-id>
	</upstream>
</pkgmetadata>

Lint Warnings

USE Flags

Manage flags for this package: euse -i <flag> -p sys-fs/dwarfs | euse -E <flag> -p sys-fs/dwarfs | euse -D <flag> -p sys-fs/dwarfs

Flag Description 0.15.3
flac Add support for FLAC: Free Lossless Audio Codec as compression algorithm
fuse Build dwarfs Fuse driver for image mounting
perfmon Simple dwarfs performance monitoring. See https://github.com/mhx/dwarfs?tab=readme-ov-file#performance-monitoring . It has no impact on performance
ricepp Enable ricepp compression algorithm, which builds on the basic idea of Rice compression (see the https://en.wikipedia.org/wiki/Golomb_coding ) with a few enhancements.
stacktrace Enable support for debug build with stacktracing
test Run mangohud tests ⚠️
tools Build dwarfs tools for creating and extracting images

Manifest

Type File Size Versions
DIST dwarfs-0.15.3.tar.xz 1339496 bytes 0.15.3
Unmatched Entries
Type File Size