Parallel compression

Parallel processing, the computing equivalent of juggling, as Shashank Sharma calls it, can be used to perform everyday tasks to save time.

Compressing files is one of the most mundane activities, and frequently performed without much thought. For most Linux users, irrespective of distro, Gzip is the tool of choice. But it’s quite slow, especially with large files running into hundreds of megabytes or more. On modern multi-core machines, you can easily speed up compression with parallel processing. Cue Pigz. Pigz achieves far faster compression because it puts the power of multi-core machines to proper use when compressing data. Released under the permissive zib licence, Pigz is the brainchild of Mark Adler, who apart from his work with NASA on the Spirit Mars Exploration Rover, has contributed to the development of the PNG image format, and developed both zlib and the Gzip utility along with Jean-lop Gailly. As a parallel implementation of…

You're reading a preview of

APC (Digital) - 1 Issue, May 2024

DiscountMags is a licensed distributor (not a publisher) of the above content and Publication through Zinio LLC. Accordingly, we have no editorial control over the Publications. Any opinions, advice, statements, services, offers or other information or content expressed or made available by third parties, including those made in Publications offered on our website, are those of the respective author(s) or publisher(s) and not of DiscountMags. DiscountMags does not guarantee the accuracy, completeness, truthfulness, or usefulness of all or any portion of any publication or any services or offers made by third parties, nor will we be liable for any loss or damage caused by your reliance on information contained in any Publication, or your use of services offered, or your acceptance of any offers made through the Service or the Publications. For content removal requests, please contact Zinio.