Commit Graph

29 Commits

Author SHA1 Message Date
Rosen Penev 11ad0c8355
include: use libdeflate's gzip to decompress
libdeflate decompresses much faster than gzip.

Example:

~/d/openwrt> time gzip -dc dl/cmake-3.25.1.tar.gz > /dev/null

________________________________________________________
Executed in    1.01 secs      fish           external
   usr time  912.61 millis    1.67 millis  910.94 millis
   sys time   32.21 millis    0.25 millis   31.96 millis

~/d/openwrt> time libdeflate-gzip -dc dl/cmake-3.25.1.tar.gz > /dev/null

________________________________________________________
Executed in  523.04 millis    fish           external
   usr time  415.48 millis    1.07 millis  414.41 millis
   sys time  107.74 millis    0.15 millis  107.59 millis

~/d/openwrt> time gzip -dc dl/tessdata-4.1.0.tar.gz > /dev/null

________________________________________________________
Executed in    8.99 secs    fish           external
   usr time    8.90 secs  530.00 micros    8.90 secs
   sys time    0.07 secs   63.00 micros    0.07 secs

~/d/openwrt> time libdeflate-gzip -dc dl/tessdata-4.1.0.tar.gz > /dev/null

________________________________________________________
Executed in    2.74 secs    fish           external
   usr time    2.38 secs  537.00 micros    2.38 secs
   sys time    0.35 secs   66.00 micros    0.35 secs

Place libdeflate into tools-core as it is needed to decompress other
archives.

Signed-off-by: Rosen Penev <rosenp@gmail.com>
2023-01-17 21:40:18 +01:00
David Bauer dc5328e7e9 include: use cpio from staging dir
As we built our own CPIO now, use this version instead of whatever the
host may or may not provide.

Signed-off-by: David Bauer <mail@david-bauer.net>
2021-02-28 00:09:09 +00:00
Paul Spooren a17b8eaa2e build: use SPDX license tags
The license folder is a core part of OpenWrt and all GPL-2.0 licensed.
Use SPDX license tags to allow machines to check licenses.

Signed-off-by: Paul Spooren <mail@aparcar.org>
[rebase, keep some Copyright lines, sharpen commit message]
Signed-off-by: Adrian Schmutzler <freifunk@adrianschmutzler.de>
2021-02-05 14:54:47 +01:00
Matthias Schiffer 4696112ea2
build: add zstd support to pack/unpack functions
Signed-off-by: Matthias Schiffer <mschiffer@universe-factory.net>
2020-05-31 11:03:30 +02:00
Alexandru Ardelean 5a829af69a include: unpack.mk: remove CRLF_WORKAROUND
This patch doesn't seem to have any more users.
The only one used to be target in
`target/linux/etrax/image/e100boot/Makefile`.

That target has since been removed via commit
1080f68b2b .

There doesn't seem to be any reason left for this workaround.

Signed-off-by: Alexandru Ardelean <ardeleanalex@gmail.com>
2019-04-18 12:06:47 +02:00
Yousong Zhou 4ebb13a0ef build: unzip: perform operations quietly
Signed-off-by: Yousong Zhou <yszhou4tech@gmail.com>
2017-01-05 11:09:13 +01:00
Alexandru Ardelean 15d8d9c271 build: drop `trapret` function from non-Linux HOST_TAR variant
Looks like this was meant to workaround some limitations with
non-GNU tar variants (like BSD-tar which are present on Mac os BSD hosts).

Though, I cannot find any use of that `+s` option that's mentioned
in the comment.

Last hash of this I found was 24faf55360

In my case, it now this fails for `python-setuptools` on Mac OS X (the host-build with):
```
trapret 2 tar -C <home-dir>/work/sources-work/lede/build_dir/target-i386_pentium4_musl-1.1.15/python-setuptools-27.2.0 --strip-components=1 -xzf <home-dir>/work/sources-work/lede/dl/setuptools-27.2.0.tar.gz
bash: trapret: command not found
```

So, I was thinking maybe it's time to remove this workaround (9 years later).
I could also fix the `python-setuptools` host build. If that's more preferred.

[ Btw, I just recently transitioned to a Mac machine for dev-ing,
  so a lot of (this Mac) stuff I'm finding out is new to me too. ]

Signed-off-by: Alexandru Ardelean <ardeleanalex@gmail.com>
2017-01-03 14:32:35 +01:00
Luka Perkov 7002f6326e include: remove trailing whitespaces
Signed-off-by: Luka Perkov <luka@openwrt.org>

SVN-Revision: 45127
2015-03-29 07:29:18 +00:00
Felix Fietkau 627e974c99 partially revert "build: remove check for nonexistant CONFIG_TAR_VERBOSITY variable and move TAR_OPTIONS to unpack.mk"
This complicates the evaluation order for some packages

SVN-Revision: 40006
2014-03-22 19:52:48 +00:00
Felix Fietkau 00bcebeb4c build: remove check for nonexistant CONFIG_TAR_VERBOSITY variable and move TAR_OPTIONS to unpack.mk
Signed-off-by: Felix Fietkau <nbd@openwrt.org>

SVN-Revision: 39979
2014-03-21 15:54:03 +00:00
Felix Fietkau a9136c0892 speed up the build system by including include/shell.sh on shell commands only where necessary
SVN-Revision: 22720
2010-08-19 12:49:37 +00:00
Jo-Philipp Wich fa802af399 support unpacking of .tar.xz archives, no prereq on xzcat for now
SVN-Revision: 22517
2010-08-06 21:29:23 +00:00
Felix Fietkau e8b6104dde allow packages to override PKG_UNPACK, HOST_UNPACK
SVN-Revision: 14659
2009-02-25 21:43:04 +00:00
Felix Fietkau 610e45ae5c only define unpack templates if PKG_SOURCE is set
SVN-Revision: 14623
2009-02-22 18:27:53 +00:00
Felix Fietkau aa0778f77e allow concurrent use of host-build.mk and package.mk as well as their templates
SVN-Revision: 14621
2009-02-22 18:10:05 +00:00
Felix Fietkau 7eb1589875 build system refactoring in preparation for allowing packages to do host-build steps
SVN-Revision: 14610
2009-02-22 04:37:20 +00:00
Felix Fietkau dbeb0fad24 Refactor downloading code into download.mk Support multiple file downloads Support svn downloads
SVN-Revision: 9057
2007-09-29 00:05:48 +00:00
Felix Fietkau 341b6afd55 simplify handling of zcat - always use gzip -dc. zcat and gzcat are either broken or nonexistant on some systems
SVN-Revision: 7096
2007-05-05 10:35:12 +00:00
Felix Fietkau 04ae63915e fix a small bug in the unpack code
SVN-Revision: 6587
2007-03-16 21:32:59 +00:00
Felix Fietkau 12051a5761 remove some debug code that slipped into the commit
SVN-Revision: 6583
2007-03-16 20:32:32 +00:00
Felix Fietkau 24faf55360 add file type autodetection for the unpack command and nuke PKG_CAT:= in lots of places
SVN-Revision: 6582
2007-03-16 20:21:39 +00:00
Felix Fietkau bc60eb3610 add a crlf workaround similar to the one from freewrt
SVN-Revision: 6507
2007-03-04 16:27:11 +00:00
Felix Fietkau 5605b82835 fix unpacking of .zip files
SVN-Revision: 6083
2007-01-11 19:07:12 +00:00
Felix Fietkau 461375c939 another bsd bugfix
SVN-Revision: 5657
2006-11-27 05:23:22 +00:00
Felix Fietkau 387570cc06 trap chmod errors in tar unpack on bsd - modes like 02755 fail
SVN-Revision: 5656
2006-11-27 04:25:34 +00:00
Felix Fietkau 06a46fb09d move '-' parameter to TAR_OPTIONS, so that packages can append commands
SVN-Revision: 5083
2006-10-14 14:51:48 +00:00
Felix Fietkau 4286347249 use $(TAR) in unpack commands
SVN-Revision: 5078
2006-10-14 13:51:40 +00:00
Felix Fietkau 794114c706 fix mistakes in unpack change
SVN-Revision: 5077
2006-10-14 13:04:50 +00:00
Felix Fietkau 0d9ddef0e8 move common unpacking code to unpack.mk, replace zcat with $(ZCAT) for systems that use gzcat instead
SVN-Revision: 5070
2006-10-14 00:40:27 +00:00