vectorscan: new package for speeding up regex ops
Vectorscan is fork of Hyperscan, a high-performance multiple regex matching library. It follows the regular expression syntax of the commonly-used libpcre library, but is a standalone library with its own C API. Currently ARM NEON/ASIMD and Power VSX are 100% functional. ARM SVE2 support is in ongoing with access to hardware now. More platforms will follow in the future. The performance difference of snort3 compiled against this is sizable. Test SoC #1 flogic/glinet_gl-mt6000 IDS mode: Download speed wo/ vectorscan: 91.2 ±0.21 Mbit/s (n=3) Download speed using vectorscan: 331.0 ±27.34 Mbit/s (n=3) Gain of 3.6x IPS mode: Download speed wo/ vectorscan: 30.0 ±0.06 Mbit/s (n=3) Download speed using vectorscan: 52.9 ±0.78 Mbit/s (n=3) Gain of 1.8x Notes: * Data generated on snapshot build on 12-Apr-2024 using kernel 6.6.26, snort 3.1.84.0, vectorscan 5.4.11. * Speedtest script hitting the same server. * Snort rules file of was 37,917 lines/22 MB. * In all cases, single core CPU saturation occurred which speaks to the efficiency gains supplied by vectorscan. Test Soc #2 bcm2712/RPi5B IPS mode: Download speed wo/ vectorscan: 164.3 ±0.64 Mbit/s (n=3) Download speed using vectorscan: 232.8 ±0.26 Mbit/s (n=3) Gain of 1.4x Notes: * Data generated on snapshot build on 13-Apr-2024 using kernel 6.1.86, snort 3.1.84.0, vectorscan 5.4.11. * Google fiber speedtest (https://fiber.google.com/speedtest/) hitting the same server. * Snort rules contained 39,801 rules/22 MB. * In all cases, single core CPU saturation occurred which speaks to the efficiency gains supplied by vectorscan. Build system: x86/64 Build-tested: flogic/glinet_gl-mt6000, bcm2712/RPi5B Run-tested: flogic/glinet_gl-mt6000, bcm2712/RPi5B Co-authored-by: Tianling Shen <cnsztl@gmail.com> Co-authored-by: Jeffery To <jeffery.to@gmail.com> Signed-off-by: John Audia <therealgraysky@proton.me>
This commit is contained in:
John Audia
parent
a9ae9bad06
commit
d62471c093
|
|
@ -0,0 +1,82 @@
|
|||
#
|
||||
# This is free software, licensed under the GNU General Public License v2.
|
||||
# See /LICENSE for more information.
|
||||
#
|
||||
|
||||
include $(TOPDIR)/rules.mk
|
||||
|
||||
PKG_NAME:=vectorscan
|
||||
PKG_VERSION:=5.4.11
|
||||
PKG_RELEASE:=1
|
||||
|
||||
PKG_SOURCE:=$(PKG_NAME)-$(PKG_VERSION).tar.gz
|
||||
PKG_SOURCE_URL:=https://codeload.github.com/VectorCamp/vectorscan/tar.gz/$(PKG_NAME)/$(PKG_VERSION)?
|
||||
PKG_HASH:=905f76ad1fa9e4ae0eb28232cac98afdb96c479666202c5a4c27871fb30a2711
|
||||
PKG_BUILD_DIR:=$(BUILD_DIR)/$(PKG_NAME)-$(PKG_NAME)-$(PKG_VERSION)
|
||||
|
||||
PKG_MAINTAINER:=John Audia <therealgraysky@proton.me>
|
||||
PKG_LICENSE:=BSD-3-Clause BSD-2-Clause BSL-1.0
|
||||
PKG_LICENSE_FILES:=LICENSE
|
||||
PKG_BUILD_PARALLEL:=1
|
||||
CMAKE_INSTALL:=1
|
||||
|
||||
PKG_BUILD_DEPENDS:=ragel/host python3/host boost/host
|
||||
|
||||
include $(INCLUDE_DIR)/package.mk
|
||||
include $(INCLUDE_DIR)/cmake.mk
|
||||
|
||||
CMAKE_OPTIONS += \
|
||||
-DCMAKE_INSTALL_PREFIX=/usr \
|
||||
-DCMAKE_INSTALL_LIBDIR=lib \
|
||||
-DBUILD_SHARED_LIBS=ON \
|
||||
-Wno-dev
|
||||
|
||||
define Package/vectorscan-headers
|
||||
CATEGORY:=Libraries
|
||||
SECTION:=libs
|
||||
TITLE:=Vectorscan Headers
|
||||
URL:=https://github.com/VectorCamp/vectorscan
|
||||
DEPENDS:=@aarch64
|
||||
endef
|
||||
|
||||
define Package/vectorscan-runtime
|
||||
CATEGORY:=Libraries
|
||||
SECTION:=libs
|
||||
TITLE:=Vectorscan Runtime
|
||||
URL:=https://github.com/VectorCamp/vectorscan
|
||||
DEPENDS:=@aarch64 +libstdcpp +libsqlite3
|
||||
endef
|
||||
|
||||
define Package/vectorscan-headers/description
|
||||
This package contains the headers for Vectorscan.
|
||||
A fork of Intel's Hyperscan, modified to run on more platforms.
|
||||
endef
|
||||
|
||||
define Package/vectorscan-runtime/description
|
||||
This package contains the headers for Vectorscan.
|
||||
A fork of Intel's Hyperscan, modified to run on more platforms.
|
||||
endef
|
||||
|
||||
# This installs files into ./staging_dir/. so that you can cross compile from the host
|
||||
define Build/InstallDev
|
||||
$(INSTALL_DIR) $(1)/usr/include/hs
|
||||
$(INSTALL_DATA) $(PKG_INSTALL_DIR)/usr/include/hs/* $(1)/usr/include/hs/
|
||||
$(INSTALL_DIR) $(1)/usr/lib
|
||||
$(CP) $(PKG_INSTALL_DIR)/usr/lib/libhs* $(1)/usr/lib/
|
||||
$(INSTALL_DIR) $(1)/usr/lib/pkgconfig
|
||||
$(INSTALL_DATA) $(PKG_BUILD_DIR)/libhs.pc $(1)/usr/lib/pkgconfig/libhs.pc
|
||||
endef
|
||||
|
||||
# This installs files on the target. Compare with Build/InstallDev
|
||||
define Package/vectorscan-headers/install
|
||||
$(INSTALL_DIR) $(1)/usr/include/hs
|
||||
$(INSTALL_DATA) $(PKG_INSTALL_DIR)/usr/include/hs/*.h $(1)/usr/include/hs/
|
||||
endef
|
||||
|
||||
define Package/vectorscan-runtime/install
|
||||
$(INSTALL_DIR) $(1)/usr/lib
|
||||
$(CP) $(PKG_INSTALL_DIR)/usr/lib/libhs* $(1)/usr/lib/
|
||||
endef
|
||||
|
||||
$(eval $(call BuildPackage,vectorscan-headers))
|
||||
$(eval $(call BuildPackage,vectorscan-runtime))
|
||||
Loading…
Reference in New Issue