Native FreeBSD compilation

[karolyi]

Hey,

I'm looking for a fulltext search engine for my project and bumped into this one.

Since I'm using FreeBSD 14.3 on the server, I was trying to compile it for myself, results vary.

So far I got the following commands in a newly created jail that will compile it:

pkg install -y cmake git-lite mysql-connector-c++ mysql-connector-odbc-unixodbc pkgconf bison
mkdir -pv /usr/local/src
cd /usr/local/src/
git clone https://github.com/manticoresoftware/manticoresearch.git
cd manticoresearch
mkdir build
cd build
ctest -VV -S ../misc/ctest/justbuild.cmake -DCTEST_SOURCE_DIRECTORY=.. --no-compress-output

Also, the POSTGRESQL dependency can be only removed the following way:

diff --git a/misc/ctest/justbuild.cmake b/misc/ctest/justbuild.cmake
index a2c18e9c0..465fe9a72 100755
--- a/misc/ctest/justbuild.cmake
+++ b/misc/ctest/justbuild.cmake
@@ -16,7 +16,7 @@ if ( NOT WITH_GALERA )
 endif()
 
 # common test options
-set ( CONFIG_OPTIONS "WITH_ODBC=1;WITH_RE2=1;WITH_STEMMER=1;WITH_POSTGRESQL=1;WITH_EXPAT=1;BUILD_TESTING=0" )
+set ( CONFIG_OPTIONS "WITH_ODBC=1;WITH_RE2=1;WITH_STEMMER=1;WITH_POSTGRESQL=0;WITH_EXPAT=1;BUILD_TESTING=0" )
 LIST ( APPEND CONFIG_OPTIONS "LIBS_BUNDLE=${LIBS_BUNDLE}" )
 LIST ( APPEND CONFIG_OPTIONS "WITH_GALERA=${WITH_GALERA}" )
 

My question would be:

• can this be compiled with mariadb support instead of mysql? (mariadb-connector-odbc)
• can the postgres dependency be removed by a command line parameter?

In the end, if I manage to consistently compile it, I might make a FreeBSD pkg from it.

[sanikolaev]

Hi @karolyi

In our CI we test compiling Manticore Search for FreeBSD. Could you please check this guide: https://manual.manticoresearch.com/Installation/Compiling_from_sources#Compiling-Manticore-from-source to see how we do it, and follow that approach instead of using justbuild.cmake, which is meant for a different purpose.

[karolyi]

Hey Sergey,

thanks, this pointed me into a direction, I started to build manticore. And then in a sudden leap of faith, I started to replace the internal, statically linked dependencies to external ones, at least to ones that FreeBSD provides as a package. So basically now I install:

cmake git-lite mariadb-connector-odbc pkgconf bison boost-libs xxhash snowballstemmer re2 cctz uni-algo nlohmann-json curlpp

With this, much less dependencies are being compiled, the /usr/local/src/cache dir only contains gtest, jieba, mcl, roaring and xxhash. Don't know why the latter wants to build despite providing a system package for it, but as it is now, it's not the biggest issue. With using uni-algo 1.2.0, the compilation fails with

/usr/local/src/manticoresearch/src/sphinxexpr.cpp:2466:9: error: no matching function for call to 't_map'
 2466 |         return una::detail::t_map<std::vector<char>, std::basic_string_view<char>, una::detail::impl_x_case_map_utf8, una::detail::impl_case_map_loc_utf8> ( dBuf, source, una::detail::impl_case_map_mode_lowercase );
      |                ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/usr/local/include/uni_algo/case.h:41:20: note: candidate template ignored: invalid explicitly-specified argument for template parameter 'Src'
   41 | uaiw_constexpr Dst t_map(const Alloc& alloc, const Src& src, int mode, type_codept loc = 0)
      |                    ^
/usr/local/src/manticoresearch/src/sphinxexpr.cpp:2471:9: error: no matching function for call to 't_map'
 2471 |         return una::detail::t_map<std::vector<char>, std::basic_string_view<char>, una::detail::impl_x_case_map_utf8, una::detail::impl_case_map_loc_utf8> ( dBuf, source, una::detail::impl_case_map_mode_uppercase );
      |                ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/usr/local/include/uni_algo/case.h:41:20: note: candidate template ignored: invalid explicitly-specified argument for template parameter 'Src'
   41 | uaiw_constexpr Dst t_map(const Alloc& alloc, const Src& src, int mode, type_codept loc = 0)
      |                    ^
2 errors generated.
--- src/CMakeFiles/lmanticore.dir/sphinxexpr.cpp.o ---
*** [src/CMakeFiles/lmanticore.dir/sphinxexpr.cpp.o] Error code 1

I think it compiles without uni-algo, I remember being able to compile it before I added that as a package.

Right now my jail installation and compilation commands are:

pkg install -y cmake git-lite mariadb-connector-c mariadb-connector-odbc pkgconf bison boost-libs 

pkg install -y cmake git-lite mariadb-connector-odbc pkgconf bison boost-libs xxhash snowballstemmer re2 cctz uni-algo nlohmann-json curlpp
mkdir -pv /usr/local/src
cd /usr/local/src/
git clone https://github.com/manticoresoftware/manticoresearch.git
cd manticoresearch
mkdir build
cd build

CMAKE_BUILD_PARALLEL_LEVEL=16 cmake -DWITH_GALERA=0 -DWITH_RE2_FORCE_STATIC=0 -DWITH_STEMMER_FORCE_STATIC=0 -DWITH_ICU_FORCE_STATIC=0 -DOPENSSL_USE_STATIC_LIBS=0 ..
cmake --build . -j16

Any help is welcome.

[sanikolaev]

Pls check if this change helps #3790

[karolyi]

Hey,

thanks for that fix! Now I have another error :) I'll attach the output of the latest compilation which seems to be bailing out on re2 issues.

The re2 provided by FreeBSD is version 20250805, hope that helps. Also, it would be nice to get that external xxhash working :)

re2-fail.txt