Kiwix & openZIM build engine
Go to file
Matthieu Gautier a565af2af4 [skip ci] WIP use kiwix-desktop window_utf16 branch 2018-07-31 15:11:09 +02:00
appveyor [skip ci] WIP use kiwix-desktop window_utf16 branch 2018-07-31 15:11:09 +02:00
kiwixbuild Update to last vresion of xapian. 2018-07-27 10:46:00 +02:00
scripts Categories=Education; 2018-06-24 11:44:24 +02:00
travis [TRAVIS] Do not make a deps archive when PLATFORM is android. 2018-07-16 18:31:50 +02:00
.gitignore Add a lot of common things to ignore to .gitignore 2017-08-14 09:57:00 -04:00
.travis.yml Do not try to decrypt the ssh_key if we cannot. 2018-07-11 15:55:11 +02:00
LICENSE Add a LICENSE file 2017-01-04 23:41:14 +01:00
MANIFEST.in Move ios cross file templates in the right directory. 2018-04-24 14:57:23 +02:00
README.md [README] Fix typos in android section in the readme. 2018-07-16 11:46:34 +02:00
appveyor.yml Sign the application after windeployqt. 2018-07-26 19:37:38 +02:00
build_custom_app.pl Change apk output directory to new location 2017-12-15 11:06:49 +00:00
build_custom_app.py [CUSTOM_APP] Small fixes of help of options. 2017-07-18 15:57:13 +02:00
kiwix-deploy.py Save nightlies at the right place #11 2017-02-26 21:39:58 +01:00
requirements_build_custom_app.txt Add script to build customapp 2017-06-25 15:49:49 +02:00
setup.py Adapte travis to new file architectures. 2018-04-04 15:43:51 +02:00

README.md

Build status: Build Status

Kiwix is an offline reader for web content. It's especially thought to make Wikipedia available offline. This is done by reading the content of the project stored in a file format ZIM, a high compressed open format with additional meta-data.

This repository contains advanced tools to (cross-)compile easily Kiwix softwares and library and deploy them. They have been tested on Fedora 23 and Ubuntu 16.10.

Prerequesites

You will need a recent version of meson (0.34) and ninja (1.6) If your distribution provides a recent enough versions for them, just install them with your package manager. Continue to read the instructions otherwise.

Before anything else you need to install Python3 related tools. On Debian based systems:

$ sudo apt-get install python3-pip virtualenv

Create a virtual environment to install python module in it instead of modifying the system.

$ virtualenv -p python3 ./ # Create virtualenv
$ source bin/activate      # Activate the virtualenv

Then, download and install kiwix-build and its dependencies:

$ git clone git://github.com/kiwix/kiwix-build.git
$ cd kiwix-build
$ pip install .
$ hash -r                  # Refresh bash paths

If your distribution doesn't provide ninja version > 1.6 you can get it this way :

$ wget https://github.com/ninja-build/ninja/releases/download/v1.8.2/ninja-linux.zip
$ unzip ninja-linux.zip ninja -d $HOME/bin

Compilation

The compilation is handled by the kiwix-build command. It will compile everything. If you are using a supported platform (Redhat or Debian based) it will install missing packages using sudo. You can get kiwix-build usage like this:

$ kiwix-build --help

Target

You may want to compile a specific target so you will have to specify it on the command line :

$ kiwix-build kiwix-lib # will build kiwix-build and its dependencies
$ kiwix-build zim-tools # will build zim-tools and its dependencies

By default, kiwix-build will build kiwix-tools .

Target platform

If no target platform is specified, a default one will be infered from the specified target :

  • kiwix-android will be build using the platform android
  • Other targets will be build using the platform native_dyn

But you can select another target platform using the option --target-platform. For now, there is ten different supported platforms :

  • native_dyn
  • native_static
  • win32_dyn
  • win32_static
  • android
  • android_arm
  • android_arm64
  • android_mips
  • android_mips64
  • android_x86
  • android_x86_64

So, if you want to compile kiwix-tools for win32 using static linkage:

$ kiwix-build --target-platform win32_dyn

Android

Android apk (kiwix-android) is a bit a special case. kiwix-android itself is architecture independent (it is written in java) but it use kiwix-lib who is architecture dependent.

When building kiwix-lib, you should directly use the target-platform android_<arch>:

$ kiwix-build kiwix-lib --target-platform android_arm

But, kiwix-android apk can also be multi arch (ie, it includes kiwix-lib for several architectures). To do so, you must ask to build kiwix-android using the android platform:

$ kiwix-build --target-platform android kiwix-android
$ kiwix-build kiwix-android # because `android` platform is the default for `kiwix-android`

By default, when using platform android, kiwix-lib will be build for all architectures. This can be changed by using the option --android-arch :

$ kiwix-build kiwix-android # apk for all architectures
$ kiwix-build kiwix-android --android-arch arm # apk for arm architecture
$ kiwix-build kiwix-anrdoid --android-arch arm --android-arch arm64 # apk for arm and arm64 architectures

IOS

When building for ios, we may want to compile a "fat library", a library for several architectures.

To do so, you should directly use the target-platfrom ios_multi. As for android, kiwix-build will build the library several times (once for each platform) and then create the fat library.

$ kiwix-build --target-platform iOS_multi kiwix-lib

You can specify the supported architectures with the option --ios-arch:

$ kiwix-build --target-platform iOS_multi kiwix-lib # all architetures
$ kiwix-build --target-platform iOS_multi --ios-arch arm --ios-arch arm64 # arm and arm64 arch only

Outputs

Kiwix-build.py will create several directories:

  • ARCHIVES: All the downloaded archives go there.
  • SOURCES: All the sources (extracted from archives and patched) go there.
  • BUILD_<target_platform>: All the build files go there.
  • BUILD_<target_platform>/INSTALL: The installed files go there.
  • BUILD_<target_platform>/LOGS: The logs files of the build.

If you want to install all those directories elsewhere, you can pass the --working-dir option to kiwix-build: