fd46c52473
Move the definition of what to build in a table.
...
This provide a better visual definition (and potential better explicit)
of the previous code base on `if/else`.
2023-06-02 15:58:00 +02:00
e751c1166c
Correctly package armv* toolchain in base dependency.
2023-05-23 08:58:17 +03:00
a302a597e2
Remove `lib_postfix` from CI.
...
This variable is never used.
2023-05-22 19:03:57 +02:00
c6ea16edd9
Build for armv6 and armv8 on the CI.
2023-05-22 19:03:57 +02:00
3cd20201c1
Use a scp cipher which goes faster
2023-05-21 14:31:33 +03:00
7db62390f1
We should build using macos11
2023-05-20 16:15:24 +02:00
af29fd5f2e
Publish dev preview in `dev_preview` subdirectory in tmp.kiwix.org/ci.
2023-05-16 15:26:24 +02:00
3e712db880
Fix publish of kiwix-desktop flatpak.
...
We cannot directly push on master. We have to create a pull request.
The CI is adapted to push a new branch. The PR has to be created manually.
2023-05-10 14:12:06 +02:00
a11b813f82
Use always fix version of macOS & Ubuntu
2023-05-04 15:06:52 +02:00
fd53141b9c
Use docker image version 38.
2023-04-28 10:00:11 +02:00
8f8ea01aec
Do not build binaries on macOS not _dyn.
...
Tools fails to compile for different reasons:
- Missing dependencies
- Use of invalid options (`-dead_strip_dylibs`/`-bitcode_bundle`)
2023-04-28 08:59:14 +02:00
02e2598056
Build zim-tools and kiwix-tools and macosOs_arm64.
2023-04-27 19:10:55 +02:00
ab14ce957b
Build kiwix-tools on macos (native)
2023-04-27 19:02:23 +02:00
fc3b446c76
Also build libzim mixed for aarch64 on bionic.
2023-04-26 16:54:35 +02:00
fffbd122c9
Make bionic CI create archive containing bionic in the name.
2023-04-26 16:54:35 +02:00
4aa613c8e6
Update CI build script
...
Update CI scripts to build only libzim on native_mixed if os name is
bionic.
2023-04-26 16:54:35 +02:00
7a0f490e00
Update CI workflows
...
Update CI to build on native_mixed bionic and build the bionic docker
image.
2023-04-26 15:21:17 +02:00
51925bc4da
Add the aarch64 toolchains to deps archive.
...
We need the aarch64 compiler to let's project build themselves.
2023-04-19 10:54:16 +02:00
65cf449c66
Update docker image to 37.
2023-04-18 10:34:08 +02:00
0919f4d3dd
[WIP] Use the docker image of our branch.
2023-04-12 16:53:32 +02:00
c9e9c5c070
Move all our CI to focal instead of bionic
...
Bionic is EOL.
2023-04-12 16:53:32 +02:00
4b8862a959
Use only one code to determine what to build.
...
As we build the "same"[*] things with build_project and build_release_nightly,
let's use the same code.
[*] We are not building the same things has we don't run the same runners
(not the same `PLATFORM_TARGET`) but for a given `PLATFORM_TARGET`, we
are building the same things.
2023-04-12 11:26:12 +02:00
b905e87280
Fix compilation on CI macOS
...
We don't want to compile zim-tools on macOS_arm64_dynamic.
2023-04-12 11:26:12 +02:00
9ee7567e80
Fix typos
2023-04-11 12:05:06 +02:00
ae3b1b6a25
Build zim-tools cross-compiling.
2023-04-11 12:05:06 +02:00
892e4bbffe
[CI] Upload `macOS_arm64_mixed` builds.
2023-03-30 17:37:11 +02:00
b218875d49
Rename `macOS_arm64` to `macOS_arm64_static`.
...
Publication code in `.github/scripts` expected that `foo_mixed` target
is tied to a `foo_static` target.
2023-03-30 14:18:53 +02:00
b4e0d60363
Build and publish libzim and libkiwix on macos_arm64.
2023-03-30 14:18:53 +02:00
c1d0ed4e4f
Correctly store the source toolchain for "aarch64"
2023-03-29 15:46:06 +02:00
695a3ef0c0
Correctly store the `static` compiled source when doing archive for mixed.
2023-03-29 15:46:06 +02:00
18c5d3bf5f
Publish nigthly and release of kiwix-tools on aarch64
2023-03-29 11:40:04 +02:00
8e61acbca2
Addapt CI to build armhf and aarch64.
...
- Aarch64 added
- libzim compilation on (armhf|aarch64)_mixed added.
2023-03-28 17:57:39 +02:00
7c02c6b778
Fixed triggering workflows on zim-tools and kiwix-tools
...
Both the fallback and the passed ref were targeting the master branch of those repositories.
This triggers the workflow on their main branch and sets the default target branch to main as all our repositories use it.
2023-03-28 07:58:41 +00:00
c5acad73b4
Prevent incorrectly setting DEV_BRANCH
...
DEV_BRANCH is used to change archive upload behavior.
We current code it was incorrectly considering being on a dev branch while on main one (main)
2023-03-28 07:56:37 +00:00
424d426a0e
Correctly package wasm archives.
...
With commit 6181d7bbFix #556
2023-03-20 19:32:41 +01:00
9f448f83de
Use fix versions for CI/CD
2023-03-19 15:24:33 +01:00
eae088e80f
Remove unecessary dependence to container workflow
2023-03-19 15:22:50 +01:00
f376e82aac
Use new container images v36
2023-03-16 10:42:07 +01:00
92951ee827
Fix container image tagging
2023-03-16 10:31:08 +01:00
245ca71692
Rename container workflow file
2023-03-16 09:34:22 +01:00
bd58d50051
Fix docker tag command
2023-03-16 09:33:56 +01:00
ea3a07e3c2
Fix container release
2023-03-16 09:05:03 +01:00
ad6de2897e
Better name for container workflow
2023-03-16 09:01:50 +01:00
534dee9c94
Use new Docker images for kiwix-build CI
2023-03-15 13:25:13 +01:00
f16f55fd07
Add container 'latest' tag
2023-03-15 13:25:13 +01:00
c1b8ff5d86
Better container image creation/upload workflow
2023-03-15 13:25:13 +01:00
b977392446
Remove CI container builds
2023-03-15 13:25:13 +01:00
b16cedc6be
Move ci_images
2023-03-15 13:25:13 +01:00
dd1a276d7a
Move CI container building to a dedicated CI workflow
2023-03-15 13:25:13 +01:00
7a23bb5b8b
Fix creation of base dependencies archive.
...
The `INSTALL_DIR` was added twice. It was not a issue as we then transform
the list into a set to remove duplicated.
But with `filter_install_dir` call only on one "add", the (textual)
entries are not duplicated and so, not removed. So the files where add
twice.
Now we correctly filter initial `INSTALL_DIR` and we remove the second add.
2023-03-14 17:17:30 +01:00
5c0d9d87c1
Remove `share/doc` and `share/man` from the deps archive.
...
They are useless and they use precious disk space.
Fix #567
2023-02-22 11:57:47 +01:00
3138c71b82
Update GitHub actions to latest version
2023-02-05 08:45:47 +01:00
9d910ac9c5
Delete move.yml
2022-12-25 16:06:52 +01:00
536748500b
Remove uneeded patches for flatpak
...
Patches are uneeded for all arch.
But we were trying to copy them on flatpak.
2022-12-09 10:55:14 +01:00
dba386a427
Fix wasm workflow configuration.
2022-12-01 22:28:23 +01:00
91ef647e78
Run releaseNigthly workflow also for wasm
2022-12-01 22:06:43 +01:00
07d1561a87
[CI] Build libkiwix on on native_mixed
2022-11-30 14:22:13 +01:00
84eea4a7ed
Package all libzim dependencies on wasm.
...
Fix #552
2022-11-30 11:07:21 +01:00
c27348bde3
Publish the CI only if we are on a dev branch.
...
If we try to publish all the time, we will conflict with `Release&Nigthly`
workflow as we would pulbish in nigthly directory.
Fix #550
2022-11-23 16:06:35 +01:00
a44531bb8a
Upload generated packages on `tmp/ci` when building on branches.
...
We need to be able to test our generated artefacts before we merge the
branches.
2022-11-16 16:37:05 +01:00
ab421848c5
Use glob instead of specifying the lib_prefix.
...
There is no need to be specific here, we are already in INSTALL_DIR which
contains only things specific to our platform.
2022-11-16 16:37:05 +01:00
9881571047
Add packaging of libzim.a
...
Wasm build is creating a static library.
2022-11-16 16:37:05 +01:00
16fc490ae7
Add build of libzim on wasm in the CI
2022-11-16 16:37:05 +01:00
180fb249f6
Add a support to compile libzim for wasm.
...
`icu4c_wasm.patch` is build by :
- Copying config.sub from liblzma source as new version of config.sub there
knows about wasm architecture.
- Copying `mh-linux` on `mh-unknown` as specified in (origin) `mh-unknown`.
This is because icu4c configure doesn't detect `emscripten` platform and
"fallback" to `mh-unknown`.
2022-11-16 16:37:05 +01:00
dc814c626d
Upload read-only archive.
...
By uploading read-only archive, we prevent potential (implicit) re-upload.
A re-upload will always be possible if we remove the archive and rerun
the workflow. But it will be clearly explicit in this case.
2022-09-28 16:08:42 +02:00
f7706428a2
Make release only if we are running the workflow on a `r_xx` tag.
...
Also check that we are not a scheduled workflow
(But it is more a double check. This shloud not happen)
2022-09-28 15:09:53 +02:00
fe92fc5080
Use notarytool to notarize on macOS
...
altool has been deprecated in favor of notarytool
2022-09-06 14:52:15 +00:00
1755044333
Added CI image for Alpine
2022-07-11 17:38:07 +04:00
33c2ec2c4d
Build and release libzim for android on the CI
2022-06-28 12:24:06 +02:00
3764fde97e
We don't need jdk anymore to build on android
2022-06-28 12:23:04 +02:00
6a3d3047e0
Do not try to package kiwix-search as it as been removed from kiwix-tools
2022-06-15 14:28:32 +02:00
dba45ced36
Build android lib in the correct directory
2022-06-14 17:48:51 +02:00
9c220866ac
Build and release each libkiwix android builds independently.
...
While it is ok to build all libkiwix android builds in one step,
the "release system" upload only one archive per platform.
So we need 4 platforms to do 4 uploads.
As we don't build on "android" platform now, we can clean up our scripts.
2022-06-10 10:26:24 +02:00
7086009a0a
We don't need to upload to bintray now.
2022-06-10 10:11:01 +02:00
51ff5e58bb
Be able to make the release of libkiwix on android.
2022-06-09 10:31:09 +02:00
72c271a74c
Remove LibkiwixApp
...
The project was used to assemble all android compilation in one
multiplatform java archive.
This allow use to remove android_sdk and Gradle builder
2022-06-09 10:28:59 +02:00
733a730877
Do not notarize macos build on CI.
...
We still sign macos build on nigthly and release.
2022-05-17 18:05:43 +02:00
f103cddd77
Trust codesign using the certificate
...
When build_release_nightly calls codesign to sign libzim.7.dylib, it appears to be
hanging forever.
What's most likely happening is that Keychain Access is prompting a password request
without any possibility to answer, given this is running on the CI.
It's unclear whether Keychain Access wants to confirm codesign can access the certificate
or if it is trying to unlock another (System) keychain to find the certificate or key.
This addresses the former.
2022-05-12 14:58:46 +00:00
8ec2cd9a11
Using sftp for mkdir step
...
As there is no shell, use SFTP's mkdir command to create the folders up to final path.
2022-04-04 13:53:20 +00:00
1351fc7f8b
Target uploads to new dropbox address
...
SSH server which was used to receive file uploads (CI, nightly and release) has been
migrated to a new one on a different address.
Username, Key and paths are unchanged.
Most notable changes are the use of `master.download.kiwix.org` as the target in
replacement of `mirror.download.kiwix.org` (although it would still work) and the
Port to which SSH is listening on (30022 instead of 22)
2022-03-30 22:10:06 +00:00
90c2705b0e
Fix workflow triggering in releaseNigthly workflow.
...
GITHUB_PAT is needed (and not needed for flatpak)
2022-03-28 10:49:14 +02:00
f1ac1b0121
Build everything using bionic instead of xenial
2022-03-11 15:05:25 +01:00
32f1bfdab3
Do not force a specific version of meson.
...
We were forcing a spcefic version has a workaround to meson issue.
We don't need now, and recent version is needed to compile on armhf.
2022-03-11 15:04:17 +01:00
64ea01e445
[CI] Do not build zim-tools on armhf
...
zim-tools depends of docopt which need a recent enough version of gcc (4.9)
But we are using gcc 4.8.3 to cross compile on armhf.
2022-03-10 18:16:39 +01:00
6505e82c37
[CI] Do not build zim-tools on macOS cross-compilation target.
...
We still build zim-tools on macOs with native build.
2022-03-10 16:57:56 +01:00
af3cff6aeb
Build flatpak in CI
2022-03-10 16:21:14 +01:00
cdf4dab0a5
Cross compile windows on fedora 35.
2022-03-10 15:19:51 +01:00
01e8f92348
Build the projects in the CI.
...
We used to build only the base dependencies in the CI
(and build the projects in nightly&Release workflow).
Now always build the projects.
2022-03-10 15:19:51 +01:00
0fb7dc63a7
Correctly detect if project is openzim or kiwix organization
2022-02-02 16:10:28 +01:00
5e6f68a3ef
Use python 3.8 on macOS CI
...
Python 3.6 is not available anymore.
2022-02-02 15:18:20 +01:00
1374e01c7a
Make the CI build the new on the new MacOS archs.
2021-12-22 15:26:01 +01:00
c78d5bbc72
Force version of python's module on xenial.
...
Xenial's python is 3.5 and recent versions of used python modules are
not supporting python 3.5 anymore.
We have to force specific versions for gcovr and its dependencies.
2021-10-19 11:28:26 +02:00
9c04df4fb2
[CI] Install automake and autoconf on macos.
2021-07-27 16:45:04 +02:00
aa349a18e7
Rename kiwix-lib to libkiwix.
...
The new name of kiwix-lib is libkiwix. Let kiwix-build adopt the name.
2021-06-30 16:45:54 +02:00
43024859b1
Directly set the env variable in the docker file.
...
When running from the CI, .bashrc is not sourced so we must set the
env variable at docker file level.
2021-06-29 16:06:53 +02:00
ed999d61af
[CI] Do not try to install packages in the CI.
...
On the CI, packages should be already installed.
Don't try to install with kiwix-build.
2021-06-23 17:27:52 +02:00
73e0cec0aa
Update bionic docker image to use qt 5.15 instead of default qt version.
2021-06-23 17:27:52 +02:00
c445db171b
Package zimrecreate in zim-tools.
2021-06-10 14:25:54 +02:00
1845879825
Add all files of zim-testing-suite to the generated base_deps archive.
2021-05-04 14:36:15 +02:00
079e03473b
Change time server in workflow
...
For the past week, the Release&Nightly workflow failed on macOS native_mixed
(but not on native_dyn) when calling ntp to sync clock before signing.
Calling time.apple.com resulted in a DNS error, leading to an error in ntp call
Why this fails on native_mixed is unknown. Maybe because it's being called twice
from the same (I guess) host in a short interleave?
This attempts to fix this by:
- using google's time server instead of Apple's
- correctly setting the timeout param before the server name (although not relevant
for this dns-based error)
- Ignore failures to sync time. We're doing it to minimize chances of unsynched clocks
to fail the signature but this is not absolutely required all the time.
2021-03-23 12:46:20 +00:00
0de55705cf
allow more time for ntp server to respond
2021-02-16 12:18:09 +00:00
b3f66e0ac0
time update requires sudo
2021-02-15 09:42:50 +00:00
fd590a5b4b
fixed syntax for macOS signing
2021-02-11 08:06:06 +00:00
ea55cac32d
Fixed #469 : Notarizing libzim release for macOS
...
This adds the notarization (see #469 ) of the libzim binary for macOS during the build.
It it not dependent on RELEASE so it benefits all builds.
It basically does two things:
- sign the build with our Developer ID certificate from Apple.
- Request notarization from Apple for the binary.
At the moment, it concerns only libzim. Might expand that to libkiwix and the zim/kiwix tools
once we start releasing those.
Github Actions prepare the certificate and environment, and signing+request is done in `notarize_macos_build()` (common.py)
It required the following new secrets:
| secret | value |
|---|---|
| `APPLE_SIGNING_CERTIFICATE` | base64 of the P12 certificate |
| `APPLE_SIGNING_P12_PASSWORD` | password for the P12 certificate (we chose that when exporting to P12. Apple doesnt provide P12) |
| `APPLE_SIGNING_IDENTITY`| Common name of our certificate. Not a private info but seems better suited there than in the CI |
| `APPLE_SIGNING_TEAM`| Apple Developer Team ID (mentionned in the signing identity) |
| `APPLE_SIGNING_ALTOOL_PASSWORD`| app-specific password created to request notarization |
| `APPLE_SIGNING_ALTOOL_USERNAME`| username associated with the app-specific password. Must be an Apple ID with perms on the Certificate. Currently mine. |
2021-02-09 13:30:24 +00:00
ff66a96980
Fixed #465 : trigger docker publish on release
...
This triggers a `workflow_dispatch` event on the `docker.yml` workflow or the matching
repository for both `zim-tools` and `kiwix-tools` targets that supports it.
2021-01-13 15:58:33 +00:00
6434150da9
[CI] Fix macos brew install packages (release&Nightly)
2020-10-28 16:40:02 +01:00
8846acc8cf
Fix macos brew install packages.
...
Directly use brew instead of `get-package` action.
`get-package` seems to be broken with some invalid git command.
2020-10-27 14:20:57 +01:00
674d6bf6df
CI
2020-08-28 14:16:25 -04:00
1dde278ad6
Correctly set the extra postfix for android kiwix-lib.
2020-08-27 19:20:05 +02:00
a3038253e8
Do not fail if there is no file to publish.
2020-07-15 17:42:32 +02:00
e81a2e7006
Merge tag 'r_10'
2020-07-15 16:20:16 +02:00
da31dd428e
remove 'zimwriterfs' project from build and CI configuration
...
'zimwriterfs' is now a part of zim-tools (openzim/zim-tools/#92)
2020-07-08 16:54:14 +02:00
2d1e8d0202
Also do the kiwix-lib release (for source publication)
2020-07-02 15:38:24 +02:00
907bd61f59
Add BINTRAY secrets to env variables.
2020-07-01 16:32:03 +02:00
7afa3f6a52
Correctly build release of kiwix-lib on android.
...
The name of the target is `kiwix-lib-app` on android but the key
in the version directory is `kiwix-lib`.
2020-07-01 11:30:26 +02:00
8478d65c90
enable compilation of native_mixed on macos
...
Issue #349 requires a native_mixed for macOS.
native_mixed is working for libzim so we whitelist it.
On the release CI, we fix the macos dylib rpath so it doesn't include the
full build-install step path which is probematic for a distributed file.
We build native_mixed for OSX in both CI and release mode
2020-06-17 09:04:10 +00:00
2243ca9d91
Deactivate static build on bionic.
...
See #447
2020-06-10 14:26:11 +02:00
4bdbc5ac53
Build the base deps on bionics also.
...
This will allow other project to have their CI running on bionics.
2020-06-09 11:37:56 +02:00
80c59b246f
Change kiwixbot email address to the new one.
2020-06-03 10:48:41 +02:00
497967236e
Publish release source archive on "native_mixed" platform.
...
`libzim` is build on "native_mixed", not "native_dyn".
2020-05-25 13:08:57 +02:00
22da0f3b6d
Fix postfix generation to not include the `0`.
2020-05-25 12:21:10 +02:00
925943a5ee
Fix checkout of code.
...
Correctly handle tag ref.
2020-05-25 12:21:10 +02:00
040171129a
Fix release tag format.
...
The release tag format change to a classic tag triplet format `\d.\d.\d`
to a custom one `r_\d`.
2020-05-25 12:21:10 +02:00
e27fd7b83d
Use distro module to detect the distribution name.
...
`platform.linux_distribution` is deprecated.
This is a recommit of 0fe69e3
2020-05-21 19:55:40 +02:00
e020eb35ac
[WIP] Move the release process to github actions.
2020-05-21 12:13:36 +02:00
b68236526d
Revert "Use distro module to detect the distribution name."
...
This reverts commit 0fe69e3991
2020-05-18 13:46:19 +02:00
0fe69e3991
Use distro module to detect the distribution name.
...
`platform.linux_distribution` is deprecated.
Fix #415
2020-05-17 17:57:24 +02:00
d0677492d1
remove from CI
2020-05-10 19:55:45 -04:00
3c8a9ffbfe
Use standard name for CI ( #433 )
2020-04-07 18:17:38 +02:00
fb07b58812
Fix recompilation of the CI of meson project.
...
We were assuming that meson project correspond to our projects and so we
were always building them, even if they were already compiled.
(This way, a simple `kiwix-build` is enough to recompile the WIP code of
our project).
However, on the CI, we do not archive the source code/build directory in
the base deps archive. So when we try to compile, the compile step of
meson projects fails because the source are not here.
We have a small workaround for pugixml but as zstd is also meson, it is
time to do something correct.
By default, all projects now try to skip if a build is already present.
Our projects are marked as `force_build` and so, they do not try to skip.
2020-04-06 19:15:40 +02:00
08ed650c78
[CI] Clone git repository with a depth of 1 in the CI.
2020-02-25 15:53:23 +01:00
2c14c1a705
Build base for all iOS architectures.
2020-02-21 15:12:17 +01:00
b790c00187
[action] Correctly fetch the right branch in the CI
2020-02-12 11:25:03 +01:00
a912b890e0
Run base build every day at 1h
2020-02-05 12:11:40 +01:00
b6e5912075
Run schedule every 20 minutes (test)
2020-02-05 11:53:46 +01:00
3326cda7e3
Schedule a base build everyday.
2020-02-05 11:25:18 +01:00
4b3178ea12
Github Kiwix Sponsoring page link
2020-02-01 17:55:53 +01:00
70b3ed0c76
Update docker images
2020-01-21 15:01:05 +01:00
1b7a2c812e
Add missing platforms.
...
No iOs for now.
2020-01-21 13:49:12 +01:00
f73e0b2abf
Build base deps on macos.
2020-01-21 13:49:12 +01:00
1d84266751
Build all base dependencies.
...
Use a custom script for this.
Set `SKIP_BIG_MEMORY_TEST` to avoid launching big test on libzim.
2020-01-21 13:49:12 +01:00
c178c6ea35
Upload an archive of the build directory in case of failure.
2020-01-21 13:49:12 +01:00
d37acc2cbe
Build basedeps archives on GithubAction.
...
Use a specific script to download/build the base deps.
Mainly based on script in travis/compile_all.py
2020-01-21 13:49:12 +01:00
ce45966d40
Add a GithubAction CI to build the docker images.
...
No really useful for now. But will be in next commit.
2020-01-21 13:49:12 +01:00
49cec493c4
Add configs for two Github bots
2019-12-14 15:12:31 +01:00
15eeb0bac8
Create FUNDING.yml
2019-06-22 07:56:57 +02:00
Matthieu Gautier
Emmanuel Engelhart
renaud gaudin
Veloman Yunkan
ChrisLi
renaud gaudin
Alexander Sashnov
ChrisLi