Commit Graph

90 Commits

Author SHA1 Message Date
Matthieu Gautier 07d1561a87 [CI] Build libkiwix on on native_mixed 2022-11-30 14:22:13 +01:00
Matthieu Gautier 84eea4a7ed Package all libzim dependencies on wasm.
Fix #552
2022-11-30 11:07:21 +01:00
Matthieu Gautier c27348bde3 Publish the CI only if we are on a dev branch.
If we try to publish all the time, we will conflict with `Release&Nigthly`
workflow as we would pulbish in nigthly directory.

Fix #550
2022-11-23 16:06:35 +01:00
Matthieu Gautier a44531bb8a Upload generated packages on `tmp/ci` when building on branches.
We need to be able to test our generated artefacts before we merge the
branches.
2022-11-16 16:37:05 +01:00
Matthieu Gautier ab421848c5 Use glob instead of specifying the lib_prefix.
There is no need to be specific here, we are already in INSTALL_DIR which
contains only things specific to our platform.
2022-11-16 16:37:05 +01:00
Matthieu Gautier 9881571047 Add packaging of libzim.a
Wasm build is creating a static library.
2022-11-16 16:37:05 +01:00
Matthieu Gautier 16fc490ae7 Add build of libzim on wasm in the CI 2022-11-16 16:37:05 +01:00
Matthieu Gautier 180fb249f6 Add a support to compile libzim for wasm.
`icu4c_wasm.patch` is build by :
 - Copying config.sub from liblzma source as new version of config.sub there
   knows about wasm architecture.
 - Copying `mh-linux` on `mh-unknown` as specified in (origin) `mh-unknown`.
   This is because icu4c configure doesn't detect `emscripten` platform and
   "fallback" to `mh-unknown`.
2022-11-16 16:37:05 +01:00
Matthieu Gautier dc814c626d Upload read-only archive.
By uploading read-only archive, we prevent potential (implicit) re-upload.

A re-upload will always be possible if we remove the archive and rerun
the workflow. But it will be clearly explicit in this case.
2022-09-28 16:08:42 +02:00
Matthieu Gautier f7706428a2 Make release only if we are running the workflow on a `r_xx` tag.
Also check that we are not a scheduled workflow
(But it is more a double check. This shloud not happen)
2022-09-28 15:09:53 +02:00
renaud gaudin fe92fc5080 Use notarytool to notarize on macOS
altool has been deprecated in favor of notarytool
2022-09-06 14:52:15 +00:00
Veloman Yunkan 1755044333 Added CI image for Alpine 2022-07-11 17:38:07 +04:00
Matthieu Gautier 33c2ec2c4d Build and release libzim for android on the CI 2022-06-28 12:24:06 +02:00
Matthieu Gautier 3764fde97e We don't need jdk anymore to build on android 2022-06-28 12:23:04 +02:00
Matthieu Gautier 6a3d3047e0 Do not try to package kiwix-search as it as been removed from kiwix-tools 2022-06-15 14:28:32 +02:00
Matthieu Gautier dba45ced36 Build android lib in the correct directory 2022-06-14 17:48:51 +02:00
Matthieu Gautier 9c220866ac Build and release each libkiwix android builds independently.
While it is ok to build all libkiwix android builds in one step,
the "release system" upload only one archive per platform.
So we need 4 platforms to do 4 uploads.

As we don't build on "android" platform now, we can clean up our scripts.
2022-06-10 10:26:24 +02:00
Matthieu Gautier 7086009a0a We don't need to upload to bintray now. 2022-06-10 10:11:01 +02:00
Matthieu Gautier 51ff5e58bb Be able to make the release of libkiwix on android. 2022-06-09 10:31:09 +02:00
Matthieu Gautier 72c271a74c Remove LibkiwixApp
The project was used to assemble all android compilation in one
multiplatform java archive.

This allow use to remove android_sdk and Gradle builder
2022-06-09 10:28:59 +02:00
Matthieu Gautier 733a730877 Do not notarize macos build on CI.
We still sign macos build on nigthly and release.
2022-05-17 18:05:43 +02:00
renaud gaudin f103cddd77 Trust codesign using the certificate
When build_release_nightly calls codesign to sign libzim.7.dylib, it appears to be
hanging forever.
What's most likely happening is that Keychain Access is prompting a password request
without any possibility to answer, given this is running on the CI.

It's unclear whether Keychain Access wants to confirm codesign can access the certificate
or if it is trying to unlock another (System) keychain to find the certificate or key.

This addresses the former.
2022-05-12 14:58:46 +00:00
renaud gaudin 8ec2cd9a11 Using sftp for mkdir step
As there is no shell, use SFTP's mkdir command to create the folders up to final path.
2022-04-04 13:53:20 +00:00
renaud gaudin 1351fc7f8b Target uploads to new dropbox address
SSH server which was used to receive file uploads (CI, nightly and release) has been
migrated to a new one on a different address.
Username, Key and paths are unchanged.
Most notable changes are the use of `master.download.kiwix.org` as the target in
replacement of `mirror.download.kiwix.org` (although it would still work) and the
Port to which SSH is listening on (30022 instead of 22)
2022-03-30 22:10:06 +00:00
Matthieu Gautier 90c2705b0e Fix workflow triggering in releaseNigthly workflow.
GITHUB_PAT is needed (and not needed for flatpak)
2022-03-28 10:49:14 +02:00
Matthieu Gautier f1ac1b0121 Build everything using bionic instead of xenial 2022-03-11 15:05:25 +01:00
Matthieu Gautier 32f1bfdab3 Do not force a specific version of meson.
We were forcing a spcefic version has a workaround to meson issue.
We don't need now, and recent version is needed to compile on armhf.
2022-03-11 15:04:17 +01:00
Matthieu Gautier 64ea01e445 [CI] Do not build zim-tools on armhf
zim-tools depends of docopt which need a recent enough version of gcc (4.9)
But we are using gcc 4.8.3 to cross compile on armhf.
2022-03-10 18:16:39 +01:00
Matthieu Gautier 6505e82c37 [CI] Do not build zim-tools on macOS cross-compilation target.
We still build zim-tools on macOs with native build.
2022-03-10 16:57:56 +01:00
Matthieu Gautier af3cff6aeb Build flatpak in CI 2022-03-10 16:21:14 +01:00
Matthieu Gautier cdf4dab0a5 Cross compile windows on fedora 35. 2022-03-10 15:19:51 +01:00
Matthieu Gautier 01e8f92348 Build the projects in the CI.
We used to build only the base dependencies in the CI
(and build the projects in nightly&Release workflow).
Now always build the projects.
2022-03-10 15:19:51 +01:00
Matthieu Gautier 0fb7dc63a7 Correctly detect if project is openzim or kiwix organization 2022-02-02 16:10:28 +01:00
Matthieu Gautier 5e6f68a3ef Use python 3.8 on macOS CI
Python 3.6 is not available anymore.
2022-02-02 15:18:20 +01:00
ChrisLi 1374e01c7a Make the CI build the new on the new MacOS archs. 2021-12-22 15:26:01 +01:00
Matthieu Gautier c78d5bbc72 Force version of python's module on xenial.
Xenial's python is 3.5 and recent versions of used python modules are
not supporting python 3.5 anymore.
We have to force specific versions for gcovr and its dependencies.
2021-10-19 11:28:26 +02:00
Matthieu Gautier 9c04df4fb2 [CI] Install automake and autoconf on macos. 2021-07-27 16:45:04 +02:00
Matthieu Gautier aa349a18e7 Rename kiwix-lib to libkiwix.
The new name of kiwix-lib is libkiwix. Let kiwix-build adopt the name.
2021-06-30 16:45:54 +02:00
Matthieu Gautier 43024859b1 Directly set the env variable in the docker file.
When running from the CI, .bashrc is not sourced so we must set the
env variable at docker file level.
2021-06-29 16:06:53 +02:00
Matthieu Gautier ed999d61af [CI] Do not try to install packages in the CI.
On the CI, packages should be already installed.
Don't try to install with kiwix-build.
2021-06-23 17:27:52 +02:00
Matthieu Gautier 73e0cec0aa Update bionic docker image to use qt 5.15 instead of default qt version. 2021-06-23 17:27:52 +02:00
Matthieu Gautier c445db171b Package zimrecreate in zim-tools. 2021-06-10 14:25:54 +02:00
Matthieu Gautier 1845879825 Add all files of zim-testing-suite to the generated base_deps archive. 2021-05-04 14:36:15 +02:00
renaud gaudin 079e03473b Change time server in workflow
For the past week, the Release&Nightly workflow failed on macOS native_mixed
(but not on native_dyn) when calling ntp to sync clock before signing.
Calling time.apple.com resulted in a DNS error, leading to an error in ntp call

Why this fails on native_mixed is unknown. Maybe because it's being called twice
from the same (I guess) host in a short interleave?

This attempts to fix this by:
- using google's time server instead of Apple's
- correctly setting the timeout param before the server name (although not relevant
for this dns-based error)
- Ignore failures to sync time. We're doing it to minimize chances of unsynched clocks
to fail the signature but this is not absolutely required all the time.
2021-03-23 12:46:20 +00:00
renaud gaudin 0de55705cf allow more time for ntp server to respond 2021-02-16 12:18:09 +00:00
renaud gaudin b3f66e0ac0 time update requires sudo 2021-02-15 09:42:50 +00:00
renaud gaudin fd590a5b4b fixed syntax for macOS signing 2021-02-11 08:06:06 +00:00
renaud gaudin ea55cac32d Fixed #469: Notarizing libzim release for macOS
This adds the notarization (see #469) of the libzim binary for macOS during the build.
It it not dependent on RELEASE so it benefits all builds.

It basically does two things:
- sign the build with our Developer ID certificate from Apple.
- Request notarization from Apple for the binary.
At the moment, it concerns only libzim. Might expand that to libkiwix and the zim/kiwix tools
once we start releasing those.

Github Actions prepare the certificate and environment, and signing+request is done in `notarize_macos_build()` (common.py)

It required the following new secrets:

| secret | value |
|---|---|
| `APPLE_SIGNING_CERTIFICATE` | base64 of the P12 certificate |
| `APPLE_SIGNING_P12_PASSWORD` | password for the P12 certificate (we chose that when exporting to P12. Apple doesnt provide P12) |
| `APPLE_SIGNING_IDENTITY`| Common name of our certificate. Not a private info but seems better suited there than in the CI |
| `APPLE_SIGNING_TEAM`| Apple Developer Team ID (mentionned in the signing identity) |
| `APPLE_SIGNING_ALTOOL_PASSWORD`| app-specific password created to request notarization |
| `APPLE_SIGNING_ALTOOL_USERNAME`| username associated with the app-specific password. Must be an Apple ID with perms on the Certificate. Currently mine. |
2021-02-09 13:30:24 +00:00
renaud gaudin ff66a96980 Fixed #465: trigger docker publish on release
This triggers a `workflow_dispatch` event on the `docker.yml` workflow or the matching
repository for both `zim-tools` and `kiwix-tools` targets that supports it.
2021-01-13 15:58:33 +00:00
Matthieu Gautier 6434150da9 [CI] Fix macos brew install packages (release&Nightly) 2020-10-28 16:40:02 +01:00