Job builder-freebsd

README

Skip to build

builder - scheduling and executing jobs

This consists of two programs, a client and a server. The single server contains a queue of jobs, which are consumed by a client. Any number of clients can be connected to the server.

The server keeps persistent state of the job queue (so restarts / crashes are dealt with). A client connects, provides some information about itself, and then waits for a job. Once a job is read and accepted, it is executed by the client. Resulting artifacts can be transferred by the client to the server.

The server has the ability to schedule jobs at regular intervals - similar to crontab - but clients are usually executed in sandboxes/ jailed environments.

Handled and unhandled error conditions:

Left to do:

Build 2021-07-22 21:41:04 -00:00

Back to readme

Build took 11min28s.

Execution result: exited 0.

Comparisons with other builds

With build 2021-07-21 21:35:15 -00:00 (output is identical binary)
With build 2021-07-20 21:54:28 -00:00 (output is identical binary)

Build artifacts

bin/builder.txz
SHA256:c44f19a30901794b08ae97596bc4288cf2f9e47f188240c8fff2ca5023385312 (2.07MB)
build-environment
SHA256:75bae4561a95d86d953ca49e4856645263c9b11d5299efb188a15ac5baa57db1 (265B)
opam-switch
SHA256:f6d82b37a51f1cb034ad8cda8e638e6f8709a327aca35c05df73d38267d4b069 (55.5kB)
system-packages
SHA256:02abf043a5818d501669e84c4a8e7c8bab5899cfcba993e2fbc1082bcef2d1f3 (238B)

Job script

#!/bin/sh

set -ex

fetch http://127.0.2.1:3000/job/orb-freebsd/build/latest/f/bin/orb.txz && pkg install -y orb.txz && rm orb.txz

repos="default:https://opam.ocaml.org,unikernels:https://git.robur.io/robur/unikernel-repo.git"
orb build --solver-timeout=600 --switch-name=/tmp/myswitch --date=1589138087 --out=. --repos=$repos builder

Build log

78 ms+ fetch http://127.0.2.1:3000/job/orb-freebsd/build/latest/f/bin/orb.txz
328 msorb.txz 3334 kB 244 MBps 00s
328 ms+ pkg install -y orb.txz
328 msUpdating poudriere repository catalogue...
368 mspoudriere repository is up to date.
368 msAll repositories are up to date.
988 msThe following 13 package(s) will be affected (of 0 checked):
988 ms
988 msNew packages to be INSTALLED:
988 ms bash: 5.1.8
988 ms ca_root_nss: 3.68
988 ms curl: 7.78.0
988 ms expat: 2.4.1
988 ms gettext-runtime: 0.21
988 ms git: 2.32.0_1
988 ms gmake: 4.3_2
988 ms libffi: 3.3_1
988 ms mpdecimal: 2.5.1
988 ms orb: 02deb66a
988 ms patch: 2.7.6_2
988 ms python38: 3.8.11
988 ms readline: 8.1.1
988 ms
988 msNumber of packages to be installed: 13
988 ms
988 msThe process will require 161 MiB more space.
988 ms24 MiB to be downloaded.
988 ms[orbd.orb] [1/13] Fetching gmake-4.3_2.txz: .......... done
1_028 ms[orbd.orb] [2/13] Fetching ca_root_nss-3.68.txz: .......... done
1_028 ms[orbd.orb] [3/13] Fetching bash-5.1.8.txz: .......... done
1_138 ms[orbd.orb] [4/13] Fetching readline-8.1.1.txz: .......... done
1_258 ms[orbd.orb] [5/13] Fetching git-2.32.0_1.txz: .......... done
1_298 ms[orbd.orb] [6/13] Fetching expat-2.4.1.txz: .......... done
1_768 ms[orbd.orb] [7/13] Fetching python38-3.8.11.txz: .......... done
2_120 ms[orbd.orb] [8/13] Fetching mpdecimal-2.5.1.txz: .......... done
2_120 ms[orbd.orb] [9/13] Fetching libffi-3.3_1.txz: ..... done
2_120 ms[orbd.orb] [10/13] Fetching gettext-runtime-0.21.txz: .......... done
2_158 ms[orbd.orb] [11/13] Fetching curl-7.78.0.txz: .......... done
2_198 ms[orbd.orb] [12/13] Fetching patch-2.7.6_2.txz: .......... done
2_598 msChecking integrity... done (0 conflicting)
2_598 ms[orbd.orb] [13/13] Installing ca_root_nss-3.68...
2_638 ms[orbd.orb] Extracting ca_root_nss-3.68: ........ done
2_738 ms[orbd.orb] [1/13] Installing readline-8.1.1...
2_818 ms[orbd.orb] [1/13] Extracting readline-8.1.1: .......... done
3_058 ms[orbd.orb] [2/13] Installing mpdecimal-2.5.1...
3_141 ms[orbd.orb] [2/13] Extracting mpdecimal-2.5.1: .......... done
3_288 ms[orbd.orb] [3/13] Installing libffi-3.3_1...
3_288 ms[orbd.orb] [3/13] Extracting libffi-3.3_1: .......... done
3_568 ms[orbd.orb] [4/13] Installing gettext-runtime-0.21...
3_688 ms[orbd.orb] [4/13] Extracting gettext-runtime-0.21: .......... done
3_998 ms[orbd.orb] [5/13] Installing expat-2.4.1...
4_041 ms[orbd.orb] [5/13] Extracting expat-2.4.1: .......... done
4_298 ms[orbd.orb] [6/13] Installing python38-3.8.11...
12_658 ms[orbd.orb] [6/13] Extracting python38-3.8.11: .......... done
13_818 ms[orbd.orb] [7/13] Installing curl-7.78.0...
14_628 ms[orbd.orb] [7/13] Extracting curl-7.78.0: .......... done
15_918 ms[orbd.orb] [8/13] Installing gmake-4.3_2...
15_958 ms[orbd.orb] [8/13] Extracting gmake-4.3_2: ......... done
16_988 ms[orbd.orb] [9/13] Installing bash-5.1.8...
17_838 ms[orbd.orb] [9/13] Extracting bash-5.1.8: .......... done
18_288 ms[orbd.orb] [10/13] Installing git-2.32.0_1...
18_428 ms===> Creating groups.
18_428 msCreating group 'git_daemon' with gid '964'.
18_538 ms===> Creating users
18_538 msCreating user 'git_daemon' with uid '964'.
21_918 ms[orbd.orb] [10/13] Extracting git-2.32.0_1: .......... done
22_178 ms[orbd.orb] [11/13] Installing patch-2.7.6_2...
22_178 ms[orbd.orb] [11/13] Extracting patch-2.7.6_2: ..... done
22_288 ms[orbd.orb] [12/13] Installing orb-02deb66a...
23_068 ms[orbd.orb] [12/13] Extracting orb-02deb66a: .. done
23_758 ms=====
23_758 msMessage from ca_root_nss-3.68:
23_758 ms
23_758 ms--
23_758 msFreeBSD does not, and can not warrant that the certification authorities
23_758 mswhose certificates are included in this package have in any way been
23_758 msaudited for trustworthiness or RFC 3647 compliance.
23_758 ms
23_758 msAssessment and verification of trust is the complete responsibility of the
23_758 mssystem administrator.
23_758 ms
23_758 ms
23_759 msThis package installs symlinks to support root certificates discovery by
23_759 msdefault for software that uses OpenSSL.
23_759 ms
23_759 msThis enables SSL Certificate Verification by client software without manual
23_759 msintervention.
23_759 ms
23_759 msIf you prefer to do this manually, replace the following symlinks with
23_759 mseither an empty file or your site-local certificate bundle.
23_759 ms
23_759 ms * /etc/ssl/cert.pem
23_759 ms * /usr/local/etc/ssl/cert.pem
23_759 ms * /usr/local/openssl/cert.pem
23_759 ms=====
23_759 msMessage from python38-3.8.11:
23_759 ms
23_759 ms--
23_759 msNote that some standard Python modules are provided as separate ports
23_759 msas they require additional dependencies. They are available as:
23_759 ms
23_759 mspy38-gdbm databases/py-gdbm@py38
23_759 mspy38-sqlite3 databases/py-sqlite3@py38
23_838 mspy38-tkinter x11-toolkits/py-tkinter@py38
23_838 ms=====
23_838 msMessage from git-2.32.0_1:
23_838 ms
23_838 ms--
23_838 msIf you installed the GITWEB option please follow these instructions:
23_838 ms
23_838 msIn the directory /usr/local/share/examples/git/gitweb you can find all files to
23_838 msmake gitweb work as a public repository on the web.
23_838 ms
23_838 msAll you have to do to make gitweb work is:
23_838 ms1) Please be sure you're able to execute CGI scripts in
23_838 ms /usr/local/share/examples/git/gitweb.
23_838 ms2) Set the GITWEB_CONFIG variable in your webserver's config to
23_838 ms /usr/local/etc/git/gitweb.conf. This variable is passed to gitweb.cgi.
23_838 ms3) Restart server.
23_838 ms
23_838 ms
23_838 msIf you installed the CONTRIB option please note that the scripts are
23_838 msinstalled in /usr/local/share/git-core/contrib. Some of them require
23_838 msother ports to be installed (perl, python, etc), which you may need to
23_838 msinstall manually.
24_688 ms+ rm orb.txz
24_688 ms+ repos=default:https://opam.ocaml.org,unikernels:https://git.robur.io/robur/unikernel-repo.git
24_688 ms+ orb build '--solver-timeout=600' '--switch-name=/tmp/myswitch' '--date=1589138087' '--out=.' '--repos=default:https://opam.ocaml.org,unikernels:https://git.robur.io/robur/unikernel-repo.git' builder
24_728 ms
24_728 ms<><> Fetching repository information ><><><><><><><><><><><><><><><><><><><><><>
24_768 ms[empty] Initialised
26_958 ms[unikernels] Initialised
44_818 ms[default] Initialised
87_789 ms[ORB] Switch /tmp/myswitch/build created!
87_789 ms[ORB] Install start
88_738 ms[ORB] Install builder
102_648 msThe following actions will be performed:
102_648 ms - install ocaml-options-vanilla 1
102_648 ms - install conf-gmp 3 [required by zarith]
102_648 ms - install base-unix base [required by bos, curly]
102_648 ms - install ocaml-base-compiler 4.12.0 [required by ocaml]
102_648 ms - install base-bigarray base
102_648 ms - install base-threads base [required by logs]
102_648 ms - install ocaml-config 2 [required by ocaml]
102_648 ms - install ocaml 4.12.0 [required by builder]
102_648 ms - install seq base [required by fmt]
102_648 ms - install ocamlfind 1.9.1 [required by bos, uuidm]
102_648 ms - install ocamlbuild 0.14.0 [required by bos, uuidm]
102_648 ms - install dune 2.9.0 [required by builder]
102_648 ms - install cmdliner 1.0.4 [required by builder]
102_648 ms - install zarith 1.12 [required by asn1-combinators]
102_648 ms - install base-bytes base [required by ocplib-endian]
102_648 ms - install topkg 1.0.3 [required by bos, uuidm]
102_648 ms - install stdlib-shims 0.3.0 [required by asn1-combinators]
102_648 ms - install result 1.5 [required by curly]
102_648 ms - install mmap 1.1.0 [required by lwt]
102_648 ms - install duration 0.1.3 [required by builder]
102_648 ms - install csexp 1.5.1 [required by dune-configurator]
102_648 ms - install cppo 1.6.7 [required by lwt]
102_648 ms - install bigarray-compat 1.0.0 [required by asn1-combinators]
102_648 ms - install bheap 2.0.0 [required by builder]
102_648 ms - install base64 3.5.0 [required by builder]
102_648 ms - install uuidm 0.9.7 [required by builder]
102_648 ms - install astring 0.8.5 [required by bos]
102_648 ms - install fmt 0.8.9 [required by builder]
102_649 ms - install rresult 0.6.0 [required by builder]
102_649 ms - install ptime 0.8.5 [required by builder]
102_649 ms - install curly 0.2.0 [required by builder]
102_649 ms - install dune-configurator 2.9.0 [required by lwt]
102_649 ms - install ocplib-endian 1.1 [required by lwt]
102_649 ms - install cstruct 6.0.0 [required by builder]
102_649 ms - install fpath 0.7.3 [required by builder]
102_649 ms - install lwt 5.4.1 [required by builder]
102_649 ms - install asn1-combinators 0.2.5 [required by builder]
102_649 ms - install logs 0.7.0 [required by builder]
102_649 ms - install bos 0.2.0 [required by builder]
102_649 ms - install builder 0.0.1~dev
102_649 ms===== 40 to install =====
102_649 ms
102_649 ms<><> Processing actions <><><><><><><><><><><><><><><><><><><><><><><><><><><><>
115_068 ms-> installed base-bigarray.base
115_068 ms-> installed base-threads.base
115_068 ms-> installed base-unix.base
115_112 ms-> retrieved base64.3.5.0 (https://opam.ocaml.org/cache)
115_200 ms-> retrieved asn1-combinators.0.2.5 (https://opam.ocaml.org/cache)
115_200 ms-> retrieved astring.0.8.5 (https://opam.ocaml.org/cache)
115_908 ms-> retrieved bheap.2.0.0 (https://opam.ocaml.org/cache)
115_908 ms-> retrieved bigarray-compat.1.0.0 (https://opam.ocaml.org/cache)
116_139 ms-> retrieved bos.0.2.0 (https://opam.ocaml.org/cache)
116_178 ms-> installed conf-gmp.3
116_938 ms-> retrieved cmdliner.1.0.4 (https://opam.ocaml.org/cache)
117_058 ms-> retrieved cppo.1.6.7 (https://opam.ocaml.org/cache)
117_678 ms-> retrieved csexp.1.5.1 (https://opam.ocaml.org/cache)
118_408 ms-> retrieved curly.0.2.0 (https://opam.ocaml.org/cache)
118_688 ms-> retrieved cstruct.6.0.0 (https://opam.ocaml.org/cache)
121_048 ms-> retrieved builder.0.0.1~dev (git+https://github.com/roburio/builder.git)
122_408 ms-> retrieved duration.0.1.3 (https://opam.ocaml.org/cache)
123_218 ms-> retrieved fmt.0.8.9 (https://opam.ocaml.org/cache)
126_121 ms-> retrieved dune.2.9.0 (https://opam.ocaml.org/cache)
126_222 ms-> retrieved fpath.0.7.3 (https://opam.ocaml.org/cache)
126_988 ms-> retrieved logs.0.7.0 (https://opam.ocaml.org/cache)
131_418 ms-> retrieved dune-configurator.2.9.0 (https://opam.ocaml.org/cache)
131_458 ms-> retrieved mmap.1.1.0 (https://opam.ocaml.org/cache)
131_458 ms-> installed ocaml-options-vanilla.1
131_721 ms-> retrieved lwt.5.4.1 (https://opam.ocaml.org/cache)
133_128 ms-> retrieved ocamlbuild.0.14.0 (https://opam.ocaml.org/cache)
133_301 ms-> retrieved ocamlfind.1.9.1 (https://opam.ocaml.org/cache)
133_988 ms-> retrieved ocplib-endian.1.1 (https://opam.ocaml.org/cache)
134_168 ms-> retrieved ptime.0.8.5 (https://opam.ocaml.org/cache)
134_711 ms-> retrieved result.1.5 (https://opam.ocaml.org/cache)
134_931 ms-> retrieved rresult.0.6.0 (https://opam.ocaml.org/cache)
135_378 ms-> retrieved stdlib-shims.0.3.0 (https://opam.ocaml.org/cache)
136_021 ms-> retrieved topkg.1.0.3 (https://opam.ocaml.org/cache)
136_098 ms-> retrieved uuidm.0.9.7 (https://opam.ocaml.org/cache)
148_798 ms-> retrieved ocaml-base-compiler.4.12.0 (https://opam.ocaml.org/cache)
150_488 ms-> retrieved zarith.1.12 (https://opam.ocaml.org/cache)
474_928 ms-> installed ocaml-base-compiler.4.12.0
474_928 ms-> installed ocaml-config.2
475_118 ms-> installed ocaml.4.12.0
476_598 ms-> installed seq.base
481_168 ms-> installed cmdliner.1.0.4
483_874 ms-> installed ocamlfind.1.9.1
483_908 ms-> installed base-bytes.base
493_188 ms-> installed ocamlbuild.0.14.0
494_108 ms-> installed zarith.1.12
504_661 ms-> installed topkg.1.0.3
506_488 ms-> installed uuidm.0.9.7
509_298 ms-> installed astring.0.8.5
510_848 ms-> installed fpath.0.7.3
513_248 ms-> installed dune.2.9.0
514_108 ms-> installed bheap.2.0.0
514_388 ms-> installed bigarray-compat.1.0.0
514_780 ms-> installed duration.0.1.3
514_780 ms-> installed csexp.1.5.1
514_818 ms-> installed mmap.1.1.0
515_128 ms-> installed stdlib-shims.0.3.0
515_378 ms-> installed result.1.5
521_468 ms-> installed curly.0.2.0
521_468 ms-> installed fmt.0.8.9
521_508 ms-> installed cstruct.6.0.0
521_508 ms-> installed cppo.1.6.7
521_668 ms-> installed base64.3.5.0
522_548 ms-> installed rresult.0.6.0
522_548 ms-> installed ocplib-endian.1.1
524_178 ms-> installed ptime.0.8.5
526_128 ms-> installed asn1-combinators.0.2.5
526_248 ms-> installed dune-configurator.2.9.0
542_858 ms-> installed lwt.5.4.1
550_298 ms-> installed logs.0.7.0
560_618 ms-> installed bos.0.2.0
583_378 ms-> installed builder.0.0.1~dev
619_418 msDone.
619_418 ms# Run eval $(opam env --switch=/tmp/myswitch/build) to update the current shell environment
619_418 ms[ORB] Installed builder
681_978 ms[ORB] tracking map got locks
681_978 ms[ORB] tracking map 1 atoms (package set 40 - 19582 packages)
681_978 ms[ORB] tracking map 1 packages
681_978 ms[ORB] tracking map 1 packages later
681_978 ms[ORB] tracking map got st and 1 packages (1 atoms_or_locals)
681_978 ms[ORB] tracking map got tr, dropping states
682_019 mscp: /tmp/myswitch/build/_opam/doc/builder is a directory (not copied).
682_019 ms[ORB] failed to copy /tmp/myswitch/build/_opam/doc/builder to ./doc/builder
682_019 ms[ORB] writing /tmp/builder-1afcc6/builder.build-hashes
682_578 ms[ORB] cleaning up
687_908 ms[ORB] Switch /tmp/myswitch/build removed
687_948 ms[ORB] cleaning up