annotate llvm/docs/HowToAddABuilder.rst @ 235:edfff9242030 cbc-llvm13

...
author Shinji KONO <kono@ie.u-ryukyu.ac.jp>
date Wed, 21 Jul 2021 11:30:30 +0900
parents 2e18cbf3894f
children c4bab56944e8
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
150
anatofuz
parents:
diff changeset
1 ===================================================================
anatofuz
parents:
diff changeset
2 How To Add Your Build Configuration To LLVM Buildbot Infrastructure
anatofuz
parents:
diff changeset
3 ===================================================================
anatofuz
parents:
diff changeset
4
anatofuz
parents:
diff changeset
5 Introduction
anatofuz
parents:
diff changeset
6 ============
anatofuz
parents:
diff changeset
7
anatofuz
parents:
diff changeset
8 This document contains information about adding a build configuration and
207
Shinji KONO <kono@ie.u-ryukyu.ac.jp>
parents: 173
diff changeset
9 buildbot-worker to private worker builder to LLVM Buildbot Infrastructure.
150
anatofuz
parents:
diff changeset
10
anatofuz
parents:
diff changeset
11 Buildmasters
anatofuz
parents:
diff changeset
12 ============
anatofuz
parents:
diff changeset
13
anatofuz
parents:
diff changeset
14 There are two buildmasters running.
anatofuz
parents:
diff changeset
15
anatofuz
parents:
diff changeset
16 * The main buildmaster at `<http://lab.llvm.org:8011>`_. All builders attached
anatofuz
parents:
diff changeset
17 to this machine will notify commit authors every time they break the build.
anatofuz
parents:
diff changeset
18 * The staging buildbot at `<http://lab.llvm.org:8014>`_. All builders attached
anatofuz
parents:
diff changeset
19 to this machine will be completely silent by default when the build is broken.
anatofuz
parents:
diff changeset
20 Builders for experimental backends should generally be attached to this
anatofuz
parents:
diff changeset
21 buildmaster.
anatofuz
parents:
diff changeset
22
anatofuz
parents:
diff changeset
23 Steps To Add Builder To LLVM Buildbot
anatofuz
parents:
diff changeset
24 =====================================
207
Shinji KONO <kono@ie.u-ryukyu.ac.jp>
parents: 173
diff changeset
25 Volunteers can provide their build machines to work as build workers to
150
anatofuz
parents:
diff changeset
26 public LLVM Buildbot.
anatofuz
parents:
diff changeset
27
anatofuz
parents:
diff changeset
28 Here are the steps you can follow to do so:
anatofuz
parents:
diff changeset
29
anatofuz
parents:
diff changeset
30 #. Check the existing build configurations to make sure the one you are
anatofuz
parents:
diff changeset
31 interested in is not covered yet or gets built on your computer much
anatofuz
parents:
diff changeset
32 faster than on the existing one. We prefer faster builds so developers
anatofuz
parents:
diff changeset
33 will get feedback sooner after changes get committed.
anatofuz
parents:
diff changeset
34
anatofuz
parents:
diff changeset
35 #. The computer you will be registering with the LLVM buildbot
anatofuz
parents:
diff changeset
36 infrastructure should have all dependencies installed and you can
anatofuz
parents:
diff changeset
37 actually build your configuration successfully. Please check what degree
anatofuz
parents:
diff changeset
38 of parallelism (-j param) would give the fastest build. You can build
anatofuz
parents:
diff changeset
39 multiple configurations on one computer.
anatofuz
parents:
diff changeset
40
207
Shinji KONO <kono@ie.u-ryukyu.ac.jp>
parents: 173
diff changeset
41 #. Install buildbot-worker (currently we are using buildbot version 2.8.5).
Shinji KONO <kono@ie.u-ryukyu.ac.jp>
parents: 173
diff changeset
42 Depending on the platform, buildbot-worker could be available to download and
150
anatofuz
parents:
diff changeset
43 install with your package manager, or you can download it directly from
anatofuz
parents:
diff changeset
44 `<http://trac.buildbot.net>`_ and install it manually.
anatofuz
parents:
diff changeset
45
207
Shinji KONO <kono@ie.u-ryukyu.ac.jp>
parents: 173
diff changeset
46 #. Create a designated user account, your buildbot-worker will be running under,
150
anatofuz
parents:
diff changeset
47 and set appropriate permissions.
anatofuz
parents:
diff changeset
48
207
Shinji KONO <kono@ie.u-ryukyu.ac.jp>
parents: 173
diff changeset
49 #. Choose the buildbot-worker root directory (all builds will be placed under
Shinji KONO <kono@ie.u-ryukyu.ac.jp>
parents: 173
diff changeset
50 it), buildbot-worker access name and password the build master will be using
Shinji KONO <kono@ie.u-ryukyu.ac.jp>
parents: 173
diff changeset
51 to authenticate your buildbot-worker.
150
anatofuz
parents:
diff changeset
52
207
Shinji KONO <kono@ie.u-ryukyu.ac.jp>
parents: 173
diff changeset
53 #. Create a buildbot-worker in context of that buildbot-worker account. Point it
Shinji KONO <kono@ie.u-ryukyu.ac.jp>
parents: 173
diff changeset
54 to the **lab.llvm.org** port **9990** (see `Buildbot documentation,
Shinji KONO <kono@ie.u-ryukyu.ac.jp>
parents: 173
diff changeset
55 Creating a worker
Shinji KONO <kono@ie.u-ryukyu.ac.jp>
parents: 173
diff changeset
56 <http://docs.buildbot.net/current/tutorial/firstrun.html#creating-a-worker>`_
150
anatofuz
parents:
diff changeset
57 for more details) by running the following command:
anatofuz
parents:
diff changeset
58
anatofuz
parents:
diff changeset
59 .. code-block:: bash
anatofuz
parents:
diff changeset
60
207
Shinji KONO <kono@ie.u-ryukyu.ac.jp>
parents: 173
diff changeset
61 $ buildbot-worker create-worker <buildbot-worker-root-directory> \
150
anatofuz
parents:
diff changeset
62 lab.llvm.org:9990 \
207
Shinji KONO <kono@ie.u-ryukyu.ac.jp>
parents: 173
diff changeset
63 <buildbot-worker-access-name> \
Shinji KONO <kono@ie.u-ryukyu.ac.jp>
parents: 173
diff changeset
64 <buildbot-worker-access-password>
150
anatofuz
parents:
diff changeset
65
207
Shinji KONO <kono@ie.u-ryukyu.ac.jp>
parents: 173
diff changeset
66 To point a worker to silent master please use lab.llvm.org:9994 instead
150
anatofuz
parents:
diff changeset
67 of lab.llvm.org:9990.
anatofuz
parents:
diff changeset
68
207
Shinji KONO <kono@ie.u-ryukyu.ac.jp>
parents: 173
diff changeset
69 #. Fill the buildbot-worker description and admin name/e-mail. Here is an
Shinji KONO <kono@ie.u-ryukyu.ac.jp>
parents: 173
diff changeset
70 example of the buildbot-worker description::
150
anatofuz
parents:
diff changeset
71
anatofuz
parents:
diff changeset
72 Windows 7 x64
anatofuz
parents:
diff changeset
73 Core i7 (2.66GHz), 16GB of RAM
anatofuz
parents:
diff changeset
74
anatofuz
parents:
diff changeset
75 g++.exe (TDM-1 mingw32) 4.4.0
anatofuz
parents:
diff changeset
76 GNU Binutils 2.19.1
anatofuz
parents:
diff changeset
77 cmake version 2.8.4
anatofuz
parents:
diff changeset
78 Microsoft(R) 32-bit C/C++ Optimizing Compiler Version 16.00.40219.01 for 80x86
anatofuz
parents:
diff changeset
79
207
Shinji KONO <kono@ie.u-ryukyu.ac.jp>
parents: 173
diff changeset
80 #. Make sure you can actually start the buildbot-worker successfully. Then set
Shinji KONO <kono@ie.u-ryukyu.ac.jp>
parents: 173
diff changeset
81 up your buildbot-worker to start automatically at the start up time. See the
150
anatofuz
parents:
diff changeset
82 buildbot documentation for help. You may want to restart your computer
anatofuz
parents:
diff changeset
83 to see if it works.
anatofuz
parents:
diff changeset
84
207
Shinji KONO <kono@ie.u-ryukyu.ac.jp>
parents: 173
diff changeset
85 #. Send a patch which adds your build worker and your builder to
Shinji KONO <kono@ie.u-ryukyu.ac.jp>
parents: 173
diff changeset
86 `zorg <https://github.com/llvm/llvm-zorg>`_. Use the typical LLVM
Shinji KONO <kono@ie.u-ryukyu.ac.jp>
parents: 173
diff changeset
87 `workflow <https://llvm.org/docs/Contributing.html#how-to-submit-a-patch>`_.
150
anatofuz
parents:
diff changeset
88
207
Shinji KONO <kono@ie.u-ryukyu.ac.jp>
parents: 173
diff changeset
89 * workers are added to ``buildbot/osuosl/master/config/workers.py``
150
anatofuz
parents:
diff changeset
90 * builders are added to ``buildbot/osuosl/master/config/builders.py``
anatofuz
parents:
diff changeset
91
anatofuz
parents:
diff changeset
92 Please make sure your builder name and its builddir are unique through the
anatofuz
parents:
diff changeset
93 file.
anatofuz
parents:
diff changeset
94
207
Shinji KONO <kono@ie.u-ryukyu.ac.jp>
parents: 173
diff changeset
95 It is possible to allow email addresses to unconditionally receive
150
anatofuz
parents:
diff changeset
96 notifications on build failure; for this you'll need to add an
anatofuz
parents:
diff changeset
97 ``InformativeMailNotifier`` to ``buildbot/osuosl/master/config/status.py``.
anatofuz
parents:
diff changeset
98 This is particularly useful for the staging buildmaster which is silent
anatofuz
parents:
diff changeset
99 otherwise.
anatofuz
parents:
diff changeset
100
207
Shinji KONO <kono@ie.u-ryukyu.ac.jp>
parents: 173
diff changeset
101 #. Send the buildbot-worker access name and the access password directly to
150
anatofuz
parents:
diff changeset
102 `Galina Kistanova <mailto:gkistanova@gmail.com>`_, and wait till she
anatofuz
parents:
diff changeset
103 will let you know that your changes are applied and buildmaster is
anatofuz
parents:
diff changeset
104 reconfigured.
anatofuz
parents:
diff changeset
105
207
Shinji KONO <kono@ie.u-ryukyu.ac.jp>
parents: 173
diff changeset
106 #. Check the status of your buildbot-worker on the `Waterfall Display
Shinji KONO <kono@ie.u-ryukyu.ac.jp>
parents: 173
diff changeset
107 <http://lab.llvm.org:8011/#/waterfall>`_ to make sure it is connected, and
Shinji KONO <kono@ie.u-ryukyu.ac.jp>
parents: 173
diff changeset
108 ``http://lab.llvm.org:8011/#/workers`` to see if administrator contact and
Shinji KONO <kono@ie.u-ryukyu.ac.jp>
parents: 173
diff changeset
109 worker information are correct.
150
anatofuz
parents:
diff changeset
110
anatofuz
parents:
diff changeset
111 #. Wait for the first build to succeed and enjoy.