Skip to content
Snippets Groups Projects
Commit b8d04544 authored by Hugo Trentesaux's avatar Hugo Trentesaux
Browse files

wip document bootstrap process

parent ba2d4ee1
No related branches found
No related tags found
No related merge requests found
This commit is part of merge request !114. Comments created here will be created in the context of that merge request.
docs/dev/img/pipeline_screenshot.png

26.6 KiB

# How to launch a live network
## 1. Choose the currency type
Launching a new live network is more difficult than spawning a local blockchain. Follow this process if you know what you are doing and you already experimented a bit with local blockchains. Part of this process is automated with Rust scripts, including interaction with GitLab's GraphQL API. Do not hesitate to improve and complete it (see TODOs inside `xtask/**/*.rs` files).
## Requirements
In order to build in a standardized environment, you need Docker.
- see docker docs to [install docker](https://docs.docker.com/engine/install/)
- make sure you can run docker as non-root user with `docker info`
## Preparation
### Runtime tag
When launching a new network, you're likely to use a new runtime for the genesis. Our runtime tags use `xxyy` version numbers where `x` corresponds to major change and `y` hotfix or minor change.
1. Make sure to move any issue or merge request assigned to the choosen milestone `runtime-xxyy` to the next one. This prevents from forgetting unfinished work.
1. Check that the [CI on master](https://git.duniter.org/nodes/rust/duniter-v2s/-/pipelines?scope=all&page=1&ref=master) is passing. This is necessary to build the docker images.
1. Increment the `spec_version` in the code. Example `spec_version: 300` -> `spec_version: 400`.
At this point, you might want to merge this commit in master and publish the branch (TODO automate).
### Release tasks
We choose [`xtask`](https://github.com/matklad/cargo-xtask/) to run Rust scripts using `cargo`. To build these scripts, just run:
```bash
cargo xtask # this will build the scripts and show the available commands
```
To interact with GitLab, the `release_runtime` script uses the environment variable `GITLAB_TOKEN` which must contain a token with write permission on the repository. Go to your [personal access token preferences](https://git.duniter.org/-/profile/personal_access_tokens) to generate one and `export` it (you might want to add it to your `.bashrc`). You can then run this command:
```bash
cargo xtask release-runtime 400 # requires to run docker as non-root user
```
This command does the following things (use your system monitor to track de progress as it produces not log):
1. download the [`paritytech/srtool`](https://docs.substrate.io/reference/command-line-tools/srtool/) (Substrate Runtime TOOLbox) docker image (about 2 minutes with a good connection). It is a docker container enabling to build the Substrate WebAssembly runtime in a deterministic way (machine-independant).
1. build gdev runtime in release mode using `srtool` (about 5 minutes depending on your computing power). The target is put in the `runtime/gdev/target` folder (about 2GB).
1. generate release notes using the template in `xtask/res`
1. publish the relase with the notes on GitLab using your `GITLAB_TOKEN`
### Substrate client docker image
Go to the pipeline and run the manual tasks as shown on the below screenshot.
- `build_release_manual`
- `deploy_docker_release_sha`
![pipeline screenshot](./img/pipeline_screenshot.png)
## Deployment
### Choose the currency type
Ensure that the currency type you want has the requirements.
......@@ -9,14 +62,14 @@ For now, only `gdev` is supported.
In the commands that will be indicated afterwards, you will have to replace `CURRENCY` by the
currency type you have chosen.
## 2. Choose the docker image
### Choose the docker image
Choose or build the docker image that contains the version of the code thut you want to use.
Choose the docker image that contains the version of the code that you want to use.
In the commands that will be indicated afterwards, you will have to replace `TAG` by the tag of the
docker image that you have chosen.
## 3. Generate the session keys of genesis authority
### Generate the session keys of genesis authority
Generate a random secret phrase:
......@@ -39,11 +92,11 @@ $ docker run --rm -it --entrypoint duniter duniter/duniter-v2s:TAG key generate-
Session Keys: 0x87189d723e1b2826c243bc433c718ac26ba60526932216a09102a254d54462b890a0c2866034db9d05f8193a95fe5af8d5e12ab295a501c17c95cdbeaf226d6290a0c2866034db9d05f8193a95fe5af8d5e12ab295a501c17c95cdbeaf226d6290a0c2866034db9d05f8193a95fe5af8d5e12ab295a501c17c95cdbeaf226d62
```
## 4. Paste sessions keys in the genesis configuration file
### Paste sessions keys in the genesis configuration file
An example of genesis configuration file: `resources/gdev.json`
An example of genesis configuration file: `resources/gdev.json`. Paste your session keys in your `smith` identity with key `session_keys`.
## 5. Generate raw spec
### Generate raw spec
```docker
docker run -v $HOME/dev/duniter-v2s/resources:/var/lib/duniter/resources -e DUNITER_GENESIS_CONFIG=/var/lib/duniter/resources/gdev.json --rm -it --entrypoint duniter duniter/duniter-v2s:TAG build-spec -lerror --chain=gdev-gl --raw > name-raw.json
......@@ -53,7 +106,9 @@ docker run -v $HOME/dev/duniter-v2s/resources:/var/lib/duniter/resources -e DUNI
./scripts/gen-live-network-raw-spec.sh CURRENCY "<path/to/your/genesis/config/file>"
```
## 6. Generate the docker compose and prepare nodes keys
This builds the specs using debug version of Duniter.
### Generate the docker compose and prepare nodes keys
```bash
./scripts/create-live-network.sh "<your secret phrase>" CURRENCY "<path/to/dist/folder>"
......@@ -64,8 +119,6 @@ root of the distribution folder:
```bash
scp -r -P SSH_PORT "<path/to/dist/folder>" user@ip:/remote/dist/path
cd "<path/to/dist/folder>"
docker compose up -d
```
Then, on the server:
......@@ -74,3 +127,33 @@ Then, on the server:
cd "<path/to/dist/folder>"
docker compose up -d
```
## Finalization
The following steps should be completed when you are satisfied with the network.
### Rotate session keys
You should rotate session keys for more secured keys (the one you used before are still in your bash history and your clipboard and could have been intercepted by an attacker). Update the raw chainspec json file with your new session keys.
TODO explain how with polkadotjs + vpn
### Inject chainspec
Once you updated your session keys, inject the runtime code inside the raw chainspec.
```bash
cargo xtask inject-runtime-code --runtime runtime/gdev/target/srtool/release/wbuild/gdev-runtime/gdev_runtime.compact.compressed.wasm --raw-spec resources/gdev-raw.json
```
### Publish image
TODO
### Tell the other smith
Once you completed all these steps, the other smith can pull the docker image with a genesis containing your bootnode with the correct session keys. They can base their `docker-compose.yml` on the `duniter-validator` template.
---
TODO rusty-hook pb?
\ No newline at end of file
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment