2016-11-30 21:42:22 +01:00
# BOLT #1: Base Protocol
2016-11-30 21:05:50 +01:00
2016-11-30 21:42:22 +01:00
## Overview
This protocol assumes an underlying authenticated and ordered transport mechanism that takes care of framing individual messages.
2016-12-06 15:54:10 +01:00
[BOLT #8 ](08-transport.md ) specifies the canonical transport layer used in Lightning, though it can be replaced by any transport that fulfills the above guarantees.
2016-11-30 21:05:50 +01:00
2016-12-09 15:17:11 +01:00
The default TCP port is 9735. This corresponds to hexadecimal `0x2607` , the unicode code point for LIGHTNING.< sup > [1 ](#reference-1 )</ sup >
2016-11-30 21:05:50 +01:00
All data fields are big-endian unless otherwise specified.
2016-12-05 12:45:47 +01:00
## Table of Contents
2017-02-14 16:02:44 +01:00
* [Connection handling and multiplexing ](#connection-handling-and-multiplexing )
2016-12-05 12:45:47 +01:00
* [Lightning Message Format ](#lightning-message-format )
2016-12-05 12:47:59 +01:00
* [Setup Messages ](#setup-messages )
2016-12-05 12:45:47 +01:00
* [The `init` message ](#the-init-message )
* [The `error` message ](#the-error-message )
2016-12-05 12:51:46 +01:00
* [Acknowledgements ](#acknowledgements )
2016-12-05 12:45:47 +01:00
* [References ](#references )
* [Authors ](#authors )
2017-02-14 16:02:44 +01:00
## Connection handling and multiplexing
Implementations MUST use one connection per peer, channel messages (which include a channel id) being multiplexed over this single connection.
2016-11-30 21:05:50 +01:00
## Lightning Message Format
After decryption, all lightning messages are of the form:
2016-11-30 21:42:22 +01:00
1. `type` : 2 byte big-endian field indicating the type of the message.
2. `payload` : variable length payload. It comprises the remainder of
the message and conforms to the format matching the `type` .
2016-11-30 21:05:50 +01:00
2016-11-30 21:42:22 +01:00
The `type` field indicates how to interpret the `payload` field.
The format for each individual type is specified in a specification in this repository.
The type follows the _it's ok to be odd_ rule, so nodes MAY send odd-numbered types without ascertaining that the recipient understands it.
A node MUST NOT send an evenly-typed message not listed here without prior negotiation.
A node MUST ignore a received message of unknown type, if that type is odd.
A node MUST fail the channels if it receives a message of unknown type, if that type is even.
2016-11-30 21:05:50 +01:00
2016-12-06 15:54:10 +01:00
The messages are grouped logically into 4 groups by their most significant set bit:
- Setup & signalling (types `0` -`31` ): messages related to supported features and error reporting. These are described below.
2016-12-07 10:38:37 +01:00
- Channel (types `32` -`127` ): comprises messages used to setup and tear down micropayment channels. These are described in [BOLT #2 ](02-peer-protocol.md ).
- Commitment (types `128` -`255` : comprises messages related to updating the current commitment transaction, which includes adding, revoking, and settling HTLCs, as well as updating fees and exchanging signatures. These are described in [BOLT #2 ](02-peer-protocol.md ).
2016-12-06 15:54:10 +01:00
- Routing (types `256` -`511` ): node and channel announcements, as well as any active route exploration. These are described in [BOLT #7 ](07-routing-gossip.md ).
2016-11-30 21:42:22 +01:00
The size of the message is required to fit into a 2 byte unsigned int by the transport layer, therefore the maximum possible size is 65535 bytes.
A node MUST ignore any additional data within a message, beyond the length it expects for that type.
A node MUST fail the channels if it receives a known message with insufficient length for the contents.
2016-11-30 21:05:50 +01:00
### Rationale
2016-12-08 07:54:35 +01:00
The standard endian of `SHA2` and the encoding of Bitcoin public keys
2016-11-30 21:05:50 +01:00
are big endian, thus it would be unusual to use a different endian for
other fields.
Length is limited to 65535 bytes by the cryptographic wrapping, and
messages in the protocol are never more than that length anyway.
The "it's OK to be odd" rule allows for future optional extensions
without negotiation or special coding in clients. The "ignore
additional data" rule similarly allows for future expansion.
2016-12-06 15:03:31 +01:00
Implementations may prefer to have message data aligned on an 8 byte
2016-11-30 21:05:50 +01:00
boundary (the largest natural alignment requirement of any type here),
2016-11-30 21:42:22 +01:00
but adding a 6 byte padding after the type field was considered
2016-11-30 21:05:50 +01:00
wasteful: alignment may be achieved by decrypting the message into
a buffer with 6 bytes of pre-padding.
2016-12-05 12:45:47 +01:00
## Setup Messages
### The `init` message
2016-11-30 21:05:50 +01:00
2017-01-05 10:17:26 +10:30
Once authentication is complete, the first message reveals the features supported or required by this node, even if this is a reconnection.
2016-11-30 21:42:22 +01:00
Odd features are optional, even features are compulsory (_it's OK to be odd_).
2016-12-04 01:16:08 -03:00
The meaning of these bits will be defined in the future.
2016-11-30 21:05:50 +01:00
1. type: 16 (`init` )
2. data:
* [2:gflen]
* [gflen:globalfeatures]
* [2:lflen]
* [lflen:localfeatures]
2016-11-30 21:42:22 +01:00
The 2 byte `gflen` and `lflen` fields indicate the number of bytes in the immediately following field.
2016-11-30 21:05:50 +01:00
2016-12-05 12:45:47 +01:00
#### Requirements
2016-11-30 21:05:50 +01:00
2017-01-05 10:17:26 +10:30
The sending node MUST send `init` as the first lightning message for any
connection.
2016-11-30 21:05:50 +01:00
The sending node SHOULD use the minimum lengths required to represent
the feature fields. The sending node MUST set feature bits
corresponding to features it requires the peer to support, and SHOULD
set feature bits corresponding to features it optionally supports.
The receiving node MUST fail the channels if it receives a
`globalfeatures` or `localfeatures` with an even bit set which it does
not understand.
2016-11-30 21:42:22 +01:00
Each node MUST wait to receive `init` before sending any other messages.
2016-11-30 21:05:50 +01:00
2016-12-05 12:45:47 +01:00
#### Rationale
2016-11-30 21:05:50 +01:00
The even/odd semantic allows future incompatible changes, or backward
compatible changes. Bits should generally be assigned in pairs, so
that optional features can later become compulsory.
Nodes wait for receipt of the other's features to simplify error
diagnosis where features are incompatible.
The feature masks are split into local features which only affect the
protocol between these two nodes, and global features which can affect
HTLCs and thus are also advertised to other nodes.
2016-12-05 12:45:47 +01:00
### The `error` message
2016-11-30 21:05:50 +01:00
2016-11-30 21:42:22 +01:00
For simplicity of diagnosis, it is often useful to tell the peer that something is incorrect.
2016-11-30 21:05:50 +01:00
1. type: 17 (`error` )
2. data:
BOLT 0,1,2,7: use txout not channel-id for demuxing. (#119)
At cost of a few extra bytes between peers, this avoids the whole "oops, we were on a chain fork" problem, and simplifies generation of temporary channel-ids (just pick a random one).
Now we move the announcement_signature exchange to at least 6 confirms, which makes re-xmit tricky; I resolved that by insisting on reconnect that we send if we haven't received, and reply to the first one.
The term "channel shortid" wasn't used anywhere, so I removed it; it's now a gossip-only thing anyway.
One subtle change: pkt_error on unknown channels is now "MUST ignore"; this section was reworked anyway, and we'll want this if the #120 goes through, where one side might have forgotten unformed channels).
Closes: #114
Suggested-by: Olaoluwa Osuntokun <laolu32@gmail.com>
Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
* FIXUP! Two bytes for funding-output-index.
Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
* FIXUP! Channel-id rework, temp ids, 32 bits only.
Re-add the idea of temporary channel ids: far simpler since they're now
big enough we can just fill with noise.
Remove the alignment issues by combining txid and outnum using XOR; we
could reduce to 128 bit if we really wanted to, but we don't.
Error handling is now simple again, but while editing I changed the
behaviour for unknown channels to MUST ignore (this is important for
Change the 8-byte gossip channel id to `short-channel-id`.
Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
* FIXUP! Minor text tweaks from Pierre-Marie and Christian
Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
2017-03-02 14:50:13 +10:30
* [32:channel-id]
2016-11-30 21:05:50 +01:00
* [2:len]
* [len:data]
2016-11-30 21:42:22 +01:00
The 2-byte `len` field indicates the number of bytes in the immediately following field.
2016-11-30 21:05:50 +01:00
2016-12-05 12:45:47 +01:00
#### Requirements
2016-11-30 21:05:50 +01:00
BOLT 0,1,2,7: use txout not channel-id for demuxing. (#119)
At cost of a few extra bytes between peers, this avoids the whole "oops, we were on a chain fork" problem, and simplifies generation of temporary channel-ids (just pick a random one).
Now we move the announcement_signature exchange to at least 6 confirms, which makes re-xmit tricky; I resolved that by insisting on reconnect that we send if we haven't received, and reply to the first one.
The term "channel shortid" wasn't used anywhere, so I removed it; it's now a gossip-only thing anyway.
One subtle change: pkt_error on unknown channels is now "MUST ignore"; this section was reworked anyway, and we'll want this if the #120 goes through, where one side might have forgotten unformed channels).
Closes: #114
Suggested-by: Olaoluwa Osuntokun <laolu32@gmail.com>
Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
* FIXUP! Two bytes for funding-output-index.
Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
* FIXUP! Channel-id rework, temp ids, 32 bits only.
Re-add the idea of temporary channel ids: far simpler since they're now
big enough we can just fill with noise.
Remove the alignment issues by combining txid and outnum using XOR; we
could reduce to 128 bit if we really wanted to, but we don't.
Error handling is now simple again, but while editing I changed the
behaviour for unknown channels to MUST ignore (this is important for
Change the 8-byte gossip channel id to `short-channel-id`.
Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
* FIXUP! Minor text tweaks from Pierre-Marie and Christian
Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
2017-03-02 14:50:13 +10:30
The channel is referred to by `channel-id` unless `channel-id` is zero (ie. all bytes zero), in which case it refers to all channels.
2016-11-30 21:05:50 +01:00
A node SHOULD send `error` for protocol violations or internal
errors which make channels unusable or further communication unusable.
A node MAY send an empty [data] field. A node sending `error` MUST
BOLT 0,1,2,7: use txout not channel-id for demuxing. (#119)
At cost of a few extra bytes between peers, this avoids the whole "oops, we were on a chain fork" problem, and simplifies generation of temporary channel-ids (just pick a random one).
Now we move the announcement_signature exchange to at least 6 confirms, which makes re-xmit tricky; I resolved that by insisting on reconnect that we send if we haven't received, and reply to the first one.
The term "channel shortid" wasn't used anywhere, so I removed it; it's now a gossip-only thing anyway.
One subtle change: pkt_error on unknown channels is now "MUST ignore"; this section was reworked anyway, and we'll want this if the #120 goes through, where one side might have forgotten unformed channels).
Closes: #114
Suggested-by: Olaoluwa Osuntokun <laolu32@gmail.com>
Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
* FIXUP! Two bytes for funding-output-index.
Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
* FIXUP! Channel-id rework, temp ids, 32 bits only.
Re-add the idea of temporary channel ids: far simpler since they're now
big enough we can just fill with noise.
Remove the alignment issues by combining txid and outnum using XOR; we
could reduce to 128 bit if we really wanted to, but we don't.
Error handling is now simple again, but while editing I changed the
behaviour for unknown channels to MUST ignore (this is important for
Change the 8-byte gossip channel id to `short-channel-id`.
Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
* FIXUP! Minor text tweaks from Pierre-Marie and Christian
Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
2017-03-02 14:50:13 +10:30
fail the channel referred to by the error message, or if `channel-id` is zero, it MUST
fail all channels and MUST close the connection.
2016-12-21 21:07:47 +10:30
A node MUST set `len` equal to the length of `data` . A node SHOULD include the raw, hex-encoded transaction in reply to a `funding_created` , `funding_signed` , `closing_signed` or `commitment_signed` message when failure was caused by an invalid signature check.
2016-11-30 21:05:50 +01:00
BOLT 0,1,2,7: use txout not channel-id for demuxing. (#119)
At cost of a few extra bytes between peers, this avoids the whole "oops, we were on a chain fork" problem, and simplifies generation of temporary channel-ids (just pick a random one).
Now we move the announcement_signature exchange to at least 6 confirms, which makes re-xmit tricky; I resolved that by insisting on reconnect that we send if we haven't received, and reply to the first one.
The term "channel shortid" wasn't used anywhere, so I removed it; it's now a gossip-only thing anyway.
One subtle change: pkt_error on unknown channels is now "MUST ignore"; this section was reworked anyway, and we'll want this if the #120 goes through, where one side might have forgotten unformed channels).
Closes: #114
Suggested-by: Olaoluwa Osuntokun <laolu32@gmail.com>
Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
* FIXUP! Two bytes for funding-output-index.
Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
* FIXUP! Channel-id rework, temp ids, 32 bits only.
Re-add the idea of temporary channel ids: far simpler since they're now
big enough we can just fill with noise.
Remove the alignment issues by combining txid and outnum using XOR; we
could reduce to 128 bit if we really wanted to, but we don't.
Error handling is now simple again, but while editing I changed the
behaviour for unknown channels to MUST ignore (this is important for
Change the 8-byte gossip channel id to `short-channel-id`.
Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
* FIXUP! Minor text tweaks from Pierre-Marie and Christian
Signed-off-by: Rusty Russell <rusty@rustcorp.com.au>
2017-03-02 14:50:13 +10:30
A node receiving `error` MUST fail the channel referred to by the message,
or if `channel-id` is zero, it MUST fail all channels and MUST close the connection. If no existing channel is referred to by the message, the receiver MUST ignore the message. A receiving node MUST truncate
2016-11-30 21:05:50 +01:00
`len` to the remainder of the packet if it is larger.
2016-12-22 14:30:00 +01:00
A receiving node SHOULD only print out `data` verbatim if the string is composed solely of printable ASCII characters.
For referece, the printable character set includes byte values 32 through 127 inclusive.
2016-11-30 21:05:50 +01:00
2016-12-05 12:45:47 +01:00
#### Rationale
2016-11-30 21:05:50 +01:00
There are unrecoverable errors which require an abort of conversations;
if the connection is simply dropped then the peer may retry the
connection. It's also useful to describe protocol violations for
diagnosis, as it indicates that one peer has a bug.
It may be wise not to distinguish errors in production settings, lest
it leak information, thus the optional data field.
## Acknowledgements
TODO(roasbeef); fin
2016-12-05 12:45:47 +01:00
## References
2016-12-09 15:17:11 +01:00
1. < a id = "reference-2" > http://www.unicode.org/charts/PDF/U2600.pdf</ a >
2016-11-30 21:05:50 +01:00
2016-12-05 12:45:47 +01:00
## Authors
2016-11-30 21:05:50 +01:00
FIXME

< br >
This work is licensed under a [Creative Commons Attribution 4.0 International License ](http://creativecommons.org/licenses/by/4.0/ ).