Commit graph

5822 commits

Author SHA1 Message Date
Matt Corallo
ce94a5ec22 Skip persistence in the usual case handling channel_reestablish
When we handle an inbound `channel_reestablish` from our peers it
generally doesn't change any state and thus doesn't need a
`ChannelManager` persistence. Here we avoid said persistence where
possible.
2023-09-12 19:06:34 +00:00
Matt Corallo
9078c0dc5c Always persist the ChannelManager on a failed ChannelUpdate
If we receive a `ChannelUpdate` message which was invalid, it can
cause us to force-close the channel, which should result in a
`ChannelManager` persistence, though its not critical to do so.
2023-09-12 19:06:34 +00:00
Matt Corallo
e37b350408 Avoid persisting ChannelManager in response to peer connection
When a peer connects and we send some `channel_reestablish`
messages or create a `per_peer_state` entry there's really no
reason to need to persist the `ChannelManager`. None of the
possible actions we take immediately result in a change to the
persisted contents of a `ChannelManager`, only the peer's later
`channel_reestablish` message does.
2023-09-12 19:06:34 +00:00
Matt Corallo
71bafecafc Move a handful of channel messages to notify-without-persist
Many channel related messages don't actually change the channel
state in a way that changes the persisted channel. For example,
an `update_add_htlc` or `update_fail_htlc` message simply adds the
change to a queue, changing the channel state when we receive a
`commitment_signed` message.

In these cases there's really no reason to wake the background
processor at all - there's no response message and there's no state
update. However, note that if we close the channel we should
persist the `ChannelManager`. If we send an error message without
closing the channel, we should wake the background processor
without persisting.

Here we move to the appropriate `NotifyOption` on some of the
simpler channel message handlers.
2023-09-12 19:06:34 +00:00
Matt Corallo
305df1d7da Update channelmanager::NotifyOption to indicate persist or event
As we now signal events-available from persistence-needed
separately, the `NotifyOption` enum should include a separate
variant for events-but-no-persistence, which we add here.
2023-09-12 19:06:34 +00:00
Matt Corallo
7fa499c188 Separate ChannelManager needing persistence from having events
Currently, when a ChannelManager generates a notification for the
background processor, any pending events are handled and the
ChannelManager is always re-persisted.

Many channel related messages don't actually change the channel
state in a way that changes the persisted channel. For example,
an `update_add_htlc` or `update_fail_htlc` message simply adds the
change to a queue, changing the channel state when we receive a
`commitment_signed` message.

In these cases we shouldn't be re-persisting the ChannelManager as
it hasn't changed (persisted) state at all. In anticipation of
doing so in the next few commits, here we make the public API
handle the two concepts (somewhat) separately. The notification
still goes out via a single waker, however whether or not to
persist is now handled via a separate atomic bool.
2023-09-12 19:06:34 +00:00
Matt Corallo
63e6b80fb0 Make it harder to forget to call CM::process_background_events
Prior to any actions which may generate a `ChannelMonitorUpdate`,
and in general after startup,
`ChannelManager::process_background_events` must be called. This is
mostly accomplished by doing so on taking the
`total_consistency_lock` via the `PersistenceNotifierGuard`. In
order to skip this call in block connection logic, the
`PersistenceNotifierGuard::optionally_notify` constructor did not
call the `process_background_events` method.

However, this is very easy to misuse - `optionally_notify` does not
convey to the reader that they need to call
`process_background_events` at all.

Here we fix this by adding a separate
`optionally_notify_skipping_background_events` method, making the
requirements much clearer to callers.
2023-09-12 19:06:34 +00:00
Matt Corallo
c2aee57770 Make PersistenceNotifierGuard::optionally_notify take a ChanMan ref
Long ago, for reasons lost to the ages, the
`PersistenceNotifierGuard::optionally_notify` constructor didn't
take a `ChannelManager` reference, but rather explicit references
to the fields of it that it needs.

This is cumbersome and useless, so we fix it here.
2023-09-11 03:10:36 +00:00
Matt Corallo
9228f902e4 Rename ChannelManager update future methods for new API
In the next commit, we separate `ChannelManager`'s concept of
waking a listener to both be persisted and to allow the user to
handle events. Here we rename the future-fetching method in
anticipation of this split.
2023-09-10 23:05:51 +00:00
Matt Corallo
448b191fec
Merge pull request #2514 from valentinewallace/2023-08-compute-blindedpayinfo
Aggregate `BlindedPayInfo` for blinded routes
2023-09-10 03:02:22 +00:00
Matt Corallo
6436232293
Merge pull request #2495 from dunxen/2023-07-channelenummap
Use a single peer state map for all channel phases in peer state
2023-09-09 18:54:06 +00:00
Duncan Dean
88db0b8221
Remove v1 peer state channel maps & refactor with ChannelPhase 2023-09-08 23:10:56 +02:00
Duncan Dean
15199a65a7
Refactor ChannelManager with ChannelPhase 2023-09-08 23:10:41 +02:00
Matt Corallo
81f4151001
Merge pull request #2549 from yanganto/socket-addr
Rename SocketAddress from NetAddress
2023-09-08 20:08:08 +00:00
Valentine Wallace
f3616e606f
Struct-ify blinded payment path intermediate node info 2023-09-08 10:43:02 -04:00
Valentine Wallace
138a5a770c
Remove unnecessary doc links 2023-09-08 10:43:02 -04:00
Valentine Wallace
d5925f210e
Fix blinded payment TLV ser to not length-prefix
impl_writeable_tlv_based includes a length prefix to the TLV stream, which we
don't want.
2023-09-08 10:43:02 -04:00
Valentine Wallace
10a159f71e
Derive Clone and Debug for blinded payment TLV structs 2023-09-08 10:43:02 -04:00
Valentine Wallace
aee7bb4acd
Make blinded payment TLV fields public.
These should've been made public when they were added for use in
BlindedPath::new_for_payment.
2023-09-08 10:43:02 -04:00
Valentine Wallace
fc0d15136e
Support aggregating htlc_maximum_msat for BlindedPayInfo 2023-09-08 10:43:02 -04:00
Valentine Wallace
02990cad80
Support aggregating htlc_minimum_msat for BlindedPayInfo 2023-09-08 10:43:02 -04:00
Valentine Wallace
ec01d7e061
Compute aggregated BlindedPayInfo in path construction 2023-09-08 10:43:01 -04:00
Antonio Yang
b1bedcfbec Rename SocketAddress from NetAddress 2023-09-08 20:42:06 +08:00
Duncan Dean
585188cda3
Introduce ChannelPhase enum
We introduce the `ChannelPhase` enum which will contain the different
channel structs wrapped by each of its variants so that we can place
these within a single `channel_by_id` map in `peer_state` in the
following commits. This will reduce the number of map lookup operations
we need to do in `ChannelManager`'s various methods. It will also make
certain channel counting logic easier to reason about with less risk of
forgetting to modify logic when new channels structs are introduced for
V2 channel establishment.
2023-09-08 10:19:41 +02:00
Duncan Dean
0cdd72c8e7
Remove outdated Channel TODO 2023-09-08 10:19:39 +02:00
Matt Corallo
c60d3058af
Merge pull request #2371 from jkczyz/2023-06-offer-message-handling
BOLT 12 Invoice payments
2023-09-08 01:52:38 +00:00
Matt Corallo
2e113b549d
Merge pull request #2472 from tnull/2023-08-add-kvstore
Replace `KVStorePersister` with `KVStore`
2023-09-07 22:26:03 +00:00
Jeffrey Czyz
44b9c54fa9
Configure BOLT 12 invoice payment retry strategy
Replace a constant three retry attempts for BOLT 12 invoice payments
with a retry strategy specified when creating a pending outbound
payment. This is configured by users in a later commit when constructing
an InvoiceRequest or a Refund.
2023-09-07 16:55:23 -05:00
Jeffrey Czyz
2f6b5d157a
Use u32 instead of usize in Retry::Attempts
An upcoming commit requires serializing Retry, so use a type with a
fixed byte length. Otherwise, using eight bytes to serialize a usize
would fail to read on 32-bit machines.
2023-09-07 16:55:22 -05:00
Jeffrey Czyz
50336b3c7b
Add tests for send_payment_for_bolt12_invoice 2023-09-07 16:55:22 -05:00
Jeffrey Czyz
19c43d0693
pub(crate) visibility for offers/test_utils.rs
The test utilities for Offers are needed for testing message handling in
ChannelManager and OutboundPayments.
2023-09-07 16:55:22 -05:00
Jeffrey Czyz
4e3c031d56
Support paying BOLT 12 invoices
Add a send_payment_for_bolt12_invoice method to OutboundPayments for
initiating payment of a BOLT 12 invoice. This will be called from an
OffersMessageHandler, after which any retries are handled using the
Retryable logic.
2023-09-07 16:55:22 -05:00
Jeffrey Czyz
2852e4cdef
Rename OutboundPayments::retry_payment_internal
It will be used for initial attempts at paying BOLT 12 invoices, so
rename it something that covers both that and retries.
2023-09-07 16:55:22 -05:00
Jeffrey Czyz
283d9b4e03
Refactor OutboundPayments::retry_payment_internal
Consolidate the creation and insertion of onion_session_privs to the
PendingOutboundPayment::Retryable arm. In an upcoming commit, this
method will be reused for an initial BOLT 12 invoice payment. However,
onion_session_privs are created using a different helper.
2023-09-07 16:55:22 -05:00
Jeffrey Czyz
b5169301d8
Add PendingOutboundPayment::InvoiceReceived
When a BOLT 12 invoice has been received, a payment attempt is made and
any errors result in abandoning the PendingOutboundPayment. This results
in generating at PaymentFailed event, which has a PaymentHash. Thus,
when receiving an invoice, transition from AwaitingInvoice to a new
InvoiceReceived state, the latter of which contains a PaymentHash such
the abandon_payment helper can still be used.
2023-09-07 16:54:09 -05:00
Jeffrey Czyz
cbeaeb708f
Test removing abandoned AwaitingInvoice payments 2023-09-07 16:45:12 -05:00
Jeffrey Czyz
fe2244e9cf
Test for removing stale AwaitingInvoice payments 2023-09-07 16:45:11 -05:00
Jeffrey Czyz
7f4c473c88
Move IDEMPOTENCY_TIMEOUT_TICKS to where it is used 2023-09-07 16:45:11 -05:00
Jeffrey Czyz
581ea7c6ed
Add PendingOutboundPayment::AwaitingInvoice
When a BOLT 12 invoice has been requested, in order to guarantee
invoice payment idempotency the future payment needs to be tracked. Add
an AwaitingInvoice variant to PendingOutboundPayment such that only
requested invoices are paid only once. Timeout after a few timer ticks
if a request has not been received.
2023-09-07 16:44:13 -05:00
Elias Rohrer
7a656719af
Add TestStore implementation of KVStore 2023-09-07 22:49:22 +02:00
Elias Rohrer
7576c89adb
Add benchmarking for FilesystemStore
We re-add benchmarking for `FilesystemStore` now that we switched over
to it.
2023-09-07 22:49:22 +02:00
Elias Rohrer
413f9a7de6
Migrate FilesystemPersister tests to FilesystemStore 2023-09-07 22:49:22 +02:00
Elias Rohrer
cc1b505b30
Migrate to KVStore/FilesystemStore
Firstly, we switch our BP over to use `FilesystemStore`, which also gives us test
coverage and ensures the compatibility.

Then, we remove the superseded `KVStorePersister` trait and
the `FilesystemPersister` code.
2023-09-07 22:49:22 +02:00
Elias Rohrer
4305ee4106
Add read_channel_monitors utility
This replaces the `FilesystemPersister::read_channelmonitors` method, as
we can now implement a single utility for all `KVStore`s.
2023-09-07 22:49:22 +02:00
Elias Rohrer
f22d1b6390
Add FilesystemStore
We upstream the `FilesystemStore` implementation, which is backwards
compatible with `lightning-persister::FilesystemPersister`.
2023-09-07 22:49:21 +02:00
Elias Rohrer
c18f43fb07
Add test_utils
We add a utility function needed by upcoming `KVStore` implementation
tests.
2023-09-07 22:49:21 +02:00
Elias Rohrer
931ea2667a
Update lightning-persister crate 2023-09-07 22:49:21 +02:00
Elias Rohrer
d1405f38bc
Add KVStore interface trait
We upstream the `KVStore` interface trait from LDK Node, which will
replace `KVStorePersister` in the coming commits.

Besides persistence, `KVStore` implementations will also offer to `list`
keys present in a given `namespace` and `read` the stored values.
2023-09-07 22:49:21 +02:00
Jeffrey Czyz
6d0c5f00ba
Add an InvoiceRequestFailed event
When an invoice is requested but either receives an error or never
receives a response, surface an event to indicate to the user that the
corresponding future payment has failed.
2023-09-07 11:08:53 -05:00
Elias Rohrer
b5e959460f
Merge pull request #2134 from jbesraa/add_fromstr_to_netaddress
implement fromstr trait to netaddress
2023-09-07 14:16:25 +02:00