Commit graph

7947 commits

Author SHA1 Message Date
Leo Nash
9e30f2560d Stop sending channel_update in onion failures
Per <https://github.com/lightning/bolts/pull/1173>.

Fixes #3277
2024-10-05 03:39:06 +00:00
Matt Corallo
c7627dfd61
Merge pull request #3311 from TheBlueMatt/2024-09-3010-followups
Quick #3010 followups
2024-09-30 21:21:20 +00:00
Matt Corallo
d156b2e30e Call ChannelMessageHandler::message_received without peer lock
While `message_received` purports to be called on every message,
prior to the message, doing so on `Init` messages means we have to
call `message_received` while holding the per-peer mutex, which
can cause some lock contention.

Instead, here, we call `message_received` after processing `Init`
messages (which is probably more useful anyway - the peer isn't
really "connected" until we've processed the `Init` messages),
allowing us to call it unlocked.
2024-09-30 18:57:52 +00:00
Matt Corallo
b8695b0c83 Check that we aren't reading a second message in BOLT 12 retry test
`creates_and_pays_for_offer_with_retry` intends to check that we
re-send a BOLT 12 `invoice_request` in response to a
`message_received` call, but doesn't actually test that there were
no messages in the outbound buffer after the initial send, which we
do here.
2024-09-30 18:57:52 +00:00
Matt Corallo
a661c92746
Merge pull request #3341 from TheBlueMatt/2024-09-gossip-rustfmt-cleanup
Minor `gossip.rs` `rustfmt` cleanups
2024-09-27 00:53:08 +00:00
Matt Corallo
bc5213dfef Minor gossip.rs rustfmt cleanups
Just a few minor updates to `gossip.rs` to reduce code verticality
and simplify things a bit.
2024-09-26 06:45:50 +00:00
valentinewallace
053281f5ad
Merge pull request #3336 from tnull/2024-09-rustfmt-router
`rustfmt`: Run on the `routing` directory (1/3)
2024-09-25 13:20:36 +09:00
Elias Rohrer
5ce2442d43
Merge pull request #3334 from arik-so/lint_fixes
Fix linter complaints
2024-09-25 11:16:08 +09:00
Elias Rohrer
f299a48695
rustfmt: Drop routing/gossip.rs from exclusion list 2024-09-24 13:51:52 +09:00
Elias Rohrer
22b82d36e2
rustfmt: Run on routing/gossip.rs 2024-09-24 13:51:52 +09:00
Arik Sosman
d340ac3b39
Suppress linter warnings
Allow `map_err` and `dependency_on_unit_never_type_fallback` pending
a future MSRV increase.
2024-09-24 13:40:40 +09:00
Elias Rohrer
a0d0f02ed0
Merge pull request #3303 from TheBlueMatt/2024-09-inbound-payment-id
Add a `PaymentId` for inbound payments
2024-09-24 13:38:16 +09:00
Matt Corallo
23109b66e9
Merge pull request #3310 from TheBlueMatt/2024-09-unlocked-checksig
Validate `channel_update` signatures without holding a graph lock
2024-09-24 03:13:51 +00:00
Elias Rohrer
4e1f1a8deb
Merge pull request #3326 from jkczyz/2024-09-split-router
Decouple `MessageRouter` from `Router`
2024-09-24 11:47:45 +09:00
Matt Corallo
131849f383 Validate channel_update signatures without holding a graph lock
We often process many gossip messages in parallel across different
peer connections, making the `NetworkGraph` mutexes fairly
contention-sensitive (not to mention the potential that we want to
send a payment and need to find a path to do so).

Because we need to look up a node's public key to validate a
signature on `channel_update` messages, we always need to take a
`NetworkGraph::channels` lock before we can validate the message.

For simplicity, and to avoid taking a lock twice, we'd always
validated the `channel_update` signature while holding the same
lock, but here we address the contention issues by doing a
`channel_update` validation in three stages.

First we take a read lock on `NetworkGraph::channels` and check if
the `channel_update` is new, then release the lock and validate the
message signature, and finally take a write lock, (re-check if the
`channel_update` is new) and update the graph.
2024-09-23 03:48:29 +00:00
Jeffrey Czyz
cad09855bf
De-couple MessageRouter from Router
Now that ChannelManager is parameterized by both a MessageRouter and a
Router, Router implementations no longer need to implement
MessageRouter, too.
2024-09-23 12:22:01 +09:00
Jeffrey Czyz
bde331fe94
Expand DefaultRouter's privacy docs
DefaultRouter::create_blinded_payment_paths may creat a one-hop blinded
path with the recipient as the introduction node. Update the privacy
section of DefaultRouter's docs to indicate this as is done in the docs
for DefaultMessageRouter.
2024-09-23 12:22:00 +09:00
Jeffrey Czyz
04c51b380d
Parameterize ChannelManager with MessageRouter
ChannelManager is parameterized by a Router, which must also implement
MessageRouter. Instead, add a MessageRouter parameter such that the
Router and MessageRouter traits can be de-coupled. This simplifies using
something other than DefaultMessageRouter, which DefaultRouter currently
delegates to.
2024-09-23 12:21:35 +09:00
Matt Corallo
aaf529d193 Add a PaymentId for inbound payments
We expect our users to have fully idempotent `Event` handling as we
may replay events on restart for one of a number of reasons. This
isn't a big deal as long as all our events have some kind of
identifier users can use to check if the `Event` has already been
handled.

For outbound payments, this is the `PaymentId` they provide in the
send methods, however for inbound payments we don't have a great
option.

`PaymentHash` largely suffices - users can simply always claim in
response to a `PaymentClaimable` of sufficient value and treat a
`PaymentClaimed` event as duplicate any time they see a second one
for the same `PaymentHash`. This mostly works, but may result in
accepting duplicative payments if someone (incorrectly) pays twice
for the same `PaymentHash`.

Users could also fail for duplicative `PaymentClaimable` events of
the same `PaymentHash`, but doing so may result in spuriously
failing a payment if the `PaymentClaimable` event is a replay and
they never saw a corresponding `PaymentClaimed` event.

While none of this will result in spuriously thinking they've been
paid when they have not, it does result in some pretty awkward
semantics which we'd rather avoid our users having to deal with.

Instead, here, we add a new `PaymentId` which is simply an HMAC of
the HTLCs (as Channel ID, HTLC ID pairs) which were included in the
payment.
2024-09-23 01:24:28 +00:00
Matt Corallo
aa09c33a17 Add an inbound_payment_id_secret to ChannelManager
In the next commit we'll start generating `PaymentId`s for inbound
payments randomly by HMAC'ing the HTLC set of the payment. Here we
start by defining the HMAC secret for these HMACs.

This requires one small test adaptation and a full_stack_target
fuzz change because it changes the RNG consumption.
2024-09-23 01:24:28 +00:00
Matt Corallo
803366a41a Do not check the ordering of HTLCs in PaymentClaim[able,ed]
In the next commit we'll change the order of HTLCs in
`PaymentClaim[able,ed]` events. This shouldn't break anything, but
our current functional tests check that the HTLCs are provided in
the order they expect (the order they were received). Instead, here
we only validate that each claimed HTLC matches one expected path.
2024-09-23 01:24:28 +00:00
Elias Rohrer
66fb520098
Merge pull request #3327 from TheBlueMatt/2024-09-local-ci-rustfmt
Only attempt to `rustfmt` files checked into git
2024-09-19 09:30:23 +02:00
Matt Corallo
930f5fbf9a Only attempt to rustfmt files checked into git
This avoids `rustfmt` failing on Rust files generated by dependent
crates in `target`, eg

```
+ rustfmt --edition 2021 --check ./target/debug/build/thiserror-8230374e07b5c05a/out/probe.rs
Diff in /home/matt/rust-lightning-3/target/debug/build/thiserror-8230374e07b5c05a/out/probe.rs at line 1:

-    #![feature(provide_any)]
+#![feature(provide_any)]

-    use std::any::{Demand, Provider};
+use std::any::{Demand, Provider};

-    fn _f<'a, P: Provider>(p: &'a P, demand: &mut Demand<'a>) {
-        p.provide(demand);
-    }
+fn _f<'a, P: Provider>(p: &'a P, demand: &mut Demand<'a>) {
+	p.provide(demand);
+}
```
2024-09-18 18:04:54 +00:00
Jeffrey Czyz
538fc5ff9b
Re-order imports 2024-09-18 12:45:33 -05:00
Matt Corallo
cdd1298a38
Merge pull request #3289 from tnull/2024-09-fix-rgs-bp-builds
Fix builds of `lightning-rapid-gossip-sync` and `lightning-background-processor` crates
2024-09-18 14:31:18 +00:00
Elias Rohrer
545b037827
Drop no-std feature
We drop the `lightning/no-std` feature and just take
`hashbrown`,`possiblyrandom` and `libm` as required dependencies.
2024-09-18 09:07:58 +02:00
Elias Rohrer
a06e7b9133
Check workspace members with default features individually in CI
Previously, we would only check the workspace as a whole. This however
would mean that we would check/test crates with `lightning`'s default
features enabled, allowing failures-to-build under the crates own
default features to slip through, if they didn't explicitly enable
`lightning/std`, for example.

Here, we extend the CI to check the workspace as a whole but then run
checks, tests, and doc generation on the workspace members individually,
asserting that all of them build even when not built as part of the same
workspace as `lightning`.
2024-09-18 09:07:58 +02:00
Elias Rohrer
3c1a5d3aa1
Re-add optional std feature dependencies to fix RGS and BP builds
We previously removed these, leading to failure to build under default
features including `std`.
2024-09-18 09:07:58 +02:00
Matt Corallo
ca27a85492
Merge pull request #3321 from valentinewallace/2024-09-fix-main
Fix silent rebase conflict that broke tests
2024-09-17 21:45:30 +00:00
Valentine Wallace
487d6a09a7
Fix silent rebase conflict that broke tests
429cbe1a06 merged a PR that renamed
Offer::signing_pubkey to Offer::issuer_signing_pubkey. However, there was a
silent rebase conflict and a test added as part of
1059f5ffc5 did not get the memo and used the old
method name, breaking the test build.
2024-09-17 17:24:42 -04:00
Matt Corallo
815d255aa8
Merge pull request #3319 from tnull/2024-09-rustfmt-sync
`rustfmt`: Run on `lightning/src/sync/*`
2024-09-17 19:37:51 +00:00
Matt Corallo
866cedf17a
Merge pull request #3313 from valentinewallace/2024-09-fix-offer-double-pay
Don't pay a duplicate BOLT 12 invoice if `ChannelManager` is stale
2024-09-17 17:38:04 +00:00
Matt Corallo
429cbe1a06
Merge pull request #3218 from jkczyz/2024-07-offers-spec-update
Rename `Offer::signing_pubkey` to `Offer::issuer_id`
2024-09-17 14:01:43 +00:00
Valentine Wallace
fbb3ab2704
Fix bug where we double-pay an offer due to stale manager
This fixes the following bug:
- An outbound payment is AwaitingInvoice
- We receive an invoice and lock the HTLCs into the relevant ChannelMonitors
- The monitors are successfully persisted, but the ChannelManager fails to
  persist, so the outbound payment remains AwaitingInvoice
- We restart, causing the channels to close due to a stale ChannelManager
- We receive a duplicate invoice, and attempt to pay it again due to the
  payment still being AwaitingInvoice in the stale ChannelManager

After the fix for this, we will notice that the payment is already locked into
the monitor on startup and transition the incorrectly-AwaitingInvoice payment
to Retryable, which prevents double-paying on duplicate invoice receipt.
2024-09-17 09:52:49 -04:00
Elias Rohrer
555bd7536f
rustfmt: Drop sync/mod.rs from exclusion list 2024-09-17 13:07:52 +02:00
Elias Rohrer
8746a80977
rustfmt: Run on sync/mod.rs 2024-09-17 13:07:28 +02:00
Elias Rohrer
a3de52f847
rustfmt: Drop sync/test_lockorder_checks.rs from exclusion list 2024-09-17 13:06:51 +02:00
Elias Rohrer
6f1949b0d6
rustfmt: Run on sync/test_lockorder_checks.rs 2024-09-17 13:06:29 +02:00
Elias Rohrer
cffbeb09b9
rustfmt: Drop sync/nostd_sync.rs from exclusion list 2024-09-17 13:06:00 +02:00
Elias Rohrer
e3fb566e05
rustfmt: Run on sync/nostd_sync.rs 2024-09-17 13:05:40 +02:00
Elias Rohrer
a161834f90
rustfmt: Drop sync/fairrwlock.rs from exclusion list 2024-09-17 13:04:55 +02:00
Elias Rohrer
2cb1664cf6
rustfmt: Run on sync/fairrwlock.rs 2024-09-17 13:04:35 +02:00
Elias Rohrer
edcdc565c4
rustfmt: Drop sync/debug_sync.rs from exclusion list 2024-09-17 13:03:59 +02:00
Elias Rohrer
9962e4b497
rustfmt: Run on sync/debug_sync.rs 2024-09-17 13:03:25 +02:00
Jeffrey Czyz
e11025f94d
Rename Refund::payer_id
For consistency with Offer::issuer_signing_pubkey, rename
Refund::payer_id to use "signing_pubkey" instead of "id".
2024-09-16 13:56:47 -05:00
Jeffrey Czyz
dd8f744257
Rename InvoiceRequest::payer_id
For consistency with Offer::issuer_signing_pubkey, rename
InvoiceRequest::payer_id to use "signing_pubkey" instead of "id".
2024-09-16 13:56:46 -05:00
Jeffrey Czyz
de29295bb4
Update offer test vectors from latest spec changes 2024-09-16 13:56:46 -05:00
Jeffrey Czyz
cfe84305cd
Use unsigned invoice types in docs 2024-09-16 13:56:46 -05:00
Jeffrey Czyz
a466f2e2f4
Add issuer_signing_pubkey to Bolt12Invoice
Useful for determining if the signing_pubkey is the
issuer_signing_pubkey or is from a blinded path.
2024-09-16 13:56:46 -05:00
Jeffrey Czyz
73512709e7
Re-write Offer::issuer_signing_pubkey documentation 2024-09-16 13:56:46 -05:00