Commit graph

5693 commits

Author SHA1 Message Date
shaavan
17d80f970f Introduce RetryableInvoiceRequest in AwaitingInvoice
1. To enable the retry of the Invoice Request message, it's necessary
   to store the essential data required to recreate the message.
2. A new struct is introduced to manage this data, ensuring the
   InvoiceRequest message can be reliably recreated for retries.
3. The addition of an `awaiting_invoice` flag allows tracking of
   retryable invoice requests, preventing the need to lock the
   `pending_outbound_payment` mutex.
2024-09-12 18:47:33 +05:30
Matt Corallo
0b7838b59d Refactor channel_update processing logic into local fns
In the next commit we'll move to checking `channel_update`s in
three steps - first we check if the `channel_update` is new and the
latest for a channel, then we check the signature, and finally we
update our local state. This allows us to avoid holding a lock on
`NetworkGraph::channels` while validating the message signature.

Here we do a quick prefactor to make that simpler - moving the
validation logic of `channel_update` that we'll do in step one (and
repeat in step three) into a local function. We also take this
opportunity to do one static check unlocked which we had been doing
while holding a `channel` lock.
2024-09-11 23:37:40 +00:00
Matt Corallo
db905e8a8d
Merge pull request #3291 from tnull/2024-09-add-their-node-id-routing-msg-handler
Add node id to remaining `RoutingMessageHandler::handle_` methods
2024-09-11 22:25:41 +00:00
Matt Corallo
4178dd770a
Merge pull request #3163 from shaavan/invoice_reply_path
Introduce Reply Paths for BOLT12 Invoice in Offers Flow.
2024-09-11 20:17:54 +00:00
Matt Corallo
6e340c43de Don't rely on route-fetching rand in blinded_path_with_custom_tlv
`blinded_path_with_custom_tlv` indirectly relied on route CLTV
randomization when sending because nodes were at substantially
different block heights after setup. Instead we make sure all nodes
are at the same height which makes the test more robust.
2024-09-11 20:01:43 +00:00
Matt Corallo
758747ac9f Drop Debug on InMemorySigner (and EntropySource)
`InMemorySigner` has various private keys in it which makes
`Debug` either useless or dangerous (because most keys won't log
anything, but if they did we'd risk logging private key material).
2024-09-11 20:01:43 +00:00
Elias Rohrer
b172942a75
Refactor: Take their_node_id by value across all handler interfaces
In order to maintain interface consistency, we refactor all message
handler interfaces to take `PublicKey` rather than `&PublicKey`, as the
difference in efficiency should be negigible and the former is easier to
handle in binding languages.

Over time, we also want to move (no pun intended) towards all messaging
interfaces using move semantics, so dropping the reference for
`PublicKey` is the first step in this direction.
2024-09-11 19:19:38 +02:00
Elias Rohrer
f68b8b6834
Add node id to remaining RoutingMessageHandler::handle_ methods
Previously, some `RoutingMessageHandler::handle_` methods (in particular
the ones handling node and channel announcements, as well as channel
updates, omitted the `their_node_id` argument. This didn't allow
implementors to discern *who* sent a particular method.

Here, we add `their_node_id: Option<&PublicKey>` to have them learn who
sent a message, and set `None` if our own node it the originator of a
broadcast operation.
2024-09-11 18:01:33 +02:00
shaavan
7b49993101 Update Offers Test to Verify BOLT12 Invoice Reply Paths
1. Updated the Offers Test to check the reply paths in BOLT12 Invoices.
2. Changed the `extract_invoice` return type from `Option<BlindedMessagePath>`
   to `BlindedMessagePath` since all BOLT12Invoices now have a corresponding
   reply path by default.
2024-09-11 18:54:49 +05:30
shaavan
a4bf936101 Add reply_path to BOLT12Invoices in Offers Flow
1. Introduced reply_path in BOLT12Invoices to address a gap in error handling.
   Previously, if a BOLT12Invoice sent in the offers flow generated an Invoice Error,
   the payer had no way to send this error back to the payee.
2. By adding a reply_path to the Invoice Message, the payer can now communicate
   any errors back to the payee, ensuring better error handling and communication
   within the offers flow.
2024-09-11 18:54:49 +05:30
shaavan
8b479ac587 Add HMAC, and nonce to OffersContext::InboundPayment
Introduce HMAC and nonce calculation when sending Invoice with
reply path, so that if we receive InvoiceError back for the
corresponding Invoice we can verify the payment hash before logging it.
2024-09-11 18:54:49 +05:30
Matt Corallo
82b3f620f5
Merge pull request #3309 from TheBlueMatt/2024-09-always-print-why
Always print why we disconnect explicitly
2024-09-10 19:47:15 +00:00
valentinewallace
a6dea2f154
Merge pull request #3305 from TheBlueMatt/2024-09-no-redundant-gossip-validation
Avoid redundant `{channel,node}_announcement` signature checks
2024-09-10 12:49:06 -04:00
Matt Corallo
7efefd7e2a Always print why we disconnect explicitly
...and drop the old, confusing, "protocol error" message when we
get a duplicate connection from a peer.

This should slightly further disambiguate disconnection reasons,
which are a key debugging tool for assigning blame.
2024-09-10 14:26:57 +00:00
Elias Rohrer
479654b0a8
Merge pull request #3306 from TheBlueMatt/2024-09-chan-id-hex
Write ChannelIds out as hex in Debug output
2024-09-10 12:33:38 +02:00
shaavan
6500277ba8 Introduce Verification trait.
- The trait defines the public method one may define for creating and
  verifying the HMAC.
- Using a pub trait to define these method allows the flexibility for
  other `OffersMessageHandler` construct to construct the HMAC and
authenticate the message.
2024-09-10 15:57:24 +05:30
Matt Corallo
56cb6a10f1 Avoid redundant {channel,node}_announcement signature checks
If we receive `{channel,node}_announcement` messages which we
already have, we first validate their signatures and then look in
our graph and discover that we should discard the messages. This
avoids a second lock in `node_announcement` handling but does not
impact our locking in `channel_announcement` handling. It also
avoids lock contention in cases where the signatures are invalid,
but that should be exceedingly rare.

For nodes with relatively few peers, this is a fine state to be in,
however for nodes with many peers, we may see the same messages
hundreds of times. This causes a rather substantial waste of CPU
resources validating gossip messages.

Instead, here, we change to checking our network graph first and
then validate the signatures only if we don't already have the
message.
2024-09-09 18:14:19 +00:00
Duncan Dean
59f16896d6
Remove AvailableBalances::balance_msat
The ChannelMonitor::get_claimable_balances and ChainMonitor::get_claimable_balances
methods provide a more straightforward approach to the balance of a channel, which
satisfies most use cases. The computation of AvailableBalances::balance_msat is
complex and originally had a different purpose that is not applicable
anymore.

Co-authored-by: Willem Van Lint <noreply@wvanlint.dev>
2024-09-09 19:37:03 +02:00
Alec Chen
1fa7bf9391 Finish closing channel after async closing signed
In addressing a followup to test reconnection during closing negotation
with async signing, we change things to only return a `ShutdownResult`
when we actually finish shutting down the channel, i.e. we have the
signature ready to send the final closing signed. This slightly
simplifies the logic where we would shutdown our channel
prematurely before we got the final signature. This also means
that we don't push multiple `ChannelClosed` events if we receive closing
signed, reconnect, and receive closing signed again.
2024-09-09 09:46:44 -07:00
Matt Corallo
cc6e2a0f7a Write ChannelIds out as hex in Debug output
`ChannelId`s are almost always referenced as hex, so having debug
output print the raw bytes is somewhat annoying. Instead, we should
dump them as hex the same way we do for `Display`.

This uses the `hex_conservative` `impl_fmt_macros` which does all
the work for us, like we use for `lightning_types`.
2024-09-09 15:32:08 +00:00
Matt Corallo
91a60c8256 impl Borrow<[u8]> for ChannelId
We do this for `Payment*` in `lightning-types` and its needed for
the `hex_conservaitve` `impl_fmt_traits` macro which we'll use in
the next commit.
2024-09-09 15:30:09 +00:00
shaavan
e2ee325101 HMAC Construction and Verification for PaymentHash
When a InvoiceError is received for a sent BOLT12Invoice, the
corresponding PaymentHash is to be logged. Introduce hmac construction
and verification function for PaymentHash for this purpose.
2024-09-06 17:57:35 +05:30
Matt Corallo
c9de257498 Update versions to 0.0.124 and invoice 0.32 types 0.1 release 2024-09-03 18:18:52 +00:00
Matt Corallo
187a2cb45e
Merge pull request #3285 from TheBlueMatt/2024-08-tx-too-small
Correct handling of added `OP_RETURN` outputs
2024-09-03 17:53:08 +00:00
Matt Corallo
5f5c275ea3 Correct ANCHOR_INPUT_WITNESS_WEIGHT constant
`ANCHOR_INPUT_WITNESS_WEIGHT` is too high by two weight units,
likely it was calculated to include the SegWit marker bytes, but
it is used to describe an `Input::satisfaction_weight`, which does
not expect the marker bytes.

This corrects that oversight, reducing the constant by two and
adding the marker bytes back in our own internal weight
calculations. It also fixes a second issue where the constant was
too low by one when `grind_signatures` is not set, as that may
result in a signature being one byte longer than we expect.
2024-09-03 15:09:32 +00:00
Matt Corallo
5a2372ce8e Add a test for the past few commits
This adds a single test for coin selection which exercises the
issues fixed in the past three commits.
2024-09-03 14:15:28 +00:00
Matt Corallo
b3644dcdb5 Drop bogus debug assertion that we don't overpay on fees
We should always select at least as many coins as is required to
meet the feerate target, but its perfectly fine if we overshoot.
Specifically, we may overshoot deliberately if we choose to burn
change to fee instead.
2024-09-03 14:15:28 +00:00
Matt Corallo
d383ac49a2 Handle under-coin-selecting due to an added OP_RETURN output
When we do coin selection for channel close anchor spends, we may
do coin selection targeting exactly the input values we need.
However, if coin selection does not include a change output, we may
add an OP_RETURN output, which may cause us to end up with less
fee than we wanted on the resulting package.

Here we address this issue by running coin selection twice - first
without seeking the extra weight of the OP_RETURN output, and again
if we find that we under-selected.
2024-09-03 14:15:28 +00:00
Matt Corallo
ff00c63171 Ensure we never try to broadcast a transaction <= 64 bytes
While these are consensus-valid, they have been nonstandard for
quite some time and will not relay nor confirm.
2024-09-03 14:13:43 +00:00
Matt Corallo
ac4815abb6 Dont output logs when benchmarking
In 11ab302087 we accidentally removed
the `not(ldk_bench)` bound before outputting logs to stderr, which
we restore here. Instead of simply ignoring logs in benchmarks,
which we did previously, we instead format logs (in a way that LLVM
will not optimize out).
2024-08-30 18:42:04 +00:00
Matt Corallo
cdcab1ce1b Remove log level filtering in tests
There's no reason why we should be filtering our logs during tests.
It seems mostly like the `TestLogger` was written more as a sample
logger than a test logger, but these days we have samples, so we
should just drop the filtering and show everything.
2024-08-30 17:37:59 +00:00
Matt Corallo
856c980594 Bump versions to rc1 2024-08-29 19:40:09 +00:00
Matt Corallo
caf0daa2dd
Merge pull request #3257 from tnull/2024-08-fix-is-public
Rename instances of `is_public` to `is_announced`
2024-08-29 19:39:30 +00:00
Elias Rohrer
5928063789
Rename announced_channel to is_announced_for_forwarding
.. we rename the flag configuring whether we announce a channel or not.
2024-08-29 21:22:22 +02:00
Matt Corallo
1122e82bf0
Merge pull request #3238 from Mirebella/clippy-checks
Added clippy ignore rules for all errors and warnings
2024-08-29 16:06:40 +00:00
Matt Corallo
bf6a53e0fd
Merge pull request #3275 from TheBlueMatt/2024-08-3259-followups
#3259 followups
2024-08-29 00:54:19 +00:00
Matt Corallo
a97807647a
Merge pull request #3276 from arik-so/arik/2024/08/apply_monitor_updates_on_archive
Process updates before archiving monitors.
2024-08-28 21:53:43 +00:00
Arik Sosman
47c8aa51a6
Process updates before archiving monitors.
Previously, `MonitorUpdatingPersister` was disregarding any unapplied
monitor updates when archiving them. This commit ensures that upon
reading monitors, their corresponding updates are also read and
applied prior to archiving.
2024-08-28 12:19:38 -07:00
Arik Sosman
61197390d6
Store Broadcaster and FeeEstimator on MonitorUpdatingPersister.
`MonitorUpdatingPersister` does not currently correctly archive
monitors because it neglects any unapplied updates. In order to start
applying these updates, the archiving methods will require access to
instances of `BroadcasterInterface` and `FeeEstimator`.

This commit requires that the `MonitorUpdatingPersister` be
instantiated with those instances, obviating the need for passing
them around, and laying the foundation for the following commit.
2024-08-28 12:19:38 -07:00
Matt Corallo
ea646ae888 Test manual funding transaction Event::DiscardFunding generation 2024-08-28 14:50:52 +00:00
Matt Corallo
683aa8350e Correct manual shutdown detection on channel closure
In 5e874c3dc9 we'd intended to not
reveal the dummy funding transaction in `Event::DiscardFunding`.
However, instead of looking at the channel that was just closed,
the logic only looks at any other channels which were funded as a
part of the same batch. Because manually-funded transactions
cannot currently be done for batch funding, this was actually dead
code, preventing the new changes from taking effect.
2024-08-28 14:35:54 +00:00
Matt Corallo
6a81d5d4bb Add additional documentation on Channel::unbroadcasted_funding 2024-08-28 13:50:17 +00:00
Matt Corallo
b7064808ac
Merge pull request #3268 from TheBlueMatt/2024-08-moar-feerate-categories
Split up `ConfirmationTarget` even more
2024-08-28 13:15:13 +00:00
Mirebella
6ff1978eba Add clippy ignore rules for all errors and warnings 2024-08-28 09:47:40 +02:00
Matt Corallo
cf97cefb47 Test new ConfirmationTarget selection based on HTLC set
This updates `test_yield_anchors_events` to test both anchor
channels with and without HTLCs, and relies on overriding only the
singular expected `ConfirmationTarget` used, testing the new
`ConfirmationTarget::UrgentOnChainSweep` use.
2024-08-27 19:57:34 +00:00
Matt Corallo
80dd594099 Don't ignore events in test_yield_anchors_events
Our tests should never ignore the events generated as they provide
critical context about what's happening in LDK. Here we fix
`test_yield_anchors_events` to avoid doing so.
2024-08-27 19:57:34 +00:00
Matt Corallo
3f23e3c288 Add a constructor and per-target override to TestFeeEstimator
This will allow us to test `ConfirmationTarget`s used in functional
tests by setting an override on just the target we expect to be
used.
2024-08-27 19:57:34 +00:00
Matt Corallo
1e285cb417 Only generate an Event::DiscardFunding when we need to
5e874c3dc9 changed
`Event::DiscardFunding` to not include a dummy transaction when we
were funded without a full funding tx, but in doing so started
generating `DiscardFunding` events on every channel closure rather
than only when there's actually still a pending funding broadcast.

This restores the previous behavior to only generate the event when
we should actually discard the funding tx.
2024-08-27 19:31:25 +00:00
Matt Corallo
5e62df7f20
Merge pull request #3259 from vincenzopalazzo/macros/dummy-tx
[RFC] event: store the outpoint when is_manual_broadcast
2024-08-27 19:16:57 +00:00
Vincenzo Palazzo
5e874c3dc9
event: store the outpoint when is_manual_broadcast
With [1], it's possible to specify `manual_broadcast` for
the channel funding transaction. When `is_manual_broadcast` is
set to true, the transaction in the `DiscardFunding` event is
replaced with a dummy empty transaction.

This commit checks if `is_manual_broadcast` is true and
stores the funding OutPoint in the DiscardFunding event instead.

[1] https://github.com/lightningdevkit/rust-lightning/pull/3024

Link: https://github.com/lightningdevkit/rust-lightning/issues/3164
Suggested-by: TheBlueMatt
Signed-off-by: Vincenzo Palazzo <vincenzopalazzodev@gmail.com>
2024-08-27 19:50:18 +02:00