lnd/itest
yyforyongyu 57c4034693
itest: track and skip flaky tests for windows
To make the CI indicative, we now starting tracking the flaky tests
found when running on Windows. As a starting point, rather than ignore
the windows CI entirely, we now identify there are cases where lnd can
be buggy when running in windows.

We should fix the tests in the future, otherwise the windows build
should be deleted.
2024-11-12 03:24:18 +08:00
..
list_exclude_test.go itest: track and skip flaky tests for windows 2024-11-12 03:24:18 +08:00
list_off_test.go itest+lntest: migrate lntemp to lntest 2023-02-23 21:56:09 +08:00
list_on_test.go itest: track and skip flaky tests for windows 2024-11-12 03:24:18 +08:00
lnd_amp_test.go channeldb: filter AMP state to relevant set IDs 2024-09-03 19:40:46 +02:00
lnd_channel_backup_test.go itest: break down channel backup restore tests 2024-11-12 03:24:17 +08:00
lnd_channel_balance_test.go itest: remove unnecessary channel close and node shutdown 2024-11-12 03:24:13 +08:00
lnd_channel_force_close_test.go itest: fix flake for neutrino backend 2024-11-12 03:24:14 +08:00
lnd_channel_funding_fund_max_test.go itest: break down channel fundmax tests 2024-11-12 03:24:18 +08:00
lnd_channel_funding_utxo_selection_test.go itest: break down utxo selection funding tests 2024-11-12 03:24:16 +08:00
lnd_channel_graph_test.go lntest+itest: remove AssertNumActiveEdges 2024-11-12 03:24:15 +08:00
lnd_channel_policy_test.go itest: remove unnecessary channel close and node shutdown 2024-11-12 03:24:13 +08:00
lnd_coop_close_external_delivery_test.go itest: remove the use of standby nodes 2024-11-12 03:24:13 +08:00
lnd_coop_close_with_htlcs_test.go itest: remove the use of standby nodes 2024-11-12 03:24:13 +08:00
lnd_custom_features.go itest: remove unnecessary channel close and node shutdown 2024-11-12 03:24:13 +08:00
lnd_custom_message_test.go itest: remove the use of standby nodes 2024-11-12 03:24:13 +08:00
lnd_estimate_route_fee_test.go itest+routing: fix flake in runFeeEstimationTestCase 2024-11-12 03:24:15 +08:00
lnd_etcd_failover_test.go itest: add itest covering the leader healthcheck 2024-08-01 19:04:10 +02:00
lnd_forward_interceptor_test.go itest: use ht.CreateSimpleNetwork whenever applicable 2024-11-12 03:24:15 +08:00
lnd_funding_test.go itest: break down basic funding flow tests 2024-11-12 03:24:17 +08:00
lnd_hold_invoice_force_test.go itest: further reduce block mined in tests 2024-11-12 03:24:18 +08:00
lnd_hold_persistence_test.go itest: remove unnecessary channel close and node shutdown 2024-11-12 03:24:13 +08:00
lnd_htlc_test.go itest: remove unnecessary channel close and node shutdown 2024-11-12 03:24:13 +08:00
lnd_htlc_timeout_resolver_test.go itest: assert payment status after sending 2024-11-11 22:31:57 +08:00
lnd_invoice_acceptor_test.go itest: remove unnecessary channel close and node shutdown 2024-11-12 03:24:13 +08:00
lnd_macaroons_test.go itest: remove the use of standby nodes 2024-11-12 03:24:13 +08:00
lnd_max_channel_size_test.go itest: remove unnecessary channel close and node shutdown 2024-11-12 03:24:13 +08:00
lnd_max_htlcs_test.go itest: remove unnecessary channel close and node shutdown 2024-11-12 03:24:13 +08:00
lnd_misc_test.go itest: optimize blocks mined in testGarbageCollectLinkNodes 2024-11-12 03:24:16 +08:00
lnd_mpp_test.go lntest+itest: remove AssertNumActiveEdges 2024-11-12 03:24:15 +08:00
lnd_multi-hop_force_close_test.go itest: break all multihop test cases 2024-11-12 03:24:16 +08:00
lnd_multi-hop-error-propagation_test.go itest: remove unnecessary channel close and node shutdown 2024-11-12 03:24:13 +08:00
lnd_multi-hop-payments_test.go itest: remove unnecessary channel close and node shutdown 2024-11-12 03:24:13 +08:00
lnd_network_test.go itest: remove unnecessary channel close and node shutdown 2024-11-12 03:24:13 +08:00
lnd_neutrino_test.go itest: remove the use of standby nodes 2024-11-12 03:24:13 +08:00
lnd_no_etcd_dummy_failover_test.go itest: add itest covering the leader healthcheck 2024-08-01 19:04:10 +02:00
lnd_nonstd_sweep_test.go itest+lntest: stop using pointer to chainhash.Hash 2024-10-17 07:14:51 +08:00
lnd_onchain_test.go itest: remove unnecessary channel close and node shutdown 2024-11-12 03:24:13 +08:00
lnd_open_channel_test.go itest: break down open channel fee policy 2024-11-12 03:24:17 +08:00
lnd_payment_test.go itest: break down payment failed tests 2024-11-12 03:24:17 +08:00
lnd_psbt_test.go itest: fix flake in runPsbtChanFundingWithNodes 2024-11-12 03:24:15 +08:00
lnd_recovery_test.go itest: fix misuse of MineBlocks and replace it with 2024-07-23 21:30:08 +08:00
lnd_remote_signer_test.go itest: break remote signer into independent cases 2024-11-12 03:24:16 +08:00
lnd_res_handoff_test.go itest: remove unnecessary channel close and node shutdown 2024-11-12 03:24:13 +08:00
lnd_rest_api_test.go itest: remove loop in wsTestCaseBiDirectionalSubscription 2024-11-12 03:24:14 +08:00
lnd_revocation_test.go itest: fix flake in testRevokedCloseRetributionZeroValueRemoteOutput 2024-11-12 03:24:14 +08:00
lnd_route_blinding_test.go itest: further reduce block mined in tests 2024-11-12 03:24:18 +08:00
lnd_routing_test.go itest: break down single hop send to route 2024-11-12 03:24:17 +08:00
lnd_rpc_middleware_interceptor_test.go lntest+itest: kill node and wait its process 2024-11-12 03:24:12 +08:00
lnd_signer_test.go itest: remove the use of standby nodes 2024-11-12 03:24:13 +08:00
lnd_single_hop_invoice_test.go itest: remove unnecessary channel close and node shutdown 2024-11-12 03:24:13 +08:00
lnd_sweep_test.go itest: fix and document flake in sweeping tests 2024-11-12 03:24:14 +08:00
lnd_switch_test.go itest: fix flake in testSwitchOfflineDelivery 2024-11-12 03:24:14 +08:00
lnd_taproot_test.go itest: break down taproot tests 2024-11-12 03:24:18 +08:00
lnd_test.go itest: track and skip flaky tests for windows 2024-11-12 03:24:18 +08:00
lnd_trackpayments_test.go itest: remove unnecessary channel close and node shutdown 2024-11-12 03:24:13 +08:00
lnd_wallet_import_test.go itest: break down wallet import account tests 2024-11-12 03:24:17 +08:00
lnd_watchtower_test.go itest: remove the use of standby nodes 2024-11-12 03:24:13 +08:00
lnd_wipe_fwdpkgs_test.go itest: further reduce block mined in tests 2024-11-12 03:24:18 +08:00
lnd_wumbo_channels_test.go itest: remove unnecessary channel close and node shutdown 2024-11-12 03:24:13 +08:00
lnd_zero_conf_test.go itest: break down scid alias channel update tests 2024-11-12 03:24:16 +08:00
log_check_errors.sh multi: move itest out of lntest 2023-02-23 21:56:08 +08:00
log_substitutions.txt lntest/itest: adds tests for fundmax flag of cli:openchannel 2023-04-05 23:09:12 +02:00
README.md itest: add readme 2023-02-23 21:56:12 +08:00

Integration Test

itest is a package that houses the integration tests made for lnd. This package builds test cases using the test framework lntest.

Add New Tests

To add a new test case, create a TestFunc and add it in list_on_test.go. Ideally, the Name should just be the snake case of the name used in TestFunc without the leading test and underscores. For instance, to test lnd's exporting channel backup, we have,

{
		Name:     "export channel backup",
		TestFunc: testExportChannelBackup,
}

The place to put the code of the TestFunc is case-specific. itest package has loosely defined a list of files to test different functionalities of lnd. The new test needs to be put into one of these files, otherwise, a new file needs to be created.

Run Tests

Run a single test case

To run a single test case, use make itest icase=$case, where case is the name defined in list_on_test.go, with spaces replaced with underscores(_).

# Run `testListChannels`.
make itest icase=list_channels

Run multiple test cases

There are two ways to run multiple test cases. One way is to use make itest icase=$cases, where cases has the format cases='(case|case|...)'. The case is the name defined in list_on_test.go, with spaces replaced with underscores(_).

# Run `testListChannels` and `testListAddresses` together.
make itest icase='(list_channels|list_addresses)'

Another way to run multiple cases is similar to how Go runs its tests - by simple regex matching. For instance, the following command will run three cases since they all start with the word list,

# Run `testListChannels`, `testListAddresses`, and `testListPayments` together.
make itest icase=list

Run all tests

To run all tests, use make itest without icase flag.

# Run all test cases.
make itest

Run tests in parallel

To run tests in parallel, use make itest-parallel. This command takes two special arguments,

  • tranches, specifies the number of parts the test cases will be split into.
  • parallel, specifies the number of threads to run in parallel. This value must be smaller than or equal to tranches.
# Split the tests into 4 parts, and run them using 2 threads.
make itest-parallel tranches=4 parallel=2

By default, itest-parallel splits the tests into 4 parts and uses 4 threads to run each of them.

Additional arguments

For both make itest and make itest-parallel, the following arguments are allowed,

  • timeout, specifies the timeout value used in testing.
  • dbbackend, specifies the database backend. Must be bbolt, etcd, or postgres, default to bbolt.
  • backend, specifies the chain backend to be used. Must be one of,
    • btcd, the default value.
    • neutrino
    • bitcoind
    • bitcoind notxindex
    • bitcoind rpcpolling
# Run a single test case using bitcoind as the chain backend and etcd as the
# database backend, with a timeout of 5 minutes.
make itest icase=list_channels backend=bitcoind dbbackend=etcd timeout=5m

# Run all test cases in parallel, using bitcoind notxindex as the chain backend
# and etcd as the database backend, with a timeout of 60 minutes for each
# parallel.
make itest-parallel backend="bitcoind notxindex" dbbackend=etcd timeout=60m