Commit Graph

1427 Commits

Author SHA1 Message Date
nymkappa
e3e7271c9d
Add avg mining pool block mathrate in pools stats API 2023-02-20 18:14:12 +09:00
Felipe Knorr Kuhn
89319d9117
Merge branch 'master' into nymkappa/bugfix/node-sockets-lnd 2023-02-19 13:56:48 -08:00
Felipe Knorr Kuhn
c260b4f0f2
Merge branch 'master' into mononaut/raise-memory-limits 2023-02-19 13:56:28 -08:00
Felipe Knorr Kuhn
6a285064af
Merge branch 'master' into mononaut/optimize-mempool-block-7 2023-02-19 13:56:18 -08:00
nymkappa
761edbce9a
Fix database usage when database is disabled 2023-02-19 19:08:29 +09:00
Felipe Knorr Kuhn
3d1d29bd3b
Merge branch 'master' into nymkappa/bugfix/remove-unused-config-setting 2023-02-18 18:43:04 -08:00
wiz
bc4d21577d
Merge pull request #3041 from mempool/nymkappa/update-readme
Add `--reindex` doc to backend README
2023-02-19 10:23:59 +09:00
Mononaut
7f54e30a26
Reuse HTTP connections to esplora backend 2023-02-18 21:34:09 +07:00
softsimon
71b373463b
Merge branch 'master' into nymkappa/bugfix/price-update-invalid-response 2023-02-18 16:59:11 +07:00
softsimon
3f0bcbe64c
Merge pull request #3043 from mempool/nymkappa/bugfix/blocks-api
Fixes blocks api (missing fee range)
2023-02-18 15:26:08 +07:00
Mononaut
59f08247ef
Reduce data sent to mempool block 7 subscription 2023-02-17 19:11:12 -06:00
Mononaut
77686821ba
Raise production memory limits
Increases maxmempool production bitcoin.conf setting to 2GB,
and raises `npm run start-production` nodejs memory limit to 8GB
2023-02-17 10:12:33 -06:00
nymkappa
ce012b7d55
Remove config.MEMPOOL.PRICE_FEED_UPDATE_INTERVAL 2023-02-16 09:44:52 +09:00
nymkappa
9734052477
Fix database used when database disabled 2023-02-15 17:45:29 +09:00
Mononaut
2363631326
Add audit / block health config feature flag 2023-02-15 16:28:29 +09:00
nymkappa
6c0dc34dd6
Run database migration before running any business logic 2023-02-15 16:13:10 +09:00
nymkappa
32aa7aaff1
Remove bisq price fetch and replace it with our in house price index 2023-02-15 16:05:14 +09:00
wiz
e009c78c3e
Merge branch 'master' into mononaut/fiat-selector 2023-02-15 12:10:07 +09:00
nymkappa
56dad33fce
Always return fully extended block in blocks API even if indexing is disabled 2023-02-14 22:14:28 +09:00
nymkappa
1fc6e13bf8
Fix node socket parsing with LND 2023-02-13 18:01:15 +09:00
nymkappa
cf720c4bef
Fix missing fee range in blocks api when querying non indexed blocks 2023-02-13 15:50:22 +09:00
nymkappa
0176afa394
Add --reindex doc to backend README 2023-02-13 14:58:35 +09:00
Mononaut
8f3b8276c5
safer mempool cloning for different GBT algorithms 2023-02-10 07:43:39 -06:00
softsimon
241850beca
Merge pull request #3010 from mempool/mononaut/cpfp-error-handling
More robust error checking & handling in CPFP repositories
2023-02-04 09:18:10 +07:00
Mononaut
900e66aef7
More robust error checking & handling in CPFP repositories 2023-02-02 17:37:32 -06:00
Mononaut
aa8a3e60c2
expose other currencies in charts APIs 2023-02-01 10:23:55 -06:00
Mononaut
e8c3273541
fix drift in next block viz with mixed template algos 2023-01-30 16:26:37 -06:00
softsimon
4407b42aab
Merge branch 'master' into nymkappa/bugfix/tx-fetcher-crash 2023-01-26 17:02:35 +04:00
softsimon
6ed4e24f86
Merge pull request #2950 from mempool/mononaut/fix-cpfp-table-drops
Correctly drop legacy cpfp db tables
2023-01-26 13:39:35 +04:00
softsimon
59eb271782
Merge pull request #2824 from mempool/mononaut/more-rbf-info
cache, serve & display more comprehensive RBF info
2023-01-25 17:29:21 +04:00
Mononaut
fc0af50ab5
Fix bugged mempool block gradients 2023-01-19 11:09:03 -06:00
Mononaut
7da308c1e1
fix RBF detection 2023-01-17 19:25:00 -06:00
Mononaut
d778530620
keep cached RBF info for 24 hours after tx leaves the mempool 2023-01-17 19:24:57 -06:00
Mononaut
0481f57304
cache, serve & display more comprehensive RBF info 2023-01-17 16:09:16 -06:00
Mononaut
eead4d0af8
Correctly drop legacy cpfp db tables 2023-01-13 16:34:04 -06:00
softsimon
9fa19e7b26
Updating patch releases 2023-01-13 13:16:50 +04:00
Felipe Knorr Kuhn
04f00ca521
Merge branch 'master' into simon/backend-dependencies-29-12 2023-01-12 22:27:10 -08:00
wiz
b2b8911030
Merge branch 'master' into mononaut/scrollable-blockchain 2023-01-12 22:01:45 +09:00
wiz
3b8802d39e
Merge branch 'master' into mononaut/document-backend-config 2023-01-12 21:32:28 +09:00
Mononaut
bd30f2eb12
migrate cpfp data from old to new schemas 2023-01-11 08:44:11 -06:00
Mononaut
f0d3bb87c6
handle gaps in indexed CPFP data 2023-01-11 08:44:11 -06:00
Mononaut
8de3fd0988
batch db inserts for cpfp data 2023-01-11 08:44:11 -06:00
Mononaut
fcd047f302
remove redundant fields from CPFP interfaces 2023-01-11 08:44:11 -06:00
Mononaut
01c96f80f9
add cpfp progress marker to avoid reindexing early blocks 2023-01-11 08:44:10 -06:00
Mononaut
b50936f001
compact schemas for cpfp tables 2023-01-11 08:44:10 -06:00
Mononaut
7793eaecbc
fix cpfp indexing rate calculation 2023-01-11 08:44:10 -06:00
Mononaut
ee95d033ac
remove slow cpfp indexing path 2023-01-11 08:44:10 -06:00
Mononaut
0d921cf7a6
don't rely on blocks table for cpfp indexing progress 2023-01-11 08:44:10 -06:00
Felipe Knorr Kuhn
5379ec0f30
Expose whether Lightning is enabled on the backend 2023-01-10 21:54:34 -08:00
nymkappa
fcd34eb876
Add new mempool lightning nodes and format the array so it's human readable 2023-01-10 16:13:16 +01:00
Mononaut
2e45dab4b7
Rename TRANSACTION_INDEXING to CPFP_INDEXING and add to mainnet prod config 2023-01-09 10:36:08 -06:00
Mononaut
7f903b0331
Add missing vars to docker config & readme 2023-01-09 10:36:08 -06:00
nymkappa
71d1c3de04
Update bitcoin-api-factory so we can use core only if needed 2023-01-08 11:24:23 +01:00
nymkappa
9f4107319f
Fetch coinbase tx with core when esplora fails to do so 2023-01-07 11:17:30 +01:00
Mononaut
befafaa60c
add paginated virtual scrolling to blockchain blocks bar 2023-01-06 10:13:53 -06:00
softsimon
05a8154db0
Merge pull request #2851 from mempool/nymkappa/bugfix/error-500-blocks-list
Fix error 500 when querying /blocks using `"INDEXING_BLOCKS_AMOUNT": 0`
2023-01-05 01:16:09 +04:00
softsimon
dcc8b81ca6
Merge branch 'master' into nymkappa/bugfix/cleanup-logs 2023-01-05 00:46:21 +04:00
softsimon
2ca12a72f8
Updating dependencies to please dependabot 2022-12-30 16:28:48 +04:00
nymkappa
a975936d3c
Don't try to import LN historical stats if no topology folder is set 2022-12-28 12:13:41 +01:00
wiz
4bcb4e37e8
Merge branch 'master' into nymkappa/bugfix/price-update-invalid-response 2022-12-26 13:13:30 +09:00
wiz
e986aaf1d9
Merge branch 'master' into mononaut/cpfp-indexer-fixes 2022-12-25 22:41:39 +09:00
nymkappa
db4bf52596
Fix error 500 when querying /blocks using "INDEXING_BLOCKS_AMOUNT": 0 2022-12-16 17:43:37 +01:00
Mononaut
fb137e6247
Fix & reenable cpfp indexer optimized path 2022-12-07 18:58:03 -06:00
Mononaut
56b6f79f97
improve thread error handling 2022-12-07 14:52:02 -06:00
Mononaut
4d0637768d
Refactor advanced gbt to minimize inter-thread comms 2022-12-07 14:52:01 -06:00
softsimon
07987ff4b6
Merge pull request #2790 from mempool/nymkappa/bugfix/sql-query
Handle ISP with no nodes
2022-12-07 17:40:36 +04:00
softsimon
484c503f6d
Merge pull request #2779 from mempool/mononaut/fix-block-summaries-repo
Fix block summaries repo upsert race condition
2022-12-07 17:23:00 +04:00
softsimon
c59ab2a129
Merge pull request #2778 from mempool/mononaut/advanced-gbt-fixes
Fix bugs related to advanced GBT transaction selection
2022-12-07 16:13:16 +04:00
nymkappa
3a7dffbe09
Fix crash when channel short id is not valid 2022-12-06 10:51:01 +01:00
nymkappa
685433fe4c
Handle ISP with no nodes 2022-12-05 08:11:46 +01:00
Mononaut
79f6ae3b6f
fix post-block advanced gbt call 2022-12-03 12:11:21 +09:00
Mononaut
e54e896e56
fix skipped descendant updates on tx inclusion 2022-12-03 12:10:54 +09:00
Mononaut
3126a559a0
Make forensics backend call rate limiting configurable 2022-12-03 11:17:53 +09:00
Mononaut
132e848fdc
Fix block summaries repo upsert race condition 2022-12-03 10:49:10 +09:00
nymkappa
efb48271f9
Cleanup logs 2022-12-01 15:52:06 +01:00
nymkappa
a671bfc226
Make sure exchange API response format is valid before using it 2022-12-01 12:05:23 +01:00
wiz
2b411aad0a
Merge pull request #2730 from mempool/nymkappa/bugfix/node-map
Don't select nodes which do not have country info
2022-12-01 17:13:12 +09:00
wiz
13b52c427c
Merge branch 'master' into nymkappa/bugfix/node-map 2022-12-01 16:55:22 +09:00
softsimon
1db11d1d67
Downgrading axios to latest 0.27.x release 2022-12-01 16:15:19 +09:00
wiz
175bcf7467
Merge branch 'master' into simon/update-backend-packages 2022-12-01 16:01:42 +09:00
softsimon
59f1b031c8
Run schema update synchronously 2022-12-01 14:41:37 +09:00
softsimon
3d45054e38
Update backend npm modules 2022-12-01 14:24:41 +09:00
Mononaut
03a3320e45
block audit truncation in separate db migrations. bump timeout to 1 hour. 2022-11-30 23:03:51 +09:00
Mononaut
ead60aaa21
save db schema version after each successful migration 2022-11-30 22:58:01 +09:00
wiz
c7cca500fa
Merge branch 'master' into simon/mempool-gbt-config 2022-11-30 21:45:25 +09:00
Mononaut
ba10df69b7
improve precision of output attribution for mutual closes 2022-11-30 18:24:00 +09:00
Mononaut
ded11892f5
merge forensics columns into main channels table 2022-11-30 18:24:00 +09:00
Mononaut
609f68eb24
move linked channel scan into forensics task, add backend throttling 2022-11-30 18:24:00 +09:00
Mononaut
dc7d5bc94d
handle batched channel opens. infer funding balances in both directions. 2022-11-30 18:24:00 +09:00
Mononaut
35ae672177
break long-running forensics tasks 2022-11-30 18:24:00 +09:00
Mononaut
8f0830f6d1
detect channels opened from change outputs 2022-11-30 18:24:00 +09:00
Mononaut
cf89ded14d
detect links between channel close and open txs 2022-11-30 18:23:59 +09:00
softsimon
030889250f
Mempool GBT config 2022-11-30 17:56:53 +09:00
wiz
272b6d2437
Disable optimization in CPFP indexing when block summaries indexing is enabled 2022-11-29 23:47:43 +09:00
wiz
89293b4358
Merge branch 'master' into mononaut/index-cpfp-info 2022-11-29 16:41:12 +09:00
wiz
cc30da0b4d
Merge branch 'master' into nymkappa/bugfix/block-timestamp 2022-11-29 14:25:45 +09:00
Mononaut
6d6dd09d11
get blocks from esplora for cpfp indexer 2022-11-29 11:42:08 +09:00
Mononaut
f2ad184d1f
optimize cpfp indexing 2022-11-29 11:42:08 +09:00
Mononaut
ab5308e1c8
adjust database migration compatibility 2022-11-29 11:42:08 +09:00
Mononaut
205d832d31
return more complete cpfp data for mempool transactions 2022-11-29 11:42:08 +09:00
Mononaut
9b6a012476
calculate & index cpfp packages 2022-11-29 11:42:07 +09:00
nymkappa
3eb4ea9048
Disable ON UPDATE for blocks.blockTimestamp field 2022-11-28 17:33:07 +09:00
Mononaut
2290f98011
only query blocks_audits on bitcoin networks 2022-11-28 14:26:28 +09:00
Mononaut
e627122239
move block audit endpoint from mining to bitcoin routes 2022-11-25 19:32:50 +09:00
Mononaut
201b32bdcd
better fallbacks for missing block summaries data 2022-11-25 10:16:58 +09:00
Mononaut
de04914851
optimize block audit scores db query 2022-11-24 17:11:45 +09:00
Mononaut
5fc3b8b70c
merge block-audit and block pages 2022-11-24 17:10:53 +09:00
Mononaut
276470474d
save 'fresh' transactions in block audit repository 2022-11-24 17:10:53 +09:00
nymkappa
1461cb1b17
Don't select nodes which do not have country info 2022-11-24 16:56:13 +09:00
Mononaut
6ada839282
reduce forensics throttle delay from 100ms to 20ms 2022-11-23 19:32:14 +09:00
softsimon
7de068368c
Update backend/src/tasks/lightning/forensics.service.ts 2022-11-23 19:24:41 +09:00
wiz
0d797ff7fd
Merge branch 'master' into mononaut/ln-penalty-scan-optimization 2022-11-23 19:14:20 +09:00
softsimon
74dbd6cee1
Add support for application/base64 content type 2022-11-23 18:43:37 +09:00
Mononaut
7d3ec63335
move long-running forensics scans to separate service, throttle backend calls 2022-11-23 10:38:24 +09:00
softsimon
584f443f56
Adding new getTransactionHex api 2022-11-22 21:45:05 +09:00
softsimon
4f3296566a
Make api available on all backends 2022-11-22 19:08:09 +09:00
wiz
1309a63430
Merge branch 'master' into junderw/psbt-complete-inputs 2022-11-22 18:57:36 +09:00
wiz
802d38c363
Merge branch 'master' into nymkappa/bugfix/404-ftx-not-found 2022-11-22 18:18:14 +09:00
wiz
2b94849881
Merge branch 'master' into junderw/psbt-complete-inputs 2022-11-22 17:59:50 +09:00
wiz
28d5ec34b3
Merge branch 'master' into nymkappa/bugfix/node-count 2022-11-22 17:25:23 +09:00
softsimon
5e72ecfdc9
Support Maxmind Lite
fixes #2553
2022-11-22 16:13:27 +09:00
Mononaut
b9a761fb88
add ADVANCED_TRANSACTION_SELECTION default to config test 2022-11-22 15:10:24 +09:00
Mononaut
b1d490972b
refactor async mempool/block update callbacks 2022-11-22 14:43:58 +09:00
Mononaut
786d73625a
guard new tx selection algo behind config setting 2022-11-22 14:43:58 +09:00
Mononaut
08ad6a0da3
move new tx selection algorithm into thread worker 2022-11-22 14:43:55 +09:00
wiz
38cb45e026
Merge pull request #2664 from mononaut/block-audit-db-migration
db migration to clear obsolete block audit data
2022-11-22 14:40:33 +09:00
Mononaut
24dba5a2ef
Bump db migration query timeout to 900s 2022-11-22 14:25:57 +09:00
Mononaut
a32f960c4a
db migration to clear obsolete audit data 2022-11-22 14:07:29 +09:00
nymkappa
9d5717f30d
Make sure we handle all isp id in the queried list 2022-11-22 11:58:16 +09:00
wiz
5da8f2b6dc
Merge branch 'master' into nymkappa/feature/rename-mining-pool 2022-11-22 10:54:20 +09:00
wiz
adcc1ba4f0
Merge branch 'master' into fix-block-summary-vsize 2022-11-21 21:03:45 +09:00
Mononaut
373e02a5b0
Store & expose node extension TLV data in backend 2022-11-21 20:27:03 +09:00
wiz
eb03fc18ad
Merge branch 'master' into scan-for-penalty-txs 2022-11-21 19:19:22 +09:00
Mononaut
5b6f713ef3
Fetch missing block audit scores 2022-11-21 18:45:34 +09:00
Mononaut
29f7c89c53
Tweak block audit algo to reduce false positives 2022-11-21 18:43:52 +09:00
wiz
7232c4755d
Merge branch 'master' into nymkappa/bugfix/node-count 2022-11-21 18:19:53 +09:00
wiz
e051758ca7
Merge pull request #2564 from mempool/junderw/search-blocktime
[Feature] Search for block by timestamp
2022-11-21 17:45:02 +09:00
wiz
be3acf8694
Merge branch 'master' into junderw/psbt-complete-inputs 2022-11-21 17:34:26 +09:00
wiz
5957b71774
Merge branch 'master' into simon/disable-mempool-config 2022-11-21 17:23:34 +09:00
wiz
8cc252642b
Merge branch 'master' into simon/updated-mempool-debug-output 2022-11-21 17:12:07 +09:00
nymkappa
7c7273b696
Remove FTX from the price feeds 2022-11-20 19:23:51 +09:00
Mononaut
c1e741a025
Rescan unresolved LN channel force closes 2022-11-19 17:30:56 +09:00
nymkappa
d32d97fbaf
Add support for renaming a mining pool without changing regex or addresses 2022-11-09 06:43:46 +01:00
Felipe Knorr Kuhn
b069196c27
Merge branch 'master' into junderw/psbt-complete-inputs 2022-11-07 07:21:24 -08:00
Felipe Knorr Kuhn
48e2df3f7a
Merge branch 'master' into junderw/search-blocktime 2022-11-07 07:21:14 -08:00
Mononaut
9c6799e193
Fix rounded vsize in block summaries 2022-11-04 10:37:14 -06:00
Mononaut
f3eb403c17
Add match rate to block page 2022-10-28 18:49:29 -06:00
Mononaut
b6343ddc2d
Clean up block audit page & tweak color scheme 2022-10-28 18:49:28 -06:00
Mononaut
6d28259515
disable block audits unless indexing is enabled 2022-10-28 15:16:03 -06:00
Mononaut
968d7b827b
Optimize makeBlockTemplates 2022-10-27 10:25:16 -06:00