Commit Graph

819 Commits

Author SHA1 Message Date
Ayanami
0b351b9fcb pools-updater: Support secure Tor connection to sync data with Github
Use Axios instead of native https
2022-05-18 11:20:28 +09:00
nymkappa
5da94fa793
Delete useless log 2022-05-17 15:58:11 +02:00
nymkappa
47bb073b9a
Define avg block time to 10 min until we have at least 146 block in the current epoch 2022-05-17 14:40:18 +02:00
nymkappa
df59c21cfe
Cleanup mining API endpoints 2022-05-17 12:02:50 +02:00
wiz
094257a9df
Merge branch 'master' into nymkappa/feature/update-block-api 2022-05-17 15:57:05 +09:00
nymkappa
7e8e4b1e6c
If bisq data folder is not ready, retry every 3 minutes instead of exit 2022-05-13 11:54:52 +02:00
nymkappa
9377faea9c
Skip missing blocks during block hash chain validation 2022-05-13 10:34:32 +02:00
nymkappa
d26b1436b5
Always expose /block/{hash} API in the node backend 2022-05-12 08:13:42 +02:00
nymkappa
384c8d17cf
Only process mining pools on Bitcoin networks 2022-05-12 08:13:41 +02:00
nymkappa
ff74e6ea8c
If block exists in memory cache, return it directly for /block API 2022-05-12 08:13:41 +02:00
nymkappa
057b5bd2e1
Update block API to use indexing if available 2022-05-12 08:13:40 +02:00
Felipe Knorr Kuhn
5ca9de5a42
Fix the socks5 connection after updating the socks lib 2022-05-11 19:08:41 -07:00
nymkappa
e9620b7b48
Add block sizes and weights graph 2022-05-10 16:41:40 +02:00
nymkappa
3e90650536
Add /api/v1/mining/blocks/sizes-weights/:interval API 2022-05-10 16:41:23 +02:00
nymkappa
de7c4774ec
Added indexing progress indicator for hashrates, update logging 2022-05-10 15:48:21 +02:00
nymkappa
802e10e0a9
Create indexing sticky notification that show indexing progress in all mining dashboard related pages 2022-05-10 15:48:20 +02:00
wiz
2d4401a336
Merge pull request #1594 from mempool/dependabot/npm_and_yarn/backend/express-4.18.1
Bump express from 4.17.1 to 4.18.1 in /backend
2022-05-09 15:17:23 +09:00
wiz
f359e956c1
Merge pull request #1593 from mempool/dependabot/npm_and_yarn/backend/ws-8.6.0
Bump ws from 8.3.0 to 8.6.0 in /backend
2022-05-09 15:09:36 +09:00
wiz
468ee7bcb1
Merge pull request #1585 from mempool/dependabot/npm_and_yarn/backend/typescript-4.6.4
Bump typescript from 4.4.4 to 4.6.4 in /backend
2022-05-09 11:49:35 +09:00
dependabot[bot]
072c192d9a
Bump ws from 8.3.0 to 8.6.0 in /backend
Bumps [ws](https://github.com/websockets/ws) from 8.3.0 to 8.6.0.
- [Release notes](https://github.com/websockets/ws/releases)
- [Commits](https://github.com/websockets/ws/compare/8.3.0...8.6.0)

---
updated-dependencies:
- dependency-name: ws
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-05-09 02:42:41 +00:00
dependabot[bot]
06451f5342
Bump crypto-js from 4.0.0 to 4.1.1 in /backend
Bumps [crypto-js](https://github.com/brix/crypto-js) from 4.0.0 to 4.1.1.
- [Release notes](https://github.com/brix/crypto-js/releases)
- [Commits](https://github.com/brix/crypto-js/compare/4.0.0...4.1.1)

---
updated-dependencies:
- dependency-name: crypto-js
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-05-09 02:40:04 +00:00
dependabot[bot]
074104e973
Bump typescript from 4.4.4 to 4.6.4 in /backend
Bumps [typescript](https://github.com/Microsoft/TypeScript) from 4.4.4 to 4.6.4.
- [Release notes](https://github.com/Microsoft/TypeScript/releases)
- [Commits](https://github.com/Microsoft/TypeScript/compare/v4.4.4...v4.6.4)

---
updated-dependencies:
- dependency-name: typescript
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-05-09 02:39:48 +00:00
wiz
a892e569a3
Merge pull request #1590 from mempool/nymkappa/feature/hashrate-around-midnight
Run hashrate indexing after midnight
2022-05-09 10:45:24 +09:00
wiz
5281c48697
Merge branch 'master' into nymkappa/bugfix/initial-indexing 2022-05-07 13:51:24 +09:00
dependabot[bot]
3baf6fdcdc
Bump express from 4.17.1 to 4.18.1 in /backend
Bumps [express](https://github.com/expressjs/express) from 4.17.1 to 4.18.1.
- [Release notes](https://github.com/expressjs/express/releases)
- [Changelog](https://github.com/expressjs/express/blob/master/History.md)
- [Commits](https://github.com/expressjs/express/compare/4.17.1...4.18.1)

---
updated-dependencies:
- dependency-name: express
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-05-06 06:27:56 +00:00
wiz
5336ba8160
Merge branch 'master' into simon/npm-audit-fix-04-28 2022-05-06 15:11:28 +09:00
wiz
e00a6aa123
Merge pull request #1587 from knorrium/fix_tiny_typo
Fix datababse typo
2022-05-06 15:01:23 +09:00
wiz
1ff51e60db
Merge branch 'master' into nymkappa/bugfix/initial-indexing 2022-05-06 14:55:29 +09:00
softsimon
9dcf421216
Upgrading npm packages and 2022-05-02 20:04:04 +04:00
nymkappa
3972e7b8f0
Show current network hashrate and difficulty even if indexing is in progress 2022-05-02 17:39:03 +09:00
nymkappa
1f4cf1710a
Show getnetworkhashps core result in dashboard + update unit formatting 2022-05-02 17:33:52 +09:00
wiz
0aac410958
Merge branch 'master' into nymkappa/bugfix/bisq-dump-loading 2022-05-02 11:29:05 +09:00
nymkappa
b56f110f28
Run hashrate indexing after midnight 2022-04-30 17:54:49 +09:00
Felipe Knorr Kuhn
0f4e0c7413
Fix datababse typo 2022-04-29 22:01:22 -07:00
nymkappa
6565c363f8
Update pools table before fetching the first blocks 2022-04-27 16:57:07 +09:00
nymkappa
6d308fc81c
Clean local block cache before loading dump: 2022-04-27 13:06:16 +09:00
wiz
addfa45548
Merge branch 'master' into nymkappa/bugfix/bisq-dump-loading 2022-04-25 22:55:56 +00:00
wiz
d701bbb2d8
Merge pull request #1564 from mempool/nymkappa/bugfix/binance-regex
Ignore case on coinbase tag regexes
2022-04-25 22:38:49 +00:00
nymkappa
0ad267b07f
Read bisq dump blocks line by line and parse manually 2022-04-25 11:49:04 +09:00
wiz
58d361df06
Merge pull request #1563 from mempool/nymkappa/feature/remove-block-extras-loading-indicator
Remove loading indicator for blocks-extras API
2022-04-24 07:25:27 +00:00
wiz
8d279edfe7
Merge branch 'master' into nymkappa/bugfix/fast-forward-re-org 2022-04-24 05:54:42 +00:00
nymkappa
0803fed0f4
Fix pool component hashrate api response handling 2022-04-23 15:51:00 +09:00
wiz
6ae20ead63
Merge branch 'master' into nymkappa/feature/timespan-selector-update 2022-04-23 06:23:23 +00:00
wiz
ed495cc019
Merge branch 'master' into nymkappa/feature/fee-range-chart 2022-04-23 04:44:03 +00:00
nymkappa
0565471ecf
Wait for external assets file writers to complete 2022-04-22 04:03:08 -04:00
nymkappa
0860e16b2b
Ignore case on coinbase tag regexes 2022-04-22 03:25:34 -04:00
nymkappa
77fddc7ed9
Remove loading indicator for blocks-extras API 2022-04-22 00:49:02 -04:00
nymkappa
84b72f8b32
Manually re-index the last 10 blocks when the new block previoushash does not match latest block hash 2022-04-19 15:45:06 +09:00
nymkappa
900e02d9a5
Validate block hash chain after indexing and for new blocks 2022-04-18 17:49:22 +09:00
nymkappa
f7d57a2737
Use block count instead of oldest block for timespan selection 2022-04-15 20:43:10 +09:00
nymkappa
31ded69a4c
Update cache warmer 2022-04-15 18:05:58 +09:00
nymkappa
3ce6e81a39
Add block fee rate percentiles chart 2022-04-15 16:16:15 +09:00
nymkappa
078c7ac228
Add /api/v1/mining/blocks/fee-rates/{interval} API 2022-04-15 16:14:20 +09:00
nymkappa
4f4f76f067
Add try/catch liquid icon loading 2022-04-15 13:20:54 +09:00
wiz
89d62b7be2
Merge branch 'master' into download_assets_over_tor 2022-04-14 21:35:59 +00:00
wiz
417542a217
Merge branch 'master' into simon/remove-locutus-lib 2022-04-14 20:27:58 +00:00
softsimon
6919393e6c
Refactored the DB class into a regular singleton class. 2022-04-13 17:38:42 +04:00
nymkappa
6fb0571b06
Refactor database pool use 2022-04-13 21:46:39 +09:00
nymkappa
bee0dbd400
Cleanup mining related backend logs 2022-04-13 16:30:49 +09:00
softsimon
b273f71d60
Breaking out strtotime from locutus lib 2022-04-12 17:52:30 +04:00
Antoni Spaanderman
b9127538ce
Merge branch 'master' into script-display-2 2022-04-11 21:46:06 +02:00
nymkappa
8fb488a675
Add block rewards chart 2022-04-11 20:57:13 +09:00
nymkappa
7dd0173e84
Improve mining graphs timespan selection UX 2022-04-11 18:17:36 +09:00
nymkappa
08e19a612c
Add block fees graph 2022-04-11 15:32:16 +09:00
nymkappa
90ca668bcb
[Indexing] - Support 10 blocks depth reorgs 2022-04-10 16:28:22 +09:00
nymkappa
ba12b10f9d
Handle empty pools table error 2022-04-07 18:14:28 +09:00
nymkappa
e451b40084
Catch http request error - Fix 24h retry period 2022-04-07 16:14:43 +09:00
nymkappa
2d29b9ef89
Upon error, re-run the PoolsUpdater within 24h instead of 7d 2022-04-07 14:51:23 +09:00
nymkappa
1969f2a275
Use github api to fetch and update the pools database, once a week 2022-04-07 14:37:16 +09:00
softsimon
33001ce96c
Merge pull request #1503 from mempool/nymkappa/feature/additional-pool-data
Updated pool summary page to display more info on hashrate and blocks
2022-04-06 14:31:53 +04:00
nymkappa
c4db7ec5f6
Updated pool summary page to display more info on hashrate and blocks 2022-04-05 00:36:00 +09:00
Antoni Spaanderman
53d68a3571
name tapscript by its name + OP_CHECKSIGADD tapscript opcode detection 2022-04-04 17:16:34 +02:00
softsimon
6386f4c68a
Merge pull request #1486 from mempool/simon/bitcoin-api-roundings
Rounding bitcoin api satoshis
2022-04-04 13:18:10 +04:00
Antoni Spaanderman
096f2172c6
more direct opcode comparison 2022-04-03 21:58:53 +02:00
Antoni Spaanderman
dfb5ba5c36
Completely rewrote convertScriptSigAsm
it now gives identical output to esplora, tested with the following TXs (testnet):

88710a9a6751827490f260e307757543f533c0f18bcd6865794713d263d5f5a4
446b2aad074de94efa28a1e82d2e6016dcb8a8ca38aca1a5a8eac6ef54e56a2e
4cfc410092e9514c14f48b61e20d2d3baf540ae7e981a821dd8c05dd4b7cd591
4b55dde38173174ab09e5571ebffffca798ba11143d28b9770600ff376dc778a
2022-04-03 21:41:12 +02:00
softsimon
ba92284e44
Merge pull request #1487 from mempool/nymkappa/bugfix/invalid-pool-handling
Send 404 when accessing non existing mining pool
2022-04-03 17:37:09 +04:00
softsimon
effe85f7c0
Merge pull request #1498 from mempool/nymkappa/bugfix/avoid-duplicated-indexing
Avoid parralel hashrate indexing when initial query is too slow
2022-04-03 15:57:43 +04:00
softsimon
3115dcbe52
Correcting wrong or missing op_codes display
fixes #1210
2022-04-03 13:59:26 +04:00
nymkappa
f393cb0839
Wrap initial query in try/catch to reset the flag upon error 2022-04-03 15:47:33 +09:00
nymkappa
2ef2a34766
Avoid parralel hashrate indexing when initial query is too slow 2022-04-03 15:47:29 +09:00
softsimon
8d97351598
Merge pull request #1488 from mempool/nymkappa/feature/testnet-signet-empty-pool-addresses
Return empty pool addresses on testnet and signet
2022-04-03 01:13:35 +04:00
nymkappa
c3a3289fcf
Mining stats does not depends on the websocket blocks number anymore 2022-04-01 12:41:25 +09:00
nymkappa
2521661c69
Remove unfiltered using input from log 2022-03-31 18:35:03 +09:00
nymkappa
12ec6bbf67
/api/v1/mining/difficulty/{interval} is not used 2022-03-30 19:46:17 +09:00
nymkappa
84394e13fa
Return empty pool addresses on testnet and signet 2022-03-30 16:49:28 +09:00
nymkappa
ccafe4a066
Send 404 when accessing non existing mining pool 2022-03-30 16:27:17 +09:00
softsimon
9a4d3817c5
Rounding bitcoin api satoshis
fixes #1466
2022-03-30 11:12:55 +04:00
nymkappa
7ab950d03c
Add slug when we insert a mining pool for the first time 2022-03-29 16:31:26 +09:00
nymkappa
f51ea5b537
Fix query to insert unknown mining pool 2022-03-29 14:37:17 +09:00
softsimon
32792f4f74
npm audit fix 2022-03-27 14:26:06 +04:00
nymkappa
9b04b3bcd6
Merge branch 'master' into nymkappa/feature/pool-slug-url 2022-03-26 12:08:39 +09:00
nymkappa
352ea950a2
Use mining pool slug in urls 2022-03-25 14:22:22 +09:00
nymkappa
810c335759
If pool slug does not exist, generate one on the fly, avoid crash 2022-03-25 12:31:09 +09:00
nymkappa
bb0fd78f28
Added slug into pools table 2022-03-24 19:44:22 +09:00
nymkappa
185dddd8c7
Truncate hashrates after #1435 - Fix hashrate indexing logs 2022-03-24 07:40:03 +09:00
softsimon
dcaa7fc4e8
Last hashrate indexing check needs to be in milliseconds 2022-03-24 00:24:17 +04:00
wiz
223dc46bd5
Merge branch 'master' into fix_git_commit_error 2022-03-23 19:49:04 +00:00
Felipe Knorr Kuhn
230fbdbc8e
Fix empty revision case 2022-03-23 12:33:15 -07:00
Felipe Knorr Kuhn
4bb6f49950
Copy the git commit hash logic to the backend 2022-03-23 12:17:23 -07:00
Felipe Knorr Kuhn
3e2e23417a
Allow syncing external backend assets using Tor 2022-03-23 08:11:22 -07:00
nymkappa
a91fa797fa
Merge branch 'master' into nymkappa/bugfix/hashrate-native-js-timestamp 2022-03-23 19:10:21 +09:00
nymkappa
2644f2fb07
Move reward stats to component - Add /api/v1/mining/reward-stats/{blockCount} 2022-03-23 11:54:31 +09:00
nymkappa
e5fd92b734
Most recent week was missing from indexing - Post merge fixes 2022-03-22 09:20:16 +09:00
nymkappa
74f4a6fcb4
Work using native javascript milliseconds timestamp 2022-03-22 08:44:54 +09:00
nymkappa
077177ecc4
If we have incomplete data for the day/week, don't index hashrate 2022-03-21 20:32:57 +09:00
nymkappa
e8e4fd3457
mempool.space/.../pools.json => raw.githubusercontent.com/.../pools.json 2022-03-17 16:07:58 +01:00
softsimon
18e9fc8717
Merge branch 'master' into difficulty 2022-03-17 11:43:29 +01:00
nymkappa
9252a45971
Fix pagination on /mining/blocks 2022-03-16 21:00:40 +01:00
nymkappa
41fed984cb
Fix pool get blocks API undefined start block behavior 2022-03-16 20:19:39 +01:00
nymkappa
56bf267664
Updated blocks list in /pool/{id} page 2022-03-16 18:12:02 +01:00
nymkappa
ffb5db69a8
Store hex in coinbase raw - Improve scripsig parsing 2022-03-16 12:10:18 +01:00
nymkappa
94dbec46cf
Index asciiScriptSig and display it in /mining/blocks 2022-03-15 23:33:51 +01:00
nymkappa
3cd1505128
Optimize RPC calls 2022-03-15 21:16:02 +01:00
Antoni Spaanderman
dbcc46be5f
fix and improve block time predictions
dce775e but then on the backed after refractor #1352
2022-03-15 20:39:25 +01:00
softsimon
e26beee44c
Merge node-bitcoin into the project 2022-03-15 14:44:31 +01:00
softsimon
8637059119
Difficulty adjustment refactor
fixes #1157
2022-03-14 16:48:59 +01:00
wiz
822c4256d7
Merge pull request #1358 from mempool/wiz/increase-default-indexing-blocks-amount
Increase default INDEXING_BLOCKS_AMOUNT by 10x to 11000 blocks
2022-03-14 13:15:54 +00:00
wiz
2023d36603
Cleanup MySQL unix socket code and add to sample config 2022-03-14 13:11:04 +00:00
Djuri Baars
465529b03f sed and config fix for MySQL socket, accept CLA for @dsbaars 2022-03-14 13:45:50 +01:00
Djuri Baars
7fd9e27cc2 Add MySQL socket support 2022-03-14 13:45:34 +01:00
nymkappa
edddf25917
Remove unnecessary migration version 15 2022-03-13 16:08:33 +01:00
nymkappa
0730053d5d
Use bitcoin RPC getblock because esplora returns int for difficulty - Fix some css in mining dashboard 2022-03-13 16:08:33 +01:00
nymkappa
bec3f214b5
Make sure to set avg_hashrate field to double unsigned 2022-03-13 16:08:32 +01:00
nymkappa
33897b029f
Set db connection to UTC - Fix hashrate indexing 2022-03-13 16:08:31 +01:00
wiz
81984e9df5
Increase default INDEXING_BLOCKS_AMOUNT by 10x to 11000 blocks 2022-03-13 13:57:20 +00:00
nymkappa
d8e986996f
Add pagination on /mining/blocks 2022-03-12 16:49:15 +01:00
nymkappa
0e0331d8ab
Create working template for the new blocks page 2022-03-12 16:49:15 +01:00
nymkappa
0dbc725c39
int -> bigint for all satoshis related indexed data 2022-03-12 15:48:22 +01:00
nymkappa
cd12e9bde9
Only insert hashrate states for bitcoin 2022-03-12 15:48:21 +01:00
nymkappa
87405ec4a5
Don't try to reset hashrates states if not bitcoin 2022-03-12 15:48:14 +01:00
nymkappa
afe7a360f7
Make blocks.fees larger data type 2022-03-11 20:42:07 +01:00
softsimon
9dbfd96249
Merge pull request #1320 from antonilol/regtest-1
regtest fixes
2022-03-11 14:07:58 +01:00
nymkappa
9a71c15b49
Fix block indexing log 2022-03-10 14:23:29 +01:00
nymkappa
8ca3f6e72b
Index more data using getblockstats core RPC 2022-03-10 14:21:11 +01:00
nymkappa
d82f9c4998
Index more data using getblockstats core RPC 2022-03-10 14:08:01 +01:00
nymkappa
9ccb23f651
Index weekly hashrates using last Monday midnight - Fix charts tooltip 2022-03-10 11:53:49 +01:00
nymkappa
643e5ceb7f
Increment db version to 10 (26ee4204ac) 2022-03-09 18:51:27 +01:00
Antoni Spaanderman
2cd24624b9
Merge branch 'master' into regtest-1 2022-03-09 17:55:09 +01:00
softsimon
381a310216
Display unknown for non standard output types
fixes #1262
2022-03-09 16:28:26 +01:00
Antoni Spaanderman
8d42b38234
simplify if statement 2022-03-09 11:51:36 +01:00
Antoni Spaanderman
b2f9c7db2d
add non null assertion 2022-03-08 20:59:46 +01:00
nymkappa
f23f7f1cfa
Cleanup empty block in api response - Update cache warmer 2022-03-08 20:46:19 +01:00
nymkappa
2b5d972e8d
Only show relevant hashrate in the pool page 2022-03-08 20:46:18 +01:00
nymkappa
ad2dcc46e4
Added pool hashrate chart 2022-03-08 20:46:14 +01:00
Antoni Spaanderman
71402f21c6
revert "add network regtest" 1f0ae60 2022-03-08 19:59:18 +01:00
Antoni Spaanderman
d179a563e4
Merge branch 'master' into regtest-1 2022-03-08 19:45:03 +01:00
softsimon
8267344cdc
Don't push full RBF-transactions to prevent old states. 2022-03-08 18:54:49 +01:00
softsimon
b15de021f7
Fixing bug where RBF wasn't detected when using bitcoind 2022-03-08 18:39:53 +01:00
softsimon
f85771e03f
Replace by fee storage
fixes #1222
2022-03-08 18:39:53 +01:00
nymkappa
26ee4204ac
Index blocks.blockTimestamp 2022-03-08 17:10:29 +01:00