14:34:22 <br-m> <rucknium> selsta (I think) has replaced the old DNS-based ban list with version 2 of the MRL ban list: https://www.nslookup.io/domains/blocklist.moneropulse.se/dns-records/
14:34:23 <br-m> <rucknium> This ban list can be enabled on your node with the --enable-dns-blocklist startup flag. Thanks, selsta!
14:35:49 <br-m> <rucknium> I noticed a huge increase in the number of nodes using the MRL ban list: https://moneronet.info/
14:35:49 <br-m> <rucknium> I think it's just the nodes that have the DNS ban list enabled, now getting the updated list.
14:41:16 <br-m> <boog900> thanks selsta 🙏
14:41:59 <selsta> I asked for it to be updated, I don't have access myself.
14:42:31 <br-m> <boog900> @rucknium:monero.social: has there been an increase in nodes that don't have the spy fingerprint? 3300 now
14:43:39 <br-m> <boog900> seems like a big increase in a short space of time do you have their IPs to see if they are all on the same AS.
14:44:00 <br-m> <rucknium> Since when do you mean?
14:45:35 <br-m> <rucknium> Remember I fixed, or at least improved, the database lock issue. That could have caused some nodes to be missed. I think I could try to check that since missed nodes should be at random from day to day. So I could see if specific nodes appear, disappear, and reappear in the older data.
14:45:42 <br-m> <boog900> when spruce creek appeared we were at 2200 spies and 2500 not spies, the numbers fluctuate a bit. But now we are at 2200 spies and 3300 not spies.
14:46:06 <br-m> <boog900> @rucknium: ah yeah that could be it
14:47:16 <br-m> <rucknium> Unfortunately it causes a break in the data series, but you live and you learn.
14:48:53 <br-m> <boog900> look at the number of nodes with pruning, it increases when the number of non-spies increase, not when spruce creek shows up from what I can tell.
14:49:16 <br-m> <boog900> if it were random that shouldn't have happened right? 
14:49:36 <br-m> <boog900> oh wait that only tracks honest nodes anyway
14:51:06 <br-m> <boog900> still if it were random I wouldn't have expected the raw amount increase to be almost the same between the 2 right? 
14:51:48 <br-m> <rucknium> The first chart shows the data gaps like missing late December properly, but the other ones don't. I'm not sure why. It's a different type of chart (stacked line chart) than the others. Maybe by default the other charts don't show the data gaps.
14:53:00 <br-m> <rucknium> @boog900: "same between the 2". Which two?
14:55:24 <br-m> <rucknium> The Herfindahl-Hirschman Index of AS concentration of honest nodes has steadily decreased over the whole data collection period. I find that interesting and encouraging.
14:56:57 <br-m> <boog900> the number of none spies and the number of pruned peers increase by almost the same amount. If it were random as some nodes were not being scanned before I would expect the number of pruned peers to increase according to the percent of pruned nodes, right?
14:57:14 <br-m> <longtermwhale:matrix.org> why cant a spy use a trusted AS?
14:57:53 <br-m> <syntheticbird> price
14:58:13 <br-m> <syntheticbird> it's expensive
14:58:54 <br-m> <longtermwhale:matrix.org> how do you assess that the information that they gain is not worth it?
14:59:04 <br-m> <boog900> @longtermwhale:matrix.org: they do, look at the treemap on moneronet.info
14:59:09 <br-m> <boog900> they use both 
15:00:11 <br-m> <boog900> hetzner and digitalocean both have spies 
15:03:53 <br-m> <rucknium> > <@boog900> the number of none spies and the number of pruned peers increase by almost the same amount. If it were random as some nodes were not being scanned before I would expect the number of pruned peers to increase according to the percent of pruned nodes, right?
15:03:53 <br-m> <rucknium> That makes sense. But an alternative explanation is that the GUI wallet prunes blockchains by default now. That was changed in mid-2024 IIRC. I don't know if most reachable nodes would be booted by the GUI wallet. Probably most unreachable nodes are.
15:06:08 <br-m> <boog900> it is sus that we gained like 500 nodes in a couple weeks though, maybe everyone spent Christmas setting up their Monero nodes though.
15:06:52 <br-m> <rucknium> The prune-by-default hypothesis would also be consistent with decrease in AS concentration because most GUI wallets would be launched from "end-consumer" ASes.
15:07:12 <nioc> should we use the  --enable-dns-blocklist startup flag or --ban-list
15:07:22 <br-m> <rucknium> I will check the node churn
15:07:23 <br-m> <syntheticbird> yes
15:08:16 <nioc> I figured but maybe there is some difference 
15:09:29 <br-m> <rucknium> nioc: Both, IMHO. The DNS blocklist has a capacity constraint. Right now it has all of the MRL ban list IP addresses, but if many more need to be added, the MRL ban list would be more complete.
15:10:43 <nioc> using the updated --ban-list rn
15:11:18 <nioc> so they can be used simultaneously ?
15:11:20 <br-m> <rucknium> @boog900:monero.social: By the way you can get a lot of the historical data from an API request: https://api.moneronet.info/__docs__/#/default/%2Findividual_node_data-GET
15:11:41 <br-m> <rucknium> curl -X 'GET' \
15:11:41 <br-m> <rucknium>   'https://api.moneronet.info/individual_node_data?date=all' \
15:11:41 <br-m> <rucknium>   -H 'accept: */*'
15:13:44 <br-m> <rucknium> It doesn't have all of the data I collect. For example, it consolidates records into one record per IP address, and lists multiple ports on the same IP if they have nodes. And it doesn't give you the peer lists that nodes share.
15:13:57 <br-m> <rucknium> ^ That data pull for all dates gets you a 500MB file.
15:15:34 <br-m> <rucknium> nioc: IIRC, there was some doubt before about whether both --ban-list and --enable-dns-blocklist could be used simultaneously, but testing showed that using them simultaneously worked fine.
15:15:40 <br-m> <boog900> oh wow nice! > <@rucknium> @boog900:monero.social: By the way you can get a lot of the historical data from an API request: https://api.moneronet.info/__docs__/#/default/%2Findividual_node_data-GET
15:16:19 <nioc> thx rucknium 
15:17:10 <br-m> <rucknium> ditatompel uses my API for https://xmr.ditatompel.com/remote-nodes/ban-list-enabled
15:20:13 <br-m> <rucknium> At the bottom of https://moneronet.info/ you can also download the individual node table in CSV format by clicking a button, but that's only for the data of the most recent day.