15:25:43 Hi folks, this is Dennis! I'm a computer network researcher and I'm just getting started looking into Monero. I'm a co-founder of ProbeLab https://probelab.io/ where we do p2p protocol research, measurements and optimizations. 15:25:43 I'm the author of https://github.com/dennis-tra/nebula, an agnostic network crawler, which I've adjusted to crawl the Monero network. I was able to identify that ~25.4k unique IP:Port combinations are shared in the initial handshake when recursively contacting all nodes in the network (just ran another crawl a few minutes ago) [... too long, see https://mrelay.p2pool.observer/e/lc656OMKaGhoZGcy ] 15:25:43 In the other channel (Monero Research Lounge) I was pointed to https://monero.fail/map which reports ~17.4k peers and also https://moneronet.info/ which reports ~5.4k nodes (much closer to what I get). I'm interested in the following:[... more lines follow, see https://mrelay.p2pool.observer/e/lc656OMKaGhoZGcy ] 16:49:19 Welcome 17:24:11 Hi there Dennis. Very interesting work that you've been doing. Do not mind the little silence in chat, there are several members that worked extensively on network mapping and spy nodes countermeasures. So all we can do is wishing you a welcome and wait for them to answer your questions 17:28:49 May this begin to satisfy your thirst I can confidently answer 5. . Yes, monerod maintains a bigger list internally (which has a maximum of several thousands white peers iirc), You are indeed served a random sample of 250 peers. 17:33:15 Monerod do not communicate to you "gray peers" which are peers that it hasn't established connection to yet. So it make sense to repeatedly handshake with a monero node to extract a maximum of its address book 17:33:27 I love matrix lagging 19:53:23 @dennis_tra:matrix.org: "What is counted by monero.fail/map? Is it also unique IP:Port? What's the aggregation time window?" I'm not sure. You can look here: https://github.com/lalanza808/monero.fail 19:54:38 "How are spy nodes identified? Is there a methodology written up somewhere or is that confidential?" It's here: https://github.com/Boog900/p2p-proxy-checker?tab=readme-ov-file#how-this-works . I took the code from boog's repo and set it to collect more data here: https://github.com/Rucknium/xmrnetscan/tree/main/src/rust 20:00:41 "The crawler is performing a handshake with every peer it discovers. What information can I extract from the handshake that is worth capturing?" I store everything IIRC. p2p port, RPC port, pruning seed, peer id, support flags, core sync data, shared peer list. https://github.com/Rucknium/xmrnetscan/blob/main/src/rust/src/main.rs 20:02:02 https://github.com/ykpyck/monero-traffic-analysis/ collects every packet with wireshark. This is the paper: https://arxiv.org/abs/2509.10214 Kopyciok, Y., Schmid, S., & Victor, F. (2025). Friend or Foe? Identifying Anomalous Peers in Moneros P2P Network. 20:04:13 "Is there potentially another API exposed on Monero nodes which the crawler could call to get even more information?" Yes. You could try the RPC port of the nodes if they are open. You could make a get_info request. https://docs.getmonero.org/rpc-library/monerod-rpc/#get_info Some of the info is not disclosed in a node's re [... too long, see https://mrelay.p2pool.observer/e/xMy18OMKX21NblVl ] 20:07:09 "Would it make sense to connect repeatedly to get more nodes?" You could try that, but the responding node may block (ban) your IP address if it thinks you are misbehaving. I don't think you will get many more, if any, additional nodes by contacting the same node more than once instead of just contacting other nodes, who have overlapping peer lists. 20:07:56 The spy node ban list is here: https://github.com/Boog900/monero-ban-list 20:10:50 You can get historical data from my webapp through its API: https://api.moneronet.info/__docs__/#/default 20:16:45 This is the PR and research supporting a spy node countermeasure that was deployed last year: https://github.com/Rucknium/misc-research/blob/main/Monero-Peer-Subnet-Deduplication/pdf/monero-peer-subnet-deduplication.pdf and https://github.com/monero-project/monero/pull/9939 20:21:27 More info about the spy node ban list: https://github.com/monero-project/meta/issues/1124 20:29:58 Oh so many great pointers! I have a lot to read through. And great to see existing numbers to which I can compare my results with! I'm already afk into the weekend and will only be able to check out the links in detail next week. I'll certainly circle back here! Thanks a lot 🙏 20:31:13 @dennis_tra:matrix.org: You're welcome. Looking forward to your thoughts on it.