-
xmr-pr
tryphe opened issue #8194: Cannot sync past block ~2450000
-
xmr-pr
-
selsta
22:41 <fluffypony> what about using OpenCL during IBD? <-- using ASM only for the initial blockchain sync is safe with forks and most of the code is already ready
-
selsta
I think that's more realistic than OpenCL
-
hyc
-
hyc
this regarding commit f6e2636493970f3cf3279fd9773efe211868ffb4
-
hyc
the commit is an improvement since it no longer tries to issue deletes that would be tossed anyway, but there was never any impact. txn abort means everything that happened since start of txn just disappears, never happened.
-
moneromooo
lol
-
moneromooo
Undoing things manually everywhere would be pretty annoying. Lots of code.
-
moneromooo
And code that'd probably be buggy.
-
moneromooo
So this is really "how monero ensures things are cancelled right".
-
hyc
yeah, and avoiding all that is why you use an ACID transactional DB in the first place
-
moneromooo
hyc: I had asked that a while ago, didn't get a reply, but:
-
moneromooo
If I have a large LMDB table, and want to query N items from it, with N being small compared to the table size, can I speed up lookups with some kind of multiple query ? AFAICT, MDB_MULTIPLE is only for writing.
-
hyc
you can read multiple values for the same DUPFIXED key
-
hyc
there is no other multiple-fetch option
-
hyc
and if N is small it's not like you'd save much overhead anyway
-
moneromooo
If you mean MDB_NEXT_MULTIPLE and friends, htose are unlikely to help in my case.
-
moneromooo
N would be... a couple hundred maybe. DB size would be a few dozen millions.
-
hyc
doesn't sound like it'd make a difference
-
moneromooo
OK, fair enough.
-
hyc
all you really need to do is keep reusing the same cursor
-
hyc
that will avoid the worst overhead
-
moneromooo
Yes, already the case.
-
hyc
-
hyc
submitter claims a 2x speedup
-
hyc
I haven't had time to test it myself yet
-
hyc
it looks like it just returns a page's worth of contiguous records.
-
hyc
if you're doing random lookups, it probably won't help
-
moneromooo
Yes, I expect the locality to be very poor, though not inexistent.
-
hyc
if you profile mdb_cursor_get() workload I doubt you will find any hotspot that can be removed...
-
Guest54
Hello
-
bootlegbilly[m]
Hi
-
selsta
moneromooo: do you see anything interesting in the logs here?
monero-project/monero #8194#issuecomment-1053098301
-
selsta
the whole issue sounds weird
-
moneromooo
The first few blocks that are needed are requested from a peer that doesn't send them.
-
moneromooo
The timeout seems to be 25 seconds here.
-
moneromooo
The blocks then get requested from another peer, but that peer gets dropped after it sends a reply to another message. Possible state machine bug here.
-
selsta
it's weird that they were able to reproduce it until they updated their OS
-
selsta
maybe bad luck
-
moneromooo
There are two instances of possible large delays in networking. So, who knows.