osi·10 lat temu·discussyes, exactly this. and by having scalable GC algos so you don't need to do "off heap" tricks in java, things are much easier.
osi·10 lat temu·discussWhere is the data kept?The very large heaps are partially driven by distributed in-memory storage systems.
osi·11 lat temu·discussMy mean pauses are a few hundred micros. Standard deviation is slightly more (300-500 micros), with a max of a millisecond or two.
osi·11 lat temu·discussTo clarify, Azul's Zing does have pauses, but they optimized the crap out of them (the pauses are more time-to-safepoint rather than GC pauses). GC time wrt application stopped time is constant regardless of heap size.(I'm an Azul customer and Zing user)