Ah, with 11Gb, it may indeed fit into the GPU memory :D. You can check this in the console (there's a message about the percentage of points that could be loaded in "VBOs").
But anyway, CC will still render all the point at each frame (as long as the LOD mechanism is not enabled), which will still be very long... Especially if you have normals (in this case make sure to disable them, otherwise the rendering will be horrible). In the same spirit, if you display the cloud with a scalar field, make sure the shader dedicated to their display is enable (see the Display Options).
In all cases you have to shift the large coordinates to avoid display issues (because OpenGL drivers don't handle large coordinates) but it won't help because the truncation from 64 bits to 32 bits is already done. However if you save your data as BIN files, or as binary PLY for instance, it may be faster than other formats (especially ASCII ones).
Daniel, CloudCompare admin