Theory and modeling of intense ion beams and diagnostic measurements in accelerator front ends