The collinear generation of sub-4 fs ultraviolet (UV) and attosecond extreme ultraviolet (XUV) pulses via subsequent third-harmonic and high harmonic generation in noble gases is demonstrated. The ultrashort coherent light bursts are produced by focusing a sub-1.5 cycle near-infrared/visible (NIR) laser pulse in two subsequent quasi-static noble gas targets. With this simple approach, inherently synchronized UV pulsed radiation with a photon energy of ∼5 eV and a pulse energy of ∼1 μJ, and XUV pulses with a cut-off photon energy of more than 120 eV and up to ∼ 107 XUV photons can be generated. This source represents a novel tool for future UV pump/XUV probe experiments with unprecedented time-resolution.