Discharge capillaries are an essential plasma-source for a wealth of different applications in plasma-based accelerators. The long, uniform plasma profiles have been pivotal in both LWFA and PWFA experiments alike. The repetition rate of such sources has been limited to 1-10 Hz, far below the required 10 kHz to MHz of a plasma-based collider or FEL. Development of high repetition rate discharge capillaries is imperative for these and other future applications and is currently being performed in the ADVANCE laboratory at DESY. Our initial goal is to achieve the milestone of continuous, stable, 1 kHz operation from which higher repetition rates might be achieved. A summary of the work being performed towards this goal is presented here.