The correct verb for this sentence will be[[1]]

Where  they ____been all this while? 

The question mark is represent that this will be a interrogative sentence because when any sentence which begins with the question mark then  it is called Interrogative sentence. The auxiliary verb will be placed before the subject in the question . As in this the subject will be "been all this while"  so the auxiliary verb that placed before the subject is "have".