Abstract: BB84 phase encoding quantum key distribution systems can distribute shared secret keys between remote communication parties via optic fiber channel with provable security. However, performance of these systems usually suffers from the phase shift in realistic running environment. The existing active phase compensation schemes for these systems have to break the key distribution process to measure phase drift parameters, leading to decrease the final key generation rate of system. A new uninterrupted scheme is proposed to address this problem. The proposed scheme allows the system to run phase compensation process and key distribution process simultaneously by collecting and analyzing the quantum bits with incompatible basis during the quantum key distribution process, which is supposed to