A set of equations for waveguide free-electron laser oscillators is derived,which can deal with 3D problems such as the diffraction, the hole-coupling output, and the misalignment. The 3D effects and transverse structure of optical field of CAEP FIR FEL are studied with an INEX model.