Closed circuit television (CCTV) has been applied in many developing or developed counties for sewer inspection due to its low setup cost and technical requirement. Through sewer inspection, pipe defects, such as fractures, hole, collapse, debris or others, would be found and processed in order to recover the original capacity of sewage. However, many researchers pointed out that good image quality is the prerequisite for accurate interpretation and diagnosis of CCTV inspection but has not a proper evaluation approach. In this paper, a CCTV image quality index considering both of the luminance distortion and the contrast distortion of a CCTV image compared by reference images is proposed and was applied to assess the image quality of the CCTV images shot for a sewer house-connection project. The experimental result indicates that rather than luminance contrast plays a more important role in the CCTV image quality that can be effectively improved by contrast enhancement. Since CCTV image quality can hardly distinguished by human eyes, the proposed image quality index can provide helpful information can efficiently assist the on-site technicians in precisely shooting better CCTV images for the pipe defection. In the future, a real-time CCTV image quality assessment will be developed by modifying the CCTV image quality index as an instantaneous reference for imaging adjustment that can be expected to be practicable for the on-site sewer inspection because of the extremely short computation time.