In this paper, some logarithmically completely monotonic, strongly completely monotonic and completely monotonic functions related to the gamma, digamma and polygamma functions are established. Several inequalities, whose bounds are best possible, are obtained.