Aiming at the problems of fixed convolution kernel size and poor targeting of extracted features in the application of deep learning in fault diagnosis, this paper develops a fault diagnosis framework called adaptive signal diagnosis network (ASDN), in which the EEMD of multi-scale signal decomposition is improved in the adaptive preprocessing stage to adaptively capture the transient changes of signals. Meanwhile, SSA is improved to further extract fault trends and periodic components to optimize the signal representation. In the adaptive deep learning stage, an innovative temporal convolutional network (TCN) with a dynamic adjustment mechanism was developed to enable the neural network to adjust its convolutional kernel size according to different frequency components so as to accurately process signals of different frequencies. Validation on datasets from Case Western Reserve University and Xi'an Jiaotong University shows the superior performance of the proposed method, with diagnostic accuracies of 100% and 97.42% on these two public datasets, respectively.