Medical studies have found that tumor mutation burden (TMB) is positively correlated with the efficacy of immunotherapy for non-small cell lung cancer (NSCLC), and TMB value can be used to predict the efficacy of targeted therapy and chemotherapy. However, the calculation of TMB value mainly depends on the whole exon sequencing (WES) technology, which usually costs too much time and expenses. To deal with above problem, this paper studies the correlation between TMB and slice images by taking advantage of digital pathological slices commonly used in clinic and then predicts the patient TMB level accordingly. This paper proposes a deep learning model (RCA-MSAG) based on residual coordinate attention (RCA) structure and combined with multi-scale attention guidance (MSAG) module. The model takes ResNet-50 as the basic model and integrates coordinate attention (CA) into bottleneck module to capture the direction-aware and position-sensitive information, which makes the model able to locate and identify the interesting positions more accurately. And then, MSAG module is embedded into the network, which makes the model able to extract the deep features of lung cancer pathological sections and the interactive information between channels. The cancer genome map (TCGA) open dataset is adopted in the experiment, which consists of 200 pathological sections of lung adenocarcinoma, including 80 data samples with high TMB value, 77 data samples with medium TMB value and 43 data samples with low TMB value. Experimental results demonstrate that the accuracy, precision, recall and F1 score of the proposed model are 96.2%, 96.4%, 96.2% and 96.3%, respectively, which are superior to the existing mainstream deep learning models. The model proposed in this paper can promote clinical auxiliary diagnosis and has certain theoretical guiding significance for TMB prediction.
The incidence of tinnitus is very high, which can affect the patient’s attention, emotion and sleep, and even cause serious psychological distress and suicidal tendency. Currently, there is no uniform and objective method for tinnitus detection and therapy, and the mechanism of tinnitus is still unclear. In this study, we first collected the resting state electroencephalogram (EEG) data of tinnitus patients and healthy subjects. Then the power spectrum topology diagrams were compared of in the band of δ (0.5–3 Hz), θ (4–7 Hz), α (8–13 Hz), β (14–30 Hz) and γ (31–50 Hz) to explore the central mechanism of tinnitus. A total of 16 tinnitus patients and 16 healthy subjects were recruited to participate in the experiment. The results of resting state EEG experiments found that the spectrum power value of tinnitus patients was higher than that of healthy subjects in all concerned frequency bands. The t-test results showed that the significant difference areas were mainly concentrated in the right temporal lobe of the θ and α band, and the temporal lobe, parietal lobe and forehead area of the β and γ band. In addition, we designed an attention-related task experiment to further study the relationship between tinnitus and attention. The results showed that the classification accuracy of tinnitus patients was significantly lower than that of healthy subjects, and the highest classification accuracies were 80.21% and 88.75%, respectively. The experimental results indicate that tinnitus may cause the decrease of patients’ attention.
Objective To automatically segment diabetic retinal exudation features from deep learning color fundus images. Methods An applied study. The method of this study is based on the U-shaped network model of the Indian Diabetic Retinopathy Image Dataset (IDRID) dataset, introduces deep residual convolution into the encoding and decoding stages, which can effectively extract seepage depth features, solve overfitting and feature interference problems, and improve the model's feature expression ability and lightweight performance. In addition, by introducing an improved context extraction module, the model can capture a wider range of feature information, enhance the perception ability of retinal lesions, and perform excellently in capturing small details and blurred edges. Finally, the introduction of convolutional triple attention mechanism allows the model to automatically learn feature weights, focus on important features, and extract useful information from multiple scales. Accuracy, recall, Dice coefficient, accuracy and sensitivity were used to evaluate the ability of the model to detect and segment the automatic retinal exudation features of diabetic patients in color fundus images. Results After applying this method, the accuracy, recall, dice coefficient, accuracy and sensitivity of the improved model on the IDRID dataset reached 81.56%, 99.54%, 69.32%, 65.36% and 78.33%, respectively. Compared with the original model, the accuracy and Dice index of the improved model are increased by 2.35% , 3.35% respectively. Conclusion The segmentation method based on U-shaped network can automatically detect and segment the retinal exudation features of fundus images of diabetic patients, which is of great significance for assisting doctors to diagnose diseases more accurately.
Electrocardiogram (ECG) can visually reflect the physiological electrical activity of human heart, which is important in the field of arrhythmia detection and classification. To address the negative effect of label imbalance in ECG data on arrhythmia classification, this paper proposes a nested long short-term memory network (NLSTM) model for unbalanced ECG signal classification. The NLSTM is built to learn and memorize the temporal characteristics in complex signals, and the focal loss function is used to reduce the weights of easily identifiable samples. Then the residual attention mechanism is used to modify the assigned weights according to the importance of sample characteristic to solve the sample imbalance problem. Then the synthetic minority over-sampling technique is used to perform a simple manual oversampling process on the Massachusetts institute of technology and Beth Israel hospital arrhythmia (MIT-BIH-AR) database to further increase the classification accuracy of the model. Finally, the MIT-BIH arrhythmia database is applied to experimentally verify the above algorithms. The experimental results show that the proposed method can effectively solve the issues of imbalanced samples and unremarkable features in ECG signals, and the overall accuracy of the model reaches 98.34%. It also significantly improves the recognition and classification of minority samples and has provided a new feasible method for ECG-assisted diagnosis, which has practical application significance.
This paper aims to utilize the intersecting cortical model (ICM), which imitates the biological neural cells sync pulse, to preliminary research about the contour integration mechanism and the selection of attention. The idea of "Excitement-Inhibition" oscillation is introduced into the ICM, and meanwhile, the target contour chain code is used as the high-level feedback to control the input. Thus, we propose the Excitation-Inhibition-ICM which contains both the BUTTON-UP and the TOP-DOWN mechanism. The experimental results showed that the proposed model could effectively suppress noise to make the smooth edge synchronization issue, thus completing the process of BOTTOM-UP. The introduction of the target contour chain code can obtain consistent target outline with the input target chain code, but other targets cannot form a closed contour since they do not match with the input target chain code, so as to realize the TOP-DOWN mechanism. The results proved that our proposed model could imitate the contour integration mechanism and the selection of attention of the visual cortex V1.
Objective To recognize the different phases of Korotkoff sounds through deep learning technology, so as to improve the accuracy of blood pressure measurement in different populations. Methods A classification model of the Korotkoff sounds phases was designed, which fused attention mechanism (Attention), residual network (ResNet) and bidirectional long short-term memory (BiLSTM). First, a single Korotkoff sound signal was extracted from the whole Korotkoff sounds signals beat by beat, and each Korotkoff sound signal was converted into a Mel spectrogram. Then, the local feature extraction of Mel spectrogram was processed by using the Attention mechanism and ResNet network, and BiLSTM network was used to deal with the temporal relations between features, and full-connection layer network was applied in reducing the dimension of features. Finally, the classification was completed by SoftMax function. The dataset used in this study was collected from 44 volunteers (24 females, 20 males with an average age of 36 years), and the model performance was verified using 10-fold cross-validation. Results The classification accuracy of the established model for the 5 types of Korotkoff sounds phases was 93.4%, which was higher than that of other models. Conclusion This study proves that the deep learning method can accurately classify Korotkoff sounds phases, which lays a strong technical foundation for the subsequent design of automatic blood pressure measurement methods based on the classification of the Korotkoff sounds phases.
The study of brain information flow is of great significance to understand brain function in the field of neuroscience. The Granger causality is widely used functional connectivity analysis using multivariate autoregressive model based on the predicted mechanism. High resolution electroencephalogram (EEG) signals of ten healthy subjects were collected with a visual selective attention task. Firstly, independent component analysis was used to extract three spatially independent components of the occipital, parietal, and frontal cortices. Secondly, the Granger causal connectivity was computed between these three regions based on the Granger causality method and then independent sample t-test and bootstrap were used to test the significance of connections. The results showed that Granger causal connectivity existed from frontal to occipital and from parietal to occipital in attentional condition, while causal connectivity from frontal to occipital disappeared in unattentional condition.
Recent studies have introduced attention models for medical visual question answering (MVQA). In medical research, not only is the modeling of “visual attention” crucial, but the modeling of “question attention” is equally significant. To facilitate bidirectional reasoning in the attention processes involving medical images and questions, a new MVQA architecture, named MCAN, has been proposed. This architecture incorporated a cross-modal co-attention network, FCAF, which identifies key words in questions and principal parts in images. Through a meta-learning channel attention module (MLCA), weights were adaptively assigned to each word and region, reflecting the model’s focus on specific words and regions during reasoning. Additionally, this study specially designed and developed a medical domain-specific word embedding model, Med-GloVe, to further enhance the model’s accuracy and practical value. Experimental results indicated that MCAN proposed in this study improved the accuracy by 7.7% on free-form questions in the Path-VQA dataset, and by 4.4% on closed-form questions in the VQA-RAD dataset, which effectively improves the accuracy of the medical vision question answer.
This study aims to explore the differences of event related potential (ERP) between attention deficit hyperactivity disorder (ADHD) and normal children, so that these differences provide scientific basis for the diagnosis of ADHD. Eight children were identified to be ADHD group by the diagnostic criteria of DSM IV (diagnostic and statistical manual of mental disorders IV), and the control group also consisted of 8 normal children. Modified visual continuous performance test (CPT) was used as the experiment paradigm. The experiment included two major conditions, i.e. Go and NoGo. All the 16 subjects participated in the study. A high density EEG acquisition instrument was used to record the EEG signal and processed these EEG data by means of ERP and spectrum analysis. P2 N2 peak peak value and spectral peak around 11 Hz were analyzed between ADHD subjects and those in the control group, and then statistical tests were applied to these two groups. Results showed that: ① Under the condition of Go, ADHD group had a significant lower P2 N2 peak peak value than the values in the control group ( P< 0.05); but under the condition of NoGo there was no significant difference in between. ② Compared with the control group, the ADHD group had significant lower spectral amplitude around 11 Hz under the condition of NoGo ( P< 0.05). However, under the condition of Go the difference was insignificant. In conclusion, there is certain cognitive dysfunction in ADHD children. P2-N2 peak-peak value and spectral peak around 11 Hz could be considered as clinical evaluation indexes of ADHD children′s cognitive function. These two objective indexes provide an early diagnosis and effective treatment of ADHD .
Skin cancer is a significant public health issue, and computer-aided diagnosis technology can effectively alleviate this burden. Accurate identification of skin lesion types is crucial when employing computer-aided diagnosis. This study proposes a multi-level attention cascaded fusion model based on Swin-T and ConvNeXt. It employed hierarchical Swin-T and ConvNeXt to extract global and local features, respectively, and introduced residual channel attention and spatial attention modules for further feature extraction. Multi-level attention mechanisms were utilized to process multi-scale global and local features. To address the problem of shallow features being lost due to their distance from the classifier, a hierarchical inverted residual fusion module was proposed to dynamically adjust the extracted feature information. Balanced sampling strategies and focal loss were employed to tackle the issue of imbalanced categories of skin lesions. Experimental testing on the ISIC2018 and ISIC2019 datasets yielded accuracy, precision, recall, and F1-Score of 96.01%, 93.67%, 92.65%, and 93.11%, respectively, and 92.79%, 91.52%, 88.90%, and 90.15%, respectively. Compared to Swin-T, the proposed method achieved an accuracy improvement of 3.60% and 1.66%, and compared to ConvNeXt, it achieved an accuracy improvement of 2.87% and 3.45%. The experiments demonstrate that the proposed method accurately classifies skin lesion images, providing a new solution for skin cancer diagnosis.