bioRxiv Science⌕ Search

Biology subjects

Ahmadian, A.

Publications and source records attributed to Ahmadian, A..

6 recordsLinked to original sources

Spatiotemporal analysis of speckle dynamics to track invisible needle in ultrasound sequences using Convolutional Neural Networks

ObjectiveAccurate needle placement to the target point is critical for ultrasound interventions like biopsies and epidural injections. However, aligning the needle to the thin plane of the transducer is a challenging issue as it leads to the decay of visibility by the naked eye. Therefore, we have developed a CNN-based framework to track the needle using the spatiotemporal features of speckle dynamics. MethodsThere are three key techniques to optimize the network for our application. First, we proposed a motion field estimation network (RMF) to extract spatiotemporal features from the stack of consecutive frames. We also designed an efficient network based on the state-of-the-art Yolo framework (nYolo). Lastly, the Assisted Excitation (AE) module was added at the neck of the network to handle imbalance problem. ResultsTen freehand ultrasound sequences are collected by inserting an injection needle steeply into the Ultrasound Compatible Lumbar Epidural Simulator and Femoral Vascular Access Ezono test phantoms. We divided the dataset into two sub-categories. In the second category, in which the situation is more challenging and the needle is totally invisible statically, the angle and tip localization error were 2.43{+/-}1.14{degrees} and 2.3{+/-}1.76 mm using Yolov3+RMF+AE and 2.08{+/-}1.18{degrees} and 2.12{+/-}1.43 mm using nYolo+RMF+AE. Conclusion and significanceThe proposed method has the potential to track the needle in a more reliable operation compared to other state-of-the-art methods and can accurately localize it in 2D B-mode US images in real-time, allowing it to be used in in current ultrasound intervention procedures.

bioengineering↗

D2BGAN: Dual Discriminator Bayesian Generative Adversarial Network for Deformable MR-Ultrasound Registration Applied to Brain Shift compensation

PurposeIn neurosurgery, image guidance is provided based on the patient to pre-operative data registration with a neuronavigation system. However, the brain shift phenomena invalidate the accuracy of the navigation system during neurosurgery. One of the most common approaches for brain shift compensation is using intra-operative ultrasound (iUS) imaging followed by registration of iUS with pre-operative magnetic resonance (MR) images. While, due to the unpredictable nature of brain deformation and the low quality of ultrasound images, finding a satisfactory multimodal image registration approach remains a challenging task. MethodsWe proposed a new automatic unsupervised end-to-end MR-iUS registration approach based on the Dual Discriminator Bayesian Generative Adversarial Network (D2BGAN). The proposed network consists of two discriminators and is optimized by introducing a Bayesian loss function to improve the generator functionality and adding a mutual information loss function to the discriminator for similarity measurement. An evaluation was performed using the RESECT training dataset based on the organizers manual landmarks. ResultsThe mean Target Registration Error (mTRE) after MR-iUS registration using D2BGAN reached 0.75{+/-}0.3 mm. The D2BGAN illustrated a clear advantage by 85% improvement in the mTRE of MR-iUS registration over the initial error. Also, the results confirmed that the proposed Bayesian loss function rather than the typical loss function outperforms the accuracy of MR-iUS registration by 23%. ConclusionThe D2BGAN improved the registration accuracy while allowing us to maintain the intensity and anatomical information of the input images in the registration process. It promotes the advancement of deep learning-based multi-modality registration techniques.

bioengineering↗

Photoacoustic-MR Images Registration Based on Co-Sparse Analysis Model to Compensate for Brain Shift

Brain shift is an important obstacle to the application of image guidance during neurosurgical interventions. There has been a growing interest in intra-operative imaging to update the image-guided surgery systems. However, due to the innate limitations of the current imaging modalities, accurate brain shift compensation continues to be a challenging task. In this study, the application of intra-operative photoacoustic imaging and registration of the intra-operative photoacoustic with pre-operative MR images is proposed to compensate for brain deformation. Finding a satisfactory registration method is challenging due to the unpredictable nature of brain deformation. In this study, the co-sparse analysis model is proposed for photoacoustic -MR image registration, which can capture the interdependency of the two modalities. The proposed algorithm works based on the minimization of the mapping transform via a pair of analysis operators that are learned by the alternating direction method of multipliers. The method was evaluated using experimental phantom and ex-vivo data obtained from the mouse brain. The results of phantom data show about 63% improvement in target registration error in comparison with the commonly used normalized mutual information method. Results proved that intra-operative photoacoustic images could become a promising tool when the brain shift invalidated pre-operative MRI.

bioengineering↗

Accurate Automatic Glioma Segmentation in Brain MRI images Based on CapsNet

Glioma is a highly invasive type of brain tumor with an irregular morphology and blurred infiltrative borders that may affect different parts of the brain. Therefore, it is a challenging task to identify the exact boundaries of the tumor in an MR image. In recent years, deep learning-based Convolutional Neural Networks (CNNs) have gained popularity in the field of image processing and have been utilized for accurate image segmentation in medical applications. However, due to the inherent constraints of CNNs, tens of thousands of images are required for training, and collecting and annotating such a large number of images poses a serious challenge for their practical implementation. Here, for the first time, we have optimized a network based on the capsule neural network called SegCaps, to achieve accurate glioma segmentation on MR images. We have compared our results with a similar experiment conducted using the commonly utilized U-Net. Both experiments were performed on the BraTS2020 challenging dataset. For U-Net, network training was performed on the entire dataset, whereas a subset containing only 20% of the whole dataset was used for the SegCaps. To evaluate the results of our proposed method, the Dice Similarity Coefficient (DSC) was used. SegCaps and U-Net reached DSC of 87.96% and 85.56% on glioma tumor core segmentation, respectively. The SegCaps uses convolutional layers as the basic components and has the intrinsic capability to generalize novel viewpoints. The network learns the spatial relationship between features using dynamic routing of capsules. These capabilities of the capsule neural network have led to a 3% improvement in results of glioma segmentation with fewer data while it contains 95.4% fewer parameters than U-Net.

bioengineering↗

Segmentation of Pancreatic Ductal Adenocarcinoma (PDAC) and surrounding vessels in CT images using deep convolutional neural networks and Texture Descriptors

Fully automated and volumetric segmentation of critical tumors may play a crucial role in diagnosis and surgical planning. One of the most challenging tumor segmentation tasks is localization of Pancreatic Ductal Adenocarcinoma (PDAC). Exclusive application of conventional methods does not appear promising. Deep learning approaches has achieved great success in the computer aided diagnosis, especially in biomedical image segmentation. This paper introduces a framework based on convolutional neural network (CNN) for segmentation of PDAC mass and surrounding vessels in CT images by incorporating powerful classic features, as well. First, a 3D-CNN architecture is used to localize the pancreas region from the whole CT volume using 3D Local Binary Pattern (LBP) map of the original image. Segmentation of PDAC mass is subsequently performed using 2D attention U-Net and Texture Attention U-Net (TAU-Net). TAU-Net is introduced by fusion of dense Scale-Invariant Feature Transform (SIFT) and LBP descriptors into the attention U-Net. An ensemble model is then used to cumulate the advantages of both networks using a 3D-CNN. In addition, to reduce the effects of imbalanced data, a new loss function is proposed as a weighted combination of three classic losses including Generalized Dice Loss (GDL), Weighted Pixel-Wise Cross Entropy loss (WPCE) and boundary loss. Due to insufficient sample size for vessel segmentation, we used the above-mentioned pre-trained networks and fin-tuned them. Experimental results show that the proposed method improves the Dice score for PDAC mass segmentation in portal-venous phase by 7.52% compared to state-of-the-art methods (from 53.08% to 60.6%) in term of DSC. Besides, three dimensional visualization of the tumor and surrounding vessels can facilitate the evaluation of PDAC treatment response.

bioengineering↗

Efficient whole genome haplotyping and high-throughput single molecule phasing with barcode-linked reads

The future of human genomics is one that seeks to resolve the entirety of genetic variation through sequencing. The prospect of utilizing genomics for medical purposes require cost-efficient and accurate base calling, long-range haplotyping capability, and reliable calling of structural variants. Short read sequencing has lead the development towards such a future but has struggled to meet the latter two of these needs1. To address this limitation, we developed a technology that preserves the molecular origin of short sequencing reads, with an insignificant increase to sequencing costs. We demonstrate a novel library preparation method which enables whole genome haplotyping, long-range phasing of single DNA molecules, and de novo genome assembly through barcode-linked reads (BLR). Millions of random barcodes are used to reconstruct megabase-scale phase blocks and call structural variants. We also highlight the versatility of our technology by generating libraries from different organisms using only picograms to nanograms of input material.

genomics↗