Medical imaging

Enhancing and combining physical imaging technologies such as MRI, CT, PET, SPECT and ultrasound permits the extraction of anatomical and functional information leading to better diagnoses. Early and differential diagnosis increases the effectiveness and safety of treatment. Techniques that can visualize individual living cells – and even the molecules in those cells – reveal the mechanisms behind the development of diseases. Tracers that attach to tumour cells make them easier to see, so the surgeon knows precisely where to operate. Image processing technologies also assist surgeons while the operation is in progress, displaying the operating area with great precision using minuscule cameras.

Charl Botha is Assistant Professor of Medical Visualization in the Mediamatics department at TU Delft, and also has an appointment in the Department of Radiology at the LUMC under the auspices of the Medical Delta project. “Put simply,” explains Dr Botha, “Medical visualization is all about turning large and complex medical datasets into visual representations that help researchers and clinicians understand the data better. The ultimate goal is to extract knowledge or new insights from data that would otherwise be hidden.”

Almost all of the research projects being conducted by Dr Botha and his colleagues involve collaboration with clinical partners. “We sometimes look at problems principally from a technical perspective,” he says, “but in general there’s always a clinician or a medical researcher involved.” Their work includes developing new techniques for pre-operative planning and intra-operative guidance, such as their research into shoulder replacement surgery, clinical diagnosis (for example in detecting polyps in virtual colonoscopy) and in medical research, such as using diffusion tensor imaging to visualize neural connections in the brain.

The biggest challenge we face is dealing with the deluge of data coming from our clinical partners

Dr. Botha

Improving shoulder replacement surgery

One of the research Lines in which much progress has been made is research into shoulder replacement surgery. These are operations in which parts of joints affected by arthritis are replaced with artificial components, which often help to reduce pain. Such operations do often cause complications that can limit or even worsen the mobility of the joints. The researchers have developed a pre-operative planning system for shoulder replacement operations, to help surgeons avoid these kinds of complications. The system makes use of an automatic planning function, based on calculations of characteristic orientation points on patient-specific surface models, generated using data from CT scans. Guided by an intra-operative guidance system, the surgeon can carry out the procedure in accordance with the preoperative plan.

A Leiden University Medical Centre (LUMC) researcher, Peter Krekel, has already obtained his PhD with research on this subject and is currently developing the pre-operative planning system Articulis for the market in the spin-off venture Clinical Graphics. Surgeons can use this system to draw up an operation plan and run a simulation of what a joint’s freedom of mobility is expected to be. This gives orthopaedic surgeons a good basis for making surgical decisions.

In addition, in a project for which STW NIG funding has recently been secured, Dr Botha, Dr Edward Valstar (LUMC Orthopaedics and Delft University Mechanical Engineering) and Prof. Rob Nelissen (LUMC Orthopaedics) and two PhD students will be researching how shoulder replacement operations can be conducted using patient-specific instruments, which are automatically configured for each patient on the basis of the pre-operative planning. This means there is no need for an expensive and time-consuming tracking system in the operating room. The instruments make it possible to use computers to plan and help secure a successful outcome for the operation.

Future challenges

“The biggest challenge we face is dealing with the deluge of data coming from our clinical partners,” says Dr Botha. “Scanning technology is moving at a rapid pace, the questions we are being asked are getting more complex, and we need to come up with new methods of visual data analysis. We are increasingly faced with dealing with longitudinal medical studies in which large amounts of multimodal data of multiple patients are acquired at multiple time points. Medical researchers want to determine which image-based features could be used to predict and characterize disease onset and progression. We’re developing techniques that will transform all the acquired data into effective visual representations with which researchers can interact and use to study the relevant characteristics and events more directly. They will be able to “see” important patterns in all datasets of all patients over all time points.”

Lucas van Vliet heads the Quantitative Imaging (QI) group of the Imaging Science & Technology department. “We invent novel solutions for biomedical imaging from molecule to man,” explains Van Vliet.

“We develop algorithms for image processing, analysis, reconstruction, and recognition.” This research, as Van Vliet explains, facilitates practical health care. It offers new ways to visualise and analyse data from medical imaging techniques such as X-ray, CT, ultrasound and MRI. Van Vliet: “The resulting quantitative information can be used for early diagnosis and to monitor disease progression and treatment.”

We invent novel solutions for biomedical imaging from molecule to man.

― L.J. van Vliet

Colon cancer

One research aim is to develop less invasive screening methods, such as virtual  colonoscopy. This technology aims to identify polyps – the precursors of colon cancer - based on 3D CT images. “Currently, patients have to undergo colonoscopy,” says Van Vliet, “which is bothersome to patients: they have to take laxatives, and many find the examination to be embarrassing. 
Moreover, it is painful and not without risk. An abdominal CT scan, on the other hand, only requires mild preparation, a low-fibre diet in combination with drinking a contrast liquid. This patient-friendly approach increases the patient compliance and therefor the chance of early detection and prevention of colon cancer. After all, patients will be more likely to agree to screening.” 

Heart in 3D

Cardiovascular diseases are among the main causes of mortality in the Western world. The “Heart in 3D” project aims to integrate information from different imaging techniques (MRI, CT, CTA, PET, ultrasound) to facilitate personalised disease management.
“If you combine CT angiography of the coronary arteries with myocardial MRI, you can build 3D models that allow for an integrated analysis,” says Van Vliet. “For example, you can study the relationship between the arteries and the way the heart muscle functions. This will eventually lead to better diagnosis and treatment of, for example, atherosclerosis.”

Future challenges

Prevention is better than cure, as the age-old saying goes. This is particularly true in an ageing population, both from a human and an economic point of view. “We try to determine risk profiles by analysing existing data from large population studies. By comparing these, we can establish patterns and distinguish normal age-related development from disease, and identify the  related biomarkers,” Van Vliet points out. One technology that is used in the search for biomarkers of neurological diseases is Diffusion Tensor MRI (DTI). DTI provides information about changes in the brain’s white matter resulting from normal ageing processes, or from diseases such as schizophrenia, ALS and Alzheimer’s. “In general, early detection facilitates early treatment and often milder illness. In addition, it leads to more effective treatment, which is also more cost-effective.”

Freek Beekman’s team develops improved radiation-based imaging systems, such as SPECT (Single Photon Emission Computed Tomography), PET and X-ray CT, separately and in combination as hybrid systems. “We try to improve images in all kinds of ways,” he explains, “using better detector technology, smarter system geometries, device timing information, and special kinds of lenses called collimators. In all these devices, image reconstruction is key – using a number of projection views of the object to reconstruct volume images, or 3D stacks or slices through the body.”

Associated research lines being followed by the Radiation, Detection and Medical Imaging group focus on detector technology and luminescent materials. The detector programme is developing innovative scintillation-based sensors for (time-offlight) PET and for high resolution SPECT. The materials programme, led by Pieter Dorenbos, focuses on the development of new materials for the detection of ionizing radiation. These new materials assist in the development of higher density, higher light output, or faster response scintillators that can be applied in novel CT, SPECT and PET devices.

We try to improve images in all kinds of ways

― Prof.dr. F.J. Beekman

The prospect of a ‘Hubble telescope’ for clinicians

SPECT systems currently in use in medical centres have a very low spatial resolution compared with the latest devices developed by Beekman’s group. “Our U-SPECT scanner is a kind of ‘Hubble telescope’ for biologists doing basic research on how molecules distribute over tissues in the body . Now the exciting challenge is to develop the same very high resolution in clinical imaging. 
We’ve shown what can be done with these machines with small animals, using them to help develop the ideal tracer molecule that can be combined with a therapeutic isotope to destroy a tumour. There are already examples in nuclear medicine where combinations of tracers and isotopes have been developed to do the same in humans.” Using future human-scale versions of U-SPECT offers the prospect of much more effective diagnosis and treatment without the disadvantages of surgery and other traditional therapies.


Beekman and his team at TU Delft are now developing new collimation, reconstruction and detector technologies to provide further improvements to the U-SPECT (Ultra-high resolution SPECT) scanner he developed. Tracer and therapeutic molecules have long been developed using PET and, more recently, SPECT scanners and laboratory rodents. U-SPECT scanning produces images with a much better resolution and associated quantitative accuracy than small animal PET. 
This enables drug and tracer accumulation to be monitored in subcompartments of organs or in tiny parts of tumours in mice or rats. A recently developed version of the device is now fully integrated with a high throughput, low dose X-ray CT scanner. This allows molecules to be examined at the sub-half-mm resolution level, and to localize them with the same accuracy in the anatomical framework.