Objects fusion

General definition

Objects fusion enables to create a new object from 2 or more other objects. Indeed, if you only put two volumes in the same window, you will see only one. To see the two volumes, you need to mix voxels from the two volumes in order to obtain a new volume. Note that fusionning more than 2 objects is only possible since 1.30 version. Besides, several new features have been added for fusion management. Several fusion combinations between objects are available,but for the moment, let's see a fusion between two 3D volumes for example :

  • STEP 1 : Load the images to merge. Here, we will fusion an anatomy and the brain mask obtained from BrainVISA anatomical pipeline.

  • STEP 2 : Select the two volumes in objects list with Ctrl + bouton gauche.

  • STEP 3 : Then click on fusion button .

  • STEP 4 : A new window pop up to select objects order and fusion type (fusion types offered differs according to selected objects, this will be detailled later, in advanced part of the manual).

    Figure 7.3. Fusion type

    Fusion type

  • STEP 5 : Click on Ok to create the new Fusion2D object.

  • STEP 6 : Put the Fusion2D object in a window.

  • STEP 7 : If the Fusion2D object is all in black, you must change fusion mode. So right click on Fusion2D object to get its menu. Choose Fusion => Control 2D fusion. This window opens :

    Figure 7.4. Fusion control

    Fusion control

  • STEP 8 : You can change the mapping mode. The default is Linear : it does a linear combination of the two volumes. The Geometric mode does RGB channels multiplication. For linear fusions, you can set objects transparency with the cursor Mixing rate.

  • STEP 9 : By default, the 2 volumes will have the same palette. To change at least one, do Right clik menu on a volume => Color => Palette.

Figure 7.5. Example of a linear fusion between two 3D volumes

Example of a linear fusion between two 3D volumes

Note

It is possible to create multi-fusion, that is to say fusionning more than 2 objects. For volumes, here is the method : with for example 3 volumes (V1, V2 and V3), Anatomist actually fusion the last volume and the volume above in the list (V2 and V3 gives V23). Then, from this fusion object, it creates a new fusion with the volume above (V23 and V1 gives V23_1). To set parameters for each fusion, you have to select the fusion's second volume. For example, to set parameters for fusion V23_1, you must select V2.

Note

In this example, we didn't have to matter about objects referential management because the brain mask (brain_lesson1.ima) have been generated from the anatomy, so objects are in the same referential. But if we had done a fusion between an anatomical volume and an activation map (which is in another referential since this map comes from a functional volume), we would have to handle referentials to put the objects in a coherent coordinates system.

Types of fusions

The following table show which type of fusion is available according to the type of objects :

Table 7.1. Fusion descriptions

ObjectsFusion nameDescription

Only one volume or 2D fusion

FusionSliceMethod

Fusion allowing to cut a volume across itself: to view/intersect 2 different slices of the same volume in the same window.

2 or more volumes

Fusion2DMethod

The volumes are merged in one volume. A voxel of the resulting volume is a combination of the same voxel in each original volume.

Volume + Mesh

Fusion3DMethod

Maps on the mesh a texture corrsponding to the volume values.

Mesh + (Volume or 2D fusion)

FusionCutMeshMethod

Mesh cut by a plane: the cutting plane will have the texture of the volume slice. When you put this object in a 3D window, the "cut mesh" control is available. It enables to control the orientation of the slice (shift) and its position (ctrl) against the mesh.

2 textures

FusionTextureMethod

Creates a 2D texture from two 1D textures.

Several textures

FusionMulitTextureMethod

Multi-texture: allows to map several textures on a mesh.

Mesh + Mesh

SurfaceMatcher

Matching surfaces. This object gives access to a surface deformation algorithm. It tries to transform one surface into the other.

Mesh + Texture

FusionTexSurfMethod

Textured surface.

Any object(s)

FusionClipMethod

Clipping: clips objects with a clipping plane. One side of the plane is cut and not displayed.

Volume or 2D fusion

FusionRGBAVolumeMethod

Converts an intensity-based volume (normally using a colormap) into a RGBA volume representation.

Volume or 2D fusion

VolumeRenderingFusionMethod

Displays a volumic object in 3D using intensities transparency on the whole volume.

Textured mesh + another mesh

Interpoler

Allows to map and interpolate textures from a mesh to another mesh with a different geometry. To obtain reasonable results, it is recommended to use a "SurfaceMatcher" first, it will warp a surface towards the other one

Fusion3D parameters

The 3D Fusion is a fusion between a volume and a mesh. This fusion can be parameterized through the right click menu on the fusion object.
  • Fusion mode : Geometrical, linear, rate.
  • Methods of interpolation : the method to estimate the value for the intersection between the mesh and the volum at each point.

    Table 7.2. Interpolation methods

    SectionDescription
    Point to point

    the simplest: only the information coming from the voxel directly under the mesh vertex is used, directly. Do not use the depth and the step prameters.

    Point to point with depth offset (inside/outside)

    Only one voxel is taken into account, but its position is shifted along the normal to the mesh (either inside the mesh or outside), for each mesh vertex (Do not use <Step>).

    Line to point

    Information is taken along the normal line, both inside and outside, with a sampling (depth and step) specified by appropriate parameters.

    Inside line to point

    The value corresponds to <the_choosen_submethod> value for the interpolation for a inside line localized at <Depth> and for a sampling <Step>

    Outside line to point

    The value corresponds to <the_choosen_submethod> value for the interpolation for a ouside line localized at <Depth> and for a sampling <Step>

    Sphere to point

    A sampling into a sphere (depth and step parameters apply) is used to get locations in the 3D volume

  • Submethods: This only applies to interpolation methods that are not single-voxel (such as point to point methods)

    Table 7.3. Interpolation sub-methods

    SectionDescription
    Max

    The maximum value of all voxels of the volume at the sampled locations is mapped on the mesh

    Min

    The minimun value of all voxels of the volume at the sampled locations is mapped on the mesh

    Mean

    Standard mean (sum of values divided by the number of locations)

    Corrected mean

    Only non-nul values are taken into account in the mean computation: this is more suitable for thresholded activation maps for instance to avoid blurring the mapped values.

    Enhanced mean

    In the enhanced mean variant, a weighting of the final value is applied depending on the proportion of null values in the set of mixed values.

  • Parameters: definition of localization of another point to do an interpolation

    Table 7.4. Interpolation parameters

    SectionDescription
    Depth

    Position of the other point

    Step

    Sampling step. Always inferior to Depth.

Note

Be aware that all this is only a visualization toy and is not very robust: no real interpolation of the volume values is performed to get a continuous intersection along the mesh: especially the methods taking points along normals can produce inaccurate results on high curvature regions (produce discontinuities, map the same voxel value on several vertices etc). The sphere mode is more robust but involves an averaging (blurring) effet, and can take values outside the brain or grey matter ...