Medical Ultrasound Video Coding with H.265/HEVC Based on ROI Extraction

High-efficiency video compression technology is of primary importance to the storage and transmission of digital medical video in modern medical communication systems. To further improve the compression performance of medical ultrasound video, two innovative technologies based on diagnostic region-of-interest (ROI) extraction using the high efficiency video coding (H.265/HEVC) standard are presented in this paper. First, an effective ROI extraction algorithm based on image textural features is proposed to strengthen the applicability of ROI detection results in the H.265/HEVC quad-tree coding structure. Second, a hierarchical coding method based on transform coefficient adjustment and a quantization parameter (QP) selection process is designed to implement the otherness encoding for ROIs and non-ROIs. Experimental results demonstrate that the proposed optimization strategy significantly improves the coding performance by achieving a BD-BR reduction of 13.52% and a BD-PSNR gain of 1.16 dB on average compared to H.265/HEVC (HM15.0). The proposed medical video coding algorithm is expected to satisfy low bit-rate compression requirements for modern medical communication systems.     

Fast Coding Unit Encoding Mechanism for Low Complexity Video Coding

In high efficiency video coding (HEVC), coding tree contributes to excellent compression performance. However, coding tree brings extremely high computational complexity. Innovative works for improving coding tree to further reduce encoding time are stated in this paper. A novel low complexity coding tree mechanism is proposed for HEVC fast coding unit (CU) encoding. Firstly, this paper makes an in-depth study of the relationship among CU distribution, quantization parameter (QP) and content change (CC). Secondly, a CU coding tree probability model is proposed for modeling and predicting CU distribution. Eventually, a CU coding tree probability update is proposed, aiming to address probabilistic model distortion problems caused by CC. Experimental results show that the proposed low complexity CU coding tree mechanism significantly reduces encoding time by 27% for lossy coding and 42% for visually lossless coding and lossless coding. The proposed low complexity CU coding tree mechanism devotes to improving coding performance under various application conditions.     

Visual learning in multiple-object tracking

Background

Tracking moving objects in space is important for the maintenance of spatiotemporal continuity in everyday visual tasks. In the laboratory, this ability is tested using the Multiple Object Tracking (MOT) task, where participants track a subset of moving objects with attention over an extended period of time. The ability to track multiple objects with attention is severely limited. Recent research has shown that this ability may improve with extensive practice (e.g., from action videogame playing). However, whether tracking also improves in a short training session with repeated trajectories has rarely been investigated. In this study we examine the role of visual learning in multiple-object tracking and characterize how varieties of attention interact with visual learning.

Methodology/Principal Findings

Participants first conducted attentive tracking on trials with repeated motion trajectories for a short session. In a transfer phase we used the same motion trajectories but changed the role of tracking targets and nontargets. We found that compared with novel trials, tracking was enhanced only when the target subset was the same as that used during training. Learning did not transfer when the previously trained targets and nontargets switched roles or mixed up. However, learning was not specific to the trained temporal order as it transferred to trials where the motion was played backwards.

Conclusions/Significance

These findings suggest that a demanding task of tracking multiple objects can benefit from learning of repeated motion trajectories. Such learning potentially facilitates tracking in natural vision, although learning is largely confined to the trajectories of attended objects. Furthermore, we showed that learning in attentive tracking relies on relational coding of all target trajectories. Surprisingly, learning was not specific to the trained temporal context, probably because observers have learned motion paths of each trajectory independently of the exact temporal order.     

Parallel Key Frame Extraction for Surveillance Video Service in a Smart City

Surveillance video service (SVS) is one of the most important services provided in a smart city. It is very important for the utilization of SVS to provide design efficient surveillance video analysis techniques. Key frame extraction is a simple yet effective technique to achieve this goal. In surveillance video applications, key frames are typically used to summarize important video content. It is very important and essential to extract key frames accurately and efficiently. A novel approach is proposed to extract key frames from traffic surveillance videos based on GPU (graphics processing units) to ensure high efficiency and accuracy. For the determination of key frames, motion is a more salient feature in presenting actions or events, especially in surveillance videos. The motion feature is extracted in GPU to reduce running time. It is also smoothed to reduce noise, and the frames with local maxima of motion information are selected as the final key frames. The experimental results show that this approach can extract key frames more accurately and efficiently compared with several other methods.     

Binary IS typing for Staphylococcus aureus

Background

We present an easily applicable test for rapid binary typing of Staphylococcus aureus: binary interspace (IS) typing. This test is a further development of a previously described molecular typing technique that is based on length polymorphisms of the 16S-23S rDNA interspace region of S. aureus.

Methodology/Principal Findings

A novel approach of IS-typing was performed in which binary profiles are created. 424 human and animal derived MRSA and MSSA isolates were tested and a subset of these isolates was compared with multi locus sequence typing (MLST) and Amplified Fragment Length Polymorphism (AFLP). Binary IS typing had a high discriminatory potential and a good correlation with MLST and AFLP.

Conclusions/Significance

Binary IS typing is easy to perform and binary profiles can be generated in a standardized fashion. These two features, combined with the high correlation with MLST clonal complexes, make the technique applicable for large-scale inter-laboratory molecular epidemiological comparisons.     

A Watermarking Scheme for High Efficiency Video Coding (HEVC)

This paper presents a high payload watermarking scheme for High Efficiency Video Coding (HEVC). HEVC is an emerging video compression standard that provides better compression performance as compared to its predecessor, i.e. H.264/AVC. Considering that HEVC may will be used in a variety of applications in the future, the proposed algorithm has a high potential of utilization in applications involving broadcast and hiding of metadata. The watermark is embedded into the Quantized Transform Coefficients (QTCs) during the encoding process. Later, during the decoding process, the embedded message can be detected and extracted completely. The experimental results show that the proposed algorithm does not significantly affect the video quality, nor does it escalate the bitrate.     

Motion measurement with high-speed video

A new kinematic measurement system based on a high-speed video system, combined with a computer-assisted evaluation for the analysis of gait patterns, is described. The system allows both a reviewable visual assessment in slow motion (up to 1000 frames s⁻¹ as well as automatic measurement of the kinematics of body segments. Specially developed software, which uses a pattern search algorithm and an additional subpixel correction, results in a deviation of less than 0.1% (without considering the lens nonlinearity). For most cases the recognition and tracking of temporarily concealed markers is also achieved. The results of the computer-assisted high-speed video analysis are being applied in rehabilitation programmes to increase the objectivity of standard movements, e.g. gait analysis of people with artificial limbs.     

Characteristics of Motor Resonance Predict the Pattern of Flash-Lag Effects for Biological Motion

Background

When a moving stimulus and a briefly flashed static stimulus are physically aligned in space the static stimulus is perceived as lagging behind the moving stimulus. This vastly replicated phenomenon is known as the Flash-Lag Effect (FLE). For the first time we employed biological motion as the moving stimulus, which is important for two reasons. Firstly, biological motion is processed by visual as well as somatosensory brain areas, which makes it a prime candidate for elucidating the interplay between the two systems with respect to the FLE. Secondly, discussions about the mechanisms of the FLE tend to recur to evolutionary arguments, while most studies employ highly artificial stimuli with constant velocities.

Methodology/Principal Finding

Since biological motion is ecologically valid it follows complex patterns with changing velocity. We therefore compared biological to symbolic motion with the same acceleration profile. Our results with 16 observers revealed a qualitatively different pattern for biological compared to symbolic motion and this pattern was predicted by the characteristics of motor resonance: The amount of anticipatory processing of perceived actions based on the induced perspective and agency modulated the FLE.

Conclusions/Significance

Our study provides first evidence for an FLE with non-linear motion in general and with biological motion in particular. Our results suggest that predictive coding within the sensorimotor system alone cannot explain the FLE. Our findings are compatible with visual prediction (Nijhawan, 2008) which assumes that extrapolated motion representations within the visual system generate the FLE. These representations are modulated by sudden visual input (e.g. offset signals) or by input from other systems (e.g. sensorimotor) that can boost or attenuate overshooting representations in accordance with biased neural competition (Desimone & Duncan, 1995).     

Focal-Plane Change Triggered Video Compression for Low-Power Vision Sensor Systems

Video sensors with embedded compression offer significant energy savings in transmission but incur energy losses in the complexity of the encoder. Energy efficient video compression architectures for CMOS image sensors with focal-plane change detection are presented and analyzed. The compression architectures use pixel-level computational circuits to minimize energy usage by selectively processing only pixels which generate significant temporal intensity changes. Using the temporal intensity change detection to gate the operation of a differential DCT based encoder achieves nearly identical image quality to traditional systems (4dB decrease in PSNR) while reducing the amount of data that is processed by 67% and reducing overall power consumption reduction of 51%. These typical energy savings, resulting from the sparsity of motion activity in the visual scene, demonstrate the utility of focal-plane change triggered compression to surveillance vision systems.     

Molecular mobility studies on the amorphous state of disaccharides. I—thermally stimulated currents and differential scanning calorimetry

The relaxational processes in amorphous solid gentiobiose and cellobiose are studied by thermally stimulated depolarization currents (TSDC) in the temperature region from 108 K up to 423 K. The slow molecular mobility was characterized in the crystal and in the glassy state. The features of different motional components of the secondary relaxation have been monitored as a function of time as the glass structurally relaxes on aging. It is concluded that some modes of motion of this mobility are aging independent, while others are affected by aging. The value of the steepness index or fragility (T_g-normalized temperature dependence of the relaxation time) was obtained by differential scanning calorimetry (DSC) from the analysis of the scanning rate dependency of T_g.     

Visual censuses of tropical fish aggregations on artificial reefs: slate versus video recording techniques

Artificial coastal reefs were initially installed off Reunion Island (SW Indian Ocean) in order to attract and catch small pelagic fish of economic importance for the local fishery. These artificial reefs also attract a high density of juvenile coral reef fish, especially after recruitment. Because of high species richness and density, a suitable method of evaluating diversity and abundance in such assemblages is needed. An experiment was conducted in situ for 1 year in order to test which of the two visual techniques, slate or video recording, would be the most suitable for sampling artificial reefs. For the quantitative study, a rope framework (four belt transects each measuring 24×3 m) was used to ease the movement of the divers. To avoid bias due to time variations, the study was conducted under limited time in situ. The advantages and disadvantages of the two techniques regarding the accuracy of qualitative and quantitative results are discussed. The qualitative study results show that the slate technique is the most accurate one for determining species richness. In the quantitative study, factors such as species characteristics (ecological type), attractiveness (relationship between fish and diver) and abundance of fish communities around the artificial reefs appear to influence our results on the comparison of the two techniques. Of 13 ‘permanent’ (observed in more than 75% of dives) species, 6 returned a similar frequency of detection by slate and video (Lutjanus kasmira, Lutjanus bengalensis, Priacanthus hamrur, Chaetodon kleinii, Heniochus diphreutes, Mulloides vanicolensis); these were then selected for comparison of the techniques using quantitative data. The correlation between video and slate census results is high, but, in comparison with the slate census, the video census underestimates abundance, especially for low values. A corrected index is proposed to remedy this underestimation; it could be used for video surveys conducted on species responding well to video detection (as below).     

Center of mass motion in swimming fish: effects of speed and locomotor mode during undulatory propulsion

Studies of center of mass (COM) motion are fundamental to understanding the dynamics of animal movement, and have been carried out extensively for terrestrial and aerial locomotion. But despite a large amount of literature describing different body movement patterns in fishes, analyses of how the center of mass moves during undulatory propulsion are not available. These data would be valuable for understanding the dynamics of different body movement patterns and the effect of differing body shapes on locomotor force production. In the present study, we analyzed the magnitude and frequency components of COM motion in three dimensions (x: surge, y: sway, z: heave) in three fish species (eel, bluegill sunfish, and clown knifefish) swimming with four locomotor modes at three speeds using high-speed video, and used an image cross-correlation technique to estimate COM motion, thus enabling untethered and unrestrained locomotion. Anguilliform swimming by eels shows reduced COM surge oscillation magnitude relative to carangiform swimming, but not compared to knifefish using a gymnotiform locomotor style. Labriform swimming (bluegill at 0.5 body lengths/s) displays reduced COM sway oscillation relative to swimming in a carangiform style at higher speeds. Oscillation frequency of the COM in the surge direction occurs at twice the tail beat frequency for carangiform and anguilliform swimming, but at the same frequency as the tail beat for gymnotiform locomotion in clown knifefish. Scaling analysis of COM heave oscillation for terrestrial locomotion suggests that COM heave motion scales with positive allometry, and that fish have relatively low COM oscillations for their body size.     

Considerations in video playback design: using optic flow analysis to examine motion characteristics of live and computer-generated animation sequences

The increasing use of the video playback technique in behavioural ecology reveals a growing need to ensure better control of the visual stimuli that focal animals experience. Technological advances now allow researchers to develop computer-generated animations instead of using video sequences of live-acting demonstrators. However, care must be taken to match the motion characteristics (speed and velocity) of the animation to the original video source. Here, we presented a tool based on the use of an optic flow analysis program to measure the resemblance of motion characteristics of computer-generated animations compared to videos of live-acting animals. We examined three distinct displays (tail-flick (TF), push-up body rock (PUBR), and slow arm wave (SAW)) exhibited by animations of Jacky dragons (Amphibolurus muricatus) that were compared to the original video sequences of live lizards. We found no significant differences between the motion characteristics of videos and animations across all three displays. Our results showed that our animations are similar the speed and velocity features of each display. Researchers need to ensure that similar motion characteristics in animation and video stimuli are represented, and this feature is a critical component in the future success of the video playback technique.     

Recording Behavioral Responses to Reflection in Crayfish

Social behavior depends on sensory input from the visual, mechanical and olfactory systems. One important issue concerns the relative roles of each sensory modality in guiding behavior. The role of visual inputs has been examined by isolating visual stimuli from mechanical and chemosensory stimuli. In some studies (Bruski & Dunham, 1987: Delgado-Morales et al., 2004) visual inputs have been removed with blindfolds or low light intensity, and effects of remaining sensory modalities have been elucidated. An alternative approach is to study the effects of visual inputs in the absence of any appropriate mechanical and chemosensory cues. This approach aims to identify the exclusive role of visual inputs. We have used two methods to provide visual stimuli to crayfish without providing chemical and mechanical cues. In one method, crayfish are videotaped in an aquarium where half of the walls are covered in mirrors to provide a reflective environment, and the other half are covered in a non-reflective (matte finish) plastic. This gives the crayfish a choice between reflective and non-reflective environments. The reflective environment provides visual cues in the form of reflected images of the crayfish as it moves throughout half of the tank; these visual cues are missing from the non-reflective half of the tank. An alternative method is to videotape the behavior of crayfish in an aquarium separated by a smaller chamber at each end, with a crayfish in one small chamber providing visual cues and an inert object in the opposite small chamber providing visual input from a non-moving, non-crayfish source. Our published results indicate that responses of crayfish to the reflective environment depend on socialization and dominance rank. Socialized crayfish spent more time in the reflective environment and exhibited certain behaviors more frequently there than in the non-reflective environment; isolated crayfish showed no such differences. Crayfish that were housed in same-sex pairs developed a social rank of either dominant or subordinate. Responses to reflection differed between dominant and subordinate crayfish (May & Mercier, 2006; May & Mercier, 2007). Dominant crayfish spent more time on the reflective side, entered reflective corners more frequently and spent more time in reflective corners compared to the non-reflective side. Subordinate crayfish walked in reverse more often on the reflective side than on the non-reflective side. Preliminary data suggest similar effects from visual cues provided by a crayfish in a small adjoining chamber (May et al., 2008).Download video file.^{(129M, mp4)}     

Direct evidence for encoding of motion streaks in human visual cortex

Temporal integration in the visual system causes fast-moving objects to generate static, oriented traces (‘motion streaks’), which could be used to help judge direction of motion. While human psychophysics and single-unit studies in non-human primates are consistent with this hypothesis, direct neural evidence from the human cortex is still lacking. First, we provide psychophysical evidence that faster and slower motions are processed by distinct neural mechanisms: faster motion raised human perceptual thresholds for static orientations parallel to the direction of motion, whereas slower motion raised thresholds for orthogonal orientations. We then used functional magnetic resonance imaging to measure brain activity while human observers viewed either fast (‘streaky’) or slow random dot stimuli moving in different directions, or corresponding static-oriented stimuli. We found that local spatial patterns of brain activity in early retinotopic visual cortex reliably distinguished between static orientations. Critically, a multivariate pattern classifier trained on brain activity evoked by these static stimuli could then successfully distinguish the direction of fast (‘streaky’) but not slow motion. Thus, signals encoding static-oriented streak information are present in human early visual cortex when viewing fast motion. These experiments show that motion streaks are present in the human visual system for faster motion.     

Frequency based feature selection method using whale algorithm

Feature selection is the problem of finding the best subset of features which have the most impact in predicting class labels. It is noteworthy that application of feature selection is more valuable in high dimensional datasets. In this paper, a filter feature selection method has been proposed on high dimensional binary medical datasets – Colon, Central Nervous System (CNS), GLI_85, SMK_CAN_187. The proposed method incorporates three sections. First, whale algorithm has been used to discard irrelevant features. Second, the rest of features are ranked based on a frequency based heuristic approach called Mutual Congestion. Third, majority voting has been applied on best feature subsets constructed using forward feature selection with threshold τ = 10. This work provides evidence that Mutual Congestion is solely powerful to predict class labels. Furthermore, applying whale algorithm increases the overall accuracy of Mutual Congestion in most of the cases. The findings also show that the proposed method improves the prediction with selecting the less possible features in comparison with state of the arts.https://github.com/hnematzadeh