Next Event:

August 8, 2019 at 10:00am - Ph.D. Thesis Defense - Ryan Ford - Water Quality and Algal Bloom Sensing from Multiple Imaging Platforms

DIRS Laboratory 76-3215
August 8, 2019 at 10:00am
Ryan Ford
Water Quality and Algal Bloom Sensing from Multiple Imaging Platforms
Ph.D. Thesis Defense
Abstract: 

Abstract

 

Harmful cyanobacteria blooms have been increasing in frequency throughout the world resulting in a greater need for water quality monitoring. Traditional methods of monitoring water quality, such as point sampling, are often resource expensive and time consuming in comparison to remote sensing approaches, however the spatial resolution of established water remote sensing satellites is often too coarse (~300 m) to resolve smaller inland waterbodies. The fine scale spatial resolution and improved radiometric sensitivity of Landsat satellites (~30 m) can resolve these smaller waterbodies, enabling their capability for cyanobacteria bloom monitoring.

In this work, the utility of Landsat to retrieve concentrations of two cyanobacteria bloom pigments, chlorophyll-a and phycocyanin, is assessed. Concentrations of these pigments are retrieved using a spectral Look-Up-Table (LUT) matching process, where an exploration of the effects of LUT design on retrieval accuracy is performed. Potential augmentations to the spectral sampling of Landsat are also tested to determine how it can be improved for waterbody constituent concentration retrieval.

Applying the LUT matching process to Landsat 8 imagery determined that concentrations of chlorophyll-a, total suspended solids, and color dissolved organic matter were retrieved with a satisfactory accuracy through appropriate choice of atmospheric compensation and LUT design, in agreement with previously reported implementations of the LUT matching process. Phycocyanin proved to be a greater challenge to this process due to its weak effect on waterbody spectrum, the lack of Landsat spectral sampling over its predominant spectral feature, and error from atmospheric compensation. From testing potential enhancements to Landsat spectral sampling, we determine that additional spectral sampling in the yellow and red edge regions of the visible/near-infrared (VNIR) spectrum can lead to improved concentration retrievals. This performance further improves when sampling is added to both regions, and when Landsat is transitioned to a VNIR imaging spectrometer, though this is dependent on band position and spacing. These results imply that Landsat can be used to monitor cyanobacteria blooms through retrieval of chlorophyll-a, and this retrieval performance can be improved in future Landsat systems, even with minor changes to spectral sampling. This includes improvement in retrieval of phycocyanin when implementing a VNIR imaging spectrometer.

 

 

August 6, 2019 at 1:00pm - MS Thesis Defense - Rinaldo Ronnie Izzo - Combining hyperspectral imaging and small unmanned aerial systems for grapevine moisture stress assessment

DIRS Laboratory 76-3215
August 6, 2019 at 1:00pm
Rinaldo Ronnie Izzo
Combining hyperspectral imaging and small unmanned aerial systems for grapevine moisture stress assessment
MS Thesis Defense
Abstract: 

Abstract

 

It has been shown that a mild water deficit in grapevine contributes to wine quality, in terms of especially flavor. Water deficit irrigation and selective harvesting are implemented to optimize quality, but these approaches require rigorous measurement of vine water status. While traditional in-field physiological measurements have made operational implementation onerous, modern small unmanned aerial systems (sUAS) have presented the unique opportunity for rigorous management across vast areas. This study sought to fuse hyperspectral remote sensing, sUAS, and sound multivariate analysis techniques for the purposes of assessing grapevine water status. High-spatial and -spectral resolution hyperspectral data were collected in the visible/near-infrared (VNIR; 400-1000nm) and short-wave infrared (SWIR; 950-2500 nm) spectral regions across three flight days at a commercial vineyard in upstate New York. A pressure chamber was used to collect traditional field measurements of stem water potential (ψstem) during image acquisition. We correlated our hyperspectral data with a limited stress range (wet growing season) of traditional measurements for ψstem using multiple linear regression (R2 between 0.34 and 0.55) and partial least squares regression (R2 between 0.36 and 0.39). We demonstrated statistically significant trends in our experiment, further qualifying the potential of hyperspectral data, collected via sUAS, for the purposes of grapevine water management. There was indication that the chlorophyll and carotenoid absorption regions in the VNIR, as well as several SWIR water band regions warrant further exploration. This work was limited since we did not have access to experimentally-controlled vineyard plots, and it therefore is recommended that future work includes a full range of water stress scenarios.

August 6, 2019 at 10:00am - Ph.D. Thesis Defense - Rehman Eon - The Characterization of Earth Sediments using Radiative Transfer Models from Directional Hyperspectral Reflectance

DIRS Laboratory 76-3215
August 6, 2019 at 10:00am
Rehman Eon
The Characterization of Earth Sediments using Radiative Transfer Models from Directional Hyperspectral Reflectance
Ph.D. Thesis Defense
Abstract: 

 

Remote sensing techniques are continuously being developed to extract physical information about the Earth's surface. Over the years, space-borne and airborne sensors have been used for the characterization of surface sediments. Spectral observations of sediments can be used to effectively identify the physical characteristics of the surface. Geophysical properties of a sediment surface such as its density, grain size, surface roughness, and moisture content can influence the angular dependence of spectral signatures, specifically the Bidirectional Reflectance Distribution Function (BRDF). Models based on radiative transfer equations can relate the angular dependence of the reflectance to these geophysical variables. Extraction of these parameters can provide a better understanding of the Earth's surface, and play a vital role in various environmental modeling processes. In this work, we focused on retrieving two of these geophysical properties of earth sediments, the bulk density and the soil moisture content (SMC), using directional hyperspectral reflectance. We proposed a modification to the radiative transfer model developed by Hapke to retrieve sediment bulk density. The model was verified under controlled experiments within a laboratory setting, followed by retrieval of the sediment density from different remote sensing platforms: airborne, space-borne and a ground-based imaging sensor. The SMC was characterized using the physics based multilayer radiative transfer model of soil reflectance or MARMIT. The MARMIT model was again validated from experiments performed in our controlled laboratory setting using several different soil samples across the United States; followed by applying the model in mapping SMC from imagery data collected by an Unmanned Aerial System (UAS) based hyperspectral sensor.

August 2, 2019 at 10:00am - MS Thesis Defense - Daniel L. Edwards - Evaluation of Single-Pixel Tunable Fabry-Perot filters for Optical Imaging

CAR1275
August 2, 2019 at 10:00am
Daniel L. Edwards
Evaluation of Single-Pixel Tunable Fabry-Perot filters for Optical Imaging
MS Thesis Defense
Abstract: 

Abstract

 

The Fabry-Perot interferometer (FPI) is a well-developed and widely used tool to control and measure wavelengths of light. In optical imaging applications, there is often a need for systems with compact, integrated, and widely tunable spectral filtering capabilities. We evaluate the performance of a novel tunable MEMS  (Micro-Electro-Mechanical System) Fabry-Perot (FP) filter device intended to be monolithically integrated over each pixel of a focal plane array. This array of individually tunable FPIs have been designed to operate across the visible light spectrum from 400-750 nm. This design can give rise to a new line of compact spectrometers with fewer moving parts and the ability to perform customizable filtering schemes at the hardware level. The original design was modeled, simulated, and fabricated but not tested and evaluated. We perform optical testing on the fabricated devices to measure the spectral resolution and wavelength tunability of these FP etalons. We collect the transmission spectrum through the FP etalons to evaluate their quality, finesse, and free spectral range. We then attempt to thermally actuate the expansion mechanisms in the FP cavity to validate tunability across the visible spectrum. The simulated design materials set was modified to create a more practical device for fabrication in a standard CMOS/MEMS foundry. Unfortunately, metal thin film stress and step coverage issues resulted in device heater failures, preventing actuation. This FP filter array design proves to be a viable manufacturing design for an imaging focal plane with individually tunable pixels. However, it will require more optimization and extensive electrical, optical, thermal, and mechanical testing when integrated with a detector array.

August 2, 2019 at 1:00am - MS Thesis Defense - Anjali K. Jogeshwar - Tool for the analysis of human interaction with two-dimensional printed imagery

DIRS Laboratory 76-3215
August 2, 2019 at 1:00am
Anjali K. Jogeshwar
Tool for the analysis of human interaction with two-dimensional printed imagery
MS Thesis Defense
Abstract: 

Abstract

 

 

The study of human vision must include our interaction with objects. These studies can include behavior modeling, understanding visual attention, and motor guidance, and enhancing user experiences. But all these studies have one thing in common. To analyze the data in detail, researchers typically have to analyze video data frame by frame. Real world interaction data often comprises of data from both eye and hand. Analyzing such data frame by frame can get very tedious and time-consuming. A calibrated scene video from an eye-tracker captured at 120 Hz for 3 minutes has over 21,000 frames to be analyzed.

 

Automating the process is crucial to allow interaction research to proceed. Research in object recognition over the last decade now allows eye-movement data to be analyzed automatically to determine what a subject is looking at and for how long. I will describe my research in which I developed a pipeline to help researchers analyze interaction data including eye and hand. Inspired by a semi-automated pipeline for analyzing eye tracking data, I have created a pipeline for analyzing hand grasp along with gaze. Putting both pipelines together can help researchers analyze interaction data.

 

The hand-grasp pipeline detects skin to locate the hands, then determines what object (if any) the hand is over, and where the thumbs/fingers occluded that object. I also compare identification with recognition throughout the pipeline. The current pipeline operates on independent frames; future work will extend the pipeline to take advantage of the dynamics of natural interactions.

 

July 31, 2019 at 10:30am - Ph.D. Thesis Defense - Lauren Taylor - Ultrafast Laser Polishing for Optical Fabrication

CAR1275
July 31, 2019 at 10:30am
Lauren Taylor
Ultrafast Laser Polishing for Optical Fabrication
Ph.D. Thesis Defense
Abstract: 

Abstract

 

Next-generation imaging systems for consumer electronics, AR/VR, and space telescopes require weight, size, and cost reduction while maintaining high optical performance. Freeform optics with rotationally asymmetric surface geometries condense the tasks of several spherical optics onto a single element. They are currently fabricated by ultraprecision sub-aperture tools like diamond turning and magnetorheological finishing, but the final surfaces contain mid-spatial-frequency tool marks and form errors which fall outside optical tolerances. Therefore, there remains a need for disruptive tools to generate optic-quality freeform surfaces.

This thesis work investigates a high precision, flexible, non-contact methodology for optics polishing using femtosecond ultrafast lasers. Femtosecond lasers enable ablation-based material removal on substrates with widely different optical properties owing to their high GW-TW/cm2 peak intensities. For polishing, it is imperative for the laser to precisely remove material while minimizing the onset of detrimental thermal and structural surface artifacts such as melting and oxidation. However, controlling the laser interaction is a non-trivial task due to the competing influence of nonthermal melting, ablation, electron/lattice thermalization, heat accumulation, and thermal melting phenomena occurring on femtosecond to microsecond timescales.

Femtosecond laser-material interaction was investigated from the fundamental theoretical and experimental standpoints to determine a methodology for optic-quality polishing of optical / photonic materials. Numerical heat accumulation and two-temperature models were constructed to simulate femtosecond laser processing and predict material-specific laser parameter combinations capable of achieving ablation with controlled thermal impact. A tunable femtosecond laser polishing system was established. Polishing of germanium substrates was successfully demonstrated using the model-determined laser parameters, achieving controllable material removal while maintaining optical surface quality. The established polishing technique opens a viable path for sub-aperture, optic quality finishing of optical / photonic materials, capable of scaling up to address complex polishing tasks towards freeform optics fabrication.

 

July 12, 2019 at 10:00am - Ph.D. Thesis Defense - Keegan McCoy - Methodology for the Integration of Optomechanical System Software Models with a Radiative Transfer Image Simulation Model

DIRS Laboratory 76-3215
July 12, 2019 at 10:00am
Keegan McCoy
Methodology for the Integration of Optomechanical System Software Models with a Radiative Transfer Image Simulation Model
Ph.D. Thesis Defense
Abstract: 

Abstract

 

Stray light, any unwanted radiation that reaches the focal plane of an optical system, reduces image contrast, creates false signals or obscures faint ones, and ultimately degrades radiometric accuracy. These detrimental effects can have a profound impact on the usability of collected remote sensing data, which must be radiometrically calibrated to be useful for scientific applications (e.g. Landsat imagery).  Understanding the full impact of stray light on data scientific utility is of particular concern for lower cost, more compact imaging systems, which inherently provide fewer opportunities for stray light control. To address these concerns, this research presents a general methodology for integrating point spread function (PSF) and stray light performance data from optomechanical system models in optical engineering software with a physics-based image and data simulation model.  This integration method effectively emulates the PSF and stray light performance of a detailed system model within a high-fidelity scene, thus producing realistic simulated imagery.  This novel capability enables system trade studies and sensitivity analyses to be conducted on parameters of interest, including those that influence stray light, by analyzing their quantitative impact on user applications when imaging realistic operational scenes, while also informing the writing of system requirements.  In addition to detailing the methodology’s radiometric framework, we describe the collection of necessary raytrace data from an optomechanical system model (in this case, using FRED Optical Engineering Software), and present PSF and stray light component validation tests through imaging Digital Imaging and Remote Sensing Image Generation (DIRSIG) model test scenes.  The integration method’s ability to produce quantitative metrics to assess the impact of stray light-focused system trade studies on user applications is then demonstrated using a Cassegrain telescope model and stray light-stressing coastal scene under various system and scene conditions.

July 11, 2019 at 9:30am - Ph.D. Thesis Defense - Sanghui Han - Utility Analysis for Optimizing Compact Adaptive Spectral Imaging Systems for Subpixel Target Detection Applications

DIRS Laboratory 76-3215
July 11, 2019 at 9:30am
Sanghui Han
Utility Analysis for Optimizing Compact Adaptive Spectral Imaging Systems for Subpixel Target Detection Applications
Ph.D. Thesis Defense
Abstract: 

Abstract

 

Since the development of spectral imaging systems where we transitioned from panchromatic, single band images to multiple bands, we have pursued a way to evaluate the quality of these images. We now have imaging systems capable of collecting images with hundreds of contiguous bands across the reflective portion of the electromagnetic spectrum that allows us to extract information at sub-pixel levels. However, prediction and assessment methods for spectral images, analyzing quality, and what this entails have yet to form a solid framework. In this research we find trends within the spectral image utility trade space, first by predicting the performance for a few combinations of targets and backgrounds, then generate images of the targets and background in a real scene that we can use to assess the utility and compare with the prediction. This allows us to find a relationship between utility, spectral separability, and scene complexity to optimize the design of compact spectral imaging systems with adaptive band selection capabilities that is focused on the mission and practical for real operations.

July 11, 2019 at 1:30am - Ph.D. Thesis Defense - Tyler Peery - System Design Considerations for a Low-Intensity Hyperspectral Imager of Sensitive Cultural Heritage Manuscripts

DIRS Laboratory 76-3215
July 11, 2019 at 1:30am
Tyler Peery
System Design Considerations for a Low-Intensity Hyperspectral Imager of Sensitive Cultural Heritage Manuscripts
Ph.D. Thesis Defense
Abstract: 

Abstract

 

Cultural heritage spectral imaging is becoming more prevalent with the increased affordability of more complex imaging systems, including multi- and hyperspectral imaging (MSI and HSI) systems.  HSI systems tend to sacrifice spatial pixels for additional spectral information, and diffracting the light into its constituent parts reduces an HSI signal one to two orders of magnitude relative to typical RGB or MSI framing cameras.  Requiring more illumination can be burdensome in cultural heritage imaging, where potentially sensitive targets are protected under various illumination standards.  In this research, spatial resolution is used as a trade space, increasing ground sample distance (GSD) to improve signal-to-noise ratios (SNRs).  Panchromatic sharpening is applied to recover sacrificed spatial detail, fusing together a high-spatial resolution panchromatic image with the HSI image.  A 14th-century manuscript was imaged with an HSI detector under museum lighting levels of 50 lux, based on the United Kingdom standard for cultural heritage display at museums, PAS 198:2012.  Detector systems are investigated that can utilize this technique, as well as additional methods of data capture to assist in the processing of sensitive cultural heritage documents while preserving their physical condition.

July 9, 2019 at 11:00am - Ph.D. Thesis Defense - Kamal Jnawali - Automatic Cancer Tissue Detection Using Multispectral Photoacoustic Imaging

CAR2155
July 9, 2019 at 11:00am
Kamal Jnawali
Automatic Cancer Tissue Detection Using Multispectral Photoacoustic Imaging
Ph.D. Thesis Defense
Abstract: 

Abstract

 

Convolutional neural networks (CNNs) have become increasingly popular in recent years because of their ability to tackle complex learning problems such as object detection, and localization.  They are being used for a variety of tasks, such as tissue abnormalities detection and localization, with an accuracy that comes close to the level of human predictive performance in medical imaging. The success is primarily due to the ability of CNNs to extract the discriminant features at multiple levels of abstraction.

Photoacoustic (PA) imaging is a promising new modality that is gaining significant clinical potential. The availability of a large dataset of three-dimensional PA images of ex-vivo human prostate and thyroid specimens has facilitated this current study aimed at evaluating the efficacy of CNN for cancer diagnosis. In PA imaging, a short pulse of near-infrared laser light is sent into the tissue, but the image is created by focusing the ultrasound waves that are photoacoustically generated due to the absorption of light, thereby mapping the optical absorption in the tissue. By choosing multiple wavelengths of laser light, multispectral photoacoustic (MPA) images of the same tissue specimen can be obtained. The objective of this thesis is to implement deep learning architecture for cancer detection using the MPA image dataset.

In this study, we built and examined a fully automated deep learning framework that learns to detect and localize cancer regions in a given specimen entirely from its MPA image dataset. The dataset for this work consisted of samples with size ranging from 12 × 45 × 200 pixels to 64 × 64 × 200 pixels at five wavelengths namely, 760 nm, 800 nm, 850 nm, 930 nm, and 970 nm.

The proposed algorithms first extract features using convolutional kernels and then identify presence of cancer region in the tissue using the softmax function, the last layer of the network. The area under curve (AUC) was calculated to evaluate the performance of each algorithm with very promising results. To the best of our knowledge, this is one of the first examples of the application of deep 3D CNN to a large cancer MPA dataset.

While previous efforts using the same dataset involved decision making using mathematically extracted image features, this work demonstrates that this process can be automated without any significant loss in accuracy. Another major contribution of this work has been to demonstrate that both prostate and thyroid datasets can be combined to produce improved results for cancer diagnosis.

 

April 26, 2019 at 1:00pm - Ph.D. Thesis Defense - Mandy Nevins - Point Spread Function Determination in the Scanning Electron Microscope and its Application in Restoring Images Acquired at Low Voltage

DIRS Laboratory 76-3215
April 26, 2019 at 1:00pm
Mandy Nevins
Point Spread Function Determination in the Scanning Electron Microscope and its Application in Restoring Images Acquired at Low Voltage
Ph.D. Thesis Defense
Abstract: 

Electron microscopes have the capability to examine specimens at much finer detail than a traditional light microscope. Higher electron beam voltages correspond to higher resolution, but some specimens are sensitive to beam damage and charging at high voltages. In the scanning electron microscope (SEM), low voltage imaging is beneficial for viewing biological, electronic, and other beam-sensitive specimens. However, image quality suffers at low voltage from reduced resolution, lower signal-to-noise, and increased visibility of beam-induced contamination. Most solutions for improving low voltage SEM imaging require specialty hardware, which can be costly or system-specific. Point spread function (PSF) deconvolution for image restoration could provide a software solution that is cost-effective and microscope-independent with the ability to produce image quality improvements comparable to specialty hardware systems. Measuring the PSF (i.e., electron probe) of the SEM has been a notoriously difficult task until now. The goals of this work are to characterize the capabilities and limitations of a novel SEM PSF determination method that uses nanoparticle dispersions to obtain a two-dimensional measurement of the PSF, and to evaluate the utility of the measured PSF for restoration of low voltage SEM images. The presented results are meant to inform prospective and existing users of this technique about its fundamental theory, best operating practices, the expected behavior of output PSFs and image restorations, and factors to be aware of during interpretation of results.

January 16, 2019 at 9:30am - Ph.D. Thesis Defense - KAMRAN BINAEE - Study of Human Eye-Hand Coordination Using Machine Learning Techniques in a Virtual Reality Setup

DIRS Laboratory 76-3215
January 16, 2019 at 9:30am
KAMRAN BINAEE
Study of Human Eye-Hand Coordination Using Machine Learning Techniques in a Virtual Reality Setup
Ph.D. Thesis Defense
Abstract: 

Theories of visually guided action are characterized as closed-loop control in the presence of reliable sources of visual information, and predictive control to compensate for visuomotor delay and temporary occlusion. However, prediction is not well understood. To investigate, a series of studies was designed to characterize the role of predictive strategies in humans as they perform visually guided actions, and to guide the development of computational models that capture these strategies. During data collection, subjects immersed in virtual reality (VR) were tasked with using a paddle to intercept a virtual ball. To force subjects into a predictive mode of control, the ball was occluded or made invisible for a portion of its 3D parabolic trajectory. The subject’s gaze, hand and head movements were recorded during the performance. To improve the quality of gaze estimation, new algorithms were developed for the measurement and calibration of spatial and temporal errors of an eye tracking system.

The analysis focused on the subjects’ gaze and hand movements reveal that, when the temporal constraints of the task did not allow the subjects to use closed-loop control, they utilized a short-term predictive strategy. Insights gained through behavioral analysis were formalized into computational models of visual prediction using machine learning techniques. In one study, LSTM recurrent neural networks were utilized to explain how information is integrated and used to guide predictive movement of the hand and eyes. In a subsequent study, subject data was used to train an inverse reinforcement learning (IRL) model that captures the full spectrum of strategies from closed-loop to predictive control of gaze and paddle placement. A comparison of recovered reward values between occlusion and no-occlusion conditions revealed a transition from online to predictive control strategies within a single course of action. This work has shed new insights into predictive

strategies that guide our eye and hand movements.

December 18, 2018 at 10:00am - Ph.D. Thesis Defense - Kevan Donlon - On Interpixel Capacitive Coupling in Hybridized HgCdTe Arrays: Theory, Characterization and Correction

DIRS Laboratory 76-3215
December 18, 2018 at 10:00am
Kevan Donlon
On Interpixel Capacitive Coupling in Hybridized HgCdTe Arrays: Theory, Characterization and Correction
Ph.D. Thesis Defense
Abstract: 

 

 

Hybridization is a process by which detector arrays and read out circuitry can be independently fabricated and then bonded together, typically using indium bumps. This technique allows for the use of exotic detector materials such as HgCdTe for the desired spectral response while benefiting from established and proven silicon CMOS readout structures. However, the introduction of an intermediate layer composed of conductors (indium) and insulators (epoxy) results in a capacitive link between adjacent pixels.

This interpixel capacitance (IPC) results in charge collected on one pixel, giving rise to a change in voltage on the output node of adjacent pixels. In imaging arrays, this capacitance manifests itself as a blur, attenuating high spatial frequency information and causing single pixel events to be spread over a local neighborhood. Due to the nature of the electric fields in proximity to the depletion region of the diodes in the detector array, the magnitude of this capacitance changes as the diode depletes. This change in capacitance manifests itself as a change in fractional coupling. This results in a blur kernel that is non-homogeneous both spatially across the array and temporally from exposure to exposure, varying as a function of charge collected in each pixel. This signal dependent behavior invalidates underlying assumptions key for conventional deconvolution/deblurring techniques such as Weiner filtering or Lucy-Richardson deconvolution. As such, these techniques cannot be relied upon to restore scientific accuracy and appropriately solve this inverse problem.

This dissertation uses first principle physics simulations to elucidate the mechanisms of IPC, establishes a data processing technique which allows for characterization of IPC, formalizes and implements a nonlinear deconvolution method by which the effects of IPC can be undone, and examines the impact that IPC can have on scientific conclusions if left uncorrected.

 

 

December 17, 2018 at 10:00am - M.S. Thesis Defense - TIMOTHY RUPRIGHT - Multi-Modal Analysis of Deciduous Tree Stands Toward Ash Tree Inventory: Biomass Estimation and Genus-Level Discrimination In a Mixed Deciduous Forest

DIRS Laboratory 76-3215
December 17, 2018 at 10:00am
TIMOTHY RUPRIGHT
Multi-Modal Analysis of Deciduous Tree Stands Toward Ash Tree Inventory: Biomass Estimation and Genus-Level Discrimination In a Mixed Deciduous Forest
M.S. Thesis Defense
Abstract: 

The invasive species Agrilus planipennis (Emerald Ash Borer or EAB) is currently impacting ash trees in a large part of the continental United States.  One way of measuring the effect of this infestation on the US markets is to determine the spread of the species and the biomass destruction/loss due to this invasive pest.  In order to assess such impacts, it is necessary to determine how and where ash trees are located toward accurately measuring the relevant ash species biomass and tree count.

 

This study utilizes data captured over the campus of RIT in Rochester, NY.  Hyperspectral data, captured by SpecTIR, and discrete LiDAR data collected by an ALS 50 are used in an attempt to accomplish two tasks:  1) estimate ash biomass and 2) create a discriminant model to determine what types of trees (genera) are located within our surveyed plots.  We surveyed four deciduous plots on the RIT campus and integrated the surveyed areas, the LiDAR data, and the hyperspectral data into a single comprehensive dataset.  Our assessment incorporated different underlying models, including hyperspectral data only, LiDAR data only, and a combination of hyperspectral and LiDAR data.

 

The results indicate that we can predict biomass with an R2 value between 0.55-0.69, at an α=0.01 statistical threshold and an R2 value between 0.85-0.92 (α=0.05 threshold) with the best models.  The results indicate that smaller plot radius hyperspectral plus LiDAR and larger radius hyperspectral approaches scored best for R2 values, but the best RMSE was returned by the model utilizing the larger-radius hyperspectral data plus LiDAR returns. 

 

The genus-level classification analysis utilized a stepwise discriminant model to extract relevant variables, followed by a linear discriminant classification which classified each tree based on the stepwise results.  These models found that one-meter hyperspectral data plus LiDAR could accurately assess the genus level of the trees 86% of the time, with a KHAT score of 0.86.  User and producer accuracies on that model vary from 73-100%, depending on the genus.

 

This study contributes to the effort for combining hyperspectral and LiDAR data to assess deciduous tree stands.  Such an approach to biomass modeling is often used in coniferous forests with high accuracy; however, the variability in uneven-aged and complex deciduous forest typically leads to poorer structural assessment outcomes, even though such species are spectrally more differentiable. Results here indicate that utilizing more robust LiDAR scans (point density) and techniques (data fusion), these methods could yield valuable genus-level biomass or carbon maps per forest genus. Such maps in turn could prove useful to decision-makers from policy experts to conservationists.

 

 

December 7, 2018 at 8:00am - Ph.D. Thesis Defense - ZHAOYU CUI - System Engineering Analyses for the Study of Future Multispectral Land Imaging Satellite Sensors for Vegetation Monitoring

DIRS Laboratory 76-3215
December 7, 2018 at 8:00am
ZHAOYU CUI
System Engineering Analyses for the Study of Future Multispectral Land Imaging Satellite Sensors for Vegetation Monitoring
Ph.D. Thesis Defense
Abstract: 

  Vegetation monitoring is one of the key applications of earth observing systems. Landsat data have spatial resolution of 30 meters, moderate temporal coverage, and reasonable spectral sampling to capture key vegetation features. These characteristics of Landsat make it a good candidate for generating vegetation monitoring products. Recently, the next satellite in the Landsat series has been under consideration and different concepts have been proposed. In this research, we studied the impact on vegetation monitoring of two proposed potential design concepts: a wider field-of-view (FOV) instrument and the addition of red-edge spectral band(s). Three aspects were studied in this thesis.

First, inspired by the potential wider FOV design, the impacts of a detector relative spectral response (RSR) central wavelength shift effect at high angles of incidence (AOI) on the radiance signal were studied and quantified. Results indicated that the RSR shift effect was more significant in green, red and SWIR2 bands, and will cause a radiance difference exceeding sensor noise specifications in all bands except SWIR1 band.

Second, the impacts of the potential new wider angular observations on vegetation monitoring scientific products were studied. Both crop classification and biophysical parameter retrieval applications were studied using the simulation code DIRSIG and the canopy radiative transfer model PROSAIL. Results show that for single view observation based analysis, the new higher angular observations have limited influence. However, for situations where two different angular observations are available potentially from two platforms, up to 4% and 2.9% improvement for crop classification and leaf chlorophyll content retrieval were found.

Third, the benefits of a potential new design with red-edge band(s) in future Landsat instruments on agroecosystem leaf area index (LAI) and canopy chlorophyll content (CCC) retrieval were studied and quantified using a real dataset. Three major retrieval approaches were tested and results show that retrieval performance were slightly improved.

November 19, 2018 at 11:00am - Ph.D. Thesis Defense - Shagan Sah - Multi-Modal Deep Learning to Understand Vision and Language

DIRS Laboratory 76-3215
November 19, 2018 at 11:00am
Shagan Sah
Multi-Modal Deep Learning to Understand Vision and Language
Ph.D. Thesis Defense
Abstract: 

Developing intelligent agents that can perceive and understand the rich visual world around us has been a long-standing goal in the field of artificial intelligence.  In the last few years, significant progress has been made towards this goal and deep learning has been attributed to recent incredible advances in general visual and language understanding.  Convolutional neural networks have been used to learn image representations while recurrent neural networks have demonstrated the ability to generate text from visual stimuli.  In this thesis, we develop methods and techniques using hybrid convolutional and recurrent neural network architectures that connect visual data and natural language utterances.

 

Towards appreciating these methods, this work is divided into two broad groups.  Firstly, we introduce a general purpose attention mechanism modeled using a continuous function for video understanding.  The use of an attention based hierarchical approach along with automatic boundary detection advances state-of-the-art video captioning results.  We also develop techniques for summarizing and annotating long videos.  In the second part, we introduce architectures along with training techniques to produce a common connection space where natural language sentences are efficiently and accurately connected with visual modalities.  In this connection space, similar concepts lie close, while dissimilar concepts lie far apart, irrespective of their modality.  We discuss four modality transformations: visual to text, text to visual, visual to visual and text to text. We introduce a novel attention mechanism to align multi-modal embeddings which are learned through a multi-modal metric loss function.  The common vector space is shown to enable bidirectional generation of images and text.  The learned common vector space is evaluated on multiple image-text datasets for cross-modal retrieval and zero-shot recognition.  The models are shown to advance the state-of-the-art on tasks that require joint processing of images and natural language.

 

November 2, 2018 at 9:00am - Ph.D. Thesis Defense - ANTON TRAVINSKY - Evaluating the performance of digital micromirror devicEvaluating the performance of digital micromirror devices for use as slit masks in multi-object spectrometerses for use as slit masks in multi-object spectrometers

DIRS Laboratory 76-3215
November 2, 2018 at 9:00am
ANTON TRAVINSKY
Evaluating the performance of digital micromirror devicEvaluating the performance of digital micromirror devices for use as slit masks in multi-object spectrometerses for use as slit masks in multi-object spectrometers
Ph.D. Thesis Defense
Abstract: 

Multi-object spectrometers (MOSs) are extremely useful astronomical instruments that allow for spectral observations of up to several thousands of objects simultaneously by using an object input selector commonly referred to as slit mask. Studies performed with such instruments in the last three decades placed unique constraints on cosmology, large scale structure, galaxy evolution, and Galactic structure. Terrestrial MOSs use large discrete components for object selection, which, aside from not being transferable to space-based applications, are limited in both minimal slit width and minimal time required to reconfigure the slit mask to a new field of objects. There is a pressing need in remotely addressable and fast-re-configurable slit masks for allowing space-based instruments with MOS capabilities. Digital micromirror devices (DMDs) can be viable candidates for the role of remotely re-configurable slit mask in both terrestrial and space-based MOSs. These devices were originally developed by Texas Instruments (TI) for projection systems and are the core part of the TI digital light processing (DLP) technology. This work focused on assessing the suitability of DMDs to be used as slit masks in space-based astronomical MOSs. The results of typical pre-launch tests such as radiation testing, vibration testing, and mechanical shock testing suggest that commercially available DMDs are mechanically suitable for space-deployment. Series of tests to assess the performance and the behaviour of DMDs in cryogenic temperatures (down to 70 K) did not identify any problems with subjecting commercially available DMDs to such temperatures for extended periods of time. An early prototype of terrestrial DMD-based MOS (Rochester Institute of Technology Multi Object Spectrometer-RITMOS) was updated with a newer DMD model and tested through two deployments at the CEK Mees observatory in Naples, NY. The results of all experiments strongly suggest that DMDs are well-positioned to serve as slit masks in terrestrial MOS and to enable a new generation of space-based instruments - with MOS capabilities.


 

 

 

October 29, 2018 at 3:00am - Ph.D. Thesis Defense - ZICHAO HAN - The design and realization of a dual mode photoacoustic and ultrasound imaging camera

DIRS Laboratory 76-3215
October 29, 2018 at 3:00am
ZICHAO HAN
The design and realization of a dual mode photoacoustic and ultrasound imaging camera
Ph.D. Thesis Defense
Abstract: 

Prostate cancer is currently the second leading cause of cancer death in American men. Diagnosis of the disease is based on persisting elevated prostate-specific antigen (PSA) levels and suspicious lesion felt on digital rectal examination (DRE), prompting transrectal ultrasound (TRUS) imaging guided biopsy. This method, however, has long been criticized for its poor sensitivity in detecting cancerous lesions, leading to the fact that these biopsies generally are not targeted but systematic multi-core in nature that try to sample the entire gland. The thesis presents a new modality that, in combination of ultrasound (US) imaging with multi-wavelength photoacoustic (PA) imaging, improves the physician’s ability to locate the suspicious cancerous regions during biopsy.

Here, building further on the innovation of an acoustic lens based focusing technology for fast PA imaging, a novel concept with the use of a polyvinylidene fluoride (PVDF) film that incorporates US imaging into our existing PA imaging probe is presented. The method takes advantage of the lens based PA signal focusing technology, while simultaneously incorporates US imaging modality without interfering with the current PA imaging system design and structure. Simulation and experimental support on tissue equivalent phantoms is provided in detail. The thesis also elaborates on the signal-to-noise ratio (SNR) improvement of the US imaging component by driving the film with frequency modulated (FM) signals. In addition, a custom-designed US simulation software that is developed to explore and evaluate various system design options is discussed. The dual modality transrectal probe is only intended as a first step. The long term goal of the study is to facilitate locating the cancer region in-vivo with PA imaging, transfer it to co-registered US image, and use the real-time US imaging for needle guidance during biopsy.

October 18, 2018 at 1:00am - Ph.D. Thesis Defense - GREG BADURA - Studies on the Photometric Effect of Roughness

DIRS Laboratory 76-3215
October 18, 2018 at 1:00am
GREG BADURA
Studies on the Photometric Effect of Roughness
Ph.D. Thesis Defense
Abstract: 

A major focus of the Goniometer of Rochester Institute of Technology (GRIT) Laboratory is using Hapke’s photometric model to retrieve geophysical parameters of sediment surfaces from bidirectional reflectance measurements. An important parameter of the model is the mean slope angle roughness metric.  A series of laboratory experiments was performed to isolate the mean slope angle parameter and correlate the parameter to observed spectral phenomena. In the first experiment, BRF and surface digital elevation measurements were performed on dry clay sediments of varying roughness. The Hapke mean slope angle parameter was derived for each sample. We found that spectral variability, especially near spectral absorption features correlates strongly with quantified measures of surface roughness. This suggests that roughness parameters used in some radiative transfer models, such as the Hapke model, might be directly determined from the spectrum itself. In the second experiment, assumptions made by Hapke in deriving the photometric roughness correction are tested by generating sand samples of constant sample density and grain size distribution, but varying roughness. The type of roughness was also classified into two different cases: “wave-like” and “grid-like.” The “grid-like” roughness parameter meets the criterion outlined by Hapke in his correction factor, while the “wave-like” roughness parameter does not. By experimentally forward propagating Hapke’s roughness correction factor for the “grid-like” roughness samples, we find that the Shadowing function potentially does not account for centimeter scale roughness accurately. By examining the bidirectional reflectance measurements of the “wave-like” roughness at different orientations to the principal plane, we found evidence that the multiple scattering term should be incorporated into future correction factors for surface roughness. A third experiment that outlines a processing chain for deriving structural parameters of marshgrass vegetation using similar computer vision and data science techniques will also be discussed.

October 17, 2018 at 2:00am - Ph.D. Thesis Defense - CHI ZHANG - Evolution of A Common Vector Space Approach to Computer Vision Problems

DIRS Laboratory 76-3215
October 17, 2018 at 2:00am
CHI ZHANG
Evolution of A Common Vector Space Approach to Computer Vision Problems
Ph.D. Thesis Defense
Abstract: 

 

 

The concept of the Common Vector Space (CVS) is introduced in this research to deal with multi-modal conversion problems. Focusing on image and text, image (or video frame) understanding can be achieved using CVS. With this concept, modality generation and other relevant applications are also considered in this research, for example, automatic image description, text paraphrasing, etc. Specifically, video sequences can be modeled by Recurrent Neural Networks (RNN), the greater depth of the RNN leads to smaller error, but that makes the gradient in the network unstable during training. To overcome this problem, a Batch-Normalized Recurrent Highway Network (BNRHN) was developed and tested on the image captioning (image-to-text) task. In BNRHN, the highway layers are incorporated with batch normalization which diminish the gradient vanishing and exploding problem. In addition, a sentence-to-vector encoding framework that is suitable for advanced natural language processing is developed. This semantic text embedding makes use of the encoder-decoder model which is trained on sentence paraphrase pairs (text-to-text). With this scheme, the latent representation of the text is shown to encode sentences with common semantic information with similar vector representations. In addition to image-to-text and text-to-text, an image generation model is developed to generate image from text (text-to-image) or another image (image-to-image) based on the semantics of the content. The developed model, which refers to the Multi-Modal Vector Representation (MMVR), builds and encodes different modalities into a common vector space that achieve the goal of keeping semantics and conversion between text and image bidirectional. In theory, this method works not only on text and image, but also can be generalized to other modalities, such as video and audio. The characteristics and performance are supported by both theoretical analysis and experimental results. Interestingly, the MMVR model is one of the many possible ways to build CVS. In the final stages of this research, a simple and straightforward framework to build CVS, which is considered as an alternative to the MMVR model, is presented.

Pages