Figure Open Access

Unsupervised Data Fusion with Deeper Perspective: A Novel Multi-Sensor Deep Clustering Algorithm

Rafiezadeh Shahi, Kasra; Ghamisi, Pedram; Rasti, Behnood; Scheunders, Paul; Gloaguen, Richard


DataCite XML Export

<?xml version='1.0' encoding='utf-8'?>
<resource xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns="http://datacite.org/schema/kernel-4" xsi:schemaLocation="http://datacite.org/schema/kernel-4 http://schema.datacite.org/meta/kernel-4.1/metadata.xsd">
  <identifier identifierType="DOI">10.14278/rodare.1312</identifier>
  <creators>
    <creator>
      <creatorName>Rafiezadeh Shahi, Kasra</creatorName>
      <givenName>Kasra</givenName>
      <familyName>Rafiezadeh Shahi</familyName>
      <nameIdentifier nameIdentifierScheme="ORCID" schemeURI="http://orcid.org/">0000-0003-3666-4223</nameIdentifier>
      <affiliation>Helmholtz-Zentrum Dresden-Rossendorf, Helmholtz Institute Freiberg for Resource Technology</affiliation>
    </creator>
    <creator>
      <creatorName>Ghamisi, Pedram</creatorName>
      <givenName>Pedram</givenName>
      <familyName>Ghamisi</familyName>
      <nameIdentifier nameIdentifierScheme="ORCID" schemeURI="http://orcid.org/">0000-0003-1203-741X</nameIdentifier>
      <affiliation>Helmholtz-Zentrum Dresden-Rossendorf, Helmholtz Institute Freiberg for Resource Technology</affiliation>
    </creator>
    <creator>
      <creatorName>Rasti, Behnood</creatorName>
      <givenName>Behnood</givenName>
      <familyName>Rasti</familyName>
      <nameIdentifier nameIdentifierScheme="ORCID" schemeURI="http://orcid.org/">0000-0002-1091-9841</nameIdentifier>
      <affiliation>Helmholtz-Zentrum Dresden-Rossendorf, Helmholtz Institute Freiberg for Resource Technology</affiliation>
    </creator>
    <creator>
      <creatorName>Scheunders, Paul</creatorName>
      <givenName>Paul</givenName>
      <familyName>Scheunders</familyName>
      <nameIdentifier nameIdentifierScheme="ORCID" schemeURI="http://orcid.org/">0000-0003-2447-4772</nameIdentifier>
      <affiliation>Imec-Visionlab, department of Physics, University of Antwerp</affiliation>
    </creator>
    <creator>
      <creatorName>Gloaguen, Richard</creatorName>
      <givenName>Richard</givenName>
      <familyName>Gloaguen</familyName>
      <nameIdentifier nameIdentifierScheme="ORCID" schemeURI="http://orcid.org/">0000-0002-4383-473X</nameIdentifier>
      <affiliation>Helmholtz-Zentrum Dresden-Rossendorf, Helmholtz Institute Freiberg for Resource Technology</affiliation>
    </creator>
  </creators>
  <titles>
    <title>Unsupervised Data Fusion with Deeper Perspective: A Novel Multi-Sensor Deep Clustering Algorithm</title>
  </titles>
  <publisher>Rodare</publisher>
  <publicationYear>2021</publicationYear>
  <dates>
    <date dateType="Issued">2021-12-06</date>
  </dates>
  <resourceType resourceTypeGeneral="Image">Figure</resourceType>
  <alternateIdentifiers>
    <alternateIdentifier alternateIdentifierType="url">https://rodare.hzdr.de/record/1312</alternateIdentifier>
  </alternateIdentifiers>
  <relatedIdentifiers>
    <relatedIdentifier relatedIdentifierType="URL" relationType="IsIdenticalTo">https://www.hzdr.de/publications/Publ-33632</relatedIdentifier>
    <relatedIdentifier relatedIdentifierType="DOI" relationType="IsVersionOf">10.14278/rodare.1311</relatedIdentifier>
    <relatedIdentifier relatedIdentifierType="URL" relationType="IsPartOf">https://rodare.hzdr.de/communities/rodare</relatedIdentifier>
  </relatedIdentifiers>
  <rightsList>
    <rights rightsURI="https://creativecommons.org/licenses/by/4.0/legalcode">Creative Commons Attribution 4.0 International</rights>
    <rights rightsURI="info:eu-repo/semantics/openAccess">Open Access</rights>
  </rightsList>
  <descriptions>
    <description descriptionType="Abstract">&lt;p&gt;The ever-growing developments in technology to capture different types of image data (e.g., hyperspectral imaging and Light Detection and Ranging (LiDAR)-derived digital surface model (DSM)), along with new processing techniques, have led to a rising interest in imaging applications for Earth observation. However, analyzing such datasets in parallel, remains a challenging task. In this paper, we propose a multi-sensor deep clustering (MDC) algorithm for the joint processing of multi-source imaging data. The architecture of MDC is inspired by autoencoder (AE)-based networks. The MDC paradigm includes three parallel networks, a spectral network using an autoencoder structure, a spatial network using a convolutional autoencoder structure, and lastly, a fusion network that reconstructs the concatenated image information from the concatenated latent features from the spatial and spectral network. The proposed algorithm combines the reconstruction losses obtained by the aforementioned networks to optimize the parameters (i.e., weights and bias) of all three networks simultaneously. To validate the performance of the proposed algorithm, we use two multi-sensor datasets from different applications (i.e., geological and rural sites) as benchmarks. The experimental results confirm the superiority of our proposed deep clustering algorithm compared to a number of state-of-the-art clustering algorithms. The code will be available at: https://github.com/Kasra2020/MDC.&lt;/p&gt;</description>
  </descriptions>
</resource>
178
123
views
downloads
All versions This version
Views 178178
Downloads 123123
Data volume 13.0 MB13.0 MB
Unique views 122122
Unique downloads 8888

Share

Cite as