Software Open Access

Data synchronizator of Where2test pipeline

Abdussalam, Wildan


JSON Export

{
  "conceptdoi": "10.14278/rodare.1500", 
  "id": 1946, 
  "files": [
    {
      "checksum": "md5:273411ded3a7945891b6650a8d3d9c37", 
      "type": "zip", 
      "size": 91123764, 
      "key": "MigrateWhere2test_2.0Unix.zip", 
      "bucket": "b1ab38f9-21d9-4811-ae2f-09957aa940d0", 
      "links": {
        "self": "https://rodare.hzdr.de/api/files/b1ab38f9-21d9-4811-ae2f-09957aa940d0/MigrateWhere2test_2.0Unix.zip"
      }
    }, 
    {
      "checksum": "md5:d314c9b917e2f6f24c686a29c1fda4a9", 
      "type": "zip", 
      "size": 93215502, 
      "key": "MigrateWhere2test_2.0Win.zip", 
      "bucket": "b1ab38f9-21d9-4811-ae2f-09957aa940d0", 
      "links": {
        "self": "https://rodare.hzdr.de/api/files/b1ab38f9-21d9-4811-ae2f-09957aa940d0/MigrateWhere2test_2.0Win.zip"
      }
    }, 
    {
      "checksum": "md5:a363c2610db122cede90192c205a6a0a", 
      "type": "txt", 
      "size": 180, 
      "key": "requirements.txt", 
      "bucket": "b1ab38f9-21d9-4811-ae2f-09957aa940d0", 
      "links": {
        "self": "https://rodare.hzdr.de/api/files/b1ab38f9-21d9-4811-ae2f-09957aa940d0/requirements.txt"
      }
    }, 
    {
      "checksum": "md5:a0897ba0e777d7890e717f3962f8704f", 
      "type": "zip", 
      "size": 273324310, 
      "key": "src.zip", 
      "bucket": "b1ab38f9-21d9-4811-ae2f-09957aa940d0", 
      "links": {
        "self": "https://rodare.hzdr.de/api/files/b1ab38f9-21d9-4811-ae2f-09957aa940d0/src.zip"
      }
    }, 
    {
      "checksum": "md5:bd7ebb7fe0999509a2a535d1695d022d", 
      "type": "sql", 
      "size": 8128, 
      "key": "w2testRegion.sql", 
      "bucket": "b1ab38f9-21d9-4811-ae2f-09957aa940d0", 
      "links": {
        "self": "https://rodare.hzdr.de/api/files/b1ab38f9-21d9-4811-ae2f-09957aa940d0/w2testRegion.sql"
      }
    }
  ], 
  "owners": [
    517
  ], 
  "updated": "2022-11-10T14:16:18.353883+00:00", 
  "stats": {
    "volume": 1830762308.0, 
    "unique_downloads": 17.0, 
    "version_unique_downloads": 33.0, 
    "unique_views": 79.0, 
    "downloads": 38.0, 
    "version_unique_views": 152.0, 
    "version_views": 295.0, 
    "version_downloads": 64.0, 
    "version_volume": 3968330281.0, 
    "views": 138.0
  }, 
  "conceptrecid": "1500", 
  "links": {
    "badge": "https://rodare.hzdr.de/badge/doi/10.14278/rodare.1946.svg", 
    "doi": "https://doi.org/10.14278/rodare.1946", 
    "conceptbadge": "https://rodare.hzdr.de/badge/doi/10.14278/rodare.1500.svg", 
    "conceptdoi": "https://doi.org/10.14278/rodare.1500", 
    "bucket": "https://rodare.hzdr.de/api/files/b1ab38f9-21d9-4811-ae2f-09957aa940d0", 
    "html": "https://rodare.hzdr.de/record/1946", 
    "latest": "https://rodare.hzdr.de/api/records/1946", 
    "latest_html": "https://rodare.hzdr.de/record/1946"
  }, 
  "created": "2022-11-10T13:03:07.635160+00:00", 
  "doi": "10.14278/rodare.1946", 
  "revision": 3, 
  "metadata": {
    "related_identifiers": [
      {
        "scheme": "url", 
        "identifier": "https://www.hzdr.de/publications/Publ-34430", 
        "relation": "isIdenticalTo"
      }, 
      {
        "scheme": "doi", 
        "identifier": "10.14278/rodare.1500", 
        "relation": "isVersionOf"
      }
    ], 
    "license": {
      "id": "CC-BY-4.0"
    }, 
    "communities": [
      {
        "id": "health"
      }, 
      {
        "id": "hzdr"
      }, 
      {
        "id": "rodare"
      }
    ], 
    "publication_date": "2022-11-10", 
    "access_right_category": "success", 
    "version": "2.0.0", 
    "relations": {
      "version": [
        {
          "is_last": true, 
          "last_child": {
            "pid_type": "recid", 
            "pid_value": "1946"
          }, 
          "index": 1, 
          "count": 2, 
          "parent": {
            "pid_type": "recid", 
            "pid_value": "1500"
          }
        }
      ]
    }, 
    "access_right": "open", 
    "description": "<p>Software to synchonise the data between various data sources and casus database server. For Unix users please use&nbsp;MigrateWhere2test_2.0Unix.zip and for WIndows users please use&nbsp;MigrateWhere2test_2.0Win.zip. In order to use the scripts, please use the following instructions:</p>\n\n<p>Windows</p>\n\n<p>1. Create the postgreq sql database and set the port 5432.</p>\n\n<p>2. Apply&nbsp;<a href=\"https://rodare.hzdr.de/api/files/0662e0ae-224f-47ea-9f3d-cf0491a11b04/w2testRegion.sql\">w2testRegion.sql</a>&nbsp;to the Postgresql database. It creates the schema of the database.</p>\n\n<p>3. Create folder C:\\Workspaces and unzip the unix file.&nbsp;</p>\n\n<p>4. Create folder in workspaces, com.com.casus.env.where2test.migration\\COM_CASUS_WHERE2TEST_MIGRATION and then unzip the source file inside&nbsp;COM_CASUS_WHERE2TEST_MIGRATION.&nbsp;</p>\n\n<p>5. Install requirement.txt. We use some python scripts for downloading and cleaning the data</p>\n\n<p>6. Set the memory on the file&nbsp;MigrateWhere2test_run.bat&nbsp;minimal to 13 GB</p>\n\n<p>7. Set run Develop and run the .bat&nbsp;file on the folder&nbsp;MigrateWhere2test_2.0Unix to run in localhost.</p>\n\n<p>Unix</p>\n\n<p>1. Create PostgreSQL with port 32771.</p>\n\n<p>2. Apply&nbsp;<a href=\"https://rodare.hzdr.de/api/files/0662e0ae-224f-47ea-9f3d-cf0491a11b04/w2testRegion.sql\">w2testRegion.sql</a>&nbsp;to the Postgresql database. It creates the schema of the database.<br>\n3. Create folder /home/wildan/Workspaces and unzip the unix file.&nbsp;</p>\n\n<p>4. Open the file&nbsp;MigrateWhere2test/MigrateWhere2test_run.sh and change the mode &quot;Default&quot; by &quot;Production&quot;</p>\n\n<p>5. Create folder in workspaces, com.com.casus.env.where2test.migration.unix/COM_CASUS_WHERE2TEST_MIGRATION and then unzip the source file inside&nbsp;COM_CASUS_WHERE2TEST_MIGRATION.&nbsp;</p>\n\n<p>6. Install requirement.txt. We use some python scripts for downloading and cleaning the data</p>\n\n<p>7. Set the memory on the file&nbsp;MigrateWhere2test_run.sh minimal to 13 GB</p>\n\n<p>8. run the MigrateWhere2test_run.sh in the &quot;Production&quot; mode.</p>\n\n<p>&nbsp;</p>", 
    "creators": [
      {
        "name": "Abdussalam, Wildan", 
        "orcid": "0000-0002-4948-3934", 
        "affiliation": "Casus"
      }
    ], 
    "doc_id": "1", 
    "keywords": [
      "data pipeline"
    ], 
    "title": "Data synchronizator of Where2test pipeline", 
    "doi": "10.14278/rodare.1946", 
    "pub_id": "34430", 
    "language": "eng", 
    "resource_type": {
      "title": "Software", 
      "type": "software"
    }
  }
}
295
64
views
downloads
All versions This version
Views 295138
Downloads 6438
Data volume 4.0 GB1.8 GB
Unique views 15279
Unique downloads 3317

Share

Cite as