Software Open Access

Data synchronizator of Where2test pipeline

Abdussalam, Wildan


JSON Export

{
  "links": {
    "badge": "https://rodare.hzdr.de/badge/doi/10.14278/rodare.1946.svg", 
    "doi": "https://doi.org/10.14278/rodare.1946", 
    "conceptbadge": "https://rodare.hzdr.de/badge/doi/10.14278/rodare.1500.svg", 
    "conceptdoi": "https://doi.org/10.14278/rodare.1500", 
    "bucket": "https://rodare.hzdr.de/api/files/b1ab38f9-21d9-4811-ae2f-09957aa940d0", 
    "html": "https://rodare.hzdr.de/record/1946", 
    "latest": "https://rodare.hzdr.de/api/records/1946", 
    "latest_html": "https://rodare.hzdr.de/record/1946"
  }, 
  "revision": 3, 
  "id": 1946, 
  "owners": [
    517
  ], 
  "updated": "2022-11-10T14:16:18.353883+00:00", 
  "metadata": {
    "pub_id": "34430", 
    "access_right": "open", 
    "relations": {
      "version": [
        {
          "last_child": {
            "pid_value": "1946", 
            "pid_type": "recid"
          }, 
          "parent": {
            "pid_value": "1500", 
            "pid_type": "recid"
          }, 
          "count": 2, 
          "is_last": true, 
          "index": 1
        }
      ]
    }, 
    "version": "2.0.0", 
    "title": "Data synchronizator of Where2test pipeline", 
    "doi": "10.14278/rodare.1946", 
    "publication_date": "2022-11-10", 
    "related_identifiers": [
      {
        "identifier": "https://www.hzdr.de/publications/Publ-34430", 
        "relation": "isIdenticalTo", 
        "scheme": "url"
      }, 
      {
        "identifier": "10.14278/rodare.1500", 
        "relation": "isVersionOf", 
        "scheme": "doi"
      }
    ], 
    "description": "<p>Software to synchonise the data between various data sources and casus database server. For Unix users please use&nbsp;MigrateWhere2test_2.0Unix.zip and for WIndows users please use&nbsp;MigrateWhere2test_2.0Win.zip. In order to use the scripts, please use the following instructions:</p>\n\n<p>Windows</p>\n\n<p>1. Create the postgreq sql database and set the port 5432.</p>\n\n<p>2. Apply&nbsp;<a href=\"https://rodare.hzdr.de/api/files/0662e0ae-224f-47ea-9f3d-cf0491a11b04/w2testRegion.sql\">w2testRegion.sql</a>&nbsp;to the Postgresql database. It creates the schema of the database.</p>\n\n<p>3. Create folder C:\\Workspaces and unzip the unix file.&nbsp;</p>\n\n<p>4. Create folder in workspaces, com.com.casus.env.where2test.migration\\COM_CASUS_WHERE2TEST_MIGRATION and then unzip the source file inside&nbsp;COM_CASUS_WHERE2TEST_MIGRATION.&nbsp;</p>\n\n<p>5. Install requirement.txt. We use some python scripts for downloading and cleaning the data</p>\n\n<p>6. Set the memory on the file&nbsp;MigrateWhere2test_run.bat&nbsp;minimal to 13 GB</p>\n\n<p>7. Set run Develop and run the .bat&nbsp;file on the folder&nbsp;MigrateWhere2test_2.0Unix to run in localhost.</p>\n\n<p>Unix</p>\n\n<p>1. Create PostgreSQL with port 32771.</p>\n\n<p>2. Apply&nbsp;<a href=\"https://rodare.hzdr.de/api/files/0662e0ae-224f-47ea-9f3d-cf0491a11b04/w2testRegion.sql\">w2testRegion.sql</a>&nbsp;to the Postgresql database. It creates the schema of the database.<br>\n3. Create folder /home/wildan/Workspaces and unzip the unix file.&nbsp;</p>\n\n<p>4. Open the file&nbsp;MigrateWhere2test/MigrateWhere2test_run.sh and change the mode &quot;Default&quot; by &quot;Production&quot;</p>\n\n<p>5. Create folder in workspaces, com.com.casus.env.where2test.migration.unix/COM_CASUS_WHERE2TEST_MIGRATION and then unzip the source file inside&nbsp;COM_CASUS_WHERE2TEST_MIGRATION.&nbsp;</p>\n\n<p>6. Install requirement.txt. We use some python scripts for downloading and cleaning the data</p>\n\n<p>7. Set the memory on the file&nbsp;MigrateWhere2test_run.sh minimal to 13 GB</p>\n\n<p>8. run the MigrateWhere2test_run.sh in the &quot;Production&quot; mode.</p>\n\n<p>&nbsp;</p>", 
    "resource_type": {
      "title": "Software", 
      "type": "software"
    }, 
    "doc_id": "1", 
    "license": {
      "id": "CC-BY-4.0"
    }, 
    "communities": [
      {
        "id": "health"
      }, 
      {
        "id": "hzdr"
      }, 
      {
        "id": "rodare"
      }
    ], 
    "creators": [
      {
        "orcid": "0000-0002-4948-3934", 
        "affiliation": "Casus", 
        "name": "Abdussalam, Wildan"
      }
    ], 
    "keywords": [
      "data pipeline"
    ], 
    "access_right_category": "success", 
    "language": "eng"
  }, 
  "doi": "10.14278/rodare.1946", 
  "conceptrecid": "1500", 
  "files": [
    {
      "links": {
        "self": "https://rodare.hzdr.de/api/files/b1ab38f9-21d9-4811-ae2f-09957aa940d0/MigrateWhere2test_2.0Unix.zip"
      }, 
      "bucket": "b1ab38f9-21d9-4811-ae2f-09957aa940d0", 
      "key": "MigrateWhere2test_2.0Unix.zip", 
      "type": "zip", 
      "checksum": "md5:273411ded3a7945891b6650a8d3d9c37", 
      "size": 91123764
    }, 
    {
      "links": {
        "self": "https://rodare.hzdr.de/api/files/b1ab38f9-21d9-4811-ae2f-09957aa940d0/MigrateWhere2test_2.0Win.zip"
      }, 
      "bucket": "b1ab38f9-21d9-4811-ae2f-09957aa940d0", 
      "key": "MigrateWhere2test_2.0Win.zip", 
      "type": "zip", 
      "checksum": "md5:d314c9b917e2f6f24c686a29c1fda4a9", 
      "size": 93215502
    }, 
    {
      "links": {
        "self": "https://rodare.hzdr.de/api/files/b1ab38f9-21d9-4811-ae2f-09957aa940d0/requirements.txt"
      }, 
      "bucket": "b1ab38f9-21d9-4811-ae2f-09957aa940d0", 
      "key": "requirements.txt", 
      "type": "txt", 
      "checksum": "md5:a363c2610db122cede90192c205a6a0a", 
      "size": 180
    }, 
    {
      "links": {
        "self": "https://rodare.hzdr.de/api/files/b1ab38f9-21d9-4811-ae2f-09957aa940d0/src.zip"
      }, 
      "bucket": "b1ab38f9-21d9-4811-ae2f-09957aa940d0", 
      "key": "src.zip", 
      "type": "zip", 
      "checksum": "md5:a0897ba0e777d7890e717f3962f8704f", 
      "size": 273324310
    }, 
    {
      "links": {
        "self": "https://rodare.hzdr.de/api/files/b1ab38f9-21d9-4811-ae2f-09957aa940d0/w2testRegion.sql"
      }, 
      "bucket": "b1ab38f9-21d9-4811-ae2f-09957aa940d0", 
      "key": "w2testRegion.sql", 
      "type": "sql", 
      "checksum": "md5:bd7ebb7fe0999509a2a535d1695d022d", 
      "size": 8128
    }
  ], 
  "created": "2022-11-10T13:03:07.635160+00:00", 
  "stats": {
    "volume": 2746164952.0, 
    "unique_downloads": 45.0, 
    "version_unique_downloads": 85.0, 
    "unique_views": 188.0, 
    "downloads": 66.0, 
    "version_unique_views": 406.0, 
    "version_views": 596.0, 
    "version_downloads": 116.0, 
    "version_volume": 6890392738.0, 
    "views": 266.0
  }, 
  "conceptdoi": "10.14278/rodare.1500"
}
596
116
views
downloads
All versions This version
Views 596266
Downloads 11666
Data volume 6.9 GB2.7 GB
Unique views 406188
Unique downloads 8545

Share

Cite as