Software Open Access

Data synchronizator of Where2test pipeline

Abdussalam, Wildan


MARC21 XML Export

<?xml version='1.0' encoding='UTF-8'?>
<record xmlns="http://www.loc.gov/MARC21/slim">
  <leader>00000nmm##2200000uu#4500</leader>
  <datafield tag="650" ind1="1" ind2="7">
    <subfield code="a">cc-by</subfield>
    <subfield code="2">opendefinition.org</subfield>
  </datafield>
  <controlfield tag="005">20221110141618.0</controlfield>
  <datafield tag="773" ind1=" " ind2=" ">
    <subfield code="a">https://www.hzdr.de/publications/Publ-34430</subfield>
    <subfield code="i">isIdenticalTo</subfield>
    <subfield code="n">url</subfield>
  </datafield>
  <datafield tag="773" ind1=" " ind2=" ">
    <subfield code="a">10.14278/rodare.1500</subfield>
    <subfield code="i">isVersionOf</subfield>
    <subfield code="n">doi</subfield>
  </datafield>
  <controlfield tag="001">1946</controlfield>
  <datafield tag="520" ind1=" " ind2=" ">
    <subfield code="a">&lt;p&gt;Software to synchonise the data between various data sources and casus database server. For Unix users please use&amp;nbsp;MigrateWhere2test_2.0Unix.zip and for WIndows users please use&amp;nbsp;MigrateWhere2test_2.0Win.zip. In order to use the scripts, please use the following instructions:&lt;/p&gt;

&lt;p&gt;Windows&lt;/p&gt;

&lt;p&gt;1. Create the postgreq sql database and set the port 5432.&lt;/p&gt;

&lt;p&gt;2. Apply&amp;nbsp;&lt;a href="https://rodare.hzdr.de/api/files/0662e0ae-224f-47ea-9f3d-cf0491a11b04/w2testRegion.sql"&gt;w2testRegion.sql&lt;/a&gt;&amp;nbsp;to the Postgresql database. It creates the schema of the database.&lt;/p&gt;

&lt;p&gt;3. Create folder C:\Workspaces and unzip the unix file.&amp;nbsp;&lt;/p&gt;

&lt;p&gt;4. Create folder in workspaces, com.com.casus.env.where2test.migration\COM_CASUS_WHERE2TEST_MIGRATION and then unzip the source file inside&amp;nbsp;COM_CASUS_WHERE2TEST_MIGRATION.&amp;nbsp;&lt;/p&gt;

&lt;p&gt;5. Install requirement.txt. We use some python scripts for downloading and cleaning the data&lt;/p&gt;

&lt;p&gt;6. Set the memory on the file&amp;nbsp;MigrateWhere2test_run.bat&amp;nbsp;minimal to 13 GB&lt;/p&gt;

&lt;p&gt;7. Set run Develop and run the .bat&amp;nbsp;file on the folder&amp;nbsp;MigrateWhere2test_2.0Unix to run in localhost.&lt;/p&gt;

&lt;p&gt;Unix&lt;/p&gt;

&lt;p&gt;1. Create PostgreSQL with port 32771.&lt;/p&gt;

&lt;p&gt;2. Apply&amp;nbsp;&lt;a href="https://rodare.hzdr.de/api/files/0662e0ae-224f-47ea-9f3d-cf0491a11b04/w2testRegion.sql"&gt;w2testRegion.sql&lt;/a&gt;&amp;nbsp;to the Postgresql database. It creates the schema of the database.&lt;br&gt;
3. Create folder /home/wildan/Workspaces and unzip the unix file.&amp;nbsp;&lt;/p&gt;

&lt;p&gt;4. Open the file&amp;nbsp;MigrateWhere2test/MigrateWhere2test_run.sh and change the mode &amp;quot;Default&amp;quot; by &amp;quot;Production&amp;quot;&lt;/p&gt;

&lt;p&gt;5. Create folder in workspaces, com.com.casus.env.where2test.migration.unix/COM_CASUS_WHERE2TEST_MIGRATION and then unzip the source file inside&amp;nbsp;COM_CASUS_WHERE2TEST_MIGRATION.&amp;nbsp;&lt;/p&gt;

&lt;p&gt;6. Install requirement.txt. We use some python scripts for downloading and cleaning the data&lt;/p&gt;

&lt;p&gt;7. Set the memory on the file&amp;nbsp;MigrateWhere2test_run.sh minimal to 13 GB&lt;/p&gt;

&lt;p&gt;8. run the MigrateWhere2test_run.sh in the &amp;quot;Production&amp;quot; mode.&lt;/p&gt;

&lt;p&gt;&amp;nbsp;&lt;/p&gt;</subfield>
  </datafield>
  <datafield tag="653" ind1=" " ind2=" ">
    <subfield code="a">data pipeline</subfield>
  </datafield>
  <datafield tag="245" ind1=" " ind2=" ">
    <subfield code="a">Data synchronizator of Where2test pipeline</subfield>
  </datafield>
  <datafield tag="041" ind1=" " ind2=" ">
    <subfield code="a">eng</subfield>
  </datafield>
  <datafield tag="540" ind1=" " ind2=" ">
    <subfield code="u">https://creativecommons.org/licenses/by/4.0/legalcode</subfield>
    <subfield code="a">Creative Commons Attribution 4.0 International</subfield>
  </datafield>
  <datafield tag="260" ind1=" " ind2=" ">
    <subfield code="c">2022-11-10</subfield>
  </datafield>
  <datafield tag="542" ind1=" " ind2=" ">
    <subfield code="l">open</subfield>
  </datafield>
  <datafield tag="980" ind1=" " ind2=" ">
    <subfield code="a">software</subfield>
  </datafield>
  <datafield tag="100" ind1=" " ind2=" ">
    <subfield code="a">Abdussalam, Wildan</subfield>
    <subfield code="u">Casus</subfield>
    <subfield code="0">(orcid)0000-0002-4948-3934</subfield>
  </datafield>
  <datafield tag="980" ind1=" " ind2=" ">
    <subfield code="a">user-health</subfield>
  </datafield>
  <datafield tag="980" ind1=" " ind2=" ">
    <subfield code="a">user-hzdr</subfield>
  </datafield>
  <datafield tag="980" ind1=" " ind2=" ">
    <subfield code="a">user-rodare</subfield>
  </datafield>
  <datafield tag="024" ind1=" " ind2=" ">
    <subfield code="a">10.14278/rodare.1946</subfield>
    <subfield code="2">doi</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">91123764</subfield>
    <subfield code="u">https://rodare.hzdr.de/record/1946/files/MigrateWhere2test_2.0Unix.zip</subfield>
    <subfield code="z">md5:273411ded3a7945891b6650a8d3d9c37</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">93215502</subfield>
    <subfield code="u">https://rodare.hzdr.de/record/1946/files/MigrateWhere2test_2.0Win.zip</subfield>
    <subfield code="z">md5:d314c9b917e2f6f24c686a29c1fda4a9</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">180</subfield>
    <subfield code="u">https://rodare.hzdr.de/record/1946/files/requirements.txt</subfield>
    <subfield code="z">md5:a363c2610db122cede90192c205a6a0a</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">273324310</subfield>
    <subfield code="u">https://rodare.hzdr.de/record/1946/files/src.zip</subfield>
    <subfield code="z">md5:a0897ba0e777d7890e717f3962f8704f</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">8128</subfield>
    <subfield code="u">https://rodare.hzdr.de/record/1946/files/w2testRegion.sql</subfield>
    <subfield code="z">md5:bd7ebb7fe0999509a2a535d1695d022d</subfield>
  </datafield>
  <datafield tag="909" ind1="C" ind2="O">
    <subfield code="o">oai:rodare.hzdr.de:1946</subfield>
    <subfield code="p">software</subfield>
    <subfield code="p">user-health</subfield>
    <subfield code="p">user-hzdr</subfield>
    <subfield code="p">user-rodare</subfield>
  </datafield>
</record>
596
116
views
downloads
All versions This version
Views 596266
Downloads 11666
Data volume 6.9 GB2.7 GB
Unique views 406188
Unique downloads 8545

Share

Cite as