Software Open Access

Data synchronizator of Where2test pipeline

Abdussalam, Wildan

Software to synchonise the data between various data sources and casus database server. For Unix users please use MigrateWhere2test_2.0Unix.zip and for WIndows users please use MigrateWhere2test_2.0Win.zip. In order to use the scripts, please use the following instructions:

Windows

1. Create the postgreq sql database and set the port 5432.

2. Apply w2testRegion.sql to the Postgresql database. It creates the schema of the database.

3. Create folder C:\Workspaces and unzip the unix file. 

4. Create folder in workspaces, com.com.casus.env.where2test.migration\COM_CASUS_WHERE2TEST_MIGRATION and then unzip the source file inside COM_CASUS_WHERE2TEST_MIGRATION. 

5. Install requirement.txt. We use some python scripts for downloading and cleaning the data

6. Set the memory on the file MigrateWhere2test_run.bat minimal to 13 GB

7. Set run Develop and run the .bat file on the folder MigrateWhere2test_2.0Unix to run in localhost.

Unix

1. Create PostgreSQL with port 32771.

2. Apply w2testRegion.sql to the Postgresql database. It creates the schema of the database.
3. Create folder /home/wildan/Workspaces and unzip the unix file. 

4. Open the file MigrateWhere2test/MigrateWhere2test_run.sh and change the mode "Default" by "Production"

5. Create folder in workspaces, com.com.casus.env.where2test.migration.unix/COM_CASUS_WHERE2TEST_MIGRATION and then unzip the source file inside COM_CASUS_WHERE2TEST_MIGRATION. 

6. Install requirement.txt. We use some python scripts for downloading and cleaning the data

7. Set the memory on the file MigrateWhere2test_run.sh minimal to 13 GB

8. run the MigrateWhere2test_run.sh in the "Production" mode.

 

Files (457.7 MB)
Name Size
MigrateWhere2test_2.0Unix.zip
md5:273411ded3a7945891b6650a8d3d9c37
91.1 MB Download
MigrateWhere2test_2.0Win.zip
md5:d314c9b917e2f6f24c686a29c1fda4a9
93.2 MB Download
requirements.txt
md5:a363c2610db122cede90192c205a6a0a
180 Bytes Download
src.zip
md5:a0897ba0e777d7890e717f3962f8704f
273.3 MB Download
w2testRegion.sql
md5:bd7ebb7fe0999509a2a535d1695d022d
8.1 kB Download
295
64
views
downloads
All versions This version
Views 295138
Downloads 6438
Data volume 4.0 GB1.8 GB
Unique views 15279
Unique downloads 3317

Share

Cite as