Test install of GraphDB on EC2

Here is a sample process of how to install and configure a 2DC (2 data-centers, each with 2 masters and 2 workers) and nagios for monitoring.

Launch EC2 Instances

Choose "onto-docker-X" instances (Tested with onto-docker-9)
Choose the appropriate instance type (e.g. m3.medium)
Open the instances for all communication
Select Number of instances: 8 in Configure Instance Details step
Launch!

When the instances start, they'll pull the latest OWLIM docker image, along with LDBC 50 and will start it (takes a few minutes).

Configuration

Each instance can act either as master or as worker. We'll configure them for our scenario by first editing the following configuration file: test.config.

The file should be saved either in the current folder or in the user home folder as "test.config".
We just have to change the IP addresses for each box to one of the public IPs of the newly created instances:

Be sure that Amazon "Security groups" and instances firewalls have proper open ports.
The following assumes that you have installed (unzipped) the new-cluster-test project, provided by Ontotext as a separate ZIP file:

This process takes awhile, so we can now start deploying the nagios instance.

Launch nagios instance

We'll need one more EC2 instance. This time choose 64-bit Amazon Linux AMI (tested again with t3.medium, though t1.micro may be enough). You'll need just SSH (22) and HTTP (80) ports open for this one.

After the instance is up, you'll need to SSH to it and run the following commands there:

We're now ready to configure and run nagios. For this we need to make sure that the cluster is configured and running (that is, the previous step has finished). We'll need also one of the masters' URLs. E.g. the master in box1 above: http://54.72.215.230:8080/openrdf-workbench/repositories/master

That's it! The start script will read the cluster's configuration, generate one for nagios and run it. To view the results point your browser to http://54.76.155.44/nagios3/ or http://54.76.155.44/pnp4nagios for graphs (you'll have to put the external IP of the nagios machine here). The credentials are nagiosadmin/nagio

Run sample LDBC-based load test

This is run from the same project new-cluster-test:

check settings in your test.config, the following parameters at the end are related to the load test

then start the tests

Note: ldbc_run_time
- LDBC benchmark required java 7
- The ldbc-run ant target depends on *Unix