Test Suite Improvements

Skip to end of metadata
Go to start of metadata
You are viewing an old version of this page. View the current version. Compare with Current  |   View Page History

Continuous query execution

The test suite now continuously executes queries and updates in a number of threads while running the tests. These queries and updates are more complex, taken from the LDBC-50M suite.

It will print statistics at the end of each test, like these:

2014-08-14 16:16:50,122 [main] INFO  com.ontotext.test.utils.ContinuousQueries - CQ: Statistics:
2014-08-14 16:16:50,122 [main] INFO  com.ontotext.test.utils.ContinuousQueries - CQ: Executed queries: 4R, 2W in 3039 ms.

Notification logging

The test tool gathers the notifications from all masters and logs them in notifications.log file.

Log4j

The test tool now uses Log4j to log the output. This makes it easier to control what to log and where to log it.

Improved cluster stabilisation detection

We verify that the cluster is in good shape at least twice per test: before we start it, and after the test is finished. This verification used to work like this:

  1. Check if all nodes are on-line, and that they have the same number of statements and fingerprints
  2. If the check passes, the cluster is OK. Stop
  3. If we repeated the process too many times then the cluster is in bad state. Stop
  4. Otherwise, sleep for some time and go to 1

The new verification is works this way. The new process is similar, but with two important differences:

  1. We are checking the state, but are waiting just 1 second between them. This ensures, that we'll pick up a "good" cluster pretty fast
  2. We count stale states (which are the same as the previous state). We'll stop the process early if we encounter too many (currently 10) consecutive stale states. This ensures, that we won't wait too long if the cluster is "frozen".
Labels:
None
Enter labels to add to this page:
Please wait 
Looking for a label? Just start typing.