Let’s start testing
In the last ARTICLE I showed how to automate actions for Notepad++. It is time to apply this to get the real value for quality control of the application: test automation.
For this purpose we need something which will allow us to follow automation good practices namely create small independent tests with setups, teardowns and reports.
Details
Let’s look at JUnit with hamcrest matchers. This is universal solution used very often by developers for their unit testing.
The example test looks like this:
|
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 |
import com.passfailerror.notepadplusplus.TestDriver; import com.passfailerror.notepadplusplus.TestDriver; import org.junit.AfterClass; import org.junit.BeforeClass; import org.junit.Test; import java.io.IOException; import java.util.logging.LogManager; import java.util.logging.Logger; import static org.hamcrest.MatcherAssert.assertThat; import static org.hamcrest.CoreMatchers.*; public class TestCases { static TestDriver testDriver; @BeforeClass public static void setUp(){ testDriver = new TestDriver("C:\\Program Files (x86)\\Notepad++\\notepad++.exe", "Notepad++"); } @AfterClass public static void tearDown(){ testDriver.shortcutControl().closeWindow(); } @Test public void testTyping(){ String text = "Sikuli can automate every kind of GUI."; try { LogManager.getLogManager().readConfiguration(TestCases.class.getClassLoader().getResourceAsStream("config/logging_configuration.properties")); Logger my_logger = Logger.getLogger(TestCases.class.getName()); my_logger.info("start"); Thread.sleep(2000); testDriver.shortcutControl().newTab(); testDriver.editingAreaControl().typeKeys(text); testDriver.shortcutControl().copyAllToClipboard(); String actual = testDriver.getClipboardContent(); my_logger.info("assertion:[" + actual + "]" + is(equalTo(text))); assertThat(actual, is(equalTo(text))); } catch(IOException ioexception){ throw new RuntimeException(ioexception); } catch(InterruptedException inexception){ throw new RuntimeException(inexception); } finally { testDriver.shortcutControl().closeTab(); } } } |
We have few interesting things here: the TestCases class has 1 test in this example. I call such a class a test set as it can contains many tests. We have a test set then with 1 test, with setup (@BeforeClass) and teardown (@AfterClass). Those are applied only once so Notepad++ will be launched at the beginning of all tests and will be closed after all tests finish.
JUnit also has a possibility to use @Before and @After decorators to allow some piece of code to fire before and after every test. Hence I try to avoid it to keep the tests as clear as possible: please take a look at finally clause. It allows to create very clear teardown without the decorator.
Hamcrest matchers are also very useful addition. I prefer them to standard JUnit assertions for both writing and logging clarity. I marked them yellow in the code above. The meaning is clear and when executing the test the following information is displayed when result is pass:
|
1 |
INFO: assertion:[Sikuli can automate every kind of GUI.]is "Sikuli can automate every kind of GUI." |
and the following for fail:
|
1 2 3 4 5 6 7 8 9 10 |
java.lang.AssertionError: Expected: is "Sikuli can automate every kind of GUI." but: was "Sikuli can automate every kind of GUI" Expected :Sikuli can automate every kind of GUI. Actual :Sikuli can automate every kind of GUI <Click to see difference> at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20) at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:8) at TestCases.testTyping(TestCases.java:48) |
If you are interested, the full code is available HERE under GUI_automation_part2 branch.
Look and feel
I use IntelliJ Community edition to run the tests. Please take a look:
What next ?
This is definately not all we can do in area of testing automation. We have Java in use here so there is much, much more. I will cover it in my next articles.