Performance/AOO3.4.1 PVT Introduction

Test Scenario

In AOO, “Asynchronous loading” is adopted to improve user experience. Therefore, we separated load scenario into two sub-scenario, “load show” and “load finish”.

Note: “Asynchronous loading” doesn’t apply to calc. Therefore, there is no “Load finish” for Calc.

• Load Show
  • Steps:
    • Open a sample file by selecting menu “File->Open…”
  • Timing Interval: From opening the sample file to the first page of the sample file showing up
• Load Finish
  • Steps:
    • Open a sample file by selecting menu “File->Open…”
  • Timing Interval: From opening the sample file to all pages of the sample file loaded in
• Save
  • Steps:
    • Open a sample file by selecting menu “File->Open…”
    • Modify the sample file, such as inserting and deleting some words for writer sample files; inserting and deleting slide for impress sample files; Inputting and deleting words in a cell for calc sample files
    • Press “Ctrl + S” to start saving
  • Timing Interval: From pressing “Ctrl + S” to save finished

Here is an explanation in our report about test scenario:

Test Sample file

2 Odf format sample files and 2 MS format sample files are used for each editor. 12 sample files are used in all. In these 2 sample files, one only contains plain text and the other contains rich objects, such as tables, pictures, and OLE objects.

Sample file list:

Editor	Odf format	MS format
Writer	sw_plain_120p_odf1.2.odt	sw_plain_120p.doc
	sw_complex_100p_odf1.2.odt	sw_complex_100p.doc
Impress	sd_plain_50p_odf1.2.odp	sd_plain_50p.ppt
	sd_complex_51p_odf1.2.odp	sd_complex_51p.ppt
Calc	sc_plain_4sh_5kcell_new_odf1.2.ods	sc_plain_4sh_5kcell.xls
	sc_complex_13sh_4kcell_new_odf1.2.ods	sc_complex_13sh_4kcell.xls

Here is an explanation in our report about sample files:

Test Method

• Automation
• Tools: Eclipse
• Judgment criteria
  • Load Show: Editor showing up stands for the first page being loaded.
  • Load Finish: Getting the page number in the status bar. When the page number after the slash equals to the file page number, it stands for the file loading finish.

• Save: Judge the insert sign in the status bar. The asterisk disappearing marks saving completing.

Result computation Method

Steps:

• We run each test case on each sample file 8 times.
• Remove the first round result, and in the rest of 7 round results, remove the minimum and maximum result
• Compute the average and standard deviation of the rest 5 results.

Note:the standard deviation is to reflect whether the 8 round results are stable.

Here is an explanation in our PVT report about results: