THE TRIANGLE TESTBED
The TRIANGLE testbed is an end-to-end framework devoted to testing and benchmarking of mobile applications, services and devices. The idea behind the testing approach adopted in the TRIANGLE testbed is to generalize QoE computation and provide a programmatic way of computing it. With this approach, the TRIANGLE testbed can accommodate the computation of the QoE for any application.
To facilitate the use of the TRIANGLE testbed for different objectives (testing, benchmarking, certifying), to remotely access the testbed, and to gather and present results, a web portal, which offers an intuitive interface, has been implemented. It provides access to the testbed hiding unnecessary complexity to App developers. For advanced users interested in deeper access to configuration parameters of the testbed elements or the test cases, the testbed offers a direct access to the Keysight TAP (Testing Automation Platform), which is a programmable sequencer of actions with plugins that expose the configuration and control of the instruments and tools integrated into the testbed.
In addition to the testbed itself, TRIANGLE has developed a test methodology and has implemented a set of test cases, which are made available through the Portal. To achieve full test case automation, all the testbed components are under the control of the testbed management framework, which coordinates their configuration, their execution, processes the measurements made in each test case, and computes QoE scores for the application tested.
The radio access (LTE RAN) emulator plays a key role in the TRIANGLE testbed. The testbed RAN is provided by a UXM Wireless Test Set from Keysight, an emulator that provides stateof-the-art test features. Most important, the UXM also provides radio channel emulation for the downlink radio channel. SDR cards can also be used as RAN, running open source solutions like OpenAirInterface.
The testbed integrates a commercial EPC (LTE Evolved Packet Core), from Polaris Networks, which includes the main elements of a standard 3GPP compliant LTE core network. The RAN emulator is connected to the EPC through the standard S1 interface. The testbed also offers the possibility of integrating artificial impairments in the interfaces between the core network and the application servers. Open source solutions are also available at the testbed, as for example OpenAirInterface or NextEPC.
The Quamotion WebDriver, another TRIANGLE element, is able to automate user actions on both iOS and Android applications whether they are native, hybrid of fully web based. This tool is also used to prerecord the apps user flows, which are needed to automate the otherwise manual user actions in the test cases. This completes the full automation operation.
Finally, the testbed also incorporates commercial mobile devices (UEs). The devices are physically connected to the testbed. To accurately measure the power consumption, the N6705B power analyzer directly powers the device. Other measurement instruments may be added in the future.