The hypothesisis as follows: Serving for almost similar purpose, however being sometimes different in their design and structure, the TOEFL and CFC tests are usually constructed according to the accepted universal pattern.
The enabling objectives are as follows:
To review literature on the nature of tests in order to make theoretically well-motivated discussions on the choice of testing types;
To analyse the selected types of tests, such as TOEFL and CFC tests;
To draw relevant conclusions.
Methods of Research: Theoretical:
Analytical and selective study of the theory available;
Selecting and adapting appropriate tests types, such as TOEFL and CFC, to exemplify the theory.
The paper consists of six chapters each including sub-chapters. Chapter 1 discusses the general data about tests. Chapter 2 describes reliability and validity.
1 Testing and monitoring of remote servers There is a need to develop a software solution to automate testing of VPN service servers not through client applications or SDK, but directly from each individual server, bypassing the user interface. This approach allows you to simulate
the user's experience on the Internet through a VPN connection and thus get
information about violations in the operation of such a connection. During the operation of the VPN service, DevOps specialists involved in the configuration and maintenance of servers were designated the most likely problems when working through VPN connections: incorrect geolocation detection by the visited electronic resources; degradation of the data reception and transmission rate; partial or complete lack of access to certain Internet resources. It is quite difficult to identify such problems at an early stage of their occurrence , since they can occur on any of more than 1000 servers of the system. There are situations when the end users of the product report the incorrect operation of the VpnService. This affects the
the idea of the quality of this software and affects its reputation. In order to prevent such problems at an early stage, an automated solution is needed to regularly check
the functioning of servers for the identified problems, as well as the organization of constant monitoring of the results of testing. Until now, such a check has been performed manually, which, with the existing number of servers, requires a lot of time and is an almost impossible task in terms of full coverage in one test pass.
To date, the set of development tools is constantly being developed and improved. With each new update, the tester needs to manually check the performance of the entire application, that is , to conduct regression testing. In addition, the application is also used to test certain functionality of the entire VPN service. At the same time, the test cases performed form a fairly routine repetitive process, while remaining one of the most important at each current stage of development. In order to increase the efficiency of the described testing process, reduce resource costs and eliminate the human factor from the routine process, it is necessary to implement automated testing
of the user interface of this SDK application.
The customer of the development, in this case, Sibedge LLC, set tasks and formed requirements for the software implementation of automated functional testing
of dedicated servers and monitoring of the results obtained, implementation automated testing of the SDK application user interface.
1 Testing and monitoring of remote servers 1. A software solution should be developed that combines the implementation of test scenarios, their launch on remote servers, collection and monitoring of the test results obtained.
2. It should be possible to run tests on all servers of the system without installing additional software on each server (including test software).
3. The connection to the servers should be created centrally from one place using SSH protocol.
4. Integration with the Prometheus data collection and notification system should be implemented.
5. The display of results from the system should be implemented Prometheus in the Grafana data monitoring and visualization system.
6. The test application should be launched from the command line with the test parameters specified: list of servers, test scenarios, type of export of test results.
7. The architecture of the developed solution should allow adding new test scenarios, while implementing only the logic of the test itself, without affecting the auxiliary parts of the code responsible for: processing test results, integration with the Prometheus system, creating a connection to servers.
8. The developed solution should be integrated into
the CircleCI continuous integration system with the setup of the test run schedule.
1. Automated testing of the application user interface should be implemented by automating existing test cases.
2. It should be possible to introduce tests into the continuous integration process.
3. The possibility of running tests on cloud devices of the Firebase Test Lab service should be considered and tested. Based on the requirements presented, the statement was made the goals and objectives of the development within the framework of the master's thesis, which are presented in section