The Fifth International Workshop on Large-Scale Testing (LT 2016)

March 12, 2016
Delft, Netherlands
Co-located with ICPE 2016
The 7th International Conference on Performance Engineering
Important Dates
Intent to submit: Nov. 16, 2015
(Submission still open after the abstract deadline!)
Technical papers: Nov. 23, 2015
Dec. 8, 2015 (Extended)
Paper notifications: Dec. 15, 2015 Camera ready: Jan. 18, 2016 Presentation track: Feb. 1, 2016 Talk notifications: Feb. 8, 2016 Workshop date: Mar. 12, 2016
Past LT Workshops
LT 2012 LT 2013 LT 2014 LT 2015

Call for papers

Many large-scale software systems (e.g., e-commerce websites, telecommunication infrastructures and enterprise systems, etc.) must service hundreds, thousands or even millions of concurrent requests. Many field problems of these systems are due to their inability to scale to field workloads, rather than feature bugs. In addition to conventional functional testing, these systems must be tested with large volumes of concurrent requests (called the load) to ensure the quality of these systems. Large-scale testing includes all different objectives and strategies of testing large-scale software systems using load. Examples of large-scale testing are live upgrade testing, load testing, high availability testing, operational profile testing, performance testing, reliability testing, stability testing and stress testing.

Large-scale testing is a difficult task requiring a great understanding of the system under test. Practitioners face many challenges such as tooling (choosing and implementing the testing tools), environments (software and hardware setup) and time (limited time to design, test, and analyze). Yet, little research is done in the software engineering domain concerning this topic. Moreover, prior large-scale testing research have been largely focused on telecommunication applications and web-based e-commerce systems. Industry has been focused primarily on creating tools to automatically drive specified load into the system under test (e.g., LoadRunner or Apache JMeter). Large-scale testing is gaining more importance, as an increasing number of systems (on-premise and/or cloud-based systems) are designed to serve thousands or millions of users.

We solicit the following two tracks of submissions: technical papers (maximum 4 pages) and presentation track for industry or experience talks (maximum 700 words extended abstract). Technical papers should follow the standard ACM SIG proceedings format and need to be submitted electronically via EasyChair. Short abstracts for the presentation track need to be submitted as "abstract only" submissions via EasyChair. Accepted technical papers will be published in the ICPE 2016 Proceedings. Materials from the presentation track will not be published in the ICPE 2016 proceedings, but will be made available on the workshop website. Submitted papers can be research papers, position papers, case studies or experience reports addressing issues including but not limited to the following: