--- 1/draft-ietf-rmcat-eval-test-07.txt 2018-11-26 07:13:37.839114406 -0800 +++ 2/draft-ietf-rmcat-eval-test-08.txt 2018-11-26 07:13:37.903115938 -0800 @@ -1,47 +1,47 @@ Network Working Group Z. Sarker Internet-Draft Ericsson AB Intended status: Informational V. Singh -Expires: April 25, 2019 callstats.io +Expires: May 30, 2019 callstats.io X. Zhu M. Ramalho Cisco Systems - October 22, 2018 + November 26, 2018 Test Cases for Evaluating RMCAT Proposals - draft-ietf-rmcat-eval-test-07 + draft-ietf-rmcat-eval-test-08 Abstract The Real-time Transport Protocol (RTP) is used to transmit media in multimedia telephony applications. These applications are typically required to implement congestion control. This document describes the test cases to be used in the performance evaluation of such - congestion control algorithms. + congestion control algorithms in a controlled environment. Status of This Memo This Internet-Draft is submitted in full conformance with the provisions of BCP 78 and BCP 79. Internet-Drafts are working documents of the Internet Engineering Task Force (IETF). Note that other groups may also distribute working documents as Internet-Drafts. The list of current Internet- Drafts is at https://datatracker.ietf.org/drafts/current/. Internet-Drafts are draft documents valid for a maximum of six months and may be updated, replaced, or obsoleted by other documents at any time. It is inappropriate to use Internet-Drafts as reference material or to cite them other than as "work in progress." - This Internet-Draft will expire on April 25, 2019. + This Internet-Draft will expire on May 30, 2019. Copyright Notice Copyright (c) 2018 IETF Trust and the persons identified as the document authors. All rights reserved. This document is subject to BCP 78 and the IETF Trust's Legal Provisions Relating to IETF Documents (https://trustee.ietf.org/license-info) in effect on the date of publication of this document. Please review these documents @@ -1055,21 +1055,21 @@ - End time: 119s. o Test Specific Information: none 5.7. Media Flow Competing with Short TCP Flows In this test case, one or more congestion controlled media flow shares the bottleneck link with multiple short-lived TCP flows. Short-lived TCP flows resemble the on/off pattern observed in the web - traffic, wherein clients ( for example -browsers) connect to a server + traffic, wherein clients (for example, browsers) connect to a server and download a resource (typically a web page, few images, text files, etc.) using several TCP connections. This scenario shows the performance of a multimedia application when several browser windows are active. The test case measures the adaptivity of the candidate algorithm to competing web traffic, it addresses the requirements 1.E in [I-D.ietf-rmcat-cc-requirements]. Depending on the number of short TCP flows, the cross-traffic either appears as a short burst flow or resembles a long TCP flow. The intention of this test is to observe the impact of short-term burst @@ -1358,27 +1358,30 @@ + Number of sources : Zero (0) 7. Wireless Access Links Additional wireless network (both cellular network and WiFi network) specific test cases are defined in [I-D.ietf-rmcat-wireless-tests]. 8. Security Considerations - The evaluations of the test cases are intended to run in a controlled - lab environment. Hence, the applications, simulators and network - nodes should be well-behaved and should not impact the desired - results. In case the evaluations are not done in a controlled - environment, the security considerations in - [I-D.ietf-rmcat-eval-criteria] and the relevant congestion control - algorithms apply. It is important to take appropriate caution to + The security considerations in [I-D.ietf-rmcat-eval-criteria] and the + relevant congestion control algorithms apply. The principles for + congestion control are described in [RFC2914], and in particular any + new method MUST implement safeguards to avoid congestion collapse of + the Internet. + + The evaluation of the test cases are intended to be run in a + controlled lab environment. Hence, the applications, simulators and + network nodes ought to be well-behaved and should not impact the + desired results. It is important to take appropriate caution to avoid leaking non-responsive traffic from unproven congestion avoidance techniques onto the open Internet. 9. IANA Considerations There are no IANA impacts in this memo. 10. Acknowledgements Much of this document is derived from previous work on congestion @@ -1387,26 +1390,26 @@ The content and concepts within this document are a product of the discussion carried out in the Design Team. 11. References 11.1. Normative References [I-D.ietf-rmcat-eval-criteria] Singh, V., Ott, J., and S. Holmer, "Evaluating Congestion Control for Interactive Real-time Media", draft-ietf- - rmcat-eval-criteria-07 (work in progress), May 2018. + rmcat-eval-criteria-08 (work in progress), November 2018. [I-D.ietf-rmcat-video-traffic-model] Zhu, X., Cruz, S., and Z. Sarker, "Video Traffic Models for RTP Congestion Control Evaluations", draft-ietf-rmcat- - video-traffic-model-05 (work in progress), July 2018. + video-traffic-model-06 (work in progress), November 2018. [I-D.ietf-rmcat-wireless-tests] Sarker, Z., Johansson, I., Zhu, X., Fu, J., Tan, W., and M. Ramalho, "Evaluation Test Cases for Interactive Real- Time Media over Wireless Networks", draft-ietf-rmcat- wireless-tests-05 (work in progress), June 2018. [RFC2119] Bradner, S., "Key words for use in RFCs to Indicate Requirement Levels", BCP 14, RFC 2119, DOI 10.17487/RFC2119, March 1997, @@ -1447,20 +1450,24 @@ [HEVC-seq] HEVC, "Test Sequences", http://www.netlab.tkk.fi/~varun/test_sequences/ . [I-D.ietf-rmcat-cc-requirements] Jesup, R. and Z. Sarker, "Congestion Control Requirements for Interactive Real-Time Media", draft-ietf-rmcat-cc- requirements-09 (work in progress), December 2014. + [RFC2914] Floyd, S., "Congestion Control Principles", BCP 41, + RFC 2914, DOI 10.17487/RFC2914, September 2000, + . + [RFC5681] Allman, M., Paxson, V., and E. Blanton, "TCP Congestion Control", RFC 5681, DOI 10.17487/RFC5681, September 2009, . [xiph-seq] Xiph.org, "Video Test Media", http://media.xiph.org/video/derf/ . Authors' Addresses