Simulation standardization: Current state and cross-platform system for network simulators

Zohaib Latif; Kashif Sharif; Maria K. Alvi; Fan Li

doi:10.1007/978-981-10-8890-2_38

Simulation standardization: Current state and cross-platform system for network simulators

Zohaib Latif, Kashif Sharif, Maria K. Alvi, Fan Li

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

1 Citation (Scopus)

Abstract

The amount of research done in the field of mobile ad hoc networks is extraordinarily large. Evaluation of protocols designed for ad hoc networks is challenging as the cost of node deployment in terms of resources required is high, hence, most of the researchers use simulations for performance evaluation. In this paper we address the pitfalls of simulation studies in ad hoc routing protocols published in recent years. We have conducted a survey to evaluate the current state of simulation studies published in top conference/journals of the communication domain. In majority of the published papers (the way simulation results are reported) we have found design flaws, unrealistic assumptions, are non-reproducible, and statistically invalid results. We also propose a standardizing architecture for automating the reporting and replication process for network simulators. This platform independent architecture alleviates the challenge of simulation parameter reporting and facilitates in designing better network simulation experiments.

Original language	English
Title of host publication	Mobile Ad-hoc and Sensor Networks - 13th International Conference, MSN 2017, Revised Selected Papers
Editors	Liehuang Zhu, Sheng Zhong
Publisher	Springer Verlag
Pages	497-508
Number of pages	12
ISBN (Print)	9789811088896
DOIs	https://doi.org/10.1007/978-981-10-8890-2_38
Publication status	Published - 2018
Externally published	Yes
Event	13th International Conference on Mobile Ad-hoc and Sensor Networks, MSN 2017 - Beijing, China Duration: Dec 17 2017 → Dec 20 2017

Publication series

Name	Communications in Computer and Information Science
Volume	747
ISSN (Print)	1865-0929

Conference

Conference	13th International Conference on Mobile Ad-hoc and Sensor Networks, MSN 2017
Country/Territory	China
City	Beijing
Period	12/17/17 → 12/20/17

Funding

The work of F. Li was supported by the National Natural Science Foundation of China (NSFC) under Grant 61772077, Grant 61370192, and Grant 61432015.

ASJC Scopus subject areas

General Computer Science
General Mathematics

Access to Document

10.1007/978-981-10-8890-2_38

Cite this

Latif, Z., Sharif, K., Alvi, M. K., & Li, F. (2018). Simulation standardization: Current state and cross-platform system for network simulators. In L. Zhu, & S. Zhong (Eds.), Mobile Ad-hoc and Sensor Networks - 13th International Conference, MSN 2017, Revised Selected Papers (pp. 497-508). (Communications in Computer and Information Science; Vol. 747). Springer Verlag. https://doi.org/10.1007/978-981-10-8890-2_38

Simulation standardization: Current state and cross-platform system for network simulators. / Latif, Zohaib; Sharif, Kashif; Alvi, Maria K. et al.
Mobile Ad-hoc and Sensor Networks - 13th International Conference, MSN 2017, Revised Selected Papers. ed. / Liehuang Zhu; Sheng Zhong. Springer Verlag, 2018. p. 497-508 (Communications in Computer and Information Science; Vol. 747).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Latif, Z, Sharif, K, Alvi, MK & Li, F 2018, Simulation standardization: Current state and cross-platform system for network simulators. in L Zhu & S Zhong (eds), Mobile Ad-hoc and Sensor Networks - 13th International Conference, MSN 2017, Revised Selected Papers. Communications in Computer and Information Science, vol. 747, Springer Verlag, pp. 497-508, 13th International Conference on Mobile Ad-hoc and Sensor Networks, MSN 2017, Beijing, China, 12/17/17. https://doi.org/10.1007/978-981-10-8890-2_38

Latif Z, Sharif K, Alvi MK, Li F. Simulation standardization: Current state and cross-platform system for network simulators. In Zhu L, Zhong S, editors, Mobile Ad-hoc and Sensor Networks - 13th International Conference, MSN 2017, Revised Selected Papers. Springer Verlag. 2018. p. 497-508. (Communications in Computer and Information Science). doi: 10.1007/978-981-10-8890-2_38

Latif, Zohaib ; Sharif, Kashif ; Alvi, Maria K. et al. / Simulation standardization : Current state and cross-platform system for network simulators. Mobile Ad-hoc and Sensor Networks - 13th International Conference, MSN 2017, Revised Selected Papers. editor / Liehuang Zhu ; Sheng Zhong. Springer Verlag, 2018. pp. 497-508 (Communications in Computer and Information Science).

@inproceedings{ee0dc3d6e77e4c4988f4efea457379c2,

title = "Simulation standardization: Current state and cross-platform system for network simulators",

abstract = "The amount of research done in the field of mobile ad hoc networks is extraordinarily large. Evaluation of protocols designed for ad hoc networks is challenging as the cost of node deployment in terms of resources required is high, hence, most of the researchers use simulations for performance evaluation. In this paper we address the pitfalls of simulation studies in ad hoc routing protocols published in recent years. We have conducted a survey to evaluate the current state of simulation studies published in top conference/journals of the communication domain. In majority of the published papers (the way simulation results are reported) we have found design flaws, unrealistic assumptions, are non-reproducible, and statistically invalid results. We also propose a standardizing architecture for automating the reporting and replication process for network simulators. This platform independent architecture alleviates the challenge of simulation parameter reporting and facilitates in designing better network simulation experiments.",

author = "Zohaib Latif and Kashif Sharif and Alvi, \{Maria K.\} and Fan Li",

note = "Funding Information: The work of F. Li was supported by the National Natural Science Foundation of China (NSFC) under Grant 61772077, Grant 61370192, and Grant 61432015. Publisher Copyright: {\textcopyright} Springer Nature Singapore Pte Ltd. 2018.; 13th International Conference on Mobile Ad-hoc and Sensor Networks, MSN 2017 ; Conference date: 17-12-2017 Through 20-12-2017",

year = "2018",

doi = "10.1007/978-981-10-8890-2\_38",

language = "English",

isbn = "9789811088896",

series = "Communications in Computer and Information Science",

publisher = "Springer Verlag",

pages = "497--508",

editor = "Liehuang Zhu and Sheng Zhong",

booktitle = "Mobile Ad-hoc and Sensor Networks - 13th International Conference, MSN 2017, Revised Selected Papers",

address = "Germany",

}

TY - GEN

T1 - Simulation standardization

T2 - 13th International Conference on Mobile Ad-hoc and Sensor Networks, MSN 2017

AU - Latif, Zohaib

AU - Sharif, Kashif

AU - Alvi, Maria K.

AU - Li, Fan

N1 - Funding Information: The work of F. Li was supported by the National Natural Science Foundation of China (NSFC) under Grant 61772077, Grant 61370192, and Grant 61432015. Publisher Copyright: © Springer Nature Singapore Pte Ltd. 2018.

PY - 2018

Y1 - 2018

N2 - The amount of research done in the field of mobile ad hoc networks is extraordinarily large. Evaluation of protocols designed for ad hoc networks is challenging as the cost of node deployment in terms of resources required is high, hence, most of the researchers use simulations for performance evaluation. In this paper we address the pitfalls of simulation studies in ad hoc routing protocols published in recent years. We have conducted a survey to evaluate the current state of simulation studies published in top conference/journals of the communication domain. In majority of the published papers (the way simulation results are reported) we have found design flaws, unrealistic assumptions, are non-reproducible, and statistically invalid results. We also propose a standardizing architecture for automating the reporting and replication process for network simulators. This platform independent architecture alleviates the challenge of simulation parameter reporting and facilitates in designing better network simulation experiments.

AB - The amount of research done in the field of mobile ad hoc networks is extraordinarily large. Evaluation of protocols designed for ad hoc networks is challenging as the cost of node deployment in terms of resources required is high, hence, most of the researchers use simulations for performance evaluation. In this paper we address the pitfalls of simulation studies in ad hoc routing protocols published in recent years. We have conducted a survey to evaluate the current state of simulation studies published in top conference/journals of the communication domain. In majority of the published papers (the way simulation results are reported) we have found design flaws, unrealistic assumptions, are non-reproducible, and statistically invalid results. We also propose a standardizing architecture for automating the reporting and replication process for network simulators. This platform independent architecture alleviates the challenge of simulation parameter reporting and facilitates in designing better network simulation experiments.

UR - http://www.scopus.com/inward/record.url?scp=85045338759&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85045338759&partnerID=8YFLogxK

U2 - 10.1007/978-981-10-8890-2_38

DO - 10.1007/978-981-10-8890-2_38

M3 - Conference contribution

AN - SCOPUS:85045338759

SN - 9789811088896

T3 - Communications in Computer and Information Science

SP - 497

EP - 508

BT - Mobile Ad-hoc and Sensor Networks - 13th International Conference, MSN 2017, Revised Selected Papers

A2 - Zhu, Liehuang

A2 - Zhong, Sheng

PB - Springer Verlag

Y2 - 17 December 2017 through 20 December 2017

ER -

Simulation standardization: Current state and cross-platform system for network simulators

Abstract

Publication series

Conference

Funding

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this