JetStream: An open-source high-performance PCI Express 3 streaming library for FPGA-to-Host and FPGA-to-FPGA communication

Malte Vesper, Dirk Koch, Kizheppatt Vipin, Suhaib A. Fahmy

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Many FPGA-based accelerators are constrained by the available resources and multi-FPGA solutions can be necessary for building more capable systems. Available PCIe solutions provide only FPGA-to-Host communication. In this paper we present JetStream, an open-source1 modular PCIe 3 library, supporting not only fast FPGA-to-Host communication, but also allowing direct FPGA-to-FPGA communication which fully bypasses the memory subsystem. The direct mode saves memory bandwidth for multicast modes and permits to connect multiple FPGAs in various software defined topologies. We show the benefits of JetStream with a large FIR filter spanning four FPGA boards, achieving throughputs of up to 7.09 GB/s per link. Utilizing direct FPGA-to-FPGA transfers reduces the required memory bandwidth by up to 75%.
Original languageEnglish
Title of host publicationFPL 2016 - 26th International Conference on Field-Programmable Logic and Applications
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Print)9782839918442
DOIs
Publication statusPublished - Sep 26 2016

Publication series

NameFPL 2016 - 26th International Conference on Field-Programmable Logic and Applications

Fingerprint

Field programmable gate arrays (FPGA)
Communication
Data storage equipment
Bandwidth
FIR filters
Particle accelerators
Throughput
Topology

Cite this

Vesper, M., Koch, D., Vipin, K., & Fahmy, S. A. (2016). JetStream: An open-source high-performance PCI Express 3 streaming library for FPGA-to-Host and FPGA-to-FPGA communication. In FPL 2016 - 26th International Conference on Field-Programmable Logic and Applications (FPL 2016 - 26th International Conference on Field-Programmable Logic and Applications). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/FPL.2016.7577334

JetStream: An open-source high-performance PCI Express 3 streaming library for FPGA-to-Host and FPGA-to-FPGA communication. / Vesper, Malte; Koch, Dirk; Vipin, Kizheppatt; Fahmy, Suhaib A.

FPL 2016 - 26th International Conference on Field-Programmable Logic and Applications. Institute of Electrical and Electronics Engineers Inc., 2016. (FPL 2016 - 26th International Conference on Field-Programmable Logic and Applications).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Vesper, M, Koch, D, Vipin, K & Fahmy, SA 2016, JetStream: An open-source high-performance PCI Express 3 streaming library for FPGA-to-Host and FPGA-to-FPGA communication. in FPL 2016 - 26th International Conference on Field-Programmable Logic and Applications. FPL 2016 - 26th International Conference on Field-Programmable Logic and Applications, Institute of Electrical and Electronics Engineers Inc. https://doi.org/10.1109/FPL.2016.7577334
Vesper M, Koch D, Vipin K, Fahmy SA. JetStream: An open-source high-performance PCI Express 3 streaming library for FPGA-to-Host and FPGA-to-FPGA communication. In FPL 2016 - 26th International Conference on Field-Programmable Logic and Applications. Institute of Electrical and Electronics Engineers Inc. 2016. (FPL 2016 - 26th International Conference on Field-Programmable Logic and Applications). https://doi.org/10.1109/FPL.2016.7577334
Vesper, Malte ; Koch, Dirk ; Vipin, Kizheppatt ; Fahmy, Suhaib A. / JetStream: An open-source high-performance PCI Express 3 streaming library for FPGA-to-Host and FPGA-to-FPGA communication. FPL 2016 - 26th International Conference on Field-Programmable Logic and Applications. Institute of Electrical and Electronics Engineers Inc., 2016. (FPL 2016 - 26th International Conference on Field-Programmable Logic and Applications).
@inproceedings{af726d9cf72b40bdaada8a12531fe020,
title = "JetStream: An open-source high-performance PCI Express 3 streaming library for FPGA-to-Host and FPGA-to-FPGA communication",
abstract = "Many FPGA-based accelerators are constrained by the available resources and multi-FPGA solutions can be necessary for building more capable systems. Available PCIe solutions provide only FPGA-to-Host communication. In this paper we present JetStream, an open-source1 modular PCIe 3 library, supporting not only fast FPGA-to-Host communication, but also allowing direct FPGA-to-FPGA communication which fully bypasses the memory subsystem. The direct mode saves memory bandwidth for multicast modes and permits to connect multiple FPGAs in various software defined topologies. We show the benefits of JetStream with a large FIR filter spanning four FPGA boards, achieving throughputs of up to 7.09 GB/s per link. Utilizing direct FPGA-to-FPGA transfers reduces the required memory bandwidth by up to 75{\%}.",
author = "Malte Vesper and Dirk Koch and Kizheppatt Vipin and Fahmy, {Suhaib A.}",
year = "2016",
month = "9",
day = "26",
doi = "10.1109/FPL.2016.7577334",
language = "English",
isbn = "9782839918442",
series = "FPL 2016 - 26th International Conference on Field-Programmable Logic and Applications",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
booktitle = "FPL 2016 - 26th International Conference on Field-Programmable Logic and Applications",
address = "United States",

}

TY - GEN

T1 - JetStream: An open-source high-performance PCI Express 3 streaming library for FPGA-to-Host and FPGA-to-FPGA communication

AU - Vesper, Malte

AU - Koch, Dirk

AU - Vipin, Kizheppatt

AU - Fahmy, Suhaib A.

PY - 2016/9/26

Y1 - 2016/9/26

N2 - Many FPGA-based accelerators are constrained by the available resources and multi-FPGA solutions can be necessary for building more capable systems. Available PCIe solutions provide only FPGA-to-Host communication. In this paper we present JetStream, an open-source1 modular PCIe 3 library, supporting not only fast FPGA-to-Host communication, but also allowing direct FPGA-to-FPGA communication which fully bypasses the memory subsystem. The direct mode saves memory bandwidth for multicast modes and permits to connect multiple FPGAs in various software defined topologies. We show the benefits of JetStream with a large FIR filter spanning four FPGA boards, achieving throughputs of up to 7.09 GB/s per link. Utilizing direct FPGA-to-FPGA transfers reduces the required memory bandwidth by up to 75%.

AB - Many FPGA-based accelerators are constrained by the available resources and multi-FPGA solutions can be necessary for building more capable systems. Available PCIe solutions provide only FPGA-to-Host communication. In this paper we present JetStream, an open-source1 modular PCIe 3 library, supporting not only fast FPGA-to-Host communication, but also allowing direct FPGA-to-FPGA communication which fully bypasses the memory subsystem. The direct mode saves memory bandwidth for multicast modes and permits to connect multiple FPGAs in various software defined topologies. We show the benefits of JetStream with a large FIR filter spanning four FPGA boards, achieving throughputs of up to 7.09 GB/s per link. Utilizing direct FPGA-to-FPGA transfers reduces the required memory bandwidth by up to 75%.

U2 - 10.1109/FPL.2016.7577334

DO - 10.1109/FPL.2016.7577334

M3 - Conference contribution

SN - 9782839918442

T3 - FPL 2016 - 26th International Conference on Field-Programmable Logic and Applications

BT - FPL 2016 - 26th International Conference on Field-Programmable Logic and Applications

PB - Institute of Electrical and Electronics Engineers Inc.

ER -