Beyond JSON: evaluating serialization formats for space-efficient communication
| dc.citation.epage | 15 | |
| dc.citation.issue | 1 | |
| dc.citation.journalTitle | Досягнення у кібер-фізичних системах | |
| dc.citation.spage | 9 | |
| dc.contributor.affiliation | Lviv Polytechnic National University | |
| dc.contributor.author | Maltsev, Eduard | |
| dc.contributor.author | Muliarevych, Oleksandr | |
| dc.coverage.placename | Львів | |
| dc.coverage.placename | Lviv | |
| dc.date.accessioned | 2025-03-17T10:08:01Z | |
| dc.date.created | 2024-02-27 | |
| dc.date.issued | 2024-02-27 | |
| dc.description.abstract | Distributed systems rely on efficient inter-service communication, heavily impacted by data transmission costs. This study investigates alternative serialization formats, like Avro and MessagePack, to reduce data size compared to the common JSON format. We utilize a custom model to comprehensively assess the space efficiency of serialization formats across various data types. Our findings demonstrate that adopting alternative formats achieves a median reduction in serialized data exceeding 30 %. Notably, Avro exhibits exceptional efficiency, leading to reductions exceeding 83 % in specific scenarios. These insights empower developers to select optimal formats, potentially leading to significant improvements in data transfer speed, reduced bandwidth consumption, and enhanced scalability for handling larger data volumes within distributed systems. | |
| dc.format.extent | 9-15 | |
| dc.format.pages | 7 | |
| dc.identifier.citation | Maltsev E. Beyond JSON: evaluating serialization formats for space-efficient communication / Maltsev Eduard, Muliarevych Oleksandr // Advances in Cyber-Physical Systems. — Lviv : Lviv Politechnic Publishing House, 2024. — Vol 9. — No 1. — P. 9–15. | |
| dc.identifier.citationen | Maltsev E. Beyond JSON: evaluating serialization formats for space-efficient communication / Maltsev Eduard, Muliarevych Oleksandr // Advances in Cyber-Physical Systems. — Lviv : Lviv Politechnic Publishing House, 2024. — Vol 9. — No 1. — P. 9–15. | |
| dc.identifier.doi | doi.org/10.23939/acps2024.01.009 | |
| dc.identifier.uri | https://ena.lpnu.ua/handle/ntb/64186 | |
| dc.language.iso | en | |
| dc.publisher | Видавництво Львівської політехніки | |
| dc.publisher | Lviv Politechnic Publishing House | |
| dc.relation.ispartof | Досягнення у кібер-фізичних системах, 1 (9), 2024 | |
| dc.relation.ispartof | Advances in Cyber-Physical Systems, 1 (9), 2024 | |
| dc.relation.references | [1] Marii B., Zholubak I. (2022). Features of Development and Analysis of REST Systems, Advances in Cyber-Physical Systems, Vol. 7, No. 2, pp. 121–129. DOI: 10.23939/acps2022.02.121. | |
| dc.relation.references | [2] Weerasinghe S., Perera I. (2024). Optimized Strategy in Cloud-Native Environment for Inter-Service Communication in Microservices, International Journal of Online and Biomedical Engineering, Vol. 20, No. 01, pp. 40–57. DOI: 10.3991/ijoe.v20i01.44021. | |
| dc.relation.references | [3] Proos D. P., Carlsson N. (2020). Performance Comparison of Messaging Protocols and Serialization Formats for Digital Twins in IoV, 2020 IFIP Networking Conference (Networking), Paris, France, pp. 10–18 [Electronic resource]. Available at: https://ieeexplore.ieee.org/document/9142787 (Accessed: 03/22/2024). | |
| dc.relation.references | [4] Buono V., Petrovic P. (2021). Enhance Inter-service Communication in Supersonic K-Native REST-based Java Microservice Architectures (Dissertation). urn https://urn.kb.se/resolve?urn=urn:nbn:se:hkr:diva-22135 | |
| dc.relation.references | [5] Morschel L. (2020). dCache – Efficient Message Encoding For Inter-Service Communication in dCache: Evaluation of Existing Serialization Protocols as a Replacement for Java Object Serialization, EPJ Web Conf., Vol. 245, p. 05017. DOI: 10.1051/epjconf/202024505017. | |
| dc.relation.references | [6] Friesel D., Spinczyk O. (2021). Data Serialization Formats for the Internet of Things, Electronic Communications of the EASST, Vol. 20, pp. 1–4. DOI: https://doi.org/10.14279/tuj.eceasst.80.1134. | |
| dc.relation.references | [7] Luis Á., Casares P., Cuadrado-Gallego J. J., Patricio M. A. (2021). PSON: A Serialization Format for IoT Sensor Networks, Sensors, Vol. 21, No. 13, p. 4559. DOI: 10.3390/s21134559. | |
| dc.relation.references | [8] Viotti J. C., Kinderkhedia M. (2022). A Survey of JSON compatible Binary Serialization Specifications. DOI: 10.48550/arXiv.2201.02089. | |
| dc.relation.references | [9] Kumar P. K., Agarwal R., Shivaprasad R., Sitaram D., Kalambur S. (2021). Performance Characterization of Communication Protocols in Microservice Applications, in International Conference on Smart Applications, Communications and Networking (SmartNets), pp. 1–5. DOI: 10.1109/SmartNets50376.2021.9555425. | |
| dc.relation.references | [10] Viotti J. C., Kinderkhedia M. (2022). Benchmarking JSON BinPack, DOI: 10.48550/ARXIV.2211.12799. | |
| dc.relation.references | [11] Huang B., Tang Y. (2021). Research on optimization of real-time efficient storage algorithm in data information serialization, PLoS ONE, Vol. 16, No. 12, p. e0260697. DOI: 10.1371/journal.pone.0260697. | |
| dc.relation.references | [12] Ahmad T., Ars Z. A., Hofstee H. P. (2022). Benchmarking Apache Arrow Flight – A wire-speed protocol for data transfer, querying and microservices. arXiv. DOI: 10.48550/arXiv.2204.03032. | |
| dc.relation.references | [13] Dauda A. B., Adam M. S., Mustapha M. A., Mabu A. M., and Mustafa S. (2020). Soap serialization effect on communication nodes and protocols, DOI: 10.48550/ARXIV.2012.12578. | |
| dc.relation.references | [14] Evans D. (2020). Energy-Efficient Transaction Serialization for IoT Devices, Journal of Computer Science Research, Vol. 2, No. 2, pp. 1–16. DOI: 10.30564/jcsr.v2i2.1620. | |
| dc.relation.references | [15] Viotti J. C., Kinderkhedia M. (2022). A Benchmark of JSON-compatible Binary Serialization Specifications. DOI: 10.48550/ARXIV.2201.03051. | |
| dc.relation.references | [16] Protocol Buffers Version 3 Language Specification. [Electronic resource]. – Available at: https://protobuf.dev/reference/protobuf/proto3-spec/ (Accessed: 03/22/2024). | |
| dc.relation.references | [17] Hummert, C., & Pawlaszczyk, D. (Eds.). (2022). Mobile Forensics–The File Format Handbook: Common File Formats and File Systems Used in Mobile Devices. Springer Nature, pp. 223–260. DOI: 10.1007/978-3-030-98467-0_9. | |
| dc.relation.references | [18] Wang X. and Xie Z. (2020). The Case For Alternative Web Archival Formats To Expedite The Data-To-Insight Cycle, in Proceedings of the ACM/IEEE Joint Conference on Digital Libraries in 2020, in JCDL ’20. New York, NY, USA: Association for Computing Machinery, pp. 177–186 DOI: 10.1145/3383583.3398542. | |
| dc.relation.references | [19] Li T., Shi H., Lu X. (2021). HatRPC: hint-accelerated thrift RPC over RDMA, in Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis, in SC ’21. New York, NY, USA: Association for Computing Machinery, pp. 1–14. DOI: 10.1145/3458817.3476191. | |
| dc.relation.references | [20] Sorokin K. (2023). Benchmark comparing various data serialization libraries, [Electronic resource]. – Available at: https://github.com/thekvs/cpp-serializers. (Accessed: 03/22/2024). | |
| dc.relation.references | [21] Hamerski J. C., Domingues R. P., Moraes F. G., Amory A. (2018). Evaluating Serialization for a Publish-Subscribe Based Middleware for MPSoCs, in 25th IEEE International Conference on Electronics, Circuits and Systems (ICECS), Bordeaux, France, pp. 773–776, DOI: 10.1109/ICECS.2018.8618003. | |
| dc.relation.references | [22] Peltenburg J., Hadnagy Á., Brobbel M., Morrow R., Al Ars Z. (2021). Tens of gigabytes per second JSON-to Arrow conversion with FPGA accelerators, in 2021 ICFPT, pp. 1–9. DOI: 10.1109/ICFPT52863.2021.9609833. | |
| dc.relation.referencesen | [1] Marii B., Zholubak I. (2022). Features of Development and Analysis of REST Systems, Advances in Cyber-Physical Systems, Vol. 7, No. 2, pp. 121–129. DOI: 10.23939/acps2022.02.121. | |
| dc.relation.referencesen | [2] Weerasinghe S., Perera I. (2024). Optimized Strategy in Cloud-Native Environment for Inter-Service Communication in Microservices, International Journal of Online and Biomedical Engineering, Vol. 20, No. 01, pp. 40–57. DOI: 10.3991/ijoe.v20i01.44021. | |
| dc.relation.referencesen | [3] Proos D. P., Carlsson N. (2020). Performance Comparison of Messaging Protocols and Serialization Formats for Digital Twins in IoV, 2020 IFIP Networking Conference (Networking), Paris, France, pp. 10–18 [Electronic resource]. Available at: https://ieeexplore.ieee.org/document/9142787 (Accessed: 03/22/2024). | |
| dc.relation.referencesen | [4] Buono V., Petrovic P. (2021). Enhance Inter-service Communication in Supersonic K-Native REST-based Java Microservice Architectures (Dissertation). urn https://urn.kb.se/resolve?urn=urn:nbn:se:hkr:diva-22135 | |
| dc.relation.referencesen | [5] Morschel L. (2020). dCache – Efficient Message Encoding For Inter-Service Communication in dCache: Evaluation of Existing Serialization Protocols as a Replacement for Java Object Serialization, EPJ Web Conf., Vol. 245, p. 05017. DOI: 10.1051/epjconf/202024505017. | |
| dc.relation.referencesen | [6] Friesel D., Spinczyk O. (2021). Data Serialization Formats for the Internet of Things, Electronic Communications of the EASST, Vol. 20, pp. 1–4. DOI: https://doi.org/10.14279/tuj.eceasst.80.1134. | |
| dc.relation.referencesen | [7] Luis Á., Casares P., Cuadrado-Gallego J. J., Patricio M. A. (2021). PSON: A Serialization Format for IoT Sensor Networks, Sensors, Vol. 21, No. 13, p. 4559. DOI: 10.3390/s21134559. | |
| dc.relation.referencesen | [8] Viotti J. C., Kinderkhedia M. (2022). A Survey of JSON compatible Binary Serialization Specifications. DOI: 10.48550/arXiv.2201.02089. | |
| dc.relation.referencesen | [9] Kumar P. K., Agarwal R., Shivaprasad R., Sitaram D., Kalambur S. (2021). Performance Characterization of Communication Protocols in Microservice Applications, in International Conference on Smart Applications, Communications and Networking (SmartNets), pp. 1–5. DOI: 10.1109/SmartNets50376.2021.9555425. | |
| dc.relation.referencesen | [10] Viotti J. C., Kinderkhedia M. (2022). Benchmarking JSON BinPack, DOI: 10.48550/ARXIV.2211.12799. | |
| dc.relation.referencesen | [11] Huang B., Tang Y. (2021). Research on optimization of real-time efficient storage algorithm in data information serialization, PLoS ONE, Vol. 16, No. 12, p. e0260697. DOI: 10.1371/journal.pone.0260697. | |
| dc.relation.referencesen | [12] Ahmad T., Ars Z. A., Hofstee H. P. (2022). Benchmarking Apache Arrow Flight – A wire-speed protocol for data transfer, querying and microservices. arXiv. DOI: 10.48550/arXiv.2204.03032. | |
| dc.relation.referencesen | [13] Dauda A. B., Adam M. S., Mustapha M. A., Mabu A. M., and Mustafa S. (2020). Soap serialization effect on communication nodes and protocols, DOI: 10.48550/ARXIV.2012.12578. | |
| dc.relation.referencesen | [14] Evans D. (2020). Energy-Efficient Transaction Serialization for IoT Devices, Journal of Computer Science Research, Vol. 2, No. 2, pp. 1–16. DOI: 10.30564/jcsr.v2i2.1620. | |
| dc.relation.referencesen | [15] Viotti J. C., Kinderkhedia M. (2022). A Benchmark of JSON-compatible Binary Serialization Specifications. DOI: 10.48550/ARXIV.2201.03051. | |
| dc.relation.referencesen | [16] Protocol Buffers Version 3 Language Specification. [Electronic resource], Available at: https://protobuf.dev/reference/protobuf/proto3-spec/ (Accessed: 03/22/2024). | |
| dc.relation.referencesen | [17] Hummert, C., & Pawlaszczyk, D. (Eds.). (2022). Mobile Forensics–The File Format Handbook: Common File Formats and File Systems Used in Mobile Devices. Springer Nature, pp. 223–260. DOI: 10.1007/978-3-030-98467-0_9. | |
| dc.relation.referencesen | [18] Wang X. and Xie Z. (2020). The Case For Alternative Web Archival Formats To Expedite The Data-To-Insight Cycle, in Proceedings of the ACM/IEEE Joint Conference on Digital Libraries in 2020, in JCDL ’20. New York, NY, USA: Association for Computing Machinery, pp. 177–186 DOI: 10.1145/3383583.3398542. | |
| dc.relation.referencesen | [19] Li T., Shi H., Lu X. (2021). HatRPC: hint-accelerated thrift RPC over RDMA, in Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis, in SC ’21. New York, NY, USA: Association for Computing Machinery, pp. 1–14. DOI: 10.1145/3458817.3476191. | |
| dc.relation.referencesen | [20] Sorokin K. (2023). Benchmark comparing various data serialization libraries, [Electronic resource], Available at: https://github.com/thekvs/cpp-serializers. (Accessed: 03/22/2024). | |
| dc.relation.referencesen | [21] Hamerski J. C., Domingues R. P., Moraes F. G., Amory A. (2018). Evaluating Serialization for a Publish-Subscribe Based Middleware for MPSoCs, in 25th IEEE International Conference on Electronics, Circuits and Systems (ICECS), Bordeaux, France, pp. 773–776, DOI: 10.1109/ICECS.2018.8618003. | |
| dc.relation.referencesen | [22] Peltenburg J., Hadnagy Á., Brobbel M., Morrow R., Al Ars Z. (2021). Tens of gigabytes per second JSON-to Arrow conversion with FPGA accelerators, in 2021 ICFPT, pp. 1–9. DOI: 10.1109/ICFPT52863.2021.9609833. | |
| dc.relation.uri | https://ieeexplore.ieee.org/document/9142787 | |
| dc.relation.uri | https://urn.kb.se/resolve?urn=urn:nbn:se:hkr:diva-22135 | |
| dc.relation.uri | https://doi.org/10.14279/tuj.eceasst.80.1134 | |
| dc.relation.uri | https://protobuf.dev/reference/protobuf/proto3-spec/ | |
| dc.relation.uri | https://github.com/thekvs/cpp-serializers | |
| dc.rights.holder | © Національний університет “Львівська політехніка”, 2024 | |
| dc.rights.holder | © Maltsev E., Muliarevych O., 2024 | |
| dc.subject | Data communication | |
| dc.subject | Encoding | |
| dc.subject | Information exchange | |
| dc.subject | Protocols | |
| dc.subject | Performance evaluation | |
| dc.title | Beyond JSON: evaluating serialization formats for space-efficient communication | |
| dc.type | Article |
Files
Original bundle
License bundle
1 - 1 of 1