Method of Short-Term Use of Idle Corporate Network Computers to Solve a Resource-Intensive Problem

S. Vostokin, M. Rusin

Abstract


The article describes the results of an experimental study of utilizing temporarily idle computing power in a corporate network. A distinctive feature of the method is the implementation of the event log paradigm to synchronize the states of distributed worker processes. The paradigm provides the following advantages over ‘tasks’. As a general method it expands the class of problems solved on temporarily idle equipment. Transferring the scheduling function to the application allows one to improve the efficiency. The main advantage of the method is the low overhead of load migration. This paper provides a detailed discussion of metrics that demonstrate this advantage when searching for members of the OEIS A022008 sequence. For a typical corporate network, the mode with the maximum intensity of calls to the event log process was studied. In this mode, the values of maximum speedup, minimum time of autonomous calculation of the worker processes, minimum time of solving the problem at maximum speedup are experimentally estimated. The results allow us to make a positive conclusion about the applicability of the method. Directions for further improvement of the method are noted.

Full Text:

PDF (Russian)

References


Gartner Top 10 Strategic Technology Trends for 2025. – URL: https://www.gartner.com/en/articles/top-technology-trends-2025 (date accessed: 20.12.2024). – Text : electronic.

HTCondor Overview. – URL: https://htcondor.org/htcondor/overview/ (date accessed: 20.12.2024). – Text : electronic.

BOINC. – URL: https://boinc.berkeley.edu/ (date accessed: 20.12.2024). – Text : electronic.

Fundamentals of grid computing: theory, algorithms and technologies: Chapman & Hall/CRC numerical analysis and scientific computing. Fundamentals of grid computing / F. Magoulès. – Boca Raton: CRC Press, 2010. – 298 С.

The Worldwide LHC Computing Grid (WLCG). – URL: https://home.cern/science/computing/grid (date accessed: 20.12.2024). – Text : electronic.

Documentation — DIRAC Documentation. – URL: https://dirac.readthedocs.io/en/latest/ (date accessed: 20.12.2024). – Text : electronic.

Welcome to PanDA documentation — PanDAWMS documentation. – URL: https://panda-wms.readthedocs.io/en/latest/ (date accessed: 20.12.2024). – Text : electronic.

USPEX overview. – URL: https://uspex-team.org/en/uspex/overview (date accessed: 20.12.2024). – Text : electronic.

Widłak, W. High-Throughput Technologies in Molecular Biology / W. Widłak. – Тext: electronic // Molecular Biology / D. Hutchison; W. Widłak. – Berlin, Heidelberg: Springer Berlin Heidelberg, 2013. – T. 8248. – С. 139-153.

Prime numbers and random walks in a square grid / A. Fraile, O. Kinouchi, P. Dwivedi [et al.] // Physical Review E. – 2021. – Т. 104. – № 5. – С. 054114.

Albertian, A. M. The use of heterogeneous computing nodes in grid systems in solving combinatorial problems / A. M. Albertian, I. I. Kurochkin, E. I. Vatutin // Izvestiya SFedU. ENGINEERING SCIENCES. - 2022. - № 7. - С. 142-153

DAGMan Applications — HTCondor Manual 8.8.17 documentation. – URL: https://htcondor.readthedocs.io/en/v8_8/users-manual/dagman-applications.html (date accessed: 20.12.2024). – Text : electronic.

Turilli, Matteo, Mark Santcroos, and Shantenu Jha. "A comprehensive perspective on pilot-job systems." ACM Computing Surveys (CSUR) 51.2 (2018): 1-32.

Basic Concepts — PanDA WMS documentation. – URL: https://panda-wms.readthedocs.io/en/latest/terminology/terminology.html#task (date accessed: 22.12.2024). – Text : electronic.

What is an Event Log? Contents and Use | CrowdStrike. – URL: https://www.crowdstrike.com/en-us/cybersecurity-101/next-gen-siem/event-logs/ (date accessed: 20.12.2024). – Text : electronic.

The On-Line Encyclopedia of Integer Sequences (OEIS). – URL: https://oeis.org/ (date accessed: 20.12.2024). – Text : electronic.

A022008 - OEIS. – URL: https://oeis.org/A022008 (date accessed: 20.12.2024). – Text : electronic.

PrimeGrid. – URL: https://www.primegrid.com/ (date accessed: 20.12.2024). – Text : electronic.

Vostokin, S., Rusin, M. Experiments with the A022008 Sequence Generator to Study Distributed Computing Based on State Synchronization Service / V. Voevodin et al. (Eds.): RuSCDays 2024, LNCS 15407, pp. 75–89, 2025. doi:10.1007/978-3-031-78462-0_6.


Refbacks

  • There are currently no refbacks.


Abava  Кибербезопасность ИБП для ЦОД

ISSN: 2307-8162