ADVANCEMENTS AND OPTIMIZATION IN DISTRIBUTED COMPUTING, HIGH-PERFORMANCE SYSTEMS, AND DECENTRALIZED FINANCIAL FRAMEWORKS
Keywords:
Distributed Computing, High-Performance Computing, BlockchainAbstract
The rapid evolution of computational paradigms, encompassing distributed computing, high-performance computing (HPC), and decentralized financial systems, has transformed the technological landscape and catalyzed a paradigm shift in both academic and industrial domains. This study critically examines contemporary methodologies in distributed computing frameworks, parallel and iterative computation models, and blockchain-driven decentralized finance (DeFi) architectures. Through an extensive review of distributed file systems, Hadoop and Spark ecosystems, MapReduce and iMapReduce models, and cluster computing frameworks such as GeoSpark, this research elucidates the operational efficiencies, limitations, and scalability challenges inherent in large-scale data processing infrastructures. Furthermore, it explores the application of HPC in specialized domains such as weather forecasting and molecular simulation, highlighting how algorithmic optimization and interconnect architectures at chip and package scales influence computational throughput and resource allocation. The study also addresses reliability and testing frameworks for distributed systems, with an emphasis on contract testing mechanisms to ensure robust API interactions. The integration of decentralized financial platforms within distributed computational paradigms is analyzed to demonstrate the synergy between secure, scalable computation and emergent financial technologies. This comprehensive synthesis provides a theoretically grounded understanding of performance bottlenecks, optimization strategies, and future research directions in distributed computational systems, offering valuable insights for both system architects and practitioners seeking to leverage high-efficiency computational frameworks in complex operational environments.
References
Achiam, J.; Adler, S.; Agarwal, S.; Ahmad, L.; Akkaya, I.; Aleman, F.L.; Almeida, D.; Altenschmidt, J.; Altman, S.; Anadkat, S.; et al. Gpt-4 technical report. arXiv 2023, arXiv:2303.08774.
Das, A.; Palesi, M.; Kim, J.; Pande, P.P. Chip and Package-Scale Interconnects for General-Purpose, Domain-Specific and Quantum Computing Systems-Overview, Challenges and Opportunities. IEEE J. Emerg. Sel. Top. Circuits Syst. 2024, 14, 354–370.
Sagar Kesarpu. Contract Testing with PACT: Ensuring Reliable API Interactions in Distributed Systems. The American Journal of Engineering and Technology, 7(06), 14–23, 2025. https://doi.org/10.37547/tajet/Volume07Issue06-03
Michalakes, J. HPC for weather forecasting. Parallel Algorithms Comput. Sci. Eng. 2020, 2, 297–323.
Pronk, S.; Pouya, I.; Lundborg, M.; Rotskoff, G.; Wesen, B.; Kasson, P.M.; Lindahl, E. Molecular simulation workflows as parallel algorithms: The execution engine of Copernicus, a distributed high-performance computing platform. J. Chem. Theory Comput. 2015, 11, 2600–2615.
Scellato, S.; Mascolo, C.; Musolesi, M.; Crowcroft, J. Track globally, deliver locally: Improving content delivery networks by tracking geographic social cascades. Proceedings of the 20th International Conference on World Wide Web, Hyderabad, India, 28 March–1 April 2011; pp. 457–466.
Sharma, R.; Singh, A. Blockchain Technologies and Call for an Open Financial System: Decentralised Finance. In Decentralized Finance and Tokenization in FinTech; IGI Global: Hershey, PA, USA, 2024; pp. 21–32.
Raj, K.B.; Mehta, K.; Siddi, S.; Sharma, M.; Sharma, D.K.; Adhav, S.; Gonzáles, J.L. Optimizing Financial Transactions and Processes Through the Power of Distributed Systems. In Meta Heuristic Algorithms for Advanced Distributed Systems; Wiley Online Library: Hoboken, NJ, USA, 2024; pp. 289–303.
Ghazi, M.R.; Gangodkar, D. Hadoop MapReduce and HDFS: A developer’s perspective. Proc. Comput. Sci. 2015, 48, 45–50.
Zhang, Y.; Gao, Q.; Gao, L.; Wang, C. iMapReduce: A distributed computing framework for iterative computation. J. Grid Comput. 2012, 10, 47–68.
Yu, J.; Wu, J.; Sarwat, M. A demonstration of GeoSpark: A cluster computing framework for processing big spatial data. Proc. 2016 IEEE 32nd Int. Conf. Data Engineering (ICDE), 1410–1413.
Yang, Z.; Zhang, C.; Hu, M.; Lin, F. OPC: A distributed computing and memory computing-based effective solution of big data. Proc. 2015 IEEE Int. Conf. Smart City/SocialCom/SustainCom (SmartCity), 50–53.
Taran, V.; Alienin, O.; Stirenko, S.; Gordienko, Y.; Rojbi, A. Performance evaluation of distributed computing environments with Hadoop and Spark frameworks. Proc. 2017 IEEE Int. Young Scientists Forum on Applied Physics and Engineering (YSF), 80–83.
Thanh, T.D.; Mohan, S.; Choi, E.; Kim, S.; Kim, P. A taxonomy and survey on distributed file systems. Proc. 2008 4th Int. Conf. Networked Computing and Advanced Information Management, 144–149.
Blomer, J. A survey on distributed file system technology. J. Phys. Conf. Ser. 2015, 608, 012039.
