Modernizing Dark Pool Infrastructure: Machine Consolidation via AKS

Authors

  • Rajat Shrivastava

Keywords:

Dark Pool Trading, Azure Kubernetes Service (AKS), Microservices Architecture, Horizontal Pod AutoScaling (HPA), Cloud-Native Infrastructure.

Abstract

A cloud-native modernization of dark pool trading infrastructure based on Azure Kubernetes Service is presented with the emphasis on machine consolidation, scalability, and low-latency performance. The common problems associated with traditional dark pool systems include: expensive infrastructure, lack of scalability and poor utilization of resources. The suggested architecture will use microservices, containerization, and Kubernetes-based orchestration to facilitate dynamic scaling and efficient workload management. It contains the basic elements such as Order Management Service, dark pool matching engine, trade execution service, and the real-time event streaming platform to provide smooth and fast trading operations. Simulated high-frequency trading load experimental evaluation has shown that there are significant performance gains, such as a maximum of 70% decrease in latency, a four-fold throughput increase, and improved resource usage. Moreover, the AKS-based system is attaining a high level of machine consolidation and cost optimization, which decreases the overhead of operations. The results demonstrate the usefulness of cloud-native solutions in improving the efficiency, scalability, and reliability of contemporary dark pool trading systems.

Downloads

Download data is not yet available.

References

S. Buti, B. Rindi, and I. M. Werner, “Dark pool trading strategies, market quality and welfare,” J. Financ. econ., vol. 124, no. 2, pp. 244–265, May 2017, doi: 10.1016/j.jfineco.2016.02.002.

H. Zhu, “Do Dark Pools Harm Price Discovery?,” Rev. Financ. Stud., vol. 27, no. 3, pp. 747–789, Mar. 2014, doi: 10.1093/rfs/hht078.

S. Chatterjee, “Risk Management in Advanced Persistent Threats (APTs) for Critical Infrastructure in the Utility Industry,” Int. J. Multidiscip. Res., vol. 3, no. 4, Aug. 2021, doi: 10.36948/ijfmr.2021.v03i04.34396.

R. Carvalho, S. A. Pushkala, and R. Saxena, “Systems and methods for rapid processing of file data,” US9594817B2, 2017

C. M. Aderaldo, N. C. Mendonça, B. Schmerl, and D. Garlan, “Kubow: An Architecture-Based Self-Adaptation Service for Cloud Native Applications,” in Proceedings of the 13th European Conference on Software Architecture - Volume 2, Sep. 2019, pp. 42–45. doi: 10.1145/3344948.3344963.

T. Mizuta et al., “Effects of Price Regulations and Dark Pools on Financial Market Stability: An Investigation by Multiagent Simulations,” Intell. Syst. Accounting, Financ. Manag., vol. 23, no. 1–2, pp. 97–120, Jan. 2016, doi: 10.1002/isaf. 1374.

K. N. Johnson, “Regulating innovation: high frequency trading in dark pools,” J. Corp. L., vol. 42, p. 833, 2016.

A. R. Segireddy, “Cloud Migration Strategies for High-Volume Financial Messaging Systems,” J. Artif. Intell. Big Data, vol. 1, no. 1, pp. 1–17, Dec. 2020, doi: 10.31586/jaibd.2020.1353.

F. Liu, J. Li, Y. Wang, and L. Li, “Kubestorage: A Cloud Native Storage Engine for Massive Small Files,” in 2019 6th International Conference on Behavioral, Economic and Socio-Cultural Computing (BESC), IEEE, Oct. 2019, pp. 1–4. doi: 10.1109/BESC48373.2019.8962995.

F. Li, “Cloud-native database systems at Alibaba,” Proc. VLDB Endow., vol. 12, no. 12, pp. 2263–2272, Aug. 2019, doi: 10.14778/3352063.3352141.

A. Pereira Ferreira and R. Sinnott, “A Performance Evaluation of Containers Running on Managed Kubernetes Services,” in 2019 IEEE International Conference on Cloud Computing Technology and Science (CloudCom), IEEE, Dec. 2019, pp. 199–208. doi: 10.1109/CloudCom.2019.00038.

M. Copeland and M. Jacobs, “Azure Kubernetes Services: Container Security,” in Cyber Security on Azure: An IT Professional’s Guide to Microsoft Azure Security, Springer, 2020, pp. 197–226.

S. K. Malaraju, “Anticipation of Data Migration Challenges for VMware Servers in ISO Compliant Environment,” J. Adv. Dev. Res., vol. 10, no. 2, 2019.

T.-T. Nguyen, Y.-J. Yeom, T. Kim, D.-H. Park, and S. Kim, “Horizontal Pod Autoscaling in Kubernetes for Elastic Container Orchestration,” Sensors, vol. 20, no. 16, p. 4621, Aug. 2020, doi: 10.3390/s20164621.

L. Srinivasan and J. A. Nadaf, “Using Azure Kubernetes Services to Deploy a Micro Service-Based Application,” Int. J. Sci. Res. Comput. Sci., vol. 8, no. 4, pp. 110–117, 2021.

W. Ding, F. Luo, C. Gu, H. Lu, and Q. Zhou, “Performance-to-Power Ratio Aware Resource Consolidation Framework Based on Reinforcement Learning in Cloud Data Centers,” IEEE Access, vol. 8, pp. 15472–15483, 2020, doi: 10.1109/ACCESS.2020.2966673.

S. Lee, S. Son, J. Han, and J. Kim, “Refining Micro Services Placement over Multiple Kubernetes-orchestrated Clusters employing Resource Monitoring,” in 2020 IEEE 40th International Conference on Distributed Computing Systems (ICDCS), IEEE, Nov. 2020, pp. 1328–1332. doi: 10.1109/ICDCS47774.2020.00173.

B. Panda, S. C. Moharana, H. Das, and M. K. Mishra, “Energy Aware Virtual Machine Consolidation for Load Balancing in Virtualized Environment,” in 2019 International Conference on Communication and Electronics Systems (ICCES), IEEE, Jul. 2019, pp. 180–185. doi: 10.1109/ICCES45898.2019.9002373.

Y. Laili, F. Tao, F. Wang, L. Zhang, and T. Lin, “An Iterative Budget Algorithm for Dynamic Virtual Machine Consolidation under Cloud Computing Environment,” IEEE Trans. Serv. Comput., vol. 14, no. 1, pp. 1–1, 2018, doi: 10.1109/TSC.2018.2793209.

J. Kon, N. Mizusawa, A. Umezawa, S. Yamaguchi, and J. Tao, “Highly consolidated servers with container-based virtualization,” in 2017 IEEE International Conference on Big Data (Big Data), IEEE, Dec. 2017, pp. 2472–2479. doi: 10.1109/BigData.2017.8258205.

R. C. Thota, “Enhancing resilience in cloud native architectures using well-architected principles,” World J. Adv. Eng. Technol. Sci., vol. 1, no. 1, pp. 148–155, Dec. 2020, doi: 10.30574/wjaets.2020.1.1.0009.

K. A. Torkura, M. I. H. Sukmana, and C. Meinel, “Integrating Continuous Security Assessments in Microservices and Cloud Native Applications,” in Proceedings of the 10th International Conference on Utility and Cloud Computing, 2017, pp. 171–180. doi: 10.1145/3147213.3147229.

Downloads

Published

11.11.2021

How to Cite

Rajat Shrivastava. (2021). Modernizing Dark Pool Infrastructure: Machine Consolidation via AKS. International Journal of Intelligent Systems and Applications in Engineering, 9(4), 519–527. Retrieved from https://mail.ijisae.org/index.php/IJISAE/article/view/8268

Issue

Vol. 9 No. 4 (2021)

Section

Research Article

License

Creative Commons License

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

All papers should be submitted electronically. All submitted manuscripts must be original work that is not under submission at another journal or under consideration for publication in another form, such as a monograph or chapter of a book. Authors of submitted papers are obligated not to submit their paper for publication elsewhere until an editorial decision is rendered on their submission. Further, authors of accepted papers are prohibited from publishing the results in other publications that appear before the paper is published in the Journal unless they receive approval for doing so from the Editor-In-Chief.

IJISAE open access articles are licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. This license lets the audience to give appropriate credit, provide a link to the license, and indicate if changes were made and if they remix, transform, or build upon the material, they must distribute contributions under the same license as the original.