Banking comprehensive risk management system based on big data architecture of hybrid processing engines and databases

Shenglan Ma; Hao Wang; Botong Xu; Hong Xiao; Fangkai Xie; Hong Ning Dai; Ran Tao; Ruihua Yi; Tongsen Wang

doi:10.1109/SmartWorld.2018.00310

Banking comprehensive risk management system based on big data architecture of hybrid processing engines and databases

Shenglan Ma
, Hao Wang
, Botong Xu^*
, Hong Xiao
, Fangkai Xie
, Hong Ning Dai
, Ran Tao
, Ruihua Yi
, Tongsen Wang

^*Corresponding author for this work

Department of Computer Science

Research output: Chapter in book/report/conference proceeding › Conference proceeding › peer-review

3 Citations (Scopus)

Abstract

Banks are shifting from a simple credit risk management model to the comprehensive risk management model. Banking risks come from many channels and systems. Big data technology provides an innovative and effective solution for data management, and thus is suitable to be applied in the risk management scenarios that require high-quality data and complex data analysis. This paper firstly proposes big data architecture of hybrid processing engines and databases. This architecture uses Hadoop ecosystem with ETL and Spark processing engines, and using massive parallel processing databases (MPP), transactional databases, and HDFS. Then a banking comprehensive risk management system prototype based on the proposed big data architecture is implemented. Comparisons and evaluations clearly demonstrate that the proposed system has better performance.

Original language	English
Title of host publication	Proceedings - 2018 IEEE SmartWorld, Ubiquitous Intelligence and Computing, Advanced and Trusted Computing, Scalable Computing and Communications, Cloud and Big Data Computing, Internet of People and Smart City Innovations, SmartWorld/UIC/ATC/ScalCom/CBDCom/IoP/SCI 2018
Editors	Frederic Loulergue, Guojun Wang, Md Zakirul Alam Bhuiyan, Xiaoxing Ma, Peng Li, Manuel Roveri, Qi Han, Lei Chen
Publisher	IEEE
Pages	1844-1851
Number of pages	8
ISBN (Electronic)	9781538693803
DOIs	https://doi.org/10.1109/SmartWorld.2018.00310
Publication status	Published - 6 Dec 2018
Event	4th IEEE SmartWorld, 15th IEEE International Conference on Ubiquitous Intelligence and Computing, Advanced and Trusted Computing, Scalable Computing and Communications, Cloud and Big Data Computing, Internet of People and Smart City Innovations, SmartWorld/UIC/ATC/ScalCom/CBDCom/IoP/SCI 2018 - Guangzhou, China Duration: 7 Oct 2018 → 11 Oct 2018

Conference

Conference	4th IEEE SmartWorld, 15th IEEE International Conference on Ubiquitous Intelligence and Computing, Advanced and Trusted Computing, Scalable Computing and Communications, Cloud and Big Data Computing, Internet of People and Smart City Innovations, SmartWorld/UIC/ATC/ScalCom/CBDCom/IoP/SCI 2018
Country/Territory	China
City	Guangzhou
Period	7/10/18 → 11/10/18

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

SDG 8 Decent Work and Economic Growth

User-Defined Keywords

Big data
Comprehensive risk management
Hybrid architecture

Access to Document

10.1109/SmartWorld.2018.00310

Cite this

Ma, S., Wang, H., Xu, B., Xiao, H., Xie, F., Dai, H. N., Tao, R., Yi, R., & Wang, T. (2018). Banking comprehensive risk management system based on big data architecture of hybrid processing engines and databases. In F. Loulergue, G. Wang, M. Z. A. Bhuiyan, X. Ma, P. Li, M. Roveri, Q. Han, & L. Chen (Eds.), Proceedings - 2018 IEEE SmartWorld, Ubiquitous Intelligence and Computing, Advanced and Trusted Computing, Scalable Computing and Communications, Cloud and Big Data Computing, Internet of People and Smart City Innovations, SmartWorld/UIC/ATC/ScalCom/CBDCom/IoP/SCI 2018 (pp. 1844-1851). Article 8560288 IEEE. https://doi.org/10.1109/SmartWorld.2018.00310

Ma, Shenglan ; Wang, Hao ; Xu, Botong et al. / Banking comprehensive risk management system based on big data architecture of hybrid processing engines and databases. Proceedings - 2018 IEEE SmartWorld, Ubiquitous Intelligence and Computing, Advanced and Trusted Computing, Scalable Computing and Communications, Cloud and Big Data Computing, Internet of People and Smart City Innovations, SmartWorld/UIC/ATC/ScalCom/CBDCom/IoP/SCI 2018. editor / Frederic Loulergue ; Guojun Wang ; Md Zakirul Alam Bhuiyan ; Xiaoxing Ma ; Peng Li ; Manuel Roveri ; Qi Han ; Lei Chen. IEEE, 2018. pp. 1844-1851

@inproceedings{8392e86644294f03a71230430fda46a9,

title = "Banking comprehensive risk management system based on big data architecture of hybrid processing engines and databases",

abstract = "Banks are shifting from a simple credit risk management model to the comprehensive risk management model. Banking risks come from many channels and systems. Big data technology provides an innovative and effective solution for data management, and thus is suitable to be applied in the risk management scenarios that require high-quality data and complex data analysis. This paper firstly proposes big data architecture of hybrid processing engines and databases. This architecture uses Hadoop ecosystem with ETL and Spark processing engines, and using massive parallel processing databases (MPP), transactional databases, and HDFS. Then a banking comprehensive risk management system prototype based on the proposed big data architecture is implemented. Comparisons and evaluations clearly demonstrate that the proposed system has better performance.",

keywords = "Big data, Comprehensive risk management, Hybrid architecture",

author = "Shenglan Ma and Hao Wang and Botong Xu and Hong Xiao and Fangkai Xie and Dai, \{Hong Ning\} and Ran Tao and Ruihua Yi and Tongsen Wang",

note = "Publisher Copyright: {\textcopyright} 2018 IEEE. This work is partially supported by the Fujian Fumin Foundation; National Natural Science Foundation of China(NFSC) (No.61672170); NSFC-Guangdong Joint Fund (No.U1401251); the Science and Technology Planning Project of Guangdong Province (No.2015B090923004 and No. 2017A050501035); Science and Technology Program of Guangzhou (No. 201807010058).; 4th IEEE SmartWorld, 15th IEEE International Conference on Ubiquitous Intelligence and Computing, Advanced and Trusted Computing, Scalable Computing and Communications, Cloud and Big Data Computing, Internet of People and Smart City Innovations, SmartWorld/UIC/ATC/ScalCom/CBDCom/IoP/SCI 2018 ; Conference date: 07-10-2018 Through 11-10-2018",

year = "2018",

month = dec,

day = "6",

doi = "10.1109/SmartWorld.2018.00310",

language = "English",

pages = "1844--1851",

editor = "Frederic Loulergue and Guojun Wang and Bhuiyan, \{Md Zakirul Alam\} and Xiaoxing Ma and Peng Li and Manuel Roveri and Qi Han and Lei Chen",

booktitle = "Proceedings - 2018 IEEE SmartWorld, Ubiquitous Intelligence and Computing, Advanced and Trusted Computing, Scalable Computing and Communications, Cloud and Big Data Computing, Internet of People and Smart City Innovations, SmartWorld/UIC/ATC/ScalCom/CBDCom/IoP/SCI 2018",

publisher = "IEEE",

address = "United States",

}

Ma, S, Wang, H, Xu, B, Xiao, H, Xie, F, Dai, HN, Tao, R, Yi, R & Wang, T 2018, Banking comprehensive risk management system based on big data architecture of hybrid processing engines and databases. in F Loulergue, G Wang, MZA Bhuiyan, X Ma, P Li, M Roveri, Q Han & L Chen (eds), Proceedings - 2018 IEEE SmartWorld, Ubiquitous Intelligence and Computing, Advanced and Trusted Computing, Scalable Computing and Communications, Cloud and Big Data Computing, Internet of People and Smart City Innovations, SmartWorld/UIC/ATC/ScalCom/CBDCom/IoP/SCI 2018., 8560288, IEEE, pp. 1844-1851, 4th IEEE SmartWorld, 15th IEEE International Conference on Ubiquitous Intelligence and Computing, Advanced and Trusted Computing, Scalable Computing and Communications, Cloud and Big Data Computing, Internet of People and Smart City Innovations, SmartWorld/UIC/ATC/ScalCom/CBDCom/IoP/SCI 2018, Guangzhou, China, 7/10/18. https://doi.org/10.1109/SmartWorld.2018.00310

Banking comprehensive risk management system based on big data architecture of hybrid processing engines and databases. / Ma, Shenglan; Wang, Hao; Xu, Botong et al.
Proceedings - 2018 IEEE SmartWorld, Ubiquitous Intelligence and Computing, Advanced and Trusted Computing, Scalable Computing and Communications, Cloud and Big Data Computing, Internet of People and Smart City Innovations, SmartWorld/UIC/ATC/ScalCom/CBDCom/IoP/SCI 2018. ed. / Frederic Loulergue; Guojun Wang; Md Zakirul Alam Bhuiyan; Xiaoxing Ma; Peng Li; Manuel Roveri; Qi Han; Lei Chen. IEEE, 2018. p. 1844-1851 8560288.

Research output: Chapter in book/report/conference proceeding › Conference proceeding › peer-review

TY - GEN

T1 - Banking comprehensive risk management system based on big data architecture of hybrid processing engines and databases

AU - Ma, Shenglan

AU - Wang, Hao

AU - Xu, Botong

AU - Xiao, Hong

AU - Xie, Fangkai

AU - Dai, Hong Ning

AU - Tao, Ran

AU - Yi, Ruihua

AU - Wang, Tongsen

N1 - Publisher Copyright: © 2018 IEEE. This work is partially supported by the Fujian Fumin Foundation; National Natural Science Foundation of China(NFSC) (No.61672170); NSFC-Guangdong Joint Fund (No.U1401251); the Science and Technology Planning Project of Guangdong Province (No.2015B090923004 and No. 2017A050501035); Science and Technology Program of Guangzhou (No. 201807010058).

PY - 2018/12/6

Y1 - 2018/12/6

N2 - Banks are shifting from a simple credit risk management model to the comprehensive risk management model. Banking risks come from many channels and systems. Big data technology provides an innovative and effective solution for data management, and thus is suitable to be applied in the risk management scenarios that require high-quality data and complex data analysis. This paper firstly proposes big data architecture of hybrid processing engines and databases. This architecture uses Hadoop ecosystem with ETL and Spark processing engines, and using massive parallel processing databases (MPP), transactional databases, and HDFS. Then a banking comprehensive risk management system prototype based on the proposed big data architecture is implemented. Comparisons and evaluations clearly demonstrate that the proposed system has better performance.

AB - Banks are shifting from a simple credit risk management model to the comprehensive risk management model. Banking risks come from many channels and systems. Big data technology provides an innovative and effective solution for data management, and thus is suitable to be applied in the risk management scenarios that require high-quality data and complex data analysis. This paper firstly proposes big data architecture of hybrid processing engines and databases. This architecture uses Hadoop ecosystem with ETL and Spark processing engines, and using massive parallel processing databases (MPP), transactional databases, and HDFS. Then a banking comprehensive risk management system prototype based on the proposed big data architecture is implemented. Comparisons and evaluations clearly demonstrate that the proposed system has better performance.

KW - Big data

KW - Comprehensive risk management

KW - Hybrid architecture

UR - https://www.scopus.com/pages/publications/85060291294

UR - https://ieeexplore.ieee.org/document/8560288

U2 - 10.1109/SmartWorld.2018.00310

DO - 10.1109/SmartWorld.2018.00310

M3 - Conference proceeding

AN - SCOPUS:85060291294

SP - 1844

EP - 1851

BT - Proceedings - 2018 IEEE SmartWorld, Ubiquitous Intelligence and Computing, Advanced and Trusted Computing, Scalable Computing and Communications, Cloud and Big Data Computing, Internet of People and Smart City Innovations, SmartWorld/UIC/ATC/ScalCom/CBDCom/IoP/SCI 2018

A2 - Loulergue, Frederic

A2 - Wang, Guojun

A2 - Bhuiyan, Md Zakirul Alam

A2 - Ma, Xiaoxing

A2 - Li, Peng

A2 - Roveri, Manuel

A2 - Han, Qi

A2 - Chen, Lei

PB - IEEE

T2 - 4th IEEE SmartWorld, 15th IEEE International Conference on Ubiquitous Intelligence and Computing, Advanced and Trusted Computing, Scalable Computing and Communications, Cloud and Big Data Computing, Internet of People and Smart City Innovations, SmartWorld/UIC/ATC/ScalCom/CBDCom/IoP/SCI 2018

Y2 - 7 October 2018 through 11 October 2018

ER -

Ma S, Wang H, Xu B, Xiao H, Xie F, Dai HN et al. Banking comprehensive risk management system based on big data architecture of hybrid processing engines and databases. In Loulergue F, Wang G, Bhuiyan MZA, Ma X, Li P, Roveri M, Han Q, Chen L, editors, Proceedings - 2018 IEEE SmartWorld, Ubiquitous Intelligence and Computing, Advanced and Trusted Computing, Scalable Computing and Communications, Cloud and Big Data Computing, Internet of People and Smart City Innovations, SmartWorld/UIC/ATC/ScalCom/CBDCom/IoP/SCI 2018. IEEE. 2018. p. 1844-1851. 8560288 doi: 10.1109/SmartWorld.2018.00310

Banking comprehensive risk management system based on big data architecture of hybrid processing engines and databases

Abstract

Conference

UN SDGs

User-Defined Keywords

Access to Document

Other files and links

Fingerprint

Cite this