南方科技大学知识苑(SUSTech KC): 一种基于HBase的分区数据调整方法、系统及终端

Title	一种基于HBase的分区数据调整方法、系统及终端
Alternative Title	Partition data adjustment method and system based on HBase and terminal
Author	朱健俊; 周建二; 黄勇
First Inventor	朱健俊
Original applicant	鹏城实验室 ; 南方科技大学
First applicant	鹏城实验室
Address of First applicant	518000 广东省深圳市南山区西丽街道留仙洞万科云城一期8栋
Current applicant	鹏城实验室 ; 南方科技大学
Address of Current applicant	518000 广东省深圳市南山区西丽街道留仙洞万科云城一期8栋 (广东,深圳,南山区)
First Current Applicant	鹏城实验室
Address of First Current Applicant	518000 广东省深圳市南山区西丽街道留仙洞万科云城一期8栋 (广东,深圳,南山区)
Application Number	CN202010973409.7
Application Date	2020-09-16
Open (Notice) Number	CN112148792A
Date Available	2020-12-29
Status of Patent	实质审查
Legal Date	2021-01-15
Subtype	发明申请
SUSTech Authorship	Others
Abstract	本发明公开了一种基于HBase的分区数据调整方法、系统及终端，所述方法包括：搜集HBase分区内的分区数据，计算所述分区数据的倾斜程度；根据所述倾斜程度、行键所属分区的调整记录、行键相关的历史分区数据倾斜及整体分区倾斜确定行键的目标调整分区，并生成目标调整分区键；根据所述目标调整分区键对待调整行键进行修改，在所述待调整行键前添加所述目标调整分区键，完成行键分区的动态调整。本发明通基于分区内数据量的大小进行动态计算，得到分区数据量的变化，动态调整行键，对分区数据进行动态分配，同时考虑相同行键尽可能归属到相同的分区，既保证了数据查询的效率，又降低了分区数据倾斜情况，提高了系统资源利用率。
Other Abstract	The invention discloses an HBase-based partition data adjustment method, system and terminal, and the method comprises the steps: searching partition data in an HBase partition, and calculating the inclination degree of the partition data; determining a target adjustment subarea of the row key according to the inclination degree, the adjustment record of the subarea to which the row key belongs, the inclination of historical subarea data related to the row key and the inclination of the whole subarea, and generating a target adjustment subarea key; and modifying a row key to be adjusted according to the target adjustment partition key, and adding the target adjustment partition key in front of the row key to be adjusted to complete dynamic adjustment of the row key partition. According tothe method, dynamic calculation is carried out based on the data size in the partition to obtain the change of the partition data size, dynamically adjust the row keys and dynamically allocate the partition data, and meanwhile, the same row keys belong to the same partition as much as possible, so that the data query efficiency is guaranteed, the partition data inclination condition is reduced, system resource utilization rate is improved.
CPC Classification Number	G06F16/217 ; G06F16/2282 ; G06F16/27
IPC Classification Number	G06F16/27 ; G06F16/22 ; G06F16/21
INPADOC Legal Status	（ENTRY INTO FORCE OF REQUEST FOR SUBSTANTIVE EXAMINATION）[2021-01-15][CN]
INPADOC Patent Family Count	1
Extended Patent Family Count	1
Priority date	2020-09-16
Patent Agent	陈专
Agency	深圳市君胜知识产权代理事务所(普通合伙)
URL	[Source Record]
Data Source	PatSnap
Document Type	Patent
Identifier	http://kc.sustech.edu.cn/handle/2SGJ60CL/533496
Department	Institute of Future Networks Technology
Recommended Citation GB/T 7714	朱健俊,周建二,黄勇. 一种基于HBase的分区数据调整方法、系统及终端.

Files in This Item:
There are no files associated with this item.

If you have any objections to this item, please fill out the form below and the administrator will contact you as soon as possible.
Content:
Email：	*
Affiliation Sequential No:
Verification Code:	Refresh

Any comments and suggestions are welcomed.
Title:	*
Content:
Email：	*
Verification Code:	Refresh