当前查询到546条专利与查询词 "Zhang Dongdong"相关,搜索用时0.4843412秒!排序方式:
发明专利:298实用新型: 229外观设计: 19
298 条,当前第 1-10 条 下一页 最后一页 返回搜索页
申请号:201910896067.0 公开号:CN110851399A 主分类号:G06F16/14
摘要:【中文】本发明提供一种分布式文件系统文件数据块传输效率优化方法及系统,包括如下步骤:向主元数据节点发送文件查询请求;获取主元数据节点返回的数据块元数据信息;将数据块分解成设定长度值个区域同时生成对应的获取自身任务锁的任务线程并将所述的任务线程放入线程池;检测到线程池中有任务完成时释放任务锁将任务重新命名再重新执行任务分配;直至线程池所有任务完成,文件下载完毕.通过采用一个写入多个读取的读写算法,不暂停所有任务,只需暂停最大的任务,不中断下载,保证了负载均衡和数据传输效率,使文件数据块传输效率提高,提高集群系统性能。 【EN】The invention provides a method and a system for optimizing file data block transmission efficiency of a distributed file system, which comprises the following steps: sending a file query request to a main metadata node; acquiring data block metadata information returned by a main metadata node; decomposing the data block into areas with set length values, generating corresponding task threads for acquiring self task locks, and putting the task threads into a thread pool; when detecting that a task is completed in the thread pool, releasing a task lock to rename the task and then re-executing task allocation; and by adopting a read-write algorithm for writing in a plurality of reads, all tasks are not suspended, only the largest task is suspended, and the downloading is not interrupted, so that the load balance and the data transmission efficiency are ensured, the file data block transmission efficiency is improved, and the cluster system performance is improved.
详细信息 下载全文

申请号:201910930753.5 公开号:CN110851348A 主分类号:G06F11/36
摘要:【中文】本发明提供一种HDFS组件高可用性的自动测试方法及系统,方法包括如下步骤:S1.在HDFS集群的测试平台设置测试脚本;S2.配置测试脚本验证HDFS集群的命名节点NAMENODE存在备用节点;S3.配置测试脚本强制切换HDFS集群主备命名节点NAMENODE,并验证HDFS集群功能是否正常;S4.配置测试脚本模拟HDFS集群的命名节点NAMENODE故障,并验证HDFS集群功能。本发明提供的HDFS组件高可用性的自动测试方法及系统,通过自动化脚本的验证测试平台HDFS组件的高可用性,同时保留了执行日志,提高了测试效率,节约人力资源,为集群的HDFS高可用性测试提供了保证和依据。 【EN】The invention provides a method and a system for automatically testing high availability of an HDFS (Hadoop distributed File System), wherein the method comprises the following steps: s1, setting a test script on a test platform of an HDFS cluster; s2, configuring a test script to verify that a named node NAMENODE of the HDFS cluster has a standby node; s3, configuring a test script to forcibly switch the master and standby named nodes NAMENODE of the HDFS cluster, and verifying whether the function of the HDFS cluster is normal or not; and S4, configuring a test script to simulate a named node NAMENODE fault of the HDFS cluster, and verifying the function of the HDFS cluster. According to the method and the system for automatically testing the high availability of the HDFS component, the high availability of the HDFS component of the testing platform is verified through the automatic script, the execution log is reserved, the testing efficiency is improved, the human resources are saved, and guarantee and basis are provided for the high availability test of the HDFS of the cluster.
详细信息 下载全文

申请号:201911048544.4 公开号:CN111008181A 主分类号:G06F16/172
摘要:【中文】本发明提供一种分布式文件系统存储策略切换方法、系统、终端及存储介质,包括:设置分布式文件系统存储策略为副本存储策略和纠删码存储策略并将其中的一种存储策略设定为初始存储策略;设置存储策略切换条件;若分布式文件系统中的数据块符合所述切换条件则对所述数据块执行存储策略切换。本发明能够实现两种存储策略的自动切换,从而适应冷热数据变化的动态场景,进而提高集群存储效率。 【EN】The invention provides a method, a system, a terminal and a storage medium for switching storage strategies of a distributed file system, wherein the method comprises the following steps: setting a storage strategy of a distributed file system into a copy storage strategy and an erasure code storage strategy, and setting one of the copy storage strategy and the erasure code storage strategy as an initial storage strategy; setting storage strategy switching conditions; and if the data blocks in the distributed file system accord with the switching conditions, executing storage strategy switching on the data blocks. The invention can realize the automatic switching of two storage strategies, thereby adapting to the dynamic scene of cold and hot data change and further improving the cluster storage efficiency.
详细信息 下载全文

申请号:201911017712.3 公开号:CN111045923A 主分类号:G06F11/36
摘要:【中文】本发明提出的一种HBASE组件高可用性的测试方法、系统及设备,采用高可用HA强制切换、模拟进程故障等操作命令来验证HDFS组件的高可用性,同时选用Hadoop自带的基准测试工具TestDFSIO验证集群在发生主备切换后集群功能正常,HBASE组件服务功能不受影响,并且保留测试过程中的日志,可对执行记录进行追溯分析。 【EN】According to the method, the system and the equipment for testing the high availability of the HBASE component, provided by the invention, the high availability of the HDFS component is verified by adopting operation commands such as high available HA forced switching, process fault simulation and the like, and meanwhile, a testDFSIO (testDFSIO) self-contained benchmark testing tool of Hadoop is selected to verify that the cluster functions normally after the main/standby switching occurs, the service function of the HBASE component is not influenced, and a log in the testing process is reserved and an execution record can be traced and analyzed.
详细信息 下载全文

申请号:202010057938.2 公开号:CN111258871A 主分类号:G06F11/34
摘要:【中文】本发明涉及了一种分布式文件系统的验证方法、装置、设备及存储介质,其中方法包括:测试节点基于从分布式文件系统集群获取的存储策略列表确定指标参数‑存储规则对照表;测试节点根据所述存储策略列表中包含的存储策略生成测试数据,并将测试数据依据存储策略分别上传至分布式文件系统集群的相应存储路径下;对分布式文件系统集群中的测试数据分别多次执行影响测试数据的指标参数的指定操作;根据分布式文件系统集群日志分别计算测试数据的当前指标参数,并记录测试数据的当前存储路径;根据当前指标参数、当前存储路径和指标参数‑存储规则对照表验证分布式文件系统集群的存储策略的生效性。本发明实现了分布式文件系统的性能的验证。 【EN】The invention relates to a verification method, a verification device, verification equipment and a storage medium of a distributed file system, wherein the method comprises the following steps: the test node determines an index parameter-storage rule comparison table based on a storage strategy list acquired from the distributed file system cluster; the test node generates test data according to the storage strategies contained in the storage strategy list and uploads the test data to corresponding storage paths of the distributed file system cluster respectively according to the storage strategies; respectively executing specified operations of index parameters influencing the test data for multiple times on the test data in the distributed file system cluster; respectively calculating current index parameters of the test data according to the cluster logs of the distributed file system, and recording the current storage path of the test data; and verifying the effectiveness of the storage strategy of the distributed file system cluster according to the current index parameter, the current storage path and the index parameter-storage rule comparison table. The invention realizes the verification of the performance of the distributed file system.
详细信息 下载全文

申请号:202010131420.9 公开号:CN111274221A 主分类号:G06F16/18
摘要:【中文】本发明提供一种大规模集群组件服务版本变更测试系统,包括组件服务选择层、版本变更执行层、数据评估对比层;组件服务选择层,用于向版本变更执行层和数据评估对比层提供组件服务详细信息;组件服务详细信息提供详细选择项;版本变更执行层,用于提供用于获取数据的数据获取模块;数据评估对比层,用于提供详细数据对比,根据组件服务选择层提供的选择项和版本变更执行层提供的数据项评估数据并提供评估参考结果。用于评估大规模集群中使用升级域技术后组件版本变更对大规模集群存储、计算等业务的影响程度,为不同大规模平台因数据剧增所需组件版本变更业务提供一份准确评估系统,提高企业平台可用性及稳定性。 【EN】The invention provides a large-scale cluster component service version change testing system, which comprises a component service selection layer, a version change execution layer and a data evaluation comparison layer, wherein the version change execution layer comprises a plurality of modules; the component service selection layer is used for providing detailed information of the component service for the version change execution layer and the data evaluation comparison layer; the component service detail information provides detailed options; the version change execution layer is used for providing a data acquisition module for acquiring data; and the data evaluation comparison layer is used for providing detailed data comparison, evaluating data according to the option provided by the component service selection layer and the data item provided by the version change execution layer and providing an evaluation reference result. The method is used for evaluating the influence degree of the version change of the component on services such as large-scale cluster storage and calculation after the upgrade domain technology is used in the large-scale cluster, provides an accurate evaluation system for the version change service of the component required by different large-scale platforms due to data surge, and improves the usability and stability of enterprise platforms.
详细信息 下载全文

申请号:201911146513.2 公开号:CN110881740A 主分类号:A43B3/00
申请人:【中文】闽南理工学院【EN】Minnan University of Science and Technology 申请日:2019.11.21 公开日:2020.03.17
摘要:【中文】本发明属于保健用品技术领域,公开了一种新型保健鞋,设置有鞋体,所述鞋体的后端嵌装有计步器,所述鞋体的底部填充有气囊,所述气囊的下端粘贴有脚底垫,所述脚底垫内部嵌装有按摩装置;所述鞋体的鞋面处设置有透气孔,所述透气孔内部填充有过滤网。该新型保健鞋设置有按摩装置,实现脚部的按摩,缓解脚部疲劳;通过设置气囊,减轻了行走过程中的震动,提高了舒适性;通过安装计步器,能够有效对使用者行走的步数进行测量,智能化程度高。 【EN】The invention belongs to the technical field of health care products, and discloses a novel health care shoe which is provided with a shoe body, wherein a pedometer is embedded at the rear end of the shoe body, an air bag is filled at the bottom of the shoe body, a sole pad is adhered to the lower end of the air bag, and a massage device is embedded in the sole pad; the shoe is characterized in that air holes are formed in the vamp of the shoe body, and filter screens are filled in the air holes. The novel health-care shoe is provided with the massage device, so that the foot is massaged, and the foot fatigue is relieved; by arranging the air bag, the vibration in the walking process is reduced, and the comfort is improved; through the installation pedometer, can effectively measure the step number of user's walking, intelligent degree is high.
详细信息 下载全文

申请号:201910995380.X 公开号:CN110928836A 主分类号:G06F16/11
摘要:【中文】本发明提供一种基于HDFS的数据均衡优化方法、系统终端及存储介质,所述方法包括:初始化节点信息后,遍历各个节点,计算节点的剩余空间和平均剩余空间;计算平均剩余空间和各个节点的剩余空间的差值;获取集群的重新平衡阈值,根据所述差值与所述阈值计算迁移量并输出;根据各节点迁移量进行数据均衡,实现剩余空间的数据均衡。本发明提高了集群剩余空间的利用率,同时通过重新平衡阈值,给节点的迁移量提供可选择的范围,避免有些数据正被使用而无法进行迁移的情况。 【EN】The invention provides a data equalization optimization method based on an HDFS (Hadoop distributed File System), a system terminal and a storage medium, wherein the method comprises the following steps: after initializing node information, traversing each node, and calculating the residual space and the average residual space of the node; calculating the difference value between the average residual space and the residual space of each node; acquiring a rebalance threshold of the cluster, calculating a migration amount according to the difference and the threshold, and outputting the migration amount; and data equalization is carried out according to the migration quantity of each node, so that the data equalization of the residual space is realized. The invention improves the utilization rate of the cluster residual space, provides a selectable range for the migration amount of the nodes by rebalancing the threshold value, and avoids the condition that some data are used and cannot be migrated.
详细信息 下载全文

申请号:201911152452.0 公开号:CN110932874A 主分类号:H04L12/18
摘要:【中文】本发明提供一种分布式消息广播通知实现方法,包括以下步骤:加入集群中的节点请求消息中心订阅公共主题;节点再次请求消息中心订阅属于每个节点的私有主题;消息发送者在发送消息前请求消息中心,获取当前订阅公共主题的客户端数量,请求数据中心发送到公共主题;消息发送者将消息体发送后,等待来自私有主题上的消息,其中等待到至少M条消息,如果在指定时间内未等到预期数量的消息,判定为执行超时;集群内的节点接收到来自公共主题的消息后,根据消息中的标识信息以发出响应或者不做响应。本发明基于长连接的通信,并且解耦节点与节点间的依赖,可实现节点上下线状态可以快速被消息中心感知到,不影响消息到达。 【EN】The invention provides a distributed message broadcast notification implementation method, which comprises the following steps: a node added into the cluster requests a message center to subscribe a public topic; the node requests the message center to subscribe the private subject belonging to each node again; a message sender requests a message center before sending a message, acquires the number of clients currently subscribing a public theme, and requests a data center to send the public theme; after the message sender sends the message body, waiting for messages from the private subject, wherein at least M messages are waited for, if the expected number of messages are not waited for in the specified time, judging that the execution is overtime; and after receiving the message from the public theme, the nodes in the cluster send out response or do not respond according to the identification information in the message. The invention is based on the communication of long connection, and decouples the dependence between the nodes, thus realizing that the on-line and off-line states of the nodes can be quickly sensed by the message center without influencing the arrival of the messages.
详细信息 下载全文

申请号:201911165931.6 公开号:CN110918114A 主分类号:B01J27/24
申请人:【中文】芜湖职业技术学院【EN】Wuhu Institute of Technology 申请日:2019.11.25 公开日:2020.03.27
摘要:【中文】本发明公开了一种酿酒废液脱色剂及其制备方法,该制备方法包括:将丝瓜络置于碱性溶液中进行热处理,然后洗涤、干燥、粉碎以制得丝瓜络粉;将钛酸丁酯、锌盐、乙酰丙酮、硫脲分散于无水乙醇中,接着加入无机酸、水、丝瓜络粉并搅拌,然后静置以得到溶胶;将溶胶进行煅烧以制得酿酒废液脱色剂;其中,碱性溶液由碱性化合物、水和醇组成;该酿酒废液脱色剂具有直接降解深色杂质同时可多次直接重复使用的特点,同时该制备方法具有原料易得、操作简单的特性。 【EN】The invention discloses a wine making waste liquid decolorizing agent and a preparation method thereof, wherein the preparation method comprises the following steps: placing the loofah sponge in an alkaline solution for heat treatment, and then washing, drying and crushing to prepare loofah sponge powder; dispersing butyl titanate, zinc salt, acetylacetone and thiourea in absolute ethyl alcohol, then adding inorganic acid, water and loofah sponge powder, stirring, and then standing to obtain sol; calcining the sol to prepare a wine making waste liquid decoloring agent; wherein the alkaline solution consists of an alkaline compound, water and alcohol; the wine making waste liquid decolorizing agent has the characteristics of directly degrading dark color impurities and being capable of being directly reused for many times, and meanwhile, the preparation method has the characteristics of easily obtained raw materials and simple operation.
详细信息 下载全文

298 条,当前第 1-10 条 下一页 最后一页 返回搜索页