Selected Article

Title

應用Kinect於3D人台系統的研發與建構

[[alternative]]Applying Kinect on the Development of a 3D Mannequin System

Creator

蕭世文

Description

計畫編號:NSC102-2221-E006-188-MY3

執行機構:國立成功大學工業設計學系(所)

研究期間:2015-08~2016-07

[[abstract]]人台是服裝設計中可讓設計構想快速地具體化的輔助工具,而當將此工具概念應用至電腦輔助服裝設計系統時,3D人台串連起了整個設計系統平台的開發與應用,這使得一個符合服裝設計所需的3D人台建構是相當重要的。在考量3D人台的可應用方向與技術層面後,本研究提出了應用Kinect於3D人台系統的研發與建構,透過Kinect的深度攝影機以即時量測得到受測者各部位特徵的人體尺寸,然後可輸入所得到的尺寸資料改變模型的控制點以變形得到專屬的3D人台。在所提出的方法論中,在將由Kinect掃瞄到的點進行準確度的校正和平滑化的處理後,可以融合影像處理方法的ICP演算法疊合出一個完整的人體外觀,進一步地可從中進行特徵辨識以得到實際的尺寸大小。最後,將這些人因尺寸輸入至應用特徵線重建的3D人台網格的形態變形中,即可透過網格細分得到具標準化與客製化的3D人台曲面,進而可以輔助服裝設計或用於3D虛擬服裝的展示與呈現中。為了驗證所提方法架構的可行性,本研究將以JAVA程式語言建構此互動式3D人台系統,並透過實測修正以得到具實用性的研究成果。本研究將以三年期計畫內容分年進行,各年的研究目標如下:第一年:進行以Kinect掃描人台的基礎研究1.建構完整的Kinect掃瞄資料的處理模式。2.建構可應用以Kinect進行3D掃描的ICP演算法架構。3.發展人台特徵的搜尋模式,並將量測到的人因尺寸套用至3D人台的形態變形中。第二年:以單一Kinect掃描人體的初階研究1.定義人體掃描所需標註的特徵點和其掃瞄方式。2.制訂人體掃描的流程步驟和其系統空間規劃。3.針對單一Kinect掃瞄模式發展完整的局部人體特徵搜尋演算法,並將量測到的人因尺寸套用至3D人台的形態變形中。第三年:以多支Kinect掃描人體的進階研究。1.建構多支Kinect掃描模式的共同座標校正方法。2.針對多支Kinect掃瞄模式發展完整的人體特徵搜尋演算法,並將量測到的人因尺寸套用至3D人台的形態變形中。3.完成所提出的互動式3D人台系統,並建立其3D人台資料庫。

[[abstract]]In the field of fashion design, 3D Mannequin is a kind of assisting tool which could rapidly realize the design concepts. While the concept of 3D Mannequin is applied to the computer added fashion design, it will connect with the development and the application of design platform and system. Thus, the situation mentioned above revealed a truth that it is very critical to develop a module of 3D Mannequin which would correspond with the necessity of fashion design. After the consideration for the possible application and technological development of 3D Mannequin, this research proposes a concrete plan that developing and constructing a system of 3D Mannequin with Kinect. Through the implement with depth camera of Kinect, ergonomic measurements of objective human features could be attained real-time, and then the mesh morphing can be implemented through transformed the locations of the control-points on the model by inputting those ergonomic data to get an exclusive 3D mannequin model. In the proposed methodology, after the scanned points from the Kinect are revised for accuracy and smoothening, a complete human feature would be reconstructed by the ICP algorithm with the method of image processing. Also, the objective human feature could be recognized to analyze and get real measurements. Furthermore, the data of ergonomic measurements could be applied to shape morphing for the division of 3D Mannequin reconstructed by feature curves. Due to a standardized and customer-oriented 3D Mannequin would be generated by the implement of subdivision, the research could be applied to the fashion design or the presentation and display of 3D virtual clothes. In order to examine the practicality of research structure, an interactive system of 3D Mannequin would be constructed with JAVA program in this study. Through the revision of experiments the practicability-contained research result would come out. This researching plan would be implemented separately in three years. The research targets would be expounded as follows: The 1st year: The fundamental research of Mannequin scanned by Kinect. 1. To construct a complete module of data processing for the scanned points from Kinect. 2. To construct a structure of ICP algorithm that could be applied in 3D scanning by Kinect. 3. To develop the searching module for features of 3D Mannequin, and applied scanned ergonomic measurement to the shape morphing of 3D Mannequin. The 2nd year: The primary research of human scanned by single Kinect. 1. To define feature points of human scanning and the way they be scanned. 2. To scheme out the process and necessary equipments of human scanning. 3. To develop a complete algorithm of searching particular human feature with single Kinect, and applied scanned ergonomic measurement to the shape morphing of 3D Mannequin. The 3rd year: The advanced research of human scanned by multiple Kinect. 1. To construct a methodology for coordinate revision of multiple Kinect scanning. 2. To develop a complete algorithm of searching whole human feature with multiple Kinect, and applied scanned ergonomic measurement to the shape morphing of 3D Mannequin. 3. To complete the interactive system of 3D Mannequin, and build a database of 3D Mannequin.