website templates

National Chung Cheng University

Welcome To Machine Vision and Learning Lab

日期 公告
2019/12/06 Lab Members Jiang,Ming-Xiu and Chen,Yan-Ming were interviewed about "Writing calligraphy on robot" by [USTV & UDN]
2019/10/18 Competition Work -- Writing calligraphy on robot
won the second place in the 2019 CTCI AI competition
2019/8/29 Completition Work -- Automatic Car: High-resolution scene depth prediction based on lidar and video
won the honorable mention in the 2019 AI hackthon
2019/5/22 Competition Work -- Let's tooth
won the third place in the 2018 national college software competition
2019/5/22 Competition Work -- I'm superstar
won the third place in the 2016 national college software competition
2019/5/22 Our MVL lab website is online

RESEARCH

The research direction and results of our laboratory in recent years

Mobirise

Writing calligraphy on obot

The research includes three areas of artistic creation, robotic automation, and artificial intelligence(AI). The AI technology is used to construct writing style of famous calligrapher, and writing with the arm.
Calligraphy style transfer: In the process of calligraphy style transfer, the method is based on CycleGAN. With a improvement of adding embedding layers to overcome that a single model can only convert a different style limit. By collecting the wrist movements during writing, the robot can simulate the calligrapher's writing. After the calligraphy are written.
Generating stroke orders and robot trajectory: Thining the transferred calligraphy lets the robotic arm simulate the calligrapher's writing action to write the calligraphy characters, we need to convert the coordinates of the thinned images to get the six-axis data. The six-axis sequence data of the calligraphy is provided to the robot arm for writing the calligraphy characters.

Mobirise

Incorporating attack information into makeup to attack deep learning models

Machine learning has evolved very rapidly, with good results in both computer vision and natural language processing. There are many deep learning techniques that are used in everyday life of humans such as autonomous vehicles and face recognition systems. Nowadays, the gradual dependence of human daily life on deep neural networks can lead to serious consequences, so the security of neural networks becomes very important. Therefore, the deep neural network has obvious weaknesses. We propose a method based on generating a confrontation network to generate a facial makeup picture that can deceive the face recognition system. We hide the perturbation of the attack in the results of the abnormal makeup photos that humans can’t detect. The experimental results show that we can not only generate high-quality facial makeup images, but also our attack results have a high attack success rate in the face recognition system.

Mobirise

Using the Generative Adversarial Network(GAN) to generate music rhythm games

The music rhythm game is currently a very popular game, and we propose to generate a music rhythm game spectrum based on the method of Generative Adversarial Network. The music is separated into two parts: the vocal and the soundtrack, which makes the generated spectrum closer to the real spectrum. The model consists of two concepts of Generative Adversarial Network: Conditional Generative Adversarial Nets (CGANs) for music information and Improved Wasserstein GAN (WGAN-GP) for better convergence of the model.

Mobirise

Be an Artist! Scribble Lines to Painting.

We propose a fully automated system that converts random graffiti into a painting. However, this is a serious challenge because the input graffiti can be very messy and hide multiple objects, so finding the correlation between these repeated lines and multiple objects is not a simple matter. In the system, we use selective search, sparse coding and Convolutional Neural Network (CNN), in which we use selective search to find the part of the object that may be the object of the graffiti; then use sparse coding to find the corresponding element; CNN sets the style to be converted. The final experimental results show that the methods we use have superior performance and produce artistic works.

Mobirise

Clothing style analysis and popular element capture

With more and more styles of clothing and accessories, regardless of the physical or online store, consumers will spend a lot of time looking for their favorite styles in many styles, so if consumers can give some photos of their favorite costumes, systematic analysis Find out the relevant information in the photo (such as the store address, matching related accessories, etc.). For the store, if you can collect the relevant clothing styles of the customers, you can adjust the purchase styles and the furnishings in the store according to this information, further recommend the related accessories to consumers according to the preferences of consumers and save consumers to find matching accessories. time. For garment manufacturers, they can analyze the data collected by various stores to know which styles are popular and those styles are unpopular, and thus become the next batch of new style design references.

Mobirise

Deep Learning for Sensor-Based Rehabilitation
Exercise Recognition and Evaluation

In this work, we aimed to evaluate four kinds of rehabilitation exercises at three levels: good, average, and bad. We propose a novel evaluation method by learning the best feature of each class. The idea was to design an evaluation matrix where each entry corresponded to one level of one exercise. By setting the largest number in one entry, the evaluation matrix could be used along with the output
layer of the deep learning model to infer the best feature of that exercise at a particular level. The evaluation score is obtained by examining the distance
measure of the current feature and the best feature of that class. We also collect a new rehabilitation exercise dataset for the rehabilitation exercise evaluation. It contains four different rehabilitation actions at three levels, defined by rehabilitation physicians.

<
Mobirise

Outdoor low resolution face recognition

The goal of this project is to compare low-resolution face images to verify that they are the same person. In today’s unrestricted environment, the effectiveness of face recognition often decreases due to posture factors, so we establish a normalization method to restore any face angle, thereby returning the face angle of any state to increase The effectiveness of face recognition. The project uses two Caffe model architectures: Matching-Convolutional NeuralNetwork (M-CNN) and Siamese Neural Network (SNN). Finally, the accuracy of the SNN model is more than 90%, which is higher than that of M-CNN.

Mobirise

Multiple attributes image classification

When sorting face images, there are inevitably some accessories in the images to be identified, such as sunglasses, scarves, earrings, etc., or external environmental factors such as light, angle, etc. These accessories or environmental factors are in people. The face image is called multiple attributes. We uses the existing Local Discriminant Embedding (LDE) algorithm as an extension to achieve multiple attribute classification purposes.

Mobirise

Sparse Coding

In recent years, sparse coding has been very popular in the field of computer vision and image processing. Sparse coding consists of a linear combination of input data, dictionary and input data. Sparse coding can be used for image denoising, restoration, and classification. The laboratory focuses on two research directions based on sparse coding: multiple attribute image classification and sparse coding of huge amounts of data.

LAB TEAM MEMBERS

Welcome to join us!

江振國
Chiang, Chen-Kuo

朱政安
Zhu, Zhen-An

李皓庭
Li, Hao-Ting

陳主恩
Chen, Chu-En

沈政璋
Shen, Jheng-Jhang

陳彥名
Chen,Yan-Ming

江明修
Jiang, Ming-Xiu

劉永平
Liu, Yung-Ping

黃韋翔
Huang, Wei-Hsiang

陳建豪
Chen, Chein-Hao

張世亞
Chang, Shih-Ya

張耘愷
Chang, Yun-Kai

蔡旻勳
Cia, Min-Syun

江軒綸
Chiang, Hsuan-Lun

李昀倫
Li, Yun-Lun

王佑安
Wang, Yu-An

Graduated Members

蔡宜伶
Tsai, Yi-Ling

林仕杰
Lin, Shi-Chieh

王振翰
Wang, Chen-Han

盧允中
Lu, Yun-Chung

宋東昱
Sung, Tung-Yu

蔡佳君
Tsai, Chia-Chun

賴怡辰
Lai, Yi-Chen

涂家維
Tu, Chia-Wei

康瑞麟
Kang, Ruie-Lin

陳政曄
Chen, Cheng-Yeh

游智翔
You, Chih-Hsiang

陳士民
Chen, Shih-Min

王暉宏
Wang, Hui-Hung

許翔宇
Hsu, Hsiang-Yu

王鴻凱
Wang, Hung-Kai

胡展碩
Hu, Chan-Shuo

楊文綉
Yang, Wen-Hsiu

黃子庭
Huang, Zi-Ting

Contact

Address:

Information Building 3F 310
No.168, Sec. 1, University Rd.,
Minhsiung Township, Chiayi Country, Taiwan (R.O.C.)

Location:

National Chung Cheng University
Information Building 3F 310

Phone:

05-2720411 #23160

E-mail:

ccumvllab@gmail.com

Copyright © 2018 CCU MVL Lab. All right reserved.
Generated with Mobirise