MagicToon: A 2D-to-3D Creative Cartoon Modeling System with Mobile AR
Lele Feng, Xubo Yang and Shuangjiu Xiao
IEEE Virtual Reality 2017

We present MagicToon, an interactive modeling system with mobile augmented reality (AR) that allows children to build 3D cartoon scenes creatively from their own 2D cartoon drawings on paper. Our system consists of two major components: an automatic 2D-to-3D cartoon model creator and an interactive model editor to construct more complicated AR scenes. The results of our user study have shown that our system is easier to use compared with traditional sketch-based modeling systems and can give more play to children's innovations compared with AR coloring books.

An Interactive 2D-to-3D Cartoon Modeling System
Lele Feng, Xubo Yang, Shuangjiu Xiao and Fan Jiang
The 10th International Conference on E-Learning and Games (Edutainment 2016)

In this paper, we propose an interactive system that can quickly convert a 2D cartoon painting into a 3D textured cartoon model, enabling non-professional adults and children to easily create personalized 3D contents. Our system exploits a new approach based on solving Poisson equations to generate 3D models, which is free from the limitations of spherical topology in prior works. We also propose a novel method to generate whole textures for both sides of the models to deliver colorful appearances, making it possible to obtain stylized models rendered with cartoon textures. The results have shown that our method can greatly simplify the modeling process comparing with both traditional modeling softwares and prior sketch-based systems.

Real-time Object Tracking And Pose Estimation On Mobile Phones
Lele Feng, Xubo Yang
Shanghai Jiaotong University 2014 Outstanding Bachelor Paper

In this paper, we analyze the existing object recognition and tracking technology based on natural features, and implement a real-time object tracking system on mobile phones for some AR applications. The original SIFT is known to be a strong, but computationally expensive feature descriptor. FAST corner detection is fast, but the generated information of key points is poor. We achieved the object recognition on mobile phones through a modified version of the SIFT algorithm using FAST. And pose estimation can be obtained from the transformation matrix matching between the identified targets and frame, and then display three-dimensional objects in the screen. In addition, we implemented a PC client management tool for management of all preprocessed target pictures. We give detail descriptors on how we modified the algorithm to make it suitable for mobile phones. We present evaluations on robustness and performance of the system, and implement a demo application in real world. Finally, we discuss the direction of future works.

Essentials of Learning Unity Shader

Publication Date: 2016-06-01

This book not only helps the readers learn how to use Unity Shader, more importantly to help the readers understand the rendering pipeline in Unity and how to use shaders to achieve a variety of effects. I hope this book will open a new door for the readers in rendering.

Water Rendering in Name of The Nature

Development Tools: Unity3D, Shader, C#

In the summer of 2016, I participated in the development of the game Name of The Nature as an intern in the engine group of Aurora Studios in Tencent Shanghai. I was responsible for the cartoon water rendering and some related effects, such as reflection, caustics and weather system.

Happy Tree

Development Tools: Unity3D, Shader, C#

A personal independent game. The player needs to help the Happy Tree blooming. Flowers can be composed of six kinds of elements. Each element has two attributes, speed (moving speed) and strength (growth rate). The player needs to make his own elements occupying all regions in order to win.

Real-time Stereo Rendering System For Naked Eyes

Development Tools: Unity3D, Shader, Compute Shader, C#

This project intends to produce real-time stereo effects for nake eyes by using RGB and depth textures as input. By exploiting GPGPU, I increased the efficiency of the algorithm by 130% and finally achieved real-time rates. The system supports 4k resolution and Windows platform.

NPR Lab

Development Tools: Unity3D, Shader, C#

This project is intended to realize some NPR effecs by using Unity3D. These effects include tone-based shading, stylized highlights for cartoon rendering，real-time hatching, real-time pencil rendering and so on. This project is still under development.

Pencil Drawing Production

Development Tools: Matlab

This project implements the algorithm proposed by Lu C et al. in their paper Combining sketch and tone for pencil drawing production.

2D Fluid Simulation

Development Tools: Unity3D, Shader, C#

This project is intended to port real-time 2D fluid simulation to Unity3D by using GPU acceleration.

Virtual Fitting Room

Development Tools: Unity3D, Json, C#, Apache Tomcat，MySQL

The course project for Advanced Introduction to Software Engineering. Virtual Fitting Room is an online system for consumers to find suitable clothes effectively. The system supports sign up and login, and the user can customize his/her virtual model by adjusting height, size, complexion and so on. The system also supports filtering based on brands, types and other conditions. If the user is attracted by some cloth, the system can direct to the shopping web page. In this project, I was responsible for the client-side realizations, including writing requirements, designing interfaces, coding and communicating with the server-side.

Ninja Fighters (Formerly known as Ninja World)

Development Tools: Unity3D, C#

Ninja Fighters is a 3D mobile game lauched by Mobage. The game inherits the story of the popular Japanese anime Naruto, and integrates a lot of modern gameplay in the meanwhile. I participated in the development of the game as an intern in DeNA China in 2013. I developed several important modules under the coorperation with my colleagues.

Let's Fly

Development Tools: Unity3D, C#

Let's Fly is a flight shooting game on Android platform. This project obtained the third prize in the Forth Android Application Development College Challenge Competition in 2013 and was one of top ten applications in the software exhibition of Software Engineering in Shanghai Jiao Tong University in 2013.

Game Series For Medical Rehabilitation

Development Tools: Unity3D, Kinect, C#

The game series aim to help patients with movement defects for sports training. According to the doctors' feedback, rehabilitation equipments make the patients boring easily due to the lack of interests. The system combines virtual games and real rehabilitation equipments to bring more joys to the patients. This project won the first prize in the Kinect for Windows Innovation Competition 2013 and was one of top ten applications in the software exhibition of Software Engineering in Shanghai Jiao Tong University in 2013.

Kikyou

Development Tools: Unity3D, Kinect, C#

Kikyou is a motion sensing game on PC. The background was that our heroine Kikyou was a student in Software Engineering who entered another world at the moment she fainted on the floor. The player controls the movements of Kikyou through a Kinect sensor and needs to help Kikyou leave this world under the help of a fairy. This project was one of top ten applications in the software exhibition of Software Engineering in Shanghai Jiao Tong University in 2012.

Love Keeping Accounts

Development Tools: Visual Studio, MySQL, C#

The course project for Database Principles and Applications.Love Keeping Accounts is a multi-user, practical desktop software with elegant interface.

Richman Online

Development Tools: Unity3D, C#

The course project for Introduction to Software Engineering. Richman Online is a P2P game, with which we obtained the title of “Top Venue” in this course in 2012.