Portfolio

What I did

论文

  • MagicToon: A 2D-to-3D Creative Cartoon Modeling System with Mobile AR
    冯乐乐,杨旭波,肖双九
    IEEE Virtual Reality 2017

    本文提出了MagicToon, 一个基于移动增强现实环境的交互式建模系统,让儿童可以从他们绘制的二维手绘图中创建三维卡通场景。我们的系统由两部分组成:一个二维到三维的自动化建模系统,以及一个交互式的模型编辑系统。结果显示,相比于传统的基于草图的建模系统,本系统更加易于使用;相比于增强现实绘本系统来说,本系统不局限于提前制作好的三维模型,可以更加充分地发挥儿童的创造力。

    Project Page
  • An Interactive 2D-to-3D Cartoon Modeling System
    冯乐乐,杨旭波,肖双九,姜帆
    The 10th International Conference on E-Learning and Games (Edutainment 2016)

    本文提出了一个快速将2D卡通图片转化成3D模型的系统,可以让非专业人员或儿童更加轻松地来创建自定义的3D模型。我们的系统使用了基于Poisson等式来生成三维模型的方法,它解决前人工作中许多针对建模类型的约束问题。我们还提出了一种新的纹理生成方法,来为3D模型的正反面都生成合适的纹理,从而得到用原始2D卡通图片着色的风格化卡通模型。结果显示,我们的方法可以大大简化传统的建模软件的建模流程。

    Project Page
  • 基于移动平台的实时物体追踪系统
    冯乐乐,杨旭波
    上海交通大学2014届优异学士学位论文

    本文分析了现有的基于自然特征的物体识别和追踪技术,设计并实现了一款基于移动终端的实时物体追踪系统,以用于增强现实的应用。我们通过实现一个使用FAST算子修改后的SIFT算法,来实现移动终端的物体识别。姿态估计则从识别出的原目标和帧图像的匹配关系得到变换矩阵,以此来显示三维物体。除此之外,我们还实现了一个PC端的管理工具,用于统 一管理所有预处理的目标图片。我们还对系统的健壮性和性能等方面进行了评估,并实现了一个在现实生活中的演示应用。

    Video

书籍

  • 《Unity Shader入门精要》

    出版日期:2016-06-01

    本书不仅要教会读者如何使用Unity Shader,更重要的是要帮助读者学习Unity中的一些渲染机制以及如何使用Unity Shader实现各种自定义的渲染效果,希望这本书可以为读者打开一扇新的大门,让读者离制作心目中杰出游戏的心愿更近一步。

    Buy Code

项目

  • 手游《蔚蓝战争》的海水渲染

    开发工具:Unity3D, Shader, C#

    2016年暑期在腾讯上海北极光引擎组实习期间支持的项目,为手游《蔚蓝战争》提供渲染技术支持,包括实现较高效率的战斗场景大范围的卡通海水渲染以及相关效果实现(如反射和焦散等)、天气变换系统和剪影特效等。

  • 游戏《欢乐树》

    开发工具:Unity3D, Shader, C#

    个人开发的独立游戏。玩家需要帮助欢乐树开满花朵。花朵可以由六种不同颜色的元素构成,每种元素有两种属性,速度(移动速度)和力量(生长速度),且不同类型的元素之间属性相克,例如红->绿->蓝->红。玩家在每个关卡需要让己方的元素占领所有区域即可获胜。期间,玩家可以利用通过每关得到的星星来升级属性或解锁新的元素。

    Video
  • 裸眼3D实时渲染系统

    开发工具:Unity3D, Shader, Compute Shader, C#

    该项目在Unity中通过输入游戏画面和场景的深度纹理来实时渲染成适合于裸眼3D的立体效果。支持4k分辨率,支持Windows平台。本项目通过GPU加速技术将算法效率提高了130%,达到了实时速度。

  • NPR实验室

    开发工具:Unity3D, Shader, C#

    该项目利用Unity3D来实现各种非真实感渲染效果,例如基于色调的卡通渲染,风格化的卡通高光渲染,实时铅笔手绘和轮廓线渲染等。该项目仍在不断更新中。

    Code
  • 图像铅笔画算法

    开发工具:Matlab

    该项目实现了Lu C等人在Combining sketch and tone for pencil drawing production一文中提出的图像铅笔画风格化的算法。

    Code
  • 2D流体模拟

    开发工具:Unity3D, Shader, C#

    该项目在Unity中使用Shader进行GPU加速,来实现实时的2D流体模拟。

    Video Code
  • 幻衣间

    开发工具:Unity3D, Json, C#, Apache Tomcat,MySQL

    高级软件工程课程大作业。幻衣间是一个在线虚拟试衣系统,用户可以通过本系统快速地虚拟试穿各类服装,方便地找到自己喜欢的衣服及搭配方式。本系统支持网络注册、登陆,调节模特身高、肤色等个性化选项,支持品牌、类型等搜索条件的筛选,还提供前去购买的功能,可以直接链接到网店去购买实体衣服。在该项目中,我负责客户端的实现,包括需求编写、界面设计、逻辑实现、与服务器端的通信等。

    Video
  • 手游《进击的忍者》(原名《忍者天下》)

    开发工具:Unity3D, C#

    《进击的忍者》是梦宝谷倾情推出的全3D超萌动漫手游。游戏继承了热门动漫火影忍者的剧情,同时也融入了很多现代化的游戏玩法。有忍村建设、忍者养成、忍术合成和搭配、装备、任务、副本、竞技、好友等。该项目是于2013年在DeNA上海实习期间参与开发的多平台手机游戏。独立开发了新版本中庄园、忍炼坊等模块的界面/逻辑功能;优化原有的战斗系统表现,优化和开发排行榜等功能;参与日本版的制作等。

  • 游戏《Let's Fly》

    开发工具:Unity3D, C#

    《Let's Fly》是一款飞行射击类游戏。该项目获得“谷歌2013年第四届Android应用开发中国大学生挑战赛”本科院校组全国三等奖;获得2013年上海交通大学软件学院软件展示会一等奖

    Video
  • 医疗康复系列游戏

    开发工具:Unity3D, Kinect, C#

    与校外体感交互公司合作开发的一款诣在通过训练不同的基础手势、帮助有运行缺陷的病人进行康复训练的游戏系统。根据医生的反馈,目前正在使用的医疗康复设备由于动作单一、缺乏趣味性,很容易使病人产生厌倦情绪。本项目把复杂的训练动作(比如说脑瘫、半身瘫病人的翻身、手指力量、站立等动作训练)进行分解,同时对简单的动作进行重复训练,逐步锻炼达到基本能力的形成或提高,最终使病人能够应对日常生活。系统还通过实际器械和虚拟游戏相结合的方式,通过游戏提高趣味性,达到定制的锻炼功能。该项目已经作为医民两用型康复系统的一部分投入浙江萧山医院和嘉兴中医院的试用中了。以该项目为子系统的医民两用型康复系统获得2013年“Kinect for Windows创新应用大赛”开发者组一等奖;获得2013年上海交通大学软件学院软件展示会一等奖

  • Kikyou体感游戏

    开发工具:Unity3D, Kinect, C#

    大二暑假大作业。《Kikyou》是一款基于Kinect的体感冒险游戏。游戏以软件学院的一名虚拟女生Kikyou为线索,讲叙了Kikyou因为过度劳累而昏迷,进入异度空间,并在小精灵的帮助下得到四个宝物离开异度空间的故事。游戏共分为四个关卡,如接水果、与敌人对战,难度依次增加,玩家可通过使用道具来回血、改变Kikyou状态,从而帮助自己通过关卡。游戏主要利用了Unity3D来构建3D场景,并结合Kinect来实现控制虚拟人物与虚拟场景之间的互动。该游戏获得2012年上海交通大学软件学院软件展示会一等奖

  • 我爱记账

    开发工具:Visual Studio, MySQL, C#

    大二数据库课程大作业。《我爱记账》是一款多用户、功能实用、界面精致的桌面版记账软件。你可以任意添加、更改和删除账户、账单(支出、支入和转账)、预算等信息,还可以使用查看年度报表、预算对比、账户对账等丰富的功能。软件还支持初始化数据信息、增加新的用户并设置权限。同时,你还可以使用备忘录功能,随时记下你的借入借出、生活小记等信息。

  • 大富翁Online

    开发工具:Unity3D, C#

    软件工程概论课程大作业。“大富翁Online”是根据大富翁棋改编的P2P的多人联网游戏。游戏中支持最多4人联网游戏,共有六个游戏角色可供选择,支持使用点数、购买点卡(共八种点卡)、买卖楼房等功能。凭借该游戏获得2012学年《软件工程概论》课程最佳小组称号

Publications

  • MagicToon: A 2D-to-3D Creative Cartoon Modeling System with Mobile AR
    Lele Feng, Xubo Yang and Shuangjiu Xiao
    IEEE Virtual Reality 2017

    We present MagicToon, an interactive modeling system with mobile augmented reality (AR) that allows children to build 3D cartoon scenes creatively from their own 2D cartoon drawings on paper. Our system consists of two major components: an automatic 2D-to-3D cartoon model creator and an interactive model editor to construct more complicated AR scenes. The results of our user study have shown that our system is easier to use compared with traditional sketch-based modeling systems and can give more play to children's innovations compared with AR coloring books.

    Project Page
  • An Interactive 2D-to-3D Cartoon Modeling System
    Lele Feng, Xubo Yang, Shuangjiu Xiao and Fan Jiang
    The 10th International Conference on E-Learning and Games (Edutainment 2016)

    In this paper, we propose an interactive system that can quickly convert a 2D cartoon painting into a 3D textured cartoon model, enabling non-professional adults and children to easily create personalized 3D contents. Our system exploits a new approach based on solving Poisson equations to generate 3D models, which is free from the limitations of spherical topology in prior works. We also propose a novel method to generate whole textures for both sides of the models to deliver colorful appearances, making it possible to obtain stylized models rendered with cartoon textures. The results have shown that our method can greatly simplify the modeling process comparing with both traditional modeling softwares and prior sketch-based systems.

    Project Page
  • Real-time Object Tracking And Pose Estimation On Mobile Phones
    Lele Feng, Xubo Yang
    Shanghai Jiaotong University 2014 Outstanding Bachelor Paper

    In this paper, we analyze the existing object recognition and tracking technology based on natural features, and implement a real-time object tracking system on mobile phones for some AR applications. The original SIFT is known to be a strong, but computationally expensive feature descriptor. FAST corner detection is fast, but the generated information of key points is poor. We achieved the object recognition on mobile phones through a modified version of the SIFT algorithm using FAST. And pose estimation can be obtained from the transformation matrix matching between the identified targets and frame, and then display three-dimensional objects in the screen. In addition, we implemented a PC client management tool for management of all preprocessed target pictures. We give detail descriptors on how we modified the algorithm to make it suitable for mobile phones. We present evaluations on robustness and performance of the system, and implement a demo application in real world. Finally, we discuss the direction of future works.

    Video

Books

  • Essentials of Learning Unity Shader

    Publication Date: 2016-06-01

    This book not only helps the readers learn how to use Unity Shader, more importantly to help the readers understand the rendering pipeline in Unity and how to use shaders to achieve a variety of effects. I hope this book will open a new door for the readers in rendering.

    Buy Code

Projects

  • Water Rendering in Name of The Nature

    Development Tools: Unity3D, Shader, C#

    In the summer of 2016, I participated in the development of the game Name of The Nature as an intern in the engine group of Aurora Studios in Tencent Shanghai. I was responsible for the cartoon water rendering and some related effects, such as reflection, caustics and weather system.

  • Happy Tree

    Development Tools: Unity3D, Shader, C#

    A personal independent game. The player needs to help the Happy Tree blooming. Flowers can be composed of six kinds of elements. Each element has two attributes, speed (moving speed) and strength (growth rate). The player needs to make his own elements occupying all regions in order to win.

    Video
  • Real-time Stereo Rendering System For Naked Eyes

    Development Tools: Unity3D, Shader, Compute Shader, C#

    This project intends to produce real-time stereo effects for nake eyes by using RGB and depth textures as input. By exploiting GPGPU, I increased the efficiency of the algorithm by 130% and finally achieved real-time rates. The system supports 4k resolution and Windows platform.

  • NPR Lab

    Development Tools: Unity3D, Shader, C#

    This project is intended to realize some NPR effecs by using Unity3D. These effects include tone-based shading, stylized highlights for cartoon rendering,real-time hatching, real-time pencil rendering and so on. This project is still under development.

    Code
  • Pencil Drawing Production

    Development Tools: Matlab

    This project implements the algorithm proposed by Lu C et al. in their paper Combining sketch and tone for pencil drawing production.

    Code
  • 2D Fluid Simulation

    Development Tools: Unity3D, Shader, C#

    This project is intended to port real-time 2D fluid simulation to Unity3D by using GPU acceleration.

    Video Code
  • Virtual Fitting Room

    Development Tools: Unity3D, Json, C#, Apache Tomcat,MySQL

    The course project for Advanced Introduction to Software Engineering. Virtual Fitting Room is an online system for consumers to find suitable clothes effectively. The system supports sign up and login, and the user can customize his/her virtual model by adjusting height, size, complexion and so on. The system also supports filtering based on brands, types and other conditions. If the user is attracted by some cloth, the system can direct to the shopping web page. In this project, I was responsible for the client-side realizations, including writing requirements, designing interfaces, coding and communicating with the server-side.

    Video
  • Ninja Fighters (Formerly known as Ninja World)

    Development Tools: Unity3D, C#

    Ninja Fighters is a 3D mobile game lauched by Mobage. The game inherits the story of the popular Japanese anime Naruto, and integrates a lot of modern gameplay in the meanwhile. I participated in the development of the game as an intern in DeNA China in 2013. I developed several important modules under the coorperation with my colleagues.

  • Let's Fly

    Development Tools: Unity3D, C#

    Let's Fly is a flight shooting game on Android platform. This project obtained the third prize in the Forth Android Application Development College Challenge Competition in 2013 and was one of top ten applications in the software exhibition of Software Engineering in Shanghai Jiao Tong University in 2013.

    Video
  • Game Series For Medical Rehabilitation

    Development Tools: Unity3D, Kinect, C#

    The game series aim to help patients with movement defects for sports training. According to the doctors' feedback, rehabilitation equipments make the patients boring easily due to the lack of interests. The system combines virtual games and real rehabilitation equipments to bring more joys to the patients. This project won the first prize in the Kinect for Windows Innovation Competition 2013 and was one of top ten applications in the software exhibition of Software Engineering in Shanghai Jiao Tong University in 2013.

  • Kikyou

    Development Tools: Unity3D, Kinect, C#

    Kikyou is a motion sensing game on PC. The background was that our heroine Kikyou was a student in Software Engineering who entered another world at the moment she fainted on the floor. The player controls the movements of Kikyou through a Kinect sensor and needs to help Kikyou leave this world under the help of a fairy. This project was one of top ten applications in the software exhibition of Software Engineering in Shanghai Jiao Tong University in 2012.

  • Love Keeping Accounts

    Development Tools: Visual Studio, MySQL, C#

    The course project for Database Principles and Applications.Love Keeping Accounts is a multi-user, practical desktop software with elegant interface.

  • Richman Online

    Development Tools: Unity3D, C#

    The course project for Introduction to Software Engineering. Richman Online is a P2P game, with which we obtained the title of “Top Venue” in this course in 2012.