设为首页   加入收藏   管理员登录 
院内新闻 更多 >>
 
通知公告 更多 >>
 
便捷链接
您所在的位置: 首页 >>学术报告与会议 >>正文
爱荷华大学李哲博士学术报告通知
日期:   2017-08-25          点击量:  

    应数学与统计学院邀请,美国爱荷华大学李哲博士于2017年8月24日访问我校,并在此期间做以下学术报告。

题目:SEP-Nets: Small and Effective Pattern Networks

时间:2017年8月24日14:30-16:30

地点:理科楼407

摘要:While going deeper has been witnessed to improve the performance of convolutional neural networks (CNN), going smaller for CNN has received increasing attention recently due to its attractiveness for mobile/embedded applications. It remains an active and important topic how to design a small network while retaining the performance of large and deep CNNs (e.g., Inception Nets, ResNets). Albeit there are already intensive studies on compressing the size of CNNs, the considerable drop of performance is still a key concern in many designs. This paper addresses this concern with several new contributions. First, we propose a simple yet powerful method for compressing the size of deep CNNs based on parameter binarization. The striking difference from most previous work on parameter binarization/ quantization lies at different treatments of 1 X 1 convolutions and k X k convolutions (k>1), where we only binarize k X k convolutions into binary patterns. The resulting networks are referred to as pattern networks. By doing this, we show that previous deep CNNs such as GoogLeNet and Inception-type Nets can be compressed dramatically with marginal drop in performance. Second, in light of the different functionalities of 1 X 1(data pro-jection/transformation) and k X k convolutions (pattern extraction), we propose a new block structure codenamed the pattern residual block that adds transformed feature maps generated by 1 X 1convolutions to the pattern feature maps generated by k X k convolutions, based on which we design a small network with ~ 1 million parameters. Combining with our parameter binarization, we achieve better performance on ImageNet than using similar sized networks including recently released Google MobileNets.

报告人简介:Zhe Li is a fourth year PhD student in computer science department in University of lowa. His research interests lie in the area of designing and analyzing optimization algorithms for machine learning, deep neural networks and its application to computer vision. He obtained his bachelor, master degree both in computer science from Xi’an Jiaotong University, South Dakota State University in 2010 and 2013, respectively. He has published papers in NIPS, AAAI, IJCAI and other conferences. In 2017, he received University of lowa post-comprehensive research award due to his outstanding research. Besides academic experience, he also did three summer research intern in General Motor research lab, Yahoo research, Snap research in 2015, 2016 and 2017, respectively.

 

 
地址:陕西省西安市咸宁西路28号   邮编:710049   版权所有:西安交通大学   站点设计:网络信息中心    陕ICP备06008037   联系我们 
读取内容中,请等待...