BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//Department of Electrical & Computer Engineering - ECPv6.15.20//NONSGML v1.0//EN
CALSCALE:GREGORIAN
METHOD:PUBLISH
X-ORIGINAL-URL:https://ece.northeastern.edu
X-WR-CALDESC:Events for Department of Electrical & Computer Engineering
REFRESH-INTERVAL;VALUE=DURATION:PT1H
X-Robots-Tag:noindex
X-PUBLISHED-TTL:PT1H
BEGIN:VTIMEZONE
TZID:America/New_York
BEGIN:DAYLIGHT
TZOFFSETFROM:-0500
TZOFFSETTO:-0400
TZNAME:EDT
DTSTART:20200308T070000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0400
TZOFFSETTO:-0500
TZNAME:EST
DTSTART:20201101T060000
END:STANDARD
BEGIN:DAYLIGHT
TZOFFSETFROM:-0500
TZOFFSETTO:-0400
TZNAME:EDT
DTSTART:20210314T070000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0400
TZOFFSETTO:-0500
TZNAME:EST
DTSTART:20211107T060000
END:STANDARD
BEGIN:DAYLIGHT
TZOFFSETFROM:-0500
TZOFFSETTO:-0400
TZNAME:EDT
DTSTART:20220313T070000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0400
TZOFFSETTO:-0500
TZNAME:EST
DTSTART:20221106T060000
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=America/New_York:20211202T150000
DTEND;TZID=America/New_York:20211202T160000
DTSTAMP:20260521T070154
CREATED:20211202T020920Z
LAST-MODIFIED:20211202T020920Z
UID:5327-1638457200-1638460800@ece.northeastern.edu
SUMMARY:ECE PhD Proposal Review: Tong Jian
DESCRIPTION:PhD Proposal Review: Robust Sparsified Deep Learning \nTong Jian \nLocation: Zoom Link \n(ID: 75807284369\, Passcode: 463BXOZk) \nAbstract: In this thesis\, we investigate and address robustness concerns about DNN-based real-life applications on resource constrained systems\, environment adaptation\, and adversarial learning\, respectively. We propose a means of compressing a Radio Frequency (RF) deep neural network architecture through weight pruning\, and provide a systems-level analysis of the implementation of such a pruned architecture at resource-constrained edge devices. In particular\, we jointly train and sparsify neural networks tailored to edge hardware implementations. Under only negligible accuracy loss (less than 1%)\, we can achieve at most 27.2x pruning rate for 50-device classification. We demonstrate the efficacy of our approach over multiple edge hardware platforms and our method yields significant inference speedups\, 11.5x on the FPGA and 3x on the smartphone\, as well as high efficiency.\nFurthermore\, we propose a new learn-prune-share (LPS) algorithm for achieving robustness to environment adaptation in the field of lifelong learning. Our method maintains a parsimonious neural network model and achieves exact no forgetting by splitting the network into task-specific partitions via an ADMM-based weight pruning strategy. Moreover\, a novel selective knowledge sharing scheme is integrated seamlessly into the ADMM optimization framework to address knowledge reuse. We show that our approach achieves significant improvement over the state-of-the-art methods on multiple real-life datasets.\nFinally\, we investigate the HSIC bottleneck as regularizer (HBaR) as a means to enhance adversarial robustness. We show that the HSIC bottleneck enhances robustness to adversarial attacks both theoretically and experimentally. In particular\, we prove that the HSIC bottleneck regularizer reduces the sensitivity of the classifier to adversarial examples. Our experiments on multiple benchmark datasets and architectures demonstrate that incorporating an HSIC bottleneck regularizer attains competitive natural accuracy and improves adversarial robustness\, both with and without adversarial examples during training.
URL:https://ece.northeastern.edu/event/ece-phd-proposal-review-tong-jian/
END:VEVENT
END:VCALENDAR