Yash Sanjay Bhalgat

I am a 1st year PhD student in Visual Geometry Group (VGG) at University of Oxford. My PhD is funded by the EPSRC + AWS fellowship as a part of the Autonomous Intelligent Machines & Systems (AIMS) CDT.

Previously, I was a Senior Researcher at Qualcomm AI Research, where I worked at the intersection of Computer Vision and Efficient Deep Learning. I developed pipelines on low-bit quantization [LSQ+, QKD], structured [StructConv] and unstructured pruning [LTP] of deep networks. Usecases included image & video classification / segmentation, pose & gaze estimation for AR/VR, etc.

I received my Masters in Computer Science from University of Michigan, Ann Arbor, and my Bachelors in Electrical Engineering (with minors in Computer Science) from Indian Institute of Technology (IIT), Bombay.

Please feel free to contact me if you are interested in my research or potential collaborations.

Email  /  CV  /  Scholar  /  Github  /  LinkedIn  /  Twitter

profile photo
News

  • [10/2021] 3D Hand Pose Estimation work with my intern John Yang has been accepted to WACV 2022.
  • [10/2021] Started my DPhil (PhD) at University of Oxford in Autonomous Intelligent Machines and Systems, funded by the EPSRC+AWS fellowship. 😊
  • [11/2020] I got promoted to Senior Machine Learning Researcher at Qualcomm AI Research. 😊
  • [09/2020] StructConv paper in accepted in NeurIPS 2020! 😃
  • [07/2020] Preprint for my work "Structured Convolutions for Efficient Neural Network Design" available.
  • [03/2020] LSQ+ paper accepted to the Efficient Deep Learning in Computer Vision workshop at CVPR 2020
  • [02/2020] Preprint for our work on "Learned Threshold Pruning" available.
  • [11/2019] 3rd position in the NeurIPS 2019 MicroNet competition ImageNet track!! - Leaderboard. Code is available here and here.

Research
Dynamic Iterative Refinement for Efficient 3D Hand Pose Estimation
John Yang, Yash Bhalgat, Simyung Chang, Fatih Porikli, Nojun Kwak
Winter Conference on Applications of Computer Vision (WACV), 2022

We propose a tiny deep network of which partial layers are recursively exploited for refining its previous estimations. During its iterative refinements, we employ learned gating criteria to decide whether to exit from the weight-sharing loop, allowing per-sample adaptation in our model. We also predict and exploit uncertainty estimations in the gating mechanism.

Structured Convolutions for Efficient Neural Network Design
Yash Bhalgat, Yizhe Zhang, Jamie Lin, Fatih Porikli
Neural Information Processing Systems (NeurIPS), 2020

We introduce a neat trick to enable the execution of convolution operations in the form of efficient, scaled, sum-pooling components. We present a Structural Regularization loss that enables this decomposition with negligible performance loss. Our method is competitive with other tensor decomposition and structured pruning methods.

Data-driven Weight Initialization with Sylvester Solvers
Debasmit Das, Yash Bhalgat, Fatih Porikli
Practical Machine Learning for Developing Countries Workshop, ICLR, 2021

We propose a data-driven scheme to initialize the parameters of a neural network. The initialization is cast as an optimization problem, which is restructured into the well-known Sylvester equation that has fast and efficient gradient-free solutions. We show that our proposed method is especially effective in few-shot and fine-tuning settings.

LSQ+: Improving low-bit quantization through learnable offsets and better initialization
Yash Bhalgat, Jinwon Lee, Markus Nagel, Tijmen Blankevoort, Nojun Kwak
Efficient Deep Learning in Computer Vision Workshop, CVPR, 2020

We introduce a general asymmetric quantization scheme with trainable scale and offset parameters. LSQ+ shows SOTA results for EfficientNet and MixNet outperforming LSQ for low-bit quantization.

Learned Threshold Pruning
Kambiz Azarian, Yash Bhalgat, Jinwon Lee, Tijmen Blankevoort
arxiv, 2020

We propose an end-to-end differentiable method for learning layerwise pruning thresholds which results in SOTA model compression ratios with AlexNet, ResNet and EfficientNet. Our method also generates a trail of checkpoints with different accuracy-efficiency operating points.

QKD: Quantization-aware Knowledge Distillation for Low-bit Quantization
Yash Bhalgat*, Jangho Kim*, Jinwon Lee, Chirag Patel, Nojun Kwak
arxiv, 2020

Low-bit quantization and KD often don't go well together, but both are important approaches to reduces a model's memory footprint. We propose an effective method to combine these two methods and show results that outperform all existing quantization/KD approaches.

Teacher-Student Learning Paradigm for Tri-training: An Efficient Method for Unlabeled Data Exploitation
Yash Bhalgat, Zhe Liu, Pritam Gundecha, Jalal Mahmud, Amita Misra
KONVENS, 2019

Teacher-student tri-training is a method for semi-supervised learning using 3 classifiers working using adaptive teacher and student thresholds.

Annotation-cost Minimization for Medical Image Segmentation using Suggestive Mixed Supervision Fully Convolutional Networks
Yash Bhalgat*, Meet Shah* Suyash Awate
Medical Imaging meets NeurIPS workshop, 2019

For Medical Image segmentation, we present a budget-based cost-minimization framework in a mixed-supervision setting via dense segmentations, bounding boxes, and landmarks.

CATSEYES: Categorizing Seismic structures with tessellated scattering wavelet networks
Yash Bhalgat, Jean Charlety, Laurent Duval
ICASSP, 2018

We use Scattering Wavelets transforms to extract sparse feature sets from seismic data. We show that using this method combined with simple PCA-based feature selection leads to promising classification performance in affordable computation time.

Hall of Fame

  • All India Rank 12 in IITJEE-Mains 2013 exam among 1.5 million students
  • All India Rank 155 in IITJEE-Advanced 2013 exam among 0.2 million students
  • Featured in National Top 30 for the International Astronomy Olympiad, 2013
  • Secured All India Rank 60 and awarded the KVPY Scholarship by Govt. of India
  • Among top 300 in India to compete in the Physics, Chemistry and Mathematics olympiads
  • Awarded Cargill Global Scholarship 2014-15 and selected in the 10-member Indian cohort to represent at the global seminar in Minneapolis, USA in 2016
  • Received the Undergraduate Research Award (URA02) for my Bachelors thesis at IIT Bombay

Music

To get away from my exciting yet stressful life as a computer scientist, I indulge myself into the realms of music. I spent my entire childhood learning Tabla, an Indian percussion instrument. I briefly also tried to learn the Piano, Drums and Harmonia but had to leave that for my higher studies. One day, I naturally started beatboxing (check this out) and I continue that passion to this day. Please checkout my music channels that I try to maintain regularly. :)


Website template borrowed from here.