Publications

1. IMWUT ’23

   Synthetic Smartwatch IMU Data Generation from In-the-Wild ASL Videos

   Santhalingam, Panneer Selvam, Pathak, Parth, Rangwala, Huzefa, and Kosecka, Jana

   Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. Jun 2023

   Abs Bib

   The scarcity of training data available for IMUs in wearables poses a serious challenge for IMU-based American Sign Language (ASL) recognition. In this paper, we ask the following question: can we "translate" the large number of publicly available, in-the-wild ASL videos to their corresponding IMU data? We answer this question by presenting a video to IMU translation framework (Vi2IMU) that takes as input user videos and estimates the IMU acceleration and gyro from the perspective of user’s wrist. Vi2IMU consists of two modules, a wrist orientation estimation module that accounts for wrist rotations by carefully incorporating hand joint positions, and an acceleration and gyro prediction module, that leverages the orientation for transformation while capturing the contributions of hand movements and shape to produce realistic wrist acceleration and gyro data. We evaluate Vi2IMU by translating publicly available ASL videos to their corresponding wrist IMU data and train a gesture recognition model purely using the translated data. Our results show that the model using translated data performs reasonably well compared to the same model trained using measured IMU data.

   @article{10.1145/3596261,
     author = {Santhalingam, Panneer Selvam and Pathak, Parth and Rangwala, Huzefa and Kosecka, Jana},
     title = {Synthetic Smartwatch IMU Data Generation from In-the-Wild ASL Videos},
     year = {2023},
     issue_date = {June 2023},
     publisher = {Association for Computing Machinery},
     address = {New York, NY, USA},
     volume = {7},
     number = {2},
     url = {https://doi.org/10.1145/3596261},
     doi = {10.1145/3596261},
     journal = {Proc. ACM Interact. Mob. Wearable Ubiquitous Technol.},
     month = jun,
     articleno = {74},
     numpages = {34},
     keywords = {Data collection, Sign language recognition, Accessible computing, IMU, Wearables}
   }

2. SIGMETRICS ’23

   CoBF: Coordinated Beamforming in Dense MmWave Networks

   Zhang, Ding,  Santhalingam, Panneer Selvam, Pathak, Parth, and Zheng, Zizhan

   Proc. ACM Meas. Anal. Comput. Syst. May 2023

   Abs Bib

   With MIMO and enhanced beamforming features, IEEE 802.11ay is poised to create the next generation of mmWave WLANs that can provide over 100 Gbps data rate. However, beamforming between densely deployed APs and clients incurs unacceptable overhead. On the other hand, the absence of up-to-date beamforming information restricts the diversity gains available through MIMO and multi-users, reducing the overall network capacity. This paper presents a novel approach of "coordinated beamforming" (called CoBF) where only a small subset of APs are selected for beamforming in the 802.11ay mmWave WLANs. Based on the concept of uncertainty, CoBF predicts the APs whose beamforming information is likely outdated and needs updating. The proposed approach complements the existing per-link beamforming solutions and extends their effectiveness from link-level to network-level. Furthermore, CoBF leverages the AP uncertainty to create MU-MIMO groups through interference-aware scheduling in 802.11ay WLANs. With extensive experimentation and simulations, we show that CoBF can significantly reduce beamforming overhead and improve network capacity for 802.11ay WLANs.

   @article{10.1145/3589975,
     author = {Zhang, Ding and Santhalingam, Panneer Selvam and Pathak, Parth and Zheng, Zizhan},
     title = {CoBF: Coordinated Beamforming in Dense MmWave Networks},
     year = {2023},
     issue_date = {June 2023},
     publisher = {Association for Computing Machinery},
     address = {New York, NY, USA},
     volume = {7},
     number = {2},
     url = {https://doi.org/10.1145/3589975},
     doi = {10.1145/3589975},
     journal = {Proc. ACM Meas. Anal. Comput. Syst.},
     month = may,
     articleno = {31},
     numpages = {26},
     keywords = {mmwave, wlan, beamforming}
   }

3. TMC ’22

   Towards Unconstrained Vocabulary Eavesdropping With Mmwave Radar Using GAN

   Hu, Pengfei, Li, Wenhao, Ma, Yifan,  Santhalingam, Panneer Selvam, Pathak, Parth, Li, Hong, Zhang, Huanle, Zhang, Guoming, Cheng, Xiuzhen, and Mohapatra, Prasant

   IEEE Transactions on Mobile Computing May 2022

   Abs Bib PDF

   As acoustic communication systems become increasingly common in our daily life, eavesdropping brings severe security and privacy risks. Current methods of acoustic eavesdropping either provide low resolution due to the use of sub-6 GHz frequencies, work only for limited words based on classification approaches, or cannot work through-wall because of the use of optical sensors. In this paper, we present milliEar , a mmWave acoustic eavesdropping system that leverages the high-resolution of mmWave FMCW ranging and generative machine learning models to not only extract vibrations but to reconstruct the audio. milliEar combines speaker vibration estimation with conditional generative adversarial networks to eavesdrop and recover high-quality audios (i.e., with no vocabulary constraints). We implement and evaluate milliEar using off-the-shelf mmWave radars deployed in different scenarios and settings. Evaluation results clearly show that milliEar can accurately reconstruct the audio even at different distances, angles, and through the wall with different insulator materials. In addition, our subjective and objective evaluations demonstrate that the reconstructed audio has a strong similarity with the original audio.

   @article{9970305,
     author = {Hu, Pengfei and Li, Wenhao and Ma, Yifan and Santhalingam, Panneer Selvam and Pathak, Parth and Li, Hong and Zhang, Huanle and Zhang, Guoming and Cheng, Xiuzhen and Mohapatra, Prasant},
     journal = {IEEE Transactions on Mobile Computing},
     title = {Towards Unconstrained Vocabulary Eavesdropping With Mmwave Radar Using GAN},
     year = {2022},
     volume = {},
     number = {},
     pages = {1-14},
     doi = {10.1109/TMC.2022.3226690},
   }

4. IEEE SP ’22

   AccEar: Accelerometer Acoustic Eavesdropping with Unconstrained Vocabulary

   Hu, Pengfei, Zhuang, Hui,  Santhalingam, Panneer Selvam, Spolaor, Riccardo, Pathak, Parth, Zhang, Guoming, and Cheng, Xiuzhen

   In Proceedings of 2022 IEEE Symposium on Security and Privacy (SP) May 2022

   Abs Bib PDF

   With the increasing popularity of voice-based applications, acoustic eavesdropping has become a serious threat to users’ privacy. While on smartphones the access to microphones needs an explicit user permission, acoustic eavesdropping attacks can rely on motion sensors (such as accelerometer and gyroscope), which access is unrestricted. However, previous instances of such attacks can only recognize a limited set of pre-trained words or phrases. In this paper, we present AccEar, an accelerometerbased acoustic eavesdropping attack that can reconstruct any audio played on the smartphone’s loudspeaker with unconstrained vocabulary. We show that an attacker can employ a conditional Generative Adversarial Network (cGAN) to reconstruct highfidelity audio from low-frequency accelerometer signals. The presented cGAN model learns to recreate high-frequency components of the user’s voice from low-frequency accelerometer signals through spectrogram enhancement. We assess the feasibility and effectiveness of AccEar attack in a thorough set of experiments using audio from 16 public personalities. As shown by the results in both objective and subjective evaluations, AccEar successfully reconstructs user speeches from accelerometer signals in different scenarios including varying sampling rate, audio volume, device model, etc.

   @inproceedings{AccEar,
     author = {Hu, Pengfei and Zhuang, Hui and Santhalingam, Panneer Selvam and Spolaor, Riccardo and Pathak, Parth and Zhang, Guoming and Cheng, Xiuzhen},
     booktitle = {Proceedings of 2022 IEEE Symposium on Security and Privacy (SP)},
     title = {AccEar: Accelerometer Acoustic Eavesdropping with Unconstrained Vocabulary},
     year = {2022},
     volume = {},
     issn = {2375-1207},
     pages = {1530-1530},
     keywords = {},
     doi = {10.1109/SP46214.2022.00101},
     url = {https://doi.ieeecomputersociety.org/10.1109/SP46214.2022.00101},
     publisher = {IEEE Computer Society},
     address = {Los Alamitos, CA, USA},
     month = may,
   }

5. INFOCOM ’22

   MILLIEAR: Millimeter-wave Acoustic Eavesdropping with Unconstrained Vocabulary

   Hu, Pengfei, Ma, Yifan,  Santhalingam, Panneer Selvam, Pathak, Parth H, and Cheng, Xiuzhen

   In IEEE INFOCOM 2022 - IEEE Conference on Computer Communications May 2022

   Abs Bib PDF

   As acoustic communication systems become more common in homes and offices, eavesdropping brings significant security and privacy risks. Current approaches of acoustic eavesdropping either provide low resolution due to the use of sub-6 GHz frequencies, work only for limited words using classification, or cannot work through-wall due to the use of optical sensors. In this paper, we present MILLIEAR, a mmWave acoustic eavesdropping system that leverages the high-resolution of mmWave FMCW ranging and generative machine learning models to not only extract vibrations but to reconstruct the audio. MILLIEAR combines speaker vibration estimation with conditional generative adversarial networks to eavesdrop with unconstrained vocabulary. We implement and evaluate MIL-LIEAR using off-the-shelf mmWave radar deployed in different scenarios and settings. We find that it can accurately reconstruct the audio even at different distances, angles and through the wall with different insulator materials. Our subjective and objective evaluations show that the reconstructed audio has a strong similarity with the original audio.

   @inproceedings{9796940,
     author = {Hu, Pengfei and Ma, Yifan and Santhalingam, Panneer Selvam and Pathak, Parth H and Cheng, Xiuzhen},
     booktitle = {IEEE INFOCOM 2022 - IEEE Conference on Computer Communications},
     title = {MILLIEAR: Millimeter-wave Acoustic Eavesdropping with Unconstrained Vocabulary},
     year = {2022},
     volume = {},
     number = {},
     pages = {11-20},
     doi = {10.1109/INFOCOM48880.2022.9796940},
   }

6. HotMobile ’22

   Networked Beamforming in Dense MmWave WLANs

   Zhang, Ding,  Santhalingam, Panneer Selvam, Pathak, Parth, and Zheng, Zizhan

   In Proceedings of the 23rd Annual International Workshop on Mobile Computing Systems and Applications May 2022

   Abs Bib PDF

   Densely deployed base stations/access points (APs) are becoming increasingly common in mmWave networks with the need to provide high capacity and reliability to clients. However, frequent beamforming between clients and APs incurs an unacceptable overhead in densely deployed mmWave WLANs with many APs. This paper presents a novel approach of "networked beamforming" where only a small subset of APs are selected for beamforming in each beacon interval in mmWave WLANs. By building a prediction model based on the concept of uncertainty, our networked beamforming scheme predicts the APs whose beamforming information is likely outdated and needs updating. The proposed approach complements the existing per-link beamforming solutions and extends their effectiveness from link-level to network-level. With experimentation, we show that our scheme can significantly reduce beamforming overhead and improve network capacity for dense mmWave WLANs.

   @inproceedings{10.1145/3508396.3512871,
     author = {Zhang, Ding and Santhalingam, Panneer Selvam and Pathak, Parth and Zheng, Zizhan},
     title = {Networked Beamforming in Dense MmWave WLANs},
     year = {2022},
     isbn = {9781450392181},
     publisher = {Association for Computing Machinery},
     address = {New York, NY, USA},
     url = {https://doi.org/10.1145/3508396.3512871},
     doi = {10.1145/3508396.3512871},
     booktitle = {Proceedings of the 23rd Annual International Workshop on Mobile Computing Systems and Applications},
     pages = {102–108},
     numpages = {7},
     location = {Tempe, Arizona},
     series = {HotMobile '22},
   }

7. WACV ’21

   Hand Pose Guided 3D Pooling for Word-Level Sign Language Recognition

   Hosain, Al Amin,  Santhalingam, Panneer Selvam, Pathak, Parth, Rangwala, Huzefa, and Kosecka, Jana

   In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) Jan 2021

   Abs Bib PDF

   Gestures in American Sign Language (ASL) are characterized by fast, highly articulate motion of upper body, including arm movements with complex hand shapes and facial expressions. In this work, we propose a new method for word-level sign recognition from American Sign Language (ASL) using video. Our method uses both motion and hand shape cues while being robust to variations of execution. We exploit the knowledge of the body pose, estimated from an off-the-shelf pose estimator. Using the pose as a guide, we pool spatio-temporal feature maps from different layers of a 3D convolutional neural network. We train separate classifiers using pose guided pooled features from different resolutions and fuse their prediction scores during test time. This leads to a significant improvement in performance on the WLASL benchmark dataset [25]. The proposed approach achieves 10%, 12%, 9:5% and 6:5% performance gain on WLASL100, WLASL300, WLASL1000, WLASL2000 subsets respectively. To demonstrate the robustness of the pose guided pooling and proposed fusion mechanism, we also evaluate our method by fine tuning the model on another dataset. This yields 10% performance improvement for the proposed method using only 0:4% training data during fine tuning stage.

   @inproceedings{Hosain_2021_WACV,
     author = {Hosain, Al Amin and Santhalingam, Panneer Selvam and Pathak, Parth and Rangwala, Huzefa and Kosecka, Jana},
     title = {Hand Pose Guided 3D Pooling for Word-Level Sign Language Recognition},
     booktitle = {Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)},
     month = jan,
     year = {2021},
     pages = {3429-3439},
   }

8. IMWUT ’20

   mmASL: Environment-Independent ASL Gesture Recognition Using 60 GHz Millimeter-Wave Signals

   Santhalingam, Panneer Selvam, Hosain, Al Amin, Zhang, Ding, Pathak, Parth, Rangwala, Huzefa, and Kushalnagar, Raja

   Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. Mar 2020

   Abs Bib PDF

   Home assistant devices such as Amazon Echo and Google Home have become tremendously popular in the last couple of years. However, due to their voice-controlled functionality, these devices are not accessible to Deaf and Hard-of-Hearing (DHH) people. Given that over half a million people in the United States communicate using American Sign Language (ASL), there is a need of a home assistant system that can recognize ASL. The objective of this work is to design a home assistant system for DHH users (referred to as mmASL) that can perform ASL recognition using 60 GHz millimeter-wave wireless signals. mmASL has two important components. First, it can perform reliable wake-word detection using spatial spectrograms. Second, using a scalable and extensible multi-task deep learning model, mmASL can learn the phonological properties of ASL signs and use them to accurately recognize the ASL signs. We implement mmASL on 60 GHz software radio platform with phased array, and evaluate it using a large-scale data collection from 15 signers, 50 ASL signs and over 12K sign instances. We show that mmASL is tolerant to the presence of other interfering users and their activities, change of environment and different user positions. We compare mmASL with a well-studied Kinect and RGB camera based ASL recognition systems, and find that it can achieve a comparable performance (87% average accuracy of sign recognition), validating the feasibility of using 60 GHz mmWave system for ASL sign recognition.

   @article{mmASL,
     author = {Santhalingam, Panneer Selvam and Hosain, Al Amin and Zhang, Ding and Pathak, Parth and Rangwala, Huzefa and Kushalnagar, Raja},
     title = {mmASL: Environment-Independent ASL Gesture Recognition Using 60 GHz Millimeter-Wave Signals},
     year = {2020},
     issue_date = {March 2020},
     publisher = {Association for Computing Machinery},
     address = {New York, NY, USA},
     volume = {4},
     number = {1},
     url = {https://doi.org/10.1145/3381010},
     doi = {10.1145/3381010},
     journal = {Proc. ACM Interact. Mob. Wearable Ubiquitous Technol.},
     month = mar,
     articleno = {26},
     numpages = {30},
     keywords = {60 GHz milli-meter wave wireless, accessible computing, sign language recognition, gesture recognition, personal digital assistants},
   }

9. SECON ’20

   Expressive ASL Recognition using Millimeter-wave Wireless Signals

   Santhalingam, Panneer Selvam, Du, Yuanqi, Wilkerson, Riley, Hosain, Al Amin, Zhang, Ding, Pathak, Parth, Rangwala, Huzefa, and Kushalnagar, Raja

   In 2020 17th Annual IEEE International Conference on Sensing, Communication, and Networking (SECON) Mar 2020

   Abs Bib PDF

   Over half a million people in the United States use American Sign Language (ASL) as their primary mode of communication. Automatic ASL recognition would enable Deaf and Hard of Hearing (DHH) users to interact with others who are not familiar with ASL as well as voice-controlled digital assistants (e.g., Alexa, Siri, etc.). While ASL recognition has been extensively studied, there is a little attention given to recognition of ASL non-manual body markers. The non-manual markers are typically expressed through head, torso and shoulder movements, and add essential meaning and context to the signed sentences. In this work, we present ExASL, a sentence-level ASL recognition system using millimeter-wave radars. ExASL can recognize manual markers (hand gestures) and non-manual markers (head and torso movements). It utilizes multi-distance clustering to recognize body parts and cluster mmWave point clouds. We then present a multi-view deep learning algorithm that can learn from clustered body part representation for an expressive sentence-level recognition. Our evaluation shows that ExASL can recognize ASL sentences with a word error rate of 0.79%, sentence error rate of 1.25%, and non-manual markers with an accuracy of 83.5%.

   @inproceedings{ExASL,
     author = {Santhalingam, Panneer Selvam and Du, Yuanqi and Wilkerson, Riley and Hosain, Al Amin and Zhang, Ding and Pathak, Parth and Rangwala, Huzefa and Kushalnagar, Raja},
     booktitle = {2020 17th Annual IEEE International Conference on Sensing, Communication, and Networking (SECON)},
     title = {Expressive ASL Recognition using Millimeter-wave Wireless Signals},
     year = {2020},
     volume = {},
     number = {},
     pages = {1-9},
     doi = {10.1109/SECON48991.2020.9158441},
   }

10. FG ’20

    FineHand: Learning Hand Shapes for American Sign Language Recognition

    Hosain, Al Amin,  Santhalingam, Panneer Selvam, Pathak, Parth, Rangwala, Huzefa, and Košecká, Jana

    In 2020 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020) Mar 2020

    Abs Bib PDF

    American Sign Language recognition is a difficult gesture recognition problem, characterized by fast, highly articulate gestures. These are comprised of arm movements with different hand shapes, facial expression and head movements. Among these components, hand shape is the vital, often the most discriminative part of a gesture. In this work, we present an approach for effective learning of hand shape embeddings, which are discriminative for ASL gestures. For hand shape recognition our method uses a mix of manually labelled hand shapes and high confidence predictions to train deep convolutional neural network (CNN). The sequential gesture component is captured by recursive neural network (RNN) trained on the embeddings learned in the first stage. We will demonstrate that higher quality hand shape models can significantly improve the accuracy of final video gesture classification in challenging conditions with variety of speakers, different illumination and significant motion blurr. We compare our model to alternative approaches exploiting different modalities and representations of the data and show improved video gesture recognition accuracy on GMU-ASL51 benchmark dataset.

    @inproceedings{9320289,
      author = {Hosain, Al Amin and Santhalingam, Panneer Selvam and Pathak, Parth and Rangwala, Huzefa and Košecká, Jana},
      booktitle = {2020 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020)},
      title = {FineHand: Learning Hand Shapes for American Sign Language Recognition},
      year = {2020},
      volume = {},
      number = {},
      pages = {700-707},
      doi = {10.1109/FG47880.2020.00062},
    }

11. DSAA ’20’

    Body Pose and Deep Hand-shape Feature Based American Sign Language Recognition

    Hosain, Al Amin,  Santhalingam, Panneer Selvam, Pathak, Parth, Košecké, Jana, and Rangwala, Huzefa

    In 2020 IEEE 7th International Conference on Data Science and Advanced Analytics (DSAA) Mar 2020

    Abs Bib PDF

    This work presents an approach for American Sign Language (ASL) gesture recognition from videos. Gestures are comprised of various upper body motions involving hand shapes, motion of both hands with facial expression and head movements. Previous approaches tackled this problem by directly learning 3D convolutional spatio-temporal models from video in a simplified settings with uniform backgrounds. To handle more complex variation in appearance and backgrounds we propose to exploit recent advances in estimation of 2D body pose using Deep Convolutional Neural Networks trained on large corpus of human pose annotations. We use the trajectories of 2D skeletal data estimated from video to train a baseline recursive neural network gesture recognition model. The basic model is further extended using embeddings of hand images obtained from another hand shape recognition model [15] with dynamics modeled by another recursive neural network. The final model learns how to fuse two Long Short Term Model (LSTM) recursive neural network models for skeletal and hand image data. We train and evaluate this model on the GMU-ASL51 dataset of 12 users and 51 ASL gestures [8] demonstrating its superior performance compared to several baseline models.

    @inproceedings{9260043,
      author = {Hosain, Al Amin and Santhalingam, Panneer Selvam and Pathak, Parth and Košecké, Jana and Rangwala, Huzefa},
      booktitle = {2020 IEEE 7th International Conference on Data Science and Advanced Analytics (DSAA)},
      title = {Body Pose and Deep Hand-shape Feature Based American Sign Language Recognition},
      year = {2020},
      volume = {},
      number = {},
      pages = {207-215},
      doi = {10.1109/DSAA49011.2020.00033},
    }

12. DSAA ’19

    Sign Language Recognition Analysis using Multimodal Data

    Hosain, Al Amin,  Santhalingam, Panneer Selvam, Pathak, Parth, Košecká, Jana, and Rangwala, Huzefa

    In 2019 IEEE International Conference on Data Science and Advanced Analytics (DSAA) Mar 2019

    Abs Bib PDF

    Voice-controlled personal and home assistants (such as the Amazon Echo and Apple Siri) are becoming increasingly popular for a variety of applications. However, the benefits of these technologies are not readily accessible to Deaf or Hard-ofHearing (DHH) users. The objective of this study is to develop and evaluate a sign recognition system using multiple modalities that can be used by DHH signers to interact with voice-controlled devices. With the advancement of depth sensors, skeletal data is used for applications like video analysis and activity recognition. Despite having similarity with the well-studied human activity recognition, the use of 3D skeleton data in sign language recognition is rare. This is because unlike activity recognition, sign language is mostly dependent on hand shape pattern. In this work, we investigate the feasibility of using skeletal and RGB video data for sign language recognition using a combination of different deep learning architectures. We validate our results on a large-scale American Sign Language (ASL) dataset of 12 users and 13107 samples across 51 signs. It is named as GMUASL51. We collected the dataset over 6 months and it will be publicly released in the hope of spurring further machine learning research towards providing improved accessibility for digital assistants.

    @inproceedings{8964180,
      author = {Hosain, Al Amin and Santhalingam, Panneer Selvam and Pathak, Parth and Košecká, Jana and Rangwala, Huzefa},
      booktitle = {2019 IEEE International Conference on Data Science and Advanced Analytics (DSAA)},
      title = {Sign Language Recognition Analysis using Multimodal Data},
      year = {2019},
      volume = {},
      number = {},
      pages = {203-210},
      doi = {10.1109/DSAA.2019.00035},
    }

13. ICCCN ’19

    Characterizing Interference Mitigation Techniques in Dense 60 GHz mmWave WLANs

    Zhang, Ding,  Santhalingam, Panneer Selvam, Pathak, Parth, and Zheng, Zizhan

    In 2019 28th International Conference on Computer Communication and Networks (ICCCN) Mar 2019

    Abs Bib PDF

    Dense deployment of access points in 60 GHz WLANs can provide always-on gigabit connectivity and robustness against blockages to mobile clients. However, this dense deployment can lead to harmful interference between the links, affecting link data rates. In this paper, we attempt to better understand the interference characteristics and effectiveness of interference mitigation techniques using 802.11ad COTS devices and 60 GHz software radio based measurements. We first find that current 802.11ad COTS devices do not consider interference in sector selection, resulting in high interference and low spatial reuse. We consider three techniques of interference mitigation - channelization, sector selection and receive beamforming. First, our results show that channelization is effective but 60 GHz channels have non-negligible adjacent and non-adjacent channel interference. Second, we show that it is possible to perform interference-aware sector selection to reduce interference but its gains can be limited in indoor environment with reflections, and such sector selection should consider fairness in medium access and avoid asymmetric interference. Third, we characterize the efficacy of receive beamforming in combating interference and quantify the related overhead involved in the search for receive sector, especially in presence of blockages. We elaborate on the insights gained through the characterization and point out important outstanding problems through the study.

    @inproceedings{8847085,
      author = {Zhang, Ding and Santhalingam, Panneer Selvam and Pathak, Parth and Zheng, Zizhan},
      booktitle = {2019 28th International Conference on Computer Communication and Networks (ICCCN)},
      title = {Characterizing Interference Mitigation Techniques in Dense 60 GHz mmWave WLANs},
      year = {2019},
      volume = {},
      number = {},
      pages = {1-9},
      doi = {10.1109/ICCCN.2019.8847085},
    }

14. SECURWARE ’14

    DeadDrop-in-a-flash: information hiding at SSD NAND flash memory physical layer

    Srinivasan, Avinash, Wu, Jie,  Santhalingam, Panneer Selvam, and Zamanski, Jeffrey

    SECURWARE Mar 2014

    Abs Bib PDF

    The research presented in this paper, to the best of our knowledge, is the first attempt at information hiding (IH) at the physical layer of a Solid State Drive (SSD) NAND flash memory. SSDs, like HDDs, require a mapping between the Logical Block Addressing (LB) and physical media. However, the mapping on SSDs is significantly more complex and is handled by the Flash Translation Layer (FTL). FTL is implemented via a proprietary firmware and serves to both protect the NAND chips from physical access as well as mediate the data exchange between the logical and the physical disk. On the other hand, the Operating System (OS), as well as the users of the SSD have just the logical view and cannot bypass the FTL implemented by a proprietary firmware. Our proposed IH framework, which requires physical access to NAND registers, can withstand any modifications to the logical drive, which is accessible by the OS as well as users. Our framework can also withstand firmware updates and is 100% imperceptible in the overt-channels. Most importantly, security applications such as anti-virus, cannot detect information hidden using our framework since they lack physical access to the NAND registers. We have evaluated the performance of our framework through implementation of a working prototype, by leveraging the OpenSSD project, on a reference SSD.

    @article{srinivasan2014deaddrop,
      title = {DeadDrop-in-a-flash: information hiding at SSD NAND flash memory physical layer},
      author = {Srinivasan, Avinash and Wu, Jie and Santhalingam, Panneer Selvam and Zamanski, Jeffrey},
      journal = {SECURWARE},
      volume = {79},
      pages = {2014},
      year = {2014},
    }