Research · R-03

Scientific Machine Learning Researcher

Neural operators that predict touch from vision: DeepONet and Fourier DeepONet models for visual-to-tactile acceleration.

  • Built PyTorch multimodal CNN-MLP latent-fusion and DeepONet baselines for visual-to-tactile acceleration prediction; in preliminary runs, the time-domain DeepONet achieved 1.11 test RMSE, 35% below the CNN-MLP baseline's 1.72.
  • Evaluated material generalization using exclusive texture splits; used Fourier encodings to encourage oscillatory predictions.
  • Implemented a Fourier DeepONet on normalized log-FFT magnitudes to address spectral bias; achieved 0.92 preliminary test RMSE (17% below time-domain DeepONet; 46% below CNN-MLP) and explained over 80% of lower-frequency X-axis variance.
Nearest neighbors · any layercosine distance in the full space