publications

For an up-to-date list, please see my Google Scholar.

2024

  1. shridhar_genima.gif
    Generative Image as Action Models
    Mohit Shridhar, Yat Long Lo, and Stephen James
    arXiv preprint arXiv:2407.07875, 2024
  2. eugene_greenaug.gif
    Green Screen Augmentation Enables Scene Generalisation in Robotic Manipulation
    Eugene Teoh, Sumit Patidar, Xiao Ma, and Stephen James
    arXiv preprint arXiv:2407.07868, 2024
  3. chernyadev_bigym.gif
    BiGym: A Demo-Driven Mobile Bi-Manual Manipulation Benchmark
    Nikita Chernyadev, Nicholas Backshall, Xiao Ma, Yunfan Lu, Younggyo Seo, and Stephen James
    arXiv preprint arXiv:2407.07788, 2024
  4. seo_cqn.gif
    Continuous Control with Coarse-to-fine Reinforcement Learning
    Younggyo Seo, Jafar Uruç, and Stephen James
    arXiv preprint arXiv:2407.07787, 2024
  5. vosylius_randd.gif
    Render and Diffuse: Aligning Image and Action Spaces for Diffusion-based Behaviour Cloning
    Vitalis Vosylius, Younggyo Seo, Jafar Uruç, and Stephen James
    Robotics: Science and Systems, 2024
  6. mazzaglia_redundancy.gif
    Redundancy-aware Action Spaces for Robot Learning
    Pietro Mazzaglia, Nicholas Backshall, Xiao Ma, and Stephen James
    IEEE Robotics and Automation Letters, 2024
  7. xiao_hdp.gif
    Hierarchical Diffusion Policy for Kinematics-Aware Multi-Task Robotic Manipulation
    Xiao Ma, Sumit Patidar, Iain Haughton, and Stephen James
    Conference on Computer Vision and Pattern Recognition, 2024

2023

  1. xie_lapp.gif
    Language-conditioned path planning
    Amber Xie, Youngwoon Lee, Pieter Abbeel, and Stephen James
    Conference on Robot Learning, 2023
  2. wang_speedco.png
    Speed Co-Augmentation for Unsupervised Audio-Visual Pre-training
    Jiangliu Wang, Jianbo Jiao, Yibing Song, Stephen James, Zhan Tong, Chongjian Ge, Pieter Abbeel, and Yun-Hui Liu
    arXiv preprint arXiv:2309.13942, 2023
  3. seo_mvmwm.png
    Multi-view masked world models for visual robotic manipulation
    Younggyo Seo, Junsu Kim, Stephen James, Kimin Lee, Jinwoo Shin, and Pieter Abbeel
    International Conference on Machine Learning, 2023
  4. adeniji_lamp.png
    Language reward modulation for pretraining reinforcement learning
    Ademi Adeniji, Amber Xie, Carmelo Sferrazza, Younggyo Seo, Stephen James, and Pieter Abbeel
    arXiv preprint arXiv:2308.12270, 2023
  5. yan_teco.gif
    Temporally consistent transformers for video generation
    Wilson Yan, Danijar Hafner, Stephen James, and Pieter Abbeel
    International Conference on Machine Learning, 2023
  6. chen_stereopose.png
    Stereopose: Category-level 6d transparent object pose estimation from stereo images via back-view nocs
    Kai Chen, Stephen James, Congying Sui, Yun-Hui Liu, Pieter Abbeel, and Qi Dou
    IEEE International Conference on Robotics and Automation, 2023

2022

  1. xie_sim2seg.gif
    Sim-to-Real via Sim-to-Seg: End-to-end Off-road Autonomous Driving Without Real Data
    John So, Amber Xie, Sunggoo Jung, Jeffrey Edlund, Rohan Thakker, Ali Agha-mohammadi, Pieter Abbeel, and Stephen James
    Conference on Robot Learning, 2022
  2. radosavovic_mvp.png
    Real-World Robot Learning with Masked Visual Pre-training
    Ilija Radosavovic, Tete Xiao, Stephen James, Pieter Abbeel, Jitendra Malik, and Trevor Darrell
    Conference on Robot Learning, 2022
  3. seo_mwm.gif
    Masked World Models for Visual Control
    Younggyo Seo, Danijar Hafner, Hao Liu, Fangchen Liu, Stephen James, Kimin Lee, and Pieter Abbeel
    Conference on Robot Learning, 2022
  4. seo_apv.png
    Reinforcement learning with action-free pre-training from videos
    Younggyo Seo, Kimin Lee, Stephen L James, and Pieter Abbeel
    International Conference on Machine Learning, 2022
  5. yan_povt.gif
    Patch-based Object-centric Transformers for Efficient Video Generation
    Wilson Yan, Ryo Okumura, Stephen James, and Pieter Abbeel
    arXiv preprint arXiv:2206.04003, 2022
  6. liu_auto_lambda.png
    Auto-Lambda: Disentangling Dynamic Task Relationships
    Shikun Liu, Stephen James, Andrew J Davison, and Edward Johns
    Transactions on Machine Learning Research, 2022
  7. zhao_fine_tuning_meta.png
    On the Effectiveness of Fine-tuning Versus Meta-reinforcement Learning
    Zhao Mandi, Pieter Abbeel, and Stephen James
    Conference on Neural Information Processing Systems, 2022
  8. james_c2f_te.png
    Coarse-to-fine Q-attention with Tree Expansion
    Stephen James, and Pieter Abbeel
    arXiv preprint arXiv:2204.12471, 2022
  9. james_c2f_lpr.png
    Coarse-to-Fine Q-attention with Learned Path Ranking
    Stephen James, and Pieter Abbeel
    arXiv preprint arXiv:2204.01571, 2022
  10. wada_reorientbot.gif
    ReorientBot: Learning Object Reorientation for Specific-Posed Placement
    Kentaro Wada, Stephen James, and Andrew J Davison
    IEEE International Conference on Robotics and Automation, 2022
  11. wada_safepicking.gif
    SafePicking: Learning safe object extraction via object-level mapping
    Kentaro Wada, Stephen James, and Andrew J Davison
    IEEE International Conference on Robotics and Automation, 2022
  12. chen_self_train_pose.png
    Sim-to-Real 6D Object Pose Estimation via Iterative Self-training for Robotic Bin-picking
    Kai Chen, Rui Cao, Stephen James, Yichuan Li, Yun-Hui Liu, Pieter Abbeel, and Qi Dou
    European Conference on Computer Vision, 2022
  13. seo_harp.png
    HARP: Autoregressive Latent Video Prediction with High-Fidelity Image Generator
    Younggyo Seo, Kimin Lee, Fangchen Liu, Stephen James, and Pieter Abbeel
    IEEE International Conference on Image Processing, 2022
  14. james_bing.png
    Bingham Policy Parameterization for 3D Rotations in Reinforcement Learning
    Stephen James, and Pieter Abbeel
    arXiv preprint arXiv:2202.03957, 2022
  15. james_c2f.gif
    Coarse-to-Fine Q-attention: Efficient Learning for Visual Robotic Manipulation via Discretisation
    Stephen James, Kentaro Wada, Tristan Laidlow, and Andrew J Davison
    Conference on Computer Vision and Pattern Recognition, 2022
  16. james_qatt.png
    Q-attention: Enabling Efficient Learning for Vision-based Robotic Manipulation
    Stephen James, and Andrew J Davison
    IEEE Robotics and Automation Letters, 2022

2021

  1. lenton_esm.png
    End-to-End Egospheric Spatial Memory
    Daniel James Lenton, Stephen James, Ronald Clark, and Andrew Davison
    International Conference on Learning Representations, 2021
  2. landgraf_simstack.gif
    SIMstack: A Generative Shape and Instance Model for Unordered Object Stacks
    Zoe Landgraf, Raluca Scona, Tristan Laidlow, Stephen James, Stefan Leutenegger, and Andrew J Davison
    IEEE International Conference on Computer Vision, 2021
  3. toma_wpn.png
    Waypoint Planning Networks
    Alexandru-Iosif Toma, Hussein Ali Jaafar, Hao-Ya Hsueh, Stephen James, Daniel Lenton, Ronald Clark, and Sajad Saeedi
    Conference on Robots and Vision, 2021

2020

  1. wada_morefusion.gif
    MoreFusion: Multi-object Reasoning for 6D Pose Estimation from Volumetric Fusion
    Kentaro Wada, Edgar Sucar, Stephen James, Daniel Lenton, and Andrew J Davison
    Conference on Computer Vision and Pattern Recognition, 2020
  2. james_rlbench.jpg
    RLBench: The Robot Learning Benchmark & Learning Environment
    Stephen James, Zicong Ma, David Rovick Arrojo, and Andrew J Davison
    IEEE Robotics and Automation Letters, 2020
  3. bonardi_humans.png
    Learning One-Shot Imitation from Humans without Humans
    Alessandro Bonardi, Stephen James, and Andrew J Davison
    IEEE Robotics and Automation Letters, 2020

2019

  1. james_pyrep.png
    Pyrep: Bringing V-Rep to Deep Robot Learning
    Stephen James, Marc Freese, and Andrew J Davison
    arXiv preprint arXiv:1906.11176, 2019
  2. james_rcan.gif
    Sim-to-Real via Sim-to-Sim: Data-efficient Robotic Grasping via Randomized-to-Canonical Adaptation Networks
    Stephen James, Paul Wohlhart, Mrinal Kalakrishnan, Dmitry Kalashnikov, Alex Irpan, Julian Ibarz, Sergey Levine, Raia Hadsell, and Konstantinos Bousmalis
    Conference on Computer Vision and Pattern Recognition, 2019

2018

  1. james_tecnets.png
    Task-Embedded Control Networks for Few-Shot Imitation Learning
    Stephen James, Michael Bloesch, and Andrew J Davison
    Conference on Robot Learning, 2018
  2. matas_sim2realcloth.gif
    Sim-to-Real Reinforcement Learning for Deformable Object Manipulation
    Jan Matas, Stephen James, and Andrew J Davison
    Conference on Robot Learning, 2018

2017

  1. james_dr.gif
    Transferring End-to-End Visuomotor Control from Simulation to Real World for a Multi-Stage Task
    Stephen James, Andrew J Davison, and Edward Johns
    Conference on Robot Learning, 2017

2016

  1. james_deepq.png
    3D Simulation for Robot Arm Control with Deep Q-Learning
    Stephen James, and Edward Johns
    NeurIPS 2016 Workshop (Deep Learning for Action and Interaction), 2016