The RAVEN on TV and in the news

Photo from the Heartbeat episode "The Land of Normal" (Credit: NBC / Universal Television)
Photo from the Heartbeat episode “The Land of Normal” (Credit: NBC / Universal Television)

The RAVEN and Surgical Cockpit were featured on NBC’s Heartbeat last week! With the hardware and expertise of Ji Ma from Jacob Rosen’s lab at UCLA and Andrew from Applied Dexterity, NBC was able use just a bit of TV magic to film a dramatic presentation of the potentials of teleoperation. The episode features the special purple RAVEN 4-armed system that were the original prototypes for the first run on RAVEN II. The RAVEN IV setup was designed to investigate collaborative surgery between two surgeons at remote sites. The Heartbeat writers found some other uses of the spare pair of arms. You can watch the episode here and read a great article about surgical robots from Seattle’s Geekwire.

 

 

 

Applied Dexterity goes to NASA

We’ve been working with NASA for a few years in an effort to send the RAVEN to the International Space Station. NASA approached us with the opportunity to replace manual rodent dissections by astronauts with ground-based teleoperation of a modified RAVEN system. After several feasibility studies, Applied Dexterity was asked to bring a RAVEN to Johnson Space center to demonstrate ground-based operator training and performance under realistic time delay of one second.

After setting up the robot, we got the chance to tour NASA’s robotics facilities and check out a lot of their new and old robots, vehicles, and assistive technologies (http://er.jsc.nasa.gov/er4/).

The week consisted of training NASA personnel to use the robot and culminated in a timed demo of the proposed robotic procedures with time delay in front of astronauts and other high level NASA employees. You can read more about the project in KQED’s coverage and our earlier article in IEEE Pulse.

IMG_1412
Andy and John hanging out with the collection of robots and vehicles at JSC’s robotics hanger.
IMG_2773
Andy, John, and Dave with the NASA “meatball” in the same room that Apollo astronauts were placed for debrief after their missions.
20160222_154423
Dave and John in front of the refurbished Saturn V rocket in Rocket Park.
IMG_2755 cropped
A NASA consultant trains to use the RAVEN with standard block transfers before attempting rodent dissections.

Welcome John!

Applied Dexterity welcomes its newest employee, Dr. John Raiti, who is a senior research engineer.  John comes to us from Brown University where he earned his PhD in Biomedical Engineering. He was funded through a NASA EPSCoR grant as a robotics research scientist in the Department of Computer Science at Brown. He designed, created, and implemented web-browser interfaces for a variety of robotic platforms to improve human-robot interaction. John will be assisting Applied Dexterity engineers in developing surgical robot technologies for NASA and other customers.

Applied Dexterity at ICRA 2014 – Hong Kong

We’ve been very busy at Applied Dexterity in 2014, and we’ll have a lot of news to share with you shortly. To whet your news appetite: we’ll be at ICRA in Hong Kong for the first week of June! We’ll have the RAVEN with us and we’re doing our best to have some cool new toys at our booth, too.

The RAVEN community will be presenting two papers as well. The first is UC Berkeley’s paper Autonomous Multilateral Debridement with the Raven Surgical Robot by Ben Kehoe et al. Ben and his labmates used stereo vision to find and remove simulated dead tissue (debridement). This work presents the automation of a surgically relevant sub-task as a stepping stone towards supervisory control of surgical robots.

Our roboticist, Andrew Lewis, will also be presenting his work on Dynamic Gravity Compensation on the RAVEN. Using an accelerometer on the base of the robot, Andrew implemented a simple and effective method to calculate induced gravity torques on the RAVEN and serial robots in general. The addition of this sensor improves control in any base orientation and any gravitational state.

We can’t wait to meet up with the robotics community at large again. And feel free to follow us on Twitter to get the latest AD and RAVEN happenings.

Robotic Hand Developments at Harvard

Professor Robert Howe at Harvard University was recently featured on Engadget for his lab’s low-cost compliant hand. It utilizes only one motor with some clever mechanisms and takes advantage of inexpensive pressure sensors commonly used as barometers in smartphones. By vacuum forming a rubber skin to the sensors, they are able to get good sensitivity. The photographers made sure to interview Professor Howe with a familiar high-tech robot in the background as well.

http://www.engadget.com/2013/12/02/peripheral-vision-013/

RAVEN’s Big Screen Debut

Ender's Game Cast and Crew

To the delight of all of Applied Dexterity, the RAVEN is making it’s Big Screen debut in the first film adaptation of Orson Scott Card’s Sci-Fi masterpiece Ender’s Game. The staff of the film got in touch with Blake Hannaford and the BioRobotics lab at the University of Washington in the spring of 2012  to invite the RAVEN to be used in one of the scenes.

RAVEN on set

Lab members and PhD students Hawkeye King and Lee White spent a week in New Orleans preparing the robot for the scene, which culminated in an all day shoot with most of the movie’s stars. You can catch their masterful teleoperation skills during a closeup on the RAVEN just under an hour into the movie.

We are huge fans of the story, and we’re proud of the great work done by all of the BioRobotics Lab in making this happen. It truly is a sign that the RAVEN is ready for the future. The film premiers today, November 1st.

Autonomous Block Transfer

UCSC FLS demo

Ji Ma at the University of California Santa Cruz has successfully demonstrated an autonomous, vision-guided block transfer task using the RAVEN research robot. The FLS Block Transfer task is a standard test used to train and test surgeons. Now, it’s being used to train the RAVEN! Ji reports 100% success in block grasping and 94% success in placement. This is a huge step for the RAVEN community and comes hot on the heels of UC Berkeley’s successes with autonomous debridement.

Autonomous Debridement at UC Berkeley

UC Berkeley Autonomous Debridement Scenario
UC Berkeley Autonomous Debridement Scenario

Researchers at the University of California Berkeley have successfully demonstrated autonomous debridement capabilities with their RAVEN robot. This is the first example of a fully autonomous subtask implemented on the RAVEN. In a simplified scenario, the robot is able to detect the locations of dead tissue and remove it to a safe location.

Graduate students, under the supervision of Professors Ken Goldberg and Pieter Abbeel, were able to take advantage of the open source RAVEN architecture in order to integrate stereo camera hardware and  Model Predictive Control software. Together, these systems are used to enable a vision-guided, autonomous application for the the robot. One day, this contribution can be used to enable surgery in remote locations where a surgeon may only have limited control of the robot due to communication limitations. A paper detailing the methods has been submitted to the IEEE for publication in 2014. This work indicates a major contribution to the field of robotic surgery and machine learning from a RAVEN team.

The advancements from the Berkeley team are shared with the RAVEN community by providing other users with their code. Several teams are actively working on adapting this software for their own research goals.

Find more information at the team’s RAVEN site.

New Members of the RAVEN Community

Applied Dexterity would like to welcome the four newest members of the RAVEN community. Between May and July, five new RAVEN systems were sent to four top surgical research institutions, including the first international community members.

We are pleased to welcome the following groups, we know that they will put their RAVENs to good use:

CHARM: Collaborative Haptics and Robotics in Medicine – Stanford University

Laboratory of Informatics, Robotics, and Microelectronics – University of Montpellier, France

Robotics Laboratory – University of Central Florida

CSTAR: Canadian Surgical Technologies and Advanced Robotics – University of Western Ontario, Canada

 

 

Safety approval for RAVEN Electronics

Yesterday, a representative from the Canadian Standards Association (CSA) made the trek down to Seattle to inspect the electronics that will be headed shortly to the University of Western Ontario. The systems were given the approval of the CSA and are now proudly wearing the blue sticker with the official seal of approval for electrical shock and fire safety. We are very proud of this achievement and will be able to furnish this safety specification to local and international customers in the future!