The vehicle developed in Phase 3 is an FFMP (Phase 1) with Flying Camera functionality (Phase 2), but additionally a Listening Mobot, with which direct voice communication in 3D space is possible. The main motivation is to communicate with an autonomous mobot in natural language [50,46]. Natural language access to autonomous mobots has been studied in detail in the context of land-based robots [30], but not for hovering mobots. Because such a vehicle is supposed to stabilize itself automatically, the movements of the platform should only be controlled by high level spoken commands such as go up and turn left. These commands describe only relative movements. The actual control of the speed of the fans should be performed automatically by the MIMO system. I suggest 4 categories of speech commands in Phase 3:
- linear movements: up, down, left, right, forward, backward
- turning: turn left, turn right
- amount: slower, faster, stop
- camera related: zoom in, zoom out11
Michio Sugeno of the Tokyo University of Technology has built a helicopter [49,21,22,23,24] that is eventually supposed to accept 256 verbal commands, such as fly forward, hover, fly faster, stop the mission and return. "Tele-control is to be achieved using fuzzy control theory. Ultimately, our helicopter will incorporate voice-activated commands using natural language as 'Fly forward a little bit.' The idea is that a relatively inexperienced remote operator can use natural language voice commands rather than a couple of joysticks that may require months of training. These commands are naturally 'fuzzy' and hence fit into the fuzzy logic framework nicely" [49]. Although the controlling concept is interesting, this helicopter cannot operate indoors; with its overall body length of 3.57m, it is far away from the size requirements of a MAV of Phase 3.
For the same reasons, I suggest using outboard processing of language in Phase 3. Verbal commands are spoken into a microphone that is connected to a standard speech recognition system (e.g., [2,19]). The output is fed into the MIMO system.
This paper outlines the possibilities, the evolution, and the basic technical elements of autonomously hovering micro robots.
First, the paper describes the application Papa-TV-Bot: an autonomously hovering mobot with a wireless video camera. This vessel carries out requests for aerial photography missions. It can operate indoors and in obstacle rich areas, where it avoids obstacles automatically. This rotary-wing micro air vehicle (MAV) follows high level spoken commands, like follow me, and tries to evade capture.
In part two of the paper, a schedule for evolving a simple Flying Micro Platform (FFMP) to a Papa-TV-Bot is shown. In even later phases of the schedule, the mobot is supposed to understand complex spoken language such as "Give me a close up of John Doe from an altitude of 3 feet" and has refined situational awareness. Furthermore, it learns from experience, repairs itself, and is truly intelligent and highly responsible.
In the last part, a description of the basic technical elements of an FFMP is given; sensors, propulsion, and batteries are discussed in detail. A simple absolute position sensor and four micro ducted fans are the main components of an FFMP of Phase 1. A micro video camera and a wireless transmitter are added in Phase 2. Speech recognition for high level control of the vessel is implemented in Phase 3.
I would like to thank Jane Dunphy for supporting me with very useful advice on how to write a paper, as well as Dave Cliff for the inspirations that I got from his Embodied Intelligence lecture. Furthermore, I would like to thank Gert-Jan Zwart† (1973-1998) for all the discussions we had. Your ideas will never die.
- Aerobot [WWW Document]. URL http://www.moller.com/~mi/aerobot.htm (visited 1998, May 6).
- AT&T Watson Speech Recognition (1996, My 31) [WWW Document]. URL http://www.speech.cs.cmu.edu/comp.speech/Section6/Recognition/att.html (visited 1998, May 9).
- Autonomous Helicopter Project: Goal Mission Applications: Cinematography [WWW Document]. URL http://www.cs.cmu.edu/afs/cs/project/chopper/www/goals.html#movies (visited 1998, May 9).
- Autonomous Helicopter Project: Vision-based Stability and Position Control [WWW Document]. URL http://www.cs.cmu.edu/afs/cs/project/chopper/www/capability.html (visited 1998, May 9).
- Baumann, U. (1998). Fliegende Plattform. Unpublished Master's thesis, Institut für Automatik, ETH Zürich, Zürich, Switzerland.
- Borenstein, J., Everett, H.R., Feng, L., & Wehe, D. (1996). Mobile Robot Positioning – Sensors and Techniques. Invited paper for the Journal of Robotic Systems, Special Issue on Mobile Robots. Submitted April 1996, conditionally accepted Aug. 1996. Available FTP: ftp://ftp.eecs.umich.edu/people/johannb/paper64.pdf.
- Borenstein, J. (1992). The HoverBot – An Electrically Powered Flying Robot. Unpublished white paper, University of Michigan, Ann Arbor, MI. Available FTP: ftp://ftp.eecs.umich.edu/people/johannb/paper99.pdf.
- Brown, W.C. (1997). The Early History of Wireless Power Transmission. Proceedings of the Space Studies Institute on Space Manufacturing, Princeton, NJ, May 8-11, 1997. URL http://engineer.tamu.edu/TEES/CSP/wireless/newhist2.htm (visited 1998, May 7).
- Brown, W.C., Mims, J.R., & Heenan, M.I. (1965). An Experimental Microwave Powered Helicopter. 1965 IEEE International Record, Vol. 13, Part 5, pp. 225-235.
- Brown, W.C. (1968). Experimental System for Automatically positioning a Microwave Supported Platform. Tech. Rept. RADC-TR-68-273, Contract AF 30(602) 4310, Oct. 1968.
- CamCopter Systems [WWW Document]. URL http://www.camcopter.com/rchelicopter/actioncam.html (visited 1998, May 6).
- Feng, L., Borenstein, J., & Everett, B. (1994). Where am I? Sensors and Methods for Autonomous Mobile Robot Localization. Technical Report, The University of Michigan UM-MEAM-94-21, December 1994. Available FTP: ftp://ftp.eecs.umich.edu/people/johannb/pos96rep.pdf.
- FreeD – The wireless joystick [WWW Document]. URL http://www.pegatech.com/prod.html (visited 1998, May 7).
- de Garis, H. (1990). The 21st. Century Artilect: Moral Dilemmas Concerning the Ultra Intelligent Machine. Revue Internationale de Philosophie, 1990. URL http://www.hip.atr.co.jp/~degaris/Artilect-phil.html.
- Gyrosaucer II E-570 [WWW Document]. URL http://ns.idanet.co.jp/keyence/english/corporate/hobby/saucer.html (visited 1998, May 4).
- HiCam helicopter [WWW Document]. URL http://bulk.microtech.com.au/hicam/heli.html (visited 1998, May 9).
- Holbrook, J. (1996). RC Helicopters – The Collective RPV Page [WWW Document]. URL http://www.primenet.com/~azfai/rpv.htm (visited 1998, May 6).
- Holt, B., Borenstein, J., Koren, Y., & Wehe, D.K. (1996). OmniNav: Obstacle Avoidance for Large, Non-circular, Omnidirectional Mobile Robots. Robotics and Manufacturing Vol. 6 (ISRAM 1996 Conference), Montpellier, France, May 27-30,1996, pp. 311-317. Available FTP: ftp://ftp.eecs.umich.edu/people/johannb/paper61.pdf.
- IBM ViaVoice Gold (1998, Apr 1) [WWW Document]. URL http://www.software.ibm.com/is/voicetype/us_vvg.html (visited 1998, May 9).
- Jetfan – Technology of the Future (1997, March 29) [WWW Document]. URL http://www.ozemail.com.au/~jetfan/ (visited 1998, May 6).
- Kahaner, D.K. (1994, Jan 28). Demonstration of unmanned helicopter with fuzzy control (Report of the Asian Technology Information Program ATIP) [WWW Document]. URL http://www.atip.or.jp/public/atip.reports.94/sugeno.94.html (visited 1998, May 9).
- Kahaner, D.K. (1991, Aug 5). Fuzzy Helicopter Flight Control (Report of the Asian Technology Information Program ATIP) [WWW Document]. URL http://www.atip.or.jp/public/atip.reports.91/helicopt.html (visited 1998, May 9).
- Kahaner, D.K. (1993, Apr 12). Fuzzy Helicopter Control (Report of the Asian Technology Information Program ATIP) [WWW Document]. URL http://www.atip.org/public/atip.reports.93/copt-fuz.93.html (visited 1998, May 9).
- Kahaner, D.K. (1995, Mar 20). Update of fuzzy helicopter research (Report of the Asian Technology Information Program ATIP) [WWW Document]. URL http://atip.or.jp/public/atip.reports.95/atip95.13.html (visited 1998, May 9).
- Kataoka, K. (1998, April 27). A History of Commercial based Electric R/C Helicopters [WWW Document]. URL http://agusta.ms.u-tokyo.ac.jp/agusta/history.html (visited 1998, May 6).
- Kelly, P. (1998, Feb 18). Swiss scientists warn of robot Armageddon. CNN interactive [WWW Document]. URL http://cnn.com/TECH/science/9802/18/swiss.robot/index.html (visited 1998, May 6).
- Kobayashi, H. (1998, May 1). Autonomous Indoor Flying Robot Honey: For communication and/or interaction between semiautonomous agents [WWW Document]. URL http://www.ifi.unizh.ch/groups/ailab/people/hiroshi/honey.html (visited 1998, May 6).
- Koo, T-K. J., Sinopoli1, B., Mostov, K., & Hoffmann, F. Design of Flight Mode Management on Model Helicopters [WWW Document]. URL http://robotics.eecs.berkeley.edu/~koo/ILP98/koo.4.html (visited 1998, May 7).
- Lagerstedt, M. (1997, Aug 23). Ducted Fan Models [WWW Document]. URL http://loke.as.arizona.edu/~ckulesa/plane_types.html (visited 1998, May 6).
- Längle, T., Lüth, T.C., Stopp, E., Herzog, G., & Kamstrup, G. (1995). KANTRA – A Natural Language Interface for Intelligent Robots. In U. Rembold, R. Dillman, L. O. Hertzberger, & T. Kanade (eds.), Intelligent Autonomous Systems (IAS 4), pp. 357-364. Amsterdam: IOS. Available FTP: ftp://ftp.cs.uni-sb.de/pub/papers/SFB314/b114.ps.gz.
- Linden, D. (Ed.) (1995). Handbook of Batteries. New York, NY: McGraw-Hill, Inc.
- Marti, S.J.W. (1998, Apr 22). Artificial Multi Ethical Advisor System (AMEAS) [WWW Document]. URL http://www.media.mit.edu/~stefanm/FFMP/FFMP_Details.html#AMEAS (visited 1998, May 6).
- Massachusetts Film Office: Equipment/Vehicle Rental: Airplane & Helicopter Rentals [WWW Document]. URL http://www.magnet.state.ma.us/film/pg-evr.htm (visited 1998, May 6).
- MB-750U [WWW Document]. URL http://www.polarisusa.com/mb750u.htm (visited 1998, May 9).
- McMichael, J.M., & Francis, M.S. (1997, August 7). Micro Air Vehicles – Toward a New Dimension in Flight Experiment [WWW Document]. URL http://www.darpa.mil/tto/mav/mav_auvsi.htm (visited 1998, May 7).
- McSpadden, J.O. (1997, June 19). Wireless Power Transmission Demonstration [WWW Document]. URL http://www.csr.utexas.edu/tsgc/power/general/wpt.html (visited 1998, May 7).
- Microplate Video Transmitter (1997-1998) [WWW Document]. URL http://www.scx.com/page1.html (visited 1998, May 9).
- Murray, R. (1996, Jul 11). The Caltech Ducted Fan: A Thrust-Vectored Flight Control Experiment [WWW Document]. URL http://avalon.caltech.edu/~dfan/ (visited 1998, May 6).
- Newsom, W. A. Jr. (1958 Jan). Experimental investigation of the lateral trim of a wing-propeller combination at angles of attack up to 90 degrees with all propellers turning in the same direction. NACA TN 4190, pp. 30.
- Paradiso, J. A. (1996). The interactive balloon: Sensing, actuation, and behavior in a common object. IBM Systems Journal 35, Nos 3&4, 473-498. URL http://isj.www.media.mit.edu/projects/isj/SectionC/473.htm.
- PC-17YC color microvideo camera [WWW Document]. URL http://www.scx.com/page7.html (visited 1998, May 9).
- PC-51 series inline microvideo camera [WWW Document]. URL http://www.scx.com/page11.html (visited 1998, May 9).
- Rechargeable Systems: Competitive System Matrix [WWW Document]. URL http://cccsrv.trevano.ch/~blutz/Electronics/ElecAkkus.html (visited 1998, May 7).
- Remote Control Aerial Photography [WWW Document]. URL http://www.flying-cam.com/ (visited 1998, May 6).
- Sadler, G. (1995, June). How the helicopter flies [WWW Document]. URL http://www.copters.com/hist/history_2.html (visited 1998, May 6).
- Schmandt, C. (1994). Voice Communication with Computers. Conversational Systems. New York, NY: Van Nostrand Reinhold.
- Shelton, R. (1998). R/C Aerial Photography [WWW Document]. URL http://www.vision.net.au/~rjs/aerial.html (visited 1998, May 6).
- Stone, A. (1998, Feb 24). Flying into the Future: Miniature flying machines could help with warfare, agriculture and more [WWW Document]. URL http://www.gtri.gatech.edu/rh-spr97/microfly.htm (visited 1998, May 6).
- Sugeno, M. et al. (1995). Intelligent Control of an Unmanned Helicopter Based on Fuzzy Logic, Proc. of American Helicopter Society, 51st. annual Forum, Texas, May 1995. URL http://www-cia.mty.itesm.mx/isai/sugeno.html.
- Suereth, R. (1997). Developing Natural Language Interfaces: Processing Human Conversations. New York, NY: McGraw-Hill, Inc. URL http://www.conversantsystems.com/book1.htm.
- Taylor, C., & Jefferson, D. (1995). Artificial Life as a Tool for Biological Inquiry. In C.G. Langton (Ed.), Artificial Life – An Overview (pp. 1-13). Cambridge, MA: The MIT press.
- The Boeing Company (1996-1998). The Tiltrotor Story [WWW Document]. URL http://www.boeing.com/rotorcraft/military/v22/1687-main.html (visited 1998, May 6).
- Trends in Battery Industry – Shaping Batteries in the Year 2001 [WWW Document]. URL http://spectra.crane.navy.mil/ctinet/battery/trend.htm (visited 1998, May 7).
- Vid1 video transmitter [WWW Document]. URL http://shop.aeinc.com/bgi/hot.html (visited 1998, May 9).
- Verplaetse, C. (1996). Inertial proprioceptive devices: Self-motion-sensing toys and tools. IBM Systems Journal 35, Nos. 3&4, 639-650. URL http://isj.www.media.mit.edu/projects/isj/SectionE/639.htm
- VidLink 100 [WWW Document]. URL http://www.lynx.bc.ca/virtualspy/vidlink.htm (visited 1998, May 9).
- Wagoner, R. (1998, Mar). Electric Ducted Fans [WWW Document]. URL http://www.ezonemag.com/articles/1998/mar/edf/rwag0398.htm (visited 1998, May 6).
- What are Micro Aerial Vehicles? (1998, March 24) [WWW Document]. URL http://www.aero.ufl.edu/~issmo/mav/info.htm (visited 1998, May 7).
- World record with an electric helicopter [WWW Document]. URL http://www.ikarus-modellbau.de/eecowr.htm.
- The expression mobot is defined as "small, computer-controlled, autonomous mobile robot” [51].
- Except for VTOL [39] and tiltrotor airplanes [52].
- Other domains for these vehicles would be hazards of all kinds, such as radiated areas, hostage situations, and structurally unstable buildings, into which it is too dangerous to send human, as well as search & rescue, surveillance, law enforcement, inspection, aerial mapping, and cinematography [3].
- [12] mention that "according to our conversations with manufacturers, none of the RF systems can be used reliably in indoor environments.” (pp. 65)
- Note that GPS is not an option, both because it is not operational indoors and its accuracy is not high enough for our purpose (even with DGPS).
- Another possibility would be to use three absolute position sensors instead of one.
- "A truly autonomous craft cannot completely rely on external positioning devices such as GPS satellites or ground beacons for stability and guidance. It must sense and interact with its environment. We chose to experiment with on-board vision as the primary sensor for this interaction” [3].
- The current world record is 63 minutes [59].
- Important research was conducted in the context of a microwave-powered helicopter that would automatically position itself over a microwave beam and use it as references for altitude and position [8,9,10].
- Only Phase 4 might use the video image for obstacle avoidance.
- [16] even use speech recognition to tilt the camera of their commercial aerial photography HiCam helicopter.
I wrote this paper as a final project for MIT class 6.836 Embodied Intelligence, as well as for MIT class 21F.225 Advanced Workshop in Writing for Science and Engineering, during May 1998.
Back to FFMP homepage
Send me some comments!
Last updated May 24 1998.
Copyright © 1997 - 2009 by Stefan Marti and MIT Media Lab. All rights reserved.
|