AR VR Robotics Park
Overview
As this year’s Technology Conference is a 10th Anniversary, we have a special area, that is “AR VR Robotics Park”. We have a lot of attractive booths and workshops with not only Rakuten but also external companies. You can experience the state-of-the-art technologies. Please enjoy!
Map
2F: Entrance
2-1. AR-HITOKE (楽天株式会社: 三條)
Biography:
Masahiro Sanjo is the assistant manager of Process Operation team at Rakuten Institute of Technology.Joined the company in 2007 and worked for initialization of Rakuten Institute of Technology.After the experience of coordinator, now supporting the team for the administration.
Demo:
AR-HITOKE is visualization of popularity on the web by showing human-shaped icons with AR technology.You can get information through the camera on REAL objects. The number of icons are calculated from POS data and the comments are from the review system.
2-2. RITじゃんけんマシーン / RIT Rock-Paper_Sissors Machine (楽天株式会社: RIT)
Biography:
Rakuten Institute of Technology is the dedicated R&D organization within Rakuten, Inc. They encourage their R&D members to cultivate their curiosity, develop their interests and face challenging problems to create opportunities in combining emerging technologies with innovative services.
2-3. Rakuten Drone Delivery Service / 楽天ドローンプロジェクト (楽天株式会社: そら楽)
Biography:
On April in 2016, Rakuten became the first company to commercialize flying delivery drones in the world."Sora Raku" (Sora means Sky in Japanese) started at a golf course in Chiba and the service was provided for over 3 months. The drone carried food, snacks and golf accessories such as new balls to golf players, and was summoned by an dedicated app.The original drone, "Tenku," was developed by the RIT (Rakuten Institute of Technology) and ACSL (Autonomous Control Systems Laboratory Ltd.) which is a venture involved in the research and development of drones that Rakuten made an investment in March.Tenku is equipped with an autopilot system developed domestically by ACSL which provides stable flight performance even under strong winds; auto release function jointly developed by the RIT and ACSL; and image recognition technology developed by the RIT for precise landing.Through the first project at a golf course, technical and operational expertise was successfully accumulated; and currently it’s moving forward to the next project for the further innovative drone deliver services.
Exhibition:
Drone Airframe which is used for experiments
4F: In front of Track-E
4-1. Virtual Reality Baseball Coaching System / VR［バーチャルリアリティー］技術による選手のトレーニングシステム (株式会社NTTデータ・株式会社楽天野球団)
Demo:
Rakuten Baseball and NTT DATA Corporation launched a new virtual reality (VR) baseball coaching system. The system uses a database of professional players’ videos and performance statistics to generate high quality simulated video images.The new system is targeted at raising the performance levels of professional baseball players, simulating for batters the sensation of standing in a real batter’s box and allowing them to experience virtual pitching scenarios through a head-mounted display.
4-2. Valuable programming language "mruby/c" in the IoT / IoT向けプログラミング言語「mruby/c」(しまねソフト研究開発センター)
Biography:
mruby / c has been developed in cooperation with Kyushu Institute ofTechnology and Shimane IT Open-innovation Center.
Demo:
The evaluation board, which is controlled by mruby / c, with each sensor oftemperature, humidity, illumination.The motor which is controlled by the mruby / c.Recently, efforts to new value creation through IoT has been attractingattention in a variety of fields for example such as the manufacturingindustry, agriculture.In such usage scene, the software requirementsspecification for the device control is changing rapidly.The programming language is required such as adapted to repeat theprototype and improvement.”mruby / c” takes over the features of the Ruby, has a high productivityand high flexibility. It’ll be ahead of the release of the stable versionin December this year.We will exhibit the feature, function, describes ,and application field ofmruby/c.
4-3. Rakuten Virtual Boutique / 楽天バーチャルブティック (PRICEMINISTER S.A.S.: Cecillia)
Biography:
Research engineer in virtual reality and human-computer interfaces in the
Rakuten Institute of Technology Paris, Cecilia is designing and developing
the Rakuten Virtual Boutique project. Before joining Rakuten, she worked as
Virtual Reality Engineer Intern in the CEA, a french-government founded
research laboratory specialized in robotics and simulations. Cecilia is
also co-founder and former President of the Virtual Association, the first
non-profit organization dedicated to sharing knowledge and discovering
virtual and augmented reality in Paris. Passionate about virtual reality
and innovation in human computer interaction, her interest is to make these
technologies accessible to everyone, so each one can understand it and
eventually make it better.
Demo:
The evaluation board, which is controlled by mruby / c, with each sensor oftemperature, humidity, illumination.The motor which is controlled by the mruby / c.
Recently, efforts to new value creation through IoT has been attractingattention in a variety of fields for example such as the manufacturingindustry, agriculture.In such usage scene, the software requirementsspecification for the device control is changing rapidly.The programming language is required such as adapted to repeat theprototype and improvement.”mruby / c” takes over the features of the Ruby, has a high productivityand high flexibility. It’ll be ahead of the release of the stable versionin December this year.We will exhibit the feature, function, describes ,and application field ofmruby/c.
4-4. Home AR / ARショッピング体験 (楽天株式会社: 武笠)
Biography:
Tomoyuki Mukasa is a scientist at Rakuten Institute of Technology.
His research interest includes 3D video and its applications in virtual, augmented, and mixed reality.
He received his B.Sc. in Engineering, M.Sc. and Ph.D. In Informatics from Kyoto University in 2004, 2006, and 2015 respectively.
In 2015, He has joined Visual Computing Group in Rakuten Institute of Technology.
He is a member of IPSJ, IEEE, and Architectural Design Association of Nippon.
Demo:
We present a new feature for AR/VR applications for consumer mobile devices equipped with video camera (e.g., smartphone).
Direct or indirect scale estimation of scene or objects is necessary for realistic rendering of virtual objects in real-world environment.
Standard approaches usually rely on 3D vision with sensor fusion (e.g., visual SLAM), or pattern recognition (e.g., using AR markers, reference object learning), and suffer from various limitations.
Here, we argue that combining inertial measurements and visual cues, the problem reduces to a 1D parameter estimation representing distance from device to floor. In particular, we discuss robust solutions to solve absolute scale estimation problem for indoor environments.
9F: Booth & Workshop Area
1. TMCN (TMCN)
Biography:
Name: Kaoru Nakamura / TMCN AssociationTitle: Technical Evangelist, Freelance Software Engineer Microsoft MVP for Windows Development
URL: http://www.naturalsoftware.jp/GitHub: https://github.com/kaorun55Twitter: https://twitter.com/kaorun55
Bio:Kaoru Nakamura is a freelance software engineer, author, speaker, and evangelist specialized in Natural User Interface using sensor devices like Microsoft Kinect, Intel RealSense, and Leapmotion.
On 2013, Kaoru took a part of the establishment of TMCN (Tokyo MotionControl Network), which is an open community for the affordable sensors and devices with open development environment.
Recently Kaoru is focusing on AR/VR/MR technology especially Microsoft Hololens.
Kaoru is entitled as MVP (Most Valuable Professional) in Windows development by Microsoft for 5 years. Key book title is “KINECT for Windows SDK Programming”.
Demo:
Tokyo Motion Control Network(TMCN) is a sensor community in Japan. TMCN will show you a live demo of HoloLens, the newest device of AR/VR by Microsoft.
2. Health Care Industry × Virtual Reality ~Simulated experience of Virtual Hallucination~ / 医療業界×VR ～統合失調症疑似体験VR～ (株式会社シー・エヌ・エス)
Biography:
"Bringing high quality creativity to the world" - we are a creative company who produce by applying ICT tool development and proprietary network to event planning,event production, event operations, graphic design, web design, movie creation and apps.
Demo:
This booth is set up to introduce state-of-the-art case of virtual reality used in the health care industry.Virtual Hallucination (schizophrenia) is a disease education (psychological education) program by which users experience a realistic simulation of symptomscaused by schizophrenia such as visual and auditory hallucinations.The system is designed to enhance the reality by combining Binaural recording and a sound system that controls the rotation and the distance of the auditory source,creating an audio that follows the visuals. Experience first hand a case of all the new possibilities that Virtual Reality can bring!
3. H2L Inc. (H2L Inc.)
Biography:
Established July 2012, H2L researches and develops technology that enables the remote delivery of haptic sensations. “PossessedHand”, one of the 50 Best Inventions selected by TIME Magazine along with “UnlimitedHand” which premiered last year are their flagship products. H2L continues to expand their 2 areas of expertise which lies in precise motion-gesture tracking for Hands, and the actuation of Haptic Feedback through Electric Muscle Stimulus applied to the forearm.
Demo:
UnlimitedHand is the Haptic Game Controller that allows a wearer to intuitively control and feel haptic feedback within Virtual Reality games. Until now, hand held and button based game devices have been the main choice of controllers. However, when we develop for the medium of Virtual or Augmented Reality games, they may break the immersion that we value. UnlimitedHand confronts this by incorporating our hands into the gaming experience. It does this by linking movements of the hand with its virtual counterpart while returning haptic feedback whenever the game deems it necessary. With the UnlimitedHand, one will be able to experience the ricochet from a gunshot, or to pet on characters with their very own hands.Last year, on September 22nd, UnlimitedHand’s Kickstarter campaign was announced when H2L premiered at the Techcrunch SF conference. The campaign managed to reach its goal in just under 22 hours.
4. 3DHapticsVR (株式会社ミライセンス)
5. & 6. HTC NIPPON～VR experience beyond imagination / HTC NIPPON～想像を超えたVR体験 (HTC NIPPON株式会社)
Biography:
HTC aims to bring brilliance to life. As a global innovator in technology, HTC has produced award-winning products and industry firsts since its inception in 1997, including the critically Vive virtual reality system and HTC smartphones. The pursuit of brilliance is at the heart of everything we do, inspiring best-in-class design and game-changing mobile and virtual reality experiences for consumers around the world.
Demo:
Vive is a first-of-its kind virtual reality system developed in partnership by HTC and Valve. Designed from the ground up for room-scale VR, Vive allows true-to-life interactions and experiences thanks to an adjustable headset displaying stunning graphics, two wireless controllers with HD haptic feedback and 360˚ absolute motion tracking. For a convenient and safe experience, Vive incorporates essential functionality from your phone and features a front facing camera that blends physical elements into the virtual world. Working in concert, this system immerses you visually, physically and emotionally in the virtual world. For more information on Vive, please visit www.htcvive.com.
7. Sony Digital Network Applications, Inc. (ソニーデジタルネットワークアプリケーションズ株式会社)
Biography:
Finding and fulfilling possibilities in software Sony Digital Network Applications?"SDNA" for short. SDNA is more than just another corporate acronym. For us, SDNA represents our fundamental mission: We take the creative DNA that has made our parent, Sony, an international leader and apply it to the world of software.
As software professionals, we apply the Sony ethos by searching for the deepest opportunities for software to enrich lives, and then we work tirelessly to realize those opportunities in the products we create. For us, success means delighting and surprising our users in the ways our software products integrate with and add to their lives.
Demo:
Our "VR Live Streaming Solution" will allow you to watch images captured remotely as Virtual Reality. Key features are as follows: - Using the internet, you can stream live 4K motion pictures - High in Mobility(Portable) ; NO need for big heavy equipment, camera can be placed in various places. - Optimized encode and upload functions for live streaming just with a mobile network(LTE) - No need for a special expensive camera! Multi-purpose design that is compatible with any camera. - No specific platform, can be used with Multi-devices(Android, iOS)
8. ロボホンとコンビニ写真プリント / RoBoHoN and Photo print service (シャープ株式会社)
Biography:
Mainly manufacturing and sales of telecommunications equipment, electric and electronic application equipment, and electronic components.
Demo:
This is a demo of API connection which can print pictures taken by RoBoHoN to Multi-function printers such as in Lawson, FamilyMart, CircleK and Sunkus.
9. VR Café - WebVR with Aframe.io (Rakuten USA, Inc.:Brad, Eric)
Biography:
Eagle Vision - Our project was a 2-day hackathon prototype only for Rakathon CHW. We used WebVR to build "Rakuten VRCafe".
Demo:
The concept for the VR Cafe prototype was as follows: An engaging VR experience for global visitors to discover “What is Rakuten?” A hub to connect and showcase other future Rakuten VR experiences Establish Rakuten’s presence in the metaverse!
We used the aframe.io framework, Javascript and some a-frame extras (Add-ons and helpers for A-Frame VR) and node.js on the backend to pull in some dynamic content via Rakuten APIs.
10. Exhibition of "Hello Ruby" workshop for Kids (Shoeisha Co., Ltd.) / ルビィのぼうけん展示 ＆ 翔泳社よろず相談所 (株式会社翔泳社)
Biography:
Shoeisha is a publishing company that published books of mainly programming and information technology. In May 2016, Shoeisha translated "Hello Ruby (ルビィのぼうけん)" written by Finnish author Linda Liukas. This picture book about a little girl's adventure helps kids to learn about technology, computing and problem-solving.
Demo:
In the exhibition booth, our editors display "Hello Ruby (ルビィのぼうけん)" and its workshop kit. Also other book samples are displayed.Beside, any question to editors about writing, publishing and anything about book are welcome.展示ブースでは、プログラミングを学べる子供向け絵本『ルビィのぼうけん』ワークショップ関連の展示を行います。他にも見本書籍の展示や、編集者への各種相談窓口を開設します。
11. RTC Coin (楽天株式会社: RTC Coin)
Biography:
Demo:
12. A dangerous brain-controlled drone / 脳波で飛ばす危険なドローン (楽天株式会社: 鳥居)
Biography:
Junji Torii is a Software/Hardware Engineeer at Nyaro Computer,Incand Visiting Resercher at Rakuten Institute of Technology.His interests include embedded computing system, IoT and radio sensor netowrk.
Demo:
A dangerous brain-controlled droneIt's hacked toys and made a brain-controlled drone.Mindflex is a game to float a small ball depending on the activity of your brain.( https://www.amazon.com/Discovery-Channel-P2639-Mindflex-Game/dp/B001UEUHCG )I replaced a small ball to a drone by hacking the game device.Let's try to take off a drone by your brain.
13. Rakuten inc. Travel Service Development Department / 楽天株式会社 トラベルサービス開発･運用部
14. Immersive VR Tour / 没入型VRツアー (楽天株式会社: 千葉、岩瀬)
Biography:
・Dr. Naoki Chiba has been working on computer vision and virtual reality over 20 years. He has obtained his PhD degree from Kyoto University, after working at the Robotics Institute, Carnegie Mellon University in USA as a visiting scientist. In 2014, he has showed an immersive virtual system based on Oculus Rift for Nagano prefecture to promote sightseeing spots from Ginza Nagano. In January 2016, he was able to commercialize the technology for Rakuten wedding business.・Hiroaki Iwase is Application Engineer and technologist of the Rakuten, Inc. and Rakuten Institute of Technology. He has obtained his master's degree of medical technology from Tohoku University. After that he joined Rakuten as engineer. He developed several DB systems including a ROMA which is NOSQL database made from Ruby. And he also implemented advertisement system in U.S. associated company. Now he is engaged in VR project as a technologist of Rakuten Institute of Technology.
・Hiroaki Iwase is Application Engineer and technologist of the Rakuten, Inc. and Rakuten Institute of Technology. He has obtained his master's degree of medical technology from Tohoku University.After that he joined Rakuten as engineer. He developed several DB systems including a ROMA which is NOSQL database made from Ruby. And he also implemented advertisement system in U.S. associated company. Now he is engaged in VR project as a technologist of Rakuten Institute of Technology
Demo:
We will show immersive virtual reality (VR) tour systems for travel promotion and wedding facility introduction. For promoting sightseeing spots or wedding facilities, our systems can provide the user with a navigation feature in the VR place by using a head-mounted display, such as Oculus Rift or Samsung Gear VR, with a controller. The user is able to walk-through photo-realistic virtual environment, as well as watching panoramic videos of dynamic events.
15. Rakuten Robot Club / 楽天ロボットクラブ (楽天株式会社: ロボット研究会)
Biography:
We are a gathering of people that are interested in robotics, from those that do not have any previous experience to those that studied electronics engineering.
Our club focuses on having everyone cooporate to design and create robots.
The main goal of our club is to be able to develop robots on a professional level.
・2014 second semester: Established as company unofficial club
・2015 first semester: Conducted Sumo Battle Project
・2015 second semester: Promoted as company official club
・2016 first semester: Cooperated with TENKU project (prototype creation)
Demo:
Showcase previous project robots.
Implementing demo for virtual experience by manipulating robots from view of VR goggle.
16. Rakuten Recruiting Booth (楽天株式会社: GHR)
9F Workshop
Please check the detail from the following page:
https://rakutentechnologyconference2016.sched.org/event/8Xnh/workshop-blockchain-coderdojo-futakotamagawajiao-p-kies-programming-workshopsjiao
17. Build Your Own Blockchain
Target: Adults
Languige: English
18. CoderDojo二子玉川 (CoderDojo Japan)
Target age (推奨年齢): 7 - 15
Language (言語): 日本語, English
19. P-kies プログラミング ワークショップ (フジテレビKIDS)
言語: 日本語
対象: 初心者親子小学生
※ PC版を使用しますので、マウス、キーボードになれている方。
