Find new answers in our case study below …
How to let people interact with your robot anytime without giving away 20k+ physical robots for free?
Is there a way to discover the world of an employer before getting hired?
Bobby2GO - AR mobile & Windows app
*UPDATE 2020*
In the first half of 2020 the “Bobby2Go” app was made available as a Windows version (UWP) for desktops. Further details can be found in the following text.
Our mission ...
The following requirements were defined as our mission statement and goals we had to achieve for our client:
- Integration of innovation strategy #BAYER360 (after the successful start Nov 11th, 2015) VRCE/VRCA with new AI technology
- Make robot “Bobby” available without the physical version of “Pepper” (mobile – anytime, anywhere)
- Use the already existing web-service for AI (chatbot) and voice control
- Make it available for as many devices as possible
- Design it for international usage (multi-language)
- Let users share their experiences with Bobby (Photo share)
- Discover the world of Bayer with 360° media (AR Portal feature)
- Support typical webchat-features like links, shortcuts and images
Missions-Update 2020
- Employees should be able to communicate directly with Bobby on their workstation PC without having to use their smartphone
- In addition to the chatbot personality Bobby, multiple internal and external chatbots should be available in a central application (“hub”)
- Possibility to roll out the application (UWP – Universal Windows Platform) easily and remotely through IT management via Windows Enterprise Store
... and our challenges
Based on our long-term experience and the ability for effective research we were able to accept and master the following challenges:
- Integrate the Blackout Nexus chatbot technology (AI backend)
- Connect to Microsoft Cognitive Services (Speech Services, TTS/STT)
- Development of a cross-plattform AR app for Smartphones and Tablets with Android (ARCore) and iOS (ARKit)
- Support for multiple AI-chatbot instances
- Porting the mobile app as a Windows application (Universal Windows Platform) // Update 2020
About the production and development
We developed a set of custom solutions for the different aspects of the project. In the following section are some feature examples we realized for the app.
Hybrid Chat (AR and non-AR)
The chat functions support the more natural approach talking to the robot (voice support) and to write messages (text-chat) at the same time. The App is ready for chatting from the start and switches automatically to AR mode with tracking in a smooth way as soon as the application tracks the real world conditions (AR).
AR Portals
The AR portal feature lets Bobby invite the user to join the world of Bayer. The users literally walk through a “Portal” and discover 360° media through a magic window on his own.
Photo share
The camera function allows the user to take an AR “selfie” or regular AR picture with Bobby, which can then be shared through multiple channels (social media, email, message).
Windows app (New 2020)
A version for Windows 10 enables convenient use by voice or keyboard on the desktop PC. Installed easily and directly from the Windows Store with just one click.
Benefits brought by this solution include
- More emphatic way for users to communicate with at chatbot than a typical text-chat (Web, WhatsApp, Facebook Messenger).
- The 360° content that was produced for VR and social media could be used inside multiple scenarios inside the same strategy (reducing cost)
- Reaches a greater audience of users than a physical robot on expos or events only.
- No/small hardware investment – only AR-ready Smartphone or Tablet needed.
- Extensible platform for new ideas and feature
Let’s get in touch with one of our consulting experts:
Mario Deutschmann
CEO & FounderI'm looking forward to your inquiry and feedback about our work and projects....
Demo and Preview
The application is currently used within a closed user group only.
Feel free to contact us and we will show and explain the advantages of the mobile AR app or the Windows application to you.
The company “MOVR” is specialized in Virtual, Augmented and Mixed Reality (VR/AR/MR) applications for business and supports clients like Bayer, E.ON, Samsung EG, PACT Training, Fraunhofer Institute for Intelligent Analysis and Information Systems IAIS and Medisana with tailor-made solutions pushing their businesses forward.
