What email address or phone number would you like to use to sign in to Docs.com?
If you already have an account that you use with Office or other Microsoft services, enter it here.
Or sign in with:
Signing in allows you to download and like content, which the author will be aware of.
Embed code for: Perceptual Intelligence
Select a size
Session about Microsoft Cognitive Services and Bot Framework I delivered at Disruptive 2016 event, updated with the latest services
"name": "Satya Nadella",
2 faces detected
Detect and Track Faces
Generate Video Thumbnails
Convert Text to Speech
Correct Spelling Errors
"suggestion": "Sons of",
Snosof Aanrcky, akla SAMCRO, is a motrocikle culbb that opertrates bot ilegla an lejgal bissineses i te smal twon of Charring.
Sons of Anarchy, aka SAMCRO, is a motorcycle club that operates both illegal and legal businesses in the small town of Charming.
"words": "welcome to my talk about microsoft cognitive services",
"words": "welcome to my talkabout microsoft cognitive services",
"words": "welcome to my talk about micro soft cognitive services",
Analyze Text Syntactically
“What’s the weather like in Madrid today?”
Create a FAQ Service
Search the Web
Search for Images, Video and News
Microsoft Cognitive Services
Bing Spell Check
I think it’s a person sitting in front of a computer and he seems . I am 99% sure that’s Bill Gates
Cognitive Video Indexing with Video Breakdown
Visual Text Recognition
Voice Activity Detection
Key words extraction
Conversations as a Platform
Human language is the new UI
Bots are the new apps; digital assistants are meta apps
Intelligence infused into all interactions
Building Conversational Experiences
Your Business Logic
MS Cognitive Services
Your Web service
Bot Builder SDK (Node.js + C#)
Your conversation logic
. . .
Cortana Intelligence Suite
Big Data Stores
Machine Learning and Analytics
Data Lake Store Blob Store
Data Lake Analytics
(Hadoop and Spark)
Dashboards & Visualizations
Sensors and devices
Alejandro Campos Magencio @ alejacma
Startup? es emprendedores @microsoft.com
Technical Community? email@example.com
Software Vendor? firstname.lastname@example.org
BOTS OF ANARCHY
© 2014 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
La Inteligencia Perceptual
Los últimos avances en Machine Learning y Servicios Cognitivos con los que podremos crear aplicaciones y Bots que puedan ver, oír, hablar, entender y pronto incluso empezar a razonar.
The cognitive revolution is the name for an intellectual movement in the 1950s that began what are known collectively as the cognitive sciences. It began in the modern context of greater interdisciplinary communication and research. The relevant areas of interchange were the combination of psychology, anthropology, and linguistics with approaches developed within the then-nascent fields of artificial intelligence, computer science, and neuroscience.
A key idea in cognitive psychology was that by studying and developing successful functions in artificial intelligence and computer science, it becomes possible to make testable inferences about human mental processes. This has been called the reverse-engineering approach.
Perceptual Intelligence: Recognition of Human Interactions and Intent
Alex Pentland defines Perceptual Intelligence technology as
computer systems that can follow people‘s actions, recognizing their faces, gestures, and expressions.
© 2015 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
Speaker Recognition API
Bing Spell Check API
Web Language Model API
Text Analytics API
Linguistic Analysis API
LUIS - Language Understanding Intelligent Service
Entity Linking Intelligence Service
Bing Autosuggest API
Bing Web Search API
Bing Image/Video/News Search API
A set of APIs, SDKs and services available to developers to make their applications more intelligent
Roll your own with REST APIs.
Simple to add: just a few lines of code required.
Make the same API code call on iOS, Android, and Windows.
Integrate into the language and platform of your choice.
Built by experts in their field from Microsoft Research, Bing, and Azure Machine Learning.
Quality documentation, sample code, and community support.
From faces to feelings, allow your apps to understand images and video
Hear and speak to your users by filtering noise, identifying speakers, and understanding intent
Process text and learn how to recognize what users want
Tap into rich knowledge amassed from the web, academia, or your own data
Gallery + Editor + Player
Video Breakdown: Cognitive Video Indexing
Video: Microsoft Cognitive Services- Introducing the Seeing AI app.mp4
This new platform includes a personal digital assistant knows you, knows about your world and is always with you across all your devices helping you with your everyday tasks. And bots, with the capability to take the power of human conversations, and apply it to everything.
We imagine a rich ecosystem of conversations, ones that include: people to people, people to your personal digital assistant, people to bots, and even personal digital assistants calling on bots on your behalf. That's the world that you're going to get to see in the years to come.
Think of bots as new applications that you converse with. Instead of looking through multiple apps, or pages and pages of websites, you can call on any application as a bot within this conversational canvas.
Bots are the new ‘apps,’ and digital assistants are meta apps or like the new browsers. In this way, intelligence is infused into all of your interactions.
To build a conversational experience, you start with your business logic. This is your area of expertise and is the code you have to run your business
To that, you can add conversational logic and Cognitive Services to give your business dialog skills
Once your bot/app can hold a conversation:
You can connect to users in a chat app like Skype, where your users already are
Or you can connect through Cortana, where your users go to get help
Or you can extend your conversational interface through your existing brand, such as on your webpage or in your own app
Chatterbot or Chat bot, a computer program that converses in natural language
A chatterbot (also known as a talkbot, chatbot, Bot, chatterbox, Artificial Conversational Entity) is a computer program which conducts a conversation via auditory or textual methods. Such programs are often designed to convincingly simulate how a human would behave as a conversational partner, thereby passing the Turing test. Chatterbots are typically used in dialog systems for various practical purposes including customer service or information acquisition. Some chatterbots use sophisticated natural language processing systems, but many simpler systems scan for keywords within the input, then pull a reply with the most matching keywords, or the most similar wording pattern, from a database.
The term "ChatterBot" was originally coined by Michael Mauldin (creator of the first Verbot, Julia) in 1994 to describe these conversational programs.
MS operated service and SDK to build and connect intelligent bots.
Interact with your users naturally wherever they are, from text/sms to Skype, Slack, Office 365 mail and other popular services.
One of many tools for building a complete bot. Others include: LUIS, Speech APIs, Azure, more.
Easiest way to reach the broadest set of users where they already are conversing
Excellent integration with companion services to add intelligence to your bot, such as LUIS for language understanding as well as many other Cognitive Services
For end users
Users can choose from a variety of conversation channels
Users have trust and control of their data
Broad access to your customers, new ways to delight them, serve them, do business with them – in your own web site or app or in any number of popular messaging experiences
Reduced cost of development
At Microsoft, we have first-hand experience writing bots and building artificial intelligence systems, so we’ve shared our services and tools so you can use them to add conversations to your own products.
First up are Microsoft’s Cognitive Services, for adding artificial intelligence to your experiences.
The next is the Bot Builder SDK, which you use in your code to build conversational smarts.
Lastly is the Bot Connector, which lets you seamlessly connect your bot up to users on: Skype, Facebook Messenger, SMS, Kik, Slack, and more.
Bot Builder SDK
Everything you need to build great dialogs within your Node.js or C# bot. Also REST
An open source SDK hosted on GitHub.
Dialogs to model conversation
Dialogs are reusable
Types of Dialogs include:
Yes/No, String, Number, Choices
FormFlow and form slot filling (branching, disambiguation, multi-turn)
Conversations are scalable to multiple machines
Support for rich attachments (image, card, video, doc, etc.); support for calling (Skype)
Service extensions for language understanding (LUIS) and translation
Online/offline Chat Emulator
Bot Connector Service
Connect your bot(s) seamlessly to text/sms, Office 365 mail, Skype, Slack, Twitter and more
A service to register your bot, configure channels and publish to the Bot Directory
Discover, try, and add bots to conversation experiences.
A public directory of bots registered and approved with Bot Framework.
Register your bot
Connect to channels
© 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
A fully managed big data and advanced analytics suite to transform your data into intelligent action
The concept of platforms is evolving. We are going beyond traditional graphical user experiences and introducing a Conversation Platform. It is about taking the power of human language and applying it more pervasively to all of our computing, whether it be apps, websites or even the hot new item of the day - bots.
Cortana Intelligence combines three distinct sets of capabilities:
Microsoft Cognitive Services, a set of cloud services, APIs and SDKs that make your applications more intelligent, engaging and discoverable.
Bot Framework, which enables you to build intelligent Bots to interact with your users in more contextual and natural ways, from text/sms to Office365 mail to Skype, Slack and other services.
Cortana, your digital personal assistant. Cortana empowers everyone to get things done in more helpful, proactive, and natural ways.
© 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANT