Don’t miss your chance to chat to an artificial human

Are you keen to help Soul Machines out on a study investigating how people respond to an artificial human in Auckland, New Zealand?

Then we would love your participation in our research.

You will be offered a $10 Westfield voucher for a 30-minute session.

What the session is

The session will include interacting with an artificial human who will talk to you, show you some images and ask what you think and feel during your conversation.


University of Auckland, Newmarket campus (Free visitor parking)

Participants must be over the age of 18 and fluent in English.

Find out more

For further information or to sign up straight away:

This study is funded by Soul Machines Ltd. Approved by the University of Auckland Human Participants Ethics Committee on 14 June 2018 for three years. Reference Number 021447

CASE-STUDY: Bringing a human face to customer-facing AI with IBM Watson

Case-Study by IBM  |  July 2018  | Full article here

Business challenge

AI-powered chatbots are already transforming customer service, but customers still value the emotional connection of interacting with human agents. Soul Machines™ saw an opportunity to give AI a human face.


Soul Machines™ is working with IBM Watson technologies to create “artificial humans”—realistic computer-generated characters that can react intelligently, empathetically and efficiently to customer needs.


Over 40%  of customer inquiries can be answered with zero human intervention

Continuous learning means that results will improve over time

8-12 weeks to create and roll out a customized artificial human for new clients

Business challenge story

Building empathetic AI

As artificial intelligence (AI) continues its move into the mainstream, many businesses are looking for areas of their business where techniques such as machine learning and deep learning can provide a competitive advantage.

One of the most promising use cases is customer service automation; over the past few years, hundreds of companies have built chatbots that can help them reduce the pressure on their customer service teams and communicate with customers at scale.

However, many people are wary of AI, and it can often be difficult to get users comfortable with the idea of connecting with new technologies—especially if they feel like they are being pushed to interact with an impersonal application interface, when they would prefer to speak directly to a human being.

But what if your interface had a human face? Soul Machines™, a tech company based in New Zealand, specializes in creating “artificial humans”—lifelike computer-generated characters with natural voices and realistic facial expressions, which can communicate and interact with users just like real people.

The company arose from a research team at the University of Auckland, led by Dr. Mark Sagar, the Oscar-winning animation specialist behind computer-generated faces in Avatar and King Kong. Today, it works with some of the world’s largest banks and software companies to create artificial humans that not only possess deep domain knowledge, but also embody the values and personalities of their brands.

The realism of these artificial humans relies on a virtual nervous system, a core technology modeled on the human brain and central nervous system. Greg Cross, Chief Business Officer for Soul Machines™, explains: “What’s unique about our artificial humans is that they are created using brain models that are similar to human brain chemistry.

“For example, imagine you are interacting with one of our artificial humans online, and you smile into your webcam. Our system uses visual recognition technology to recognize that this is an image of someone smiling. The virtual nervous system then interprets this as a positive situation, and creates the virtual equivalent of dopamine and serotonin. This in turn triggers the artificial human to “feel happy” and smile back at you.”

Soul Machines™ supplies the interactive, AI-powered face and voice that registers emotional cues from the customer and modulates voice and expression in response. This helps customers feel much more comfortable interacting with an AI-powered customer service system.

However, while Soul Machines™’ technology makes these interactions feel natural, the other half of the problem is to ensure that the artificial humans can answer customer questions correctly and accurately, with a deep understanding of the company’s business domain. That’s where IBM Watson™ Assistant comes in.

“The ease of integration with Watson Assistant means that the time to market for our clients is very short. We can get an artificial human up and running in just eight to 12 weeks. ”

— Greg Cross, Chief Business Officer, Soul Machines

Transformation story

Getting to the right answer

Watson Assistant is an enterprise-level AI assistant—customizable to any business—that delivers proactive, personalized services. It interprets natural language (in multiple languages) and can be continuously trained on domain-specific data to deliver appropriate responses to clients’ queries.

As the number of channels which customers use to communicate with companies continues to increase, Watson Assistant offers a more scalable alternative to human customer service agents. Companies can deploy Watson to handle thousands of everyday queries automatically, leaving human agents to focus their expertise on addressing more specific and complex issues.

“Many of our clients were already working with IBM, using Watson-based chatbots to answer customer questions through text-based interfaces,” Greg Cross says. “We just needed to integrate our artificial humans with Watson Assistant to provide a new user experience layer that would deliver Watson’s answers as if you were talking to someone live and in-person.”

The integration between the Soul Machines™ platform and IBM Watson Assistant is relatively straightforward. Watson Assistant runs in the IBM Cloud™, so there is no infrastructure to manage, and it provides a simple API that makes it easy to connect with other applications.

As a customer speaks to an artificial human, Soul Machines™ sends the audio stream of the customer’s voice to the Watson Assistant API. Watson converts the audio into text, then searches the company’s corpus of knowledge for relevant answers to the customer’s question, ranks the results, and returns the top-ranked answer to the Soul Machines™ solution.

Meanwhile, the Soul Machines™ platform is analyzing the audiovisual input for emotional cues from the customer’s tone of voice and their facial micro-expressions. It then converts the answer into modulated, emotionally inflected speech for the artificial human to deliver, matched with appropriately generated facial expressions.

“The ease of integration with Watson Assistant means that the time to market for our clients is very short,” says Greg Cross. “If a company has a Watson chatbot set up already, we can get an artificial human up and running in just eight to 12 weeks.”

“One of our banking clients has found that it can already satisfy 40 percent of queries without any kind of human intervention, and we expect that number to climb even higher as the solution continues to learn.”

— Greg Cross, Chief Business Officer, Soul Machines

Results story

Winning customers’ trust

“We’ve had great experiences working with the IBM team, both technically and commercially,” comments Greg Cross. “As a technology company, partnering with IBM gives us an increased reach because of the scale of their global consulting services team. IBM consultants can help clients implement our solutions, and the deep relationships that IBM has with its customers give us a strong foundation to build upon.”

As more businesses make the move from simple chatbots to Soul Machines™’ more sophisticated customer service solutions, the number of API calls to Watson Assistant is increasing substantially.

Greg Cross remarks: “So far, our clients’ customers are very happy using the technology. They love the immediacy of the customer experience interacting with our artificial humans. As the Watson solution keeps learning every day, it can answer more and more customer questions, and the answers get better over time.

“One of our joint banking clients has found that it can already satisfy 40 percent of queries without any kind of human intervention, and we expect that number to climb even higher as the solution continues to learn.”

As the world moves into the AI era, the pressing question is: how can businesses reinvent customer experience to retain and add value to customer relationships? As more and more companies take up AI solutions, the race will be on to add value in a way that keeps customers away from competitors.

Greg Cross concludes: “AI solutions keep learning and developing from the day they are implemented, so anyone late to the game will find it very difficult to catch up with the continued advances made by early adopters. Together with IBM we are proud to be helping businesses take an early lead in the AI race—potentially giving them an insuperable advantage in the years to come.”

Solution components


Take the next step

To learn more about IBM Watson Assistant, please contact your IBM representative or IBM Business Partner, or visit the following website:

To learn more about IBM Watson Platform

HOT OFF THE PRESS: Introducing Jamie – ANZ’s new digital assistant

Media Release | Tuesday 10th July 2018

 Introducing Jamie Introducing Jamie

Meet Jamie, ANZ’s new digital assistant, who starts work tomorrow helping customers with some of their general banking queries.

Jamie has a human face, voice and expressions and can have a two-way verbal conversation with people via a computer screen, tablet or mobile phone – thanks to advances in neuroscience, psychology, computing power and artificial intelligence.

She has been programmed to answer questions on 30 of the most frequently searched-for topics on the ANZ Help section of

ANZ will be trialling Jamie at where she will answer questions such as: “What do I do if I’ve lost my card?” and “How long does it take for a payment to process?” 

All of the questions she can answer are general in nature and do not require any specific customer information.

“Through the trial, we want to see if Jamie will appeal to those who might not be as comfortable using our other digital channels,” Liz Maguire, Head of Digital & Transformation at ANZ Bank said.

“While we know many of our customers love connecting through our existing digital channels, we have been talking face to face a lot longer than we’ve been using small screens.”

ANZ partnered with New Zealand tech company, Soul Machines™, to develop Jamie. Soul Machines™, co-founder and CEO, Mark Sagar, has won awards for his ground-breaking facial technology in King Kong and Avatar.

Jamie has a digital human face and persona, and is ‘brought to life’ using Soul Machines™’ world-leading Human Computing Engine™ (HCE). The Soul Machines™ HCE is a Virtual Nervous System™ that combines neural networks and biologically inspired models of the human brain which allow her to express personality and character in an incredibly human-like way.

Initial feedback from staff and customers has been positive. Around 90 percent of customers who have spoken to Jamie think it is a good idea for ANZ to introduce the technology.

“One of the things that is really exciting about this project is that we are starting to understand some of the benefits we can deliver for ANZ’s customers. The fact they can talk to somebody immediately,” Greg Cross, Chief Business Officer at Soul Machines™ said. “It’s a personal interaction – it is a face-to-face interaction.”

“How we move forward will be guided by what our customers and staff tell us they want,” Ms. Maguire said. “We’re excited to show Jamie to more of our customers and get their feedback.”

Soul Machines™ is making a name for itself globally for humanizing artificial intelligence. The company has just been named as one of the 61 most innovative start-ups in the world by the World Economic Forum developing “world changing” technology.

About Jamie

  • Jamie is ANZ’s digital banking assistant developed by New Zealand tech company, Soul Machines.
  • Customers can start talking with Jamie at
  • She has been optimized for desktop, tablet and mobile. 
  • All of the questions Jamie can answer are general in nature and do not require any specific customer information.
  • Jamie’s favourite colour is ANZ blue, and her favourite TV show is NZ’s Country Calendar.