Virtual Caregiving + AWS Use Case

Case study: building Addison Care, a 3D augmented-reality virtual caregiver using Amazon Sumerian, Amazon Lex, Amazon Polly, AWS Lambda, Amazon DynamoDB, and AWS IoT Greengrass.
Live Demo — Sumerian Squares

Sumerian Squares — Hollywood Squares meets ancient Sumer

live 3×3 game built on the Amazon Sumerian Hosts SDK

First Sumerian scene dec 2017
first Sumerian scene — dec 2017
// babylon.js + Sumerian Hosts SDK
import { HostObject } from "amazon-sumerian-hosts-babylon";
const host = await HostObject.create({
  character: "cristine",
  pollyConfig: { voice: "Joanna" },
  lexConfig: { botName: "SumerianSquares" }
});
host.listenTo(POI);

// 9 hosts, 6 layers, 134–137 joints, LRU pool cap 6/9, eye gaze 30Hz activateHost(“cristine”); playGesture(“agree”);

// question-bank.json — 110 Addison-era Qs
{
"hosts": ["cristine","fiona","grace","maya","alien","luke","jay","preston","wes"],
"sdk": "amazon-sumerian-hosts-babylon@1.0",
"polly": "Brian",
"lex": "SumerianSquares"
}

Live demo playable at /sumerian-squares · code samples from assets/sumerian-squares/src · open-source.

The demo above runs today. What follows is how it started — Addison Care, CES co-branded media, and partner development.

Use Case — Historical Backdrop

Virtual Caregiving + AWS

building Addison Care™ — a 3d augmented-reality health monitoring product

Addison Care product interface — medication tracking with 3D virtual caregiver
addison care — the virtual caregiver product interface

press + coverage

the published aws case study

amazon web services published this case study at aws.amazon.com/solutions/case-studies/electronic-caregiver/ in january 2019. the archived version is preserved below and verifiable via the internet archive.

PDF preview unavailable in this browser.

Amazon Sumerian™ Healthcare Augmented Reality AWS IoT Greengrass™ AWS Hero

what we built

addison care™ is an interactive, voice-controlled virtual caregiving solution featuring a 3d augmented-reality character. patients interact with addison via tablets installed throughout their homes, connected to wireless visual sensors, local ai processors, bluetooth biometric wearables, and emergency monitoring devices.

the system detects gait anomalies, provides medication and treatment reminders through specialized modules for diabetes, heart disease, and copd, and learns about the patient through continuous observation. serving seniors who need health monitoring but cannot afford in-home human caregivers at $20/hour.

technology stack

Amazon Sumerian™ rendered 3d scenes. Amazon Lex™ handled conversational ai. Amazon Polly™ provided text-to-speech. AWS Lambda™ ran serverless logic. Amazon DynamoDB™ stored health markers. AWS Amplify™ hosted scenes. AWS IoT Greengrass™ ran facial-recognition locally on tablets, even offline.

development breakthrough

three years with a traditional game engine produced eight-month cycles with teams of 10-12. within two hours of accessing Amazon Sumerian, developers were building scenes. three months later, addison was complete — two-person teams averaging 70 iterations per developer per day.

timeline

2009

founded on aws

electronic caregiver launches with Amazon EC2 powering services

2017

first Amazon Sumerian scene

creates the first Amazon Sumerian scene — the genesis moment for the entire product direction

2018

addison complete

three months from Amazon Sumerian access to finished ar character. presented at aws re:Invent™ to thousands of customers. clinical trials begin with g60trauma.org

2019

ces debut + nmsu partnership

consumer electronics show debut. $350,000+ partnership with new mexico state university establishes a vr lab at milton hall

this page documents work performed during my tenure as chief technology officer at electronic caregiver (2009-2024). i am not currently affiliated with electronic caregiver or amazon web services in any capacity related to these products. the aws case study content is reproduced from a publicly archived source for portfolio purposes. views expressed are my own.

Amazon Web Services, AWS, Amazon Sumerian, Amazon Lex, Amazon Polly, AWS Lambda, Amazon DynamoDB, AWS Amplify, AWS IoT Greengrass, and the Powered by AWS logo are trademarks of Amazon.com, Inc. or its affiliates. Addison Care is a trademark of Electronic Caregiver, Inc. All other trademarks are the property of their respective owners. Use of these marks here constitutes fair use for factual reference only and does not imply sponsorship, endorsement, or affiliation.