EAII / Research
Market Validation / 2026-05-14

Does the emotional AI infrastructure thesis survive 2026 scrutiny?

226 searches across 7 sections. The full consumer cross-platform thesis is the weakest version of the bet. The B2B SDK version survives.

226 searches7 sectionsAsked by Matt2026-05-14
TL;DR

The full consumer cross-platform thesis is the weakest version of the bet. The strong B2B SDK version survives. Lead with mental health coaching, sequence into agent infrastructure, treat the consumer cross-platform vision as a 24 to 48 month outcome of B2B network effects.

00 / Executive Summary

What 226 searches concluded

The full EAII thesis as posed (a neutral cross-platform consumer emotional profile that travels with the user across OpenAI, Anthropic, Google, Meta, Apple, and Amazon) is the weakest version of the bet. Every historical analogue (identity, payments, health data, analytics) shows platform giants absorbing the consumer-facing UX layer through on-device personalization moats, while the neutral layer survives only in B2B infrastructure (Plaid, Stripe, Twilio). Apple's on-device + Private Cloud Compute architecture, Anthropic's April 2026 finding of 171 emotion vectors inside Claude Sonnet 4.5, and Inflection's talent-strip by Microsoft are all evidence that platforms will own the consumer cross-platform memory layer themselves. Without a regulatory mandate equivalent to PSD2 or CFPB 1033 for emotional data (none exists in 2026), the consumer thesis breaks.

Weak thesis

Consumer cross-platform breaks without mandate

Platform giants absorb the consumer-facing UX layer through on-device personalization moats. Apple's Private Cloud Compute and the Inflection talent-strip precedent are evidence. Without a PSD2-equivalent emotional data portability regulation (none exists), the neutral consumer layer cannot survive.

Strong thesis

B2B SDK with on-device first survives

Clear vacant space for a B2B emotional-signal infrastructure SDK that ships on-device first, is opt-in by architecture, outputs structured auditable emotional state to the developer's choice of LLM, and ships EU AI Act, HIPAA, BIPA, and Colorado AI Act compliance documentation in the box. No incumbent (Hume, Affectiva, NICE, Cogito, Uniphore, Mem0) covers all four.

Sharpest wedge

Mental health coaching platforms

The Article 5(1)(f) workplace ban has medical and safety carve-outs. HIPAA's BAA gate is a moat once cleared. The buyer (CMO / Chief People Officer through employer benefits procurement) is exactly the motion Michelle already runs. Hume cannot land these without a HIPAA BAA path or FHIR output.

Recommendation: lead with mental health coaching platforms. Sequence into agent infrastructure at Series A. Treat the consumer cross-platform vision as a 24 to 48 month outcome of B2B network effects, not the pre-seed pitch.

Section 01

Market map of emotional / affective AI in 2026

Fourteen vendors charted across modality breadth and persistent-per-user profile depth. Crowded zones at the contact-center and ad-research corners. Sparse zones in cross-platform portability and developer-first neutral SDKs.

Market quadrant chart of 14 emotional AI vendors in 2026 Scatter plot with modality breadth on the x-axis and persistent per-user profile depth on the y-axis. The upper-right quadrant labeled Vacant zone is sparsely populated. SINGLE MODALITY MULTIMODAL SESSION-ONLY PERSISTENT Vacant zone (THE THESIS SPACE) Where vendors actually sit Hume AI SmartEye / Affectiva Cogito Uniphore NICE Behavioral Signals Empath audEERING MorphCast Realeyes Entropik Mem0 Humans (raising) Sanas

14 vendors charted

CompanyFoundedLast raiseHQWhat they sellModalitiesPersistent per-userCross-platformPricingNamed customers
Hume AI2021$50M Series B (Mar 2024, total ~$62.7M; lead EQT Ventures, USV)New YorkEVI voice API + Expression Measurement API + Expressive TTSVoice (primary), face, text, physiologicalSession-level only; no shipped persistent productLLM-agnostic but Hume-lockedPublic tiers $0 to $500/mo + customVonova, Hamming AI, hpy, Northwell Health (investor + partner)
SmartEye / Affectiva2009 / merged 2021 (~$73.5M)Public (Nasdaq First North)Boston + GothenburgAutomotive Interior Sensing + Media Analytics + Human FactorsFace (15M+ videos, 8B+ frames, 90 countries), voice, gazeNo persistent user product (session, in-cabin)Vertical-locked (auto / advert / research)Enterprise OEM licensing, per-vehicleOEMs (NDA); Unilever, CBS (pre-acquisition era); CES 2026
Cogito2007~$70M total (last Series D 2019)BostonReal-time agent voice coachingVoice onlyPer-agent longitudinal (yes), per-caller weakContact-center lockedEnterprise SaaS, undisclosedMetLife, Humana, Cigna, Principal
Uniphore2008$400M Series E (Feb 2022, total ~$610M)Palo AltoU-Analyze / U-Assist / Q for Sales (CX agentic AI)Voice, video, text, screenStrongest cross-session per-caller profile of the threeContact-center locked, multimodalEnterprise, $500K to $2M+ ACVBajaj Allianz, Franklin Templeton, Conduent, HGS
NICE Ltd.1986Public (NASDAQ:NICE), ~$8 to $10B market cap, ~$2.4B FY24 revenueRa'anana, IsraelCXone Mpower + Enlighten AI (CSAT/QA/routing/Copilot); Cognigy (2024 acq)Voice, chat, email, SMS, social, screenScore/outcome-oriented journey profilesLocked to CXoneModular per-seat SaaS, enterpriseVerizon, Virgin Media O2, Radisson, HUB International, Bradesco
Behavioral Signals2016Kairos Ventures portfolio (rounds undisclosed)Los AngelesAIMC platform: real-time emotion-routing for callsVoiceImplied (routing optimization)Call-center lockedEnterprise, undisclosedCall center + defense; specifics not public
Empath (Japan)~2015 to 2016320M yen (~$2.9M, 2018)TokyoREST API (language-independent acoustic emotion)VoiceNo (stateless)API-onlyFreemium + enterpriseNTT Docomo (disaster support); ~1,000 companies across 50 countries (2018 figure)
audEERING2012ERC H2020 + acquired by Agile Robots (~2024 to 2025)MunichopenSMILE (OSS) + AI SoundLab + SDK for auto/health/roboticsVoice, environmental sound, music; ~7,000 acoustic featuresPartial (AI SoundLab longitudinal voice biomarkers)SaaS + SDK, vertical-targetedEnterprise / undisclosedBMW, Huawei, GfK, Red Bull, Ipsos
MorphCast2017BootstrappedMilanBrowser JS / WASM SDK (100+ affective signals)Face (in-browser, on-device)No (ephemeral by design)Web-first SDKFreemium + paid + enterpriseEdTech / telehealth / martech (most names not public)
Realeyes2007~$33.8M total (Series A+B)LondonAd / media attention measurement (panel-based)Face (opt-in webcam panels)No (research-scoped)SaaS + lightweight JS loaderEnterprise / undisclosedAT&T, Mars, Hershey's, Coca-Cola
Entropik2016$25M Series B (Bessemer, 2023; total ~$35M)BengaluruDecode platform (facial + eye + EEG + survey)MultimodalNo (research-scoped)Cloud SaaS + APIEnterprise / undisclosedFMCG / media / retail (specifics limited)
Mem02023$24M (Oct to Nov 2025; YC, Peak XV, Basis Set)Bay AreaPersistent AI memory layer (model-agnostic SDK)Text (no affect modality)Yes (cognitive memory, not affective)API + SDK, framework-agnosticUsage-based + enterpriseThousands of startups; 41K GitHub stars
Humans& (Eric Zelikman)2025Raising ~$1B at ~$4B (Oct 2025, in progress)Bay Area (inferred)EQ-native foundation modelMultimodal (planned)UnknownFoundation modelPre-revenueNone public
Sanas2020$32M Series A (2022), ongoing growth roundsBay AreaReal-time accent / emotional tone neutralization for BPO callsVoice (real-time transformation)NoTelephony stackEnterpriseLarge BPOs, F500 (unnamed)

Crowded zones

Facial action unit scoring for ad research (Realeyes, Affectiva, Entropik, MorphCast). Contact-center voice coaching (Cogito, NICE, Uniphore, Behavioral Signals, Empath). Automotive DMS (SmartEye + Seeing Machines effective oligopoly). Session-level voice emotion APIs (Hume EVI vs ElevenLabs / Cartesia / Sesame).

Sparse zones

Persistent cross-session emotional profiles tied to user identity (no vendor has shipped this). Cross-platform / cross-application portability (zero). Developer-first neutral third-party SDKs not vertical-locked (closest are Hume API and MorphCast browser SDK, neither persistent). Consent-governed user-controlled emotional data portability (the Plaid analogy, zero vendors). Edge plus cloud hybrid with persistent identity graph (none). Emotional context primitives for AI agents (none, despite the agentic-AI wave). EDNA-like products: ChatGPT memory has the most depth but no portability; KAi (privacy-first newcomer) is closest to persistent understanding architecture; Kindroid permits manual portable journals. No product meets the four-criteria EDNA bar (deep inference + user ownership + cross-product portability + interop standard).

Section 02

The cross-platform thesis, stress-tested

Foundation model providers, portable state standards, six historical analogues, and the bear case. The B2B layer is where the neutral middleware survives. The consumer cross-platform layer is where platforms absorb the UX.

Foundation-model providers' emotion surfaces in 2026

OpenAI

GPT-4o expressive audio via the Realtime API (production); ChatGPT memory (auto-managed as of April 2026) is consumer-only, not exposed via API. Responses API context compaction and reusable skills exist (March 2026 update). No structured detected_emotion API endpoint. (OpenAI, InfoQ March 2026)

No structured emotion API
Anthropic

Claude April 2026 interpretability research identified 171 distinct emotion vectors in Sonnet 4.5 internals that causally shape behavior. Positioned as safety / model-welfare research, not productized; no public API exposure of emotion state. (Megaone analysis)

Research, not product
Google

Gemini sentiment via prompting; Project Astra has affective scene understanding in prototype, not API-exposed. Older Natural Language API still offers structured sentiment.

Sentiment only
Meta

Llama internal emotion encoding confirmed in academic research (ACL 2025 SENTRILLAMA); Meta AI affective tone locked to Meta surfaces; Reality Labs Codec Avatars expose limited expression tracking via Quest Presence Platform.

Locked to Meta surfaces
Apple

Writing Tools tone rewriting, priority notifications, Siri contextual empathy. All locked. Apple Intelligence 3B on-device model + Private Cloud Compute is the production reference for hybrid local + cloud. No emotion API exposed. (Apple research)

No emotion API
Amazon

Comprehend sentiment API (open); Alexa Skills Kit frustration detection (limited); Alexa+ empathy locked.

Sentiment open; rest locked
Microsoft

Azure AI Language Sentiment + Azure AI Speech emotion are both GA and the most open structured emotion APIs from a foundation provider. Copilot/Viva sentiment locked to M365.

Most open emotion API

Portable state and emotion standards

MCP is the de-facto agent transport but has no emotion extension. W3C WebAgents CG (March 2026 interop report) and Smart Voice Agents Workshop (Oct 2025) raised cross-cultural emotion modeling and identity delegation as open items; potential W3C Activity Group at TPAC 2026. IEEE 7010 (wellbeing metrics) is process-oriented, not a wire format. Letta / Mem0 / Agent Protocol are practitioner-led de-facto memory standards. No ratified cross-vendor emotional context standard exists in 2026. EmotionML 1.0 (2014 W3C Recommendation) is stale.

Historical analogue chain showing how prior neutral layers fared Six analogue nodes (OAuth, Stripe, Plaid, FHIR, Twilio, Segment) connect to a final node representing the emotional layer in 2026. Each analogue carries a verdict caption above it. OPEN STANDARD WON B2B MIDDLEWARE REGULATOR-PROTECTED OPEN PROTOCOL CLEAR B2B WIN ATT-CRIPPLED OAuth Stripe Plaid FHIR Twilio Segment Emotional layer (2026) Closest analogue: Plaid. But Plaid survived because regulators mandated portability. No equivalent mandate exists for emotional data.

Historical analogues (full table)

AnalogueOpen standardNeutral B2B middlewarePlatform absorption of consumer UXRegulatory force
Identity (OAuth / Okta+Auth0 / SIWA / Google)OAuth open wonOkta+Auth0 won enterpriseApple/Google won consumerPartial
Payments (Stripe / Adyen / Apple Pay / Google Pay)API commoditizedStripe / Adyen won B2BApple Pay / Google Pay won wallet UXEU DMA forced NFC opening
Financial data (Plaid / FDX / PSD2)FDX won protocolPlaid survived (DOJ blocked Visa acquisition)Banks tried, failedPSD2 + CFPB 1033 mandated portability
Health data (FHIR / Apple Health / Health Connect)FHIR wonFragmentedApple Health / Health Connect won consumer21st Century Cures Act
Comms APIs (Twilio / Sinch / MessageBird)Open protocolsTwilio won clearlyPlatforms tried, failedTelecom regulatory neutrality
Analytics / CDP (Segment / mParticle / RudderStack)FragmentedPartially absorbed (Segment to Twilio struggled)Google Analytics dominant; ATT crippled CDPsNone protective; ATT hostile

The closest predictive analogue is Plaid (financial data). Plaid survived only because regulators mandated portability. There is no equivalent emotional-data portability regulation in 2026 and none on the legislative calendar. The EU AI Act regulates emotional data sharply but does not mandate user-controlled portability. The honest read: without regulatory backing, the neutral cross-platform emotional layer is structurally more like CDPs after ATT than Plaid after PSD2. It survives B2B; it loses consumer.

The bear case

Five compounding forces work against the consumer cross-platform thesis.

01

On-device personalization moats are now cryptographic, not contractual, with Apple's Private Cloud Compute and Secure Enclave deliberately preventing third-party access.

02

Apple + Google's January 2026 Gemini-powers-Siri deal is a bilateral vertical integration that squeezes any independent layer.

03

Every analogous neutral consumer layer was absorbed (Workflow / Siri Shortcuts, Auth0 consumer, Stripe consumer, Twilio Segment after ATT).

04

The Inflection / Pi precedent is the new playbook: Microsoft talent-stripped Inflection in March 2024 without acquiring it, gutting the neutral consumer emotional AI while avoiding antitrust scrutiny.

05

Every multimodal stream emotional AI needs (HRV, voice tone, typing cadence, app-usage) is now owned by Apple Health / Gemini / WhatsApp / Quest.

Conditions that would have to be true to keep the consumer thesis alive: regulatory interoperability mandate (low probability), users actively port their context via a W3C standard (very low), platform AI stays bad (low and dropping), the neutral layer becomes a hardware play above the OS (medium and the only viable escape hatch), or the neutral layer pivots to B2B enterprise (medium to high; this is what actually works).

Bottom line: build the B2B layer first, treat consumer cross-platform as an emergent property of B2B network effects, and accept that consumer UX will be owned by platforms.

Section 03

Who would actually pay for this, ranked by realism

Nine customer segments ranked top to bottom by realistic accessibility. Companion apps and gaming NPCs are fastest. HR hiring and automotive OEM are effectively closed at pre-seed.

Customer segment accessibility ladder Nine ranked segments stacked top to bottom. Top of the ladder is the most accessible, illuminated by a mint and peach orb wash. Bottom is the least accessible, dimmed. 01. AI COMPANION APPS $24K to $180K 02. GAMING NPCs / CHARACTER INFRA $8K to $500K 03. DATING APPS $18K to $1M 04. AI AGENT INFRASTRUCTURE $12K to $400K 05. ENTERPRISE CX / CONTACT CENTERS $40K to $800K 06. MENTAL HEALTH (COACHING / CLINICAL) $20K to $500K 07. EDUCATION (CORPORATE L&D) $15K to $200K 08. HR TECH (POST-HIRE ONLY) $30K to $100K 09. AUTOMOTIVE (FLEET AFTERMARKET) $40K to $150K
01
AI companion apps
Replika, Character.AI, Kindroid, Nomi, Paradot
Regulatory drag: Medium
Sales cycle 4 to 10 weeks Realistic first ACV $24K to $180K
02
Gaming NPCs / character infrastructure
Inworld, Convai, Charisma.ai, Replica Studios, Niantic
Regulatory drag: Low
Sales cycle 3 to 8 weeks Realistic first ACV $8K to $60K indie / $150K to $500K publisher
03
Dating apps
Thursday, Feels, Hinge, Locket, Paired
Regulatory drag: Medium (BIPA, FTC dark patterns)
Sales cycle 6 to 14 weeks (small) / 9 to 18 mo (Match) Realistic first ACV $18K to $120K small / $300K to $1M Match/Bumble
04
AI agent infrastructure
Bland AI, Vapi, Retell AI, Sierra AI, Cognigy
Regulatory drag: Low
Sales cycle 2 to 6 weeks Realistic first ACV $12K to $400K
05
Enterprise CX / contact centers
Observe.AI, Balto, Talkdesk, Intercom, Qualtrics
Regulatory drag: Medium (EU AI Act high-risk; BIPA)
Sales cycle 4 to 18 months Realistic first ACV $40K to $800K
06
Mental health (consumer wellness lane)
Woebot Health, Wysa, Calm, Spring Health, Headspace for Work
Regulatory drag: High (HIPAA, FDA SaMD, IL WOPRA)
Sales cycle 8 to 16 weeks wellness / 18 to 36 mo clinical Realistic first ACV $20K to $80K wellness / $150K to $500K clinical
07
Education (corporate L&D only)
Coursera for Business, Duolingo, Synthesis, Khanmigo, Articulate 360
Regulatory drag: Very high in K-12
Sales cycle 3 to 6 mo L&D / 12 to 24+ mo K-12 Realistic first ACV $15K to $60K L&D / $50K to $200K uni
08
HR tech (post-hire only)
Leapsome, Lattice, Humu (acquired), Perceptyx, BetterUp
Regulatory drag: Very high (NYC LL144, CO AI Act, EU AI Act Art 5 hiring ban)
Sales cycle 3 to 6 months Realistic first ACV $30K to $100K
09
Automotive (fleet aftermarket only)
Samsara, Lytx, Netradyne, Mobileye, SmartDrive
Regulatory drag: Very high (UNECE R157, ISO 26262, EU AI Act high-risk)
Sales cycle 6 to 12 mo fleet / 3 to 5 yr OEM Realistic first ACV $40K to $150K fleet

Companion apps and gaming NPCs are the fastest first-customer paths. AI agent infrastructure is the fastest deal cycle (developer buyer, no procurement). Enterprise CX is large but slow and incumbent-saturated. Mental health is high-mission, high-friction. HR tech for hiring is effectively closed. Automotive OEM is structurally unreachable at pre-seed; fleet telematics is the only viable lane and still slow.

Budget owners by 2026 reality

Chief AI Officer has emerged at ~35% of F500 and is now a mandatory approval for any AI SDK above ~$50K. Trust & Safety / Chief Trust Officer has independent budget in consumer platforms (DSA / KOSA pressure). CMO (Chief Medical Officer) is the gating buyer in any health-touching deal. Head of Platform owns developer-tooling budget in gaming and agent-infra contexts.

2024 to 2026 shift

AI moved from innovation budget (25% of LLM spend in 2024) to core OpEx (7% innovation, 93% operating in 2026). Procurement is gate-driven not curiosity-driven. Vendor consolidation is the dominant pressure. Lead with compliance, not capability. Map to an existing line item (Trust & Safety, Clinical AI, Contact Center OpEx). ROI documentation is mandatory.

Section 04

The SDK in the client distribution model

Five SDK meta-lessons that survive, the 2026 integration friction map, on-device feasibility for Phi / Gemma / Apple Foundation, and the compliance certification sequence that opens enterprise doors.

Lessons from successful SDK businesses

01
Time-to-first-call under 10 minutes

No sales call. Just init() plus dsn key.

Stripe, Sentry

02
Public, usage-based pricing

Generous free tier; pricing on the homepage.

Pinecone, ElevenLabs, Sentry

03
Idiomatic per-language SDKs

Written by company engineers, never auto-generated wrappers.

Stripe (gold standard)

04
Integration density compounds

Sources and Destinations marketplaces lock distribution.

Datadog 1,000+, Segment

05
Data trust is everything

One pricing change can trigger mass exodus.

Mixpanel 2017 to Amplitude

What killed companies that failed: Heap (autocapture without data governance), MoEngage and similar mobile marketing SDKs (marketer-buyer plus engineer-integrator misalignment), Auth0 challengers (any security incident was fatal). Emerging dealbreaker in 2026: SDKs without machine-readable schemas (OpenAPI, MCP) are becoming invisible to AI coding agents that provision infrastructure.

2026 integration friction

Total SDK-to-production timeline for a mid-complexity mobile SDK is 8 to 20 weeks. Hard gates include SOC 2 Type II report current within 12 months, SBOM (SPDX or CycloneDX), SLSA Level 2 provenance, Apple PrivacyInfo.xcprivacy manifest (enforced since May 2024; without it the SDK literally cannot ship on iOS), required-reason API declarations, Google Play Data Safety disclosures (automated binary scanning since 2025; 255K+ apps blocked in 2025 alone), ATT-denial graceful fallback, and performance budgets (iOS binary <1.5MB, Android <2MB post-shrink, main-thread init <200ms, web bundles <50KB gzipped for synchronous loads). (Bitrise Apple Privacy Manifest, Respectlytics Data Safety guide)

On-device and cloud hybrid architecture Split-pane diagram showing on-device phone tier containing Phi-4-mini or Gemma 3 1B and a DistilBERT classifier, connected via a Private Cloud Compute boundary to a three-card cloud backbone of Observer 8B, Strategist 70B, and Compliance layer. PRIVATE CLOUD COMPUTE BOUNDARY ON-DEVICE Phi-4-mini / Gemma 3 1B DistilBERT classifier CLOUD BACKBONE Observer 8B Strategist 70B Compliance layer STRUCTURED EMOTION PAYLOAD OPT-IN, ENCRYPTED APPLE INTELLIGENCE REFERENCE ARCHITECTURE

On-device feasibility (the EAII technical bet)

Yes, credible in 2026 and shipping in production. Apple Intelligence's 3B on-device model with 2-bit QAT plus Private Cloud Compute is the production reference architecture. Gemini Nano (1.8B) on Tensor G3 / Pixel + AICore is the Android equivalent. Samsung Galaxy AI (Gauss 1 to 3B) plus cloud is also live.

ModelQuantized sizeRAMiPhone 17 Pro tok/secOld 4GB Android tok/secEmotion fit
Gemma 3 1B (4-bit)0.6 to 0.9 GB1.0 to 1.5 GB35 to 4510 to 15Best low-end / real-time
Llama 3.2 1B0.7 to 1.0 GB1.2 to 1.8 GB30 to 408 to 12Broad fine-tunes
Llama 3.2 3B1.8 to 2.2 GB2.5 to 3.5 GB16 to 225 to 9Tool-calling, broad community
Phi-4-mini (3.8B)2.2 to 2.8 GB3.0 to 4.5 GB13 to 184 to 7Strongest reasoning per param
Apple Foundation (~3B, 2-bit QAT)2 to 3 GB2 to 3 GB10 to 20iOS onlySystem-managed, zero latency

For emotion classification specifically, fine-tuned encoder-only models (DistilBERT / DeBERTa-v3-small, 80 to 250MB, 5 to 40ms prefill) dominate small LLMs on latency, often by 10x to 50x, at comparable accuracy. The case for using an on-device LLM is generalization to novel emotion schemas without retraining, or sharing the model already loaded for other features. PAD regression on-device hits r ~0.68 to 0.78 with DeBERTa-small or fine-tuned 1B to 3B LLMs (cloud GPT-4o ceiling is r ~0.80 to 0.86; human inter-annotator agreement is r ~0.60 to 0.70, so models are at the annotation noise floor). Browser-side: Transformers.js plus DistilRoBERTa-emotion (~80MB, ~100ms) is production-ready; WebGPU LLM inference is too slow on mobile browser. (Apple foundation models, On-Device LLMs State of the Union 2026)

Compliance posture and certification sequencing

Compliance sequencing timeline Horizontal timeline with five stations: SOC 2 Type II, HIPAA BAA plus GDPR DPA, ISO 27001, EU AI Act plus ISO 42001, and FedRAMP. Each station has cost and timing labels. SOC 2 TYPE II $25K to $55K 8 to 12 mo HIPAA BAA + GDPR DPA $8K to $20K parallel ISO 27001 $15K to $35K 60% overlap w/ SOC 2 EU AI ACT + ISO 42001 $25K to $65K 2026 FEDRAMP $500K to $2M+ Series A+ SERIES A+

SOC 2 Type II is the universal door-opener (8 to 12 months, $25K to $55K total; observation period 3 to 6 months minimum; Vanta or Drata automation $10K to $20K per year). HIPAA BAA + GDPR DPA in parallel ($8K to $20K). ISO 27001 after ($15K to $35K; 60% overlap with SOC 2). EU AI Act conformity assessment + ISO 42001 in 2026 ($25K to $65K combined). FedRAMP is Series A+ territory ($500K to $2M+). Total Year 1 to 2 excluding FedRAMP: ~$96K to $235K. The single largest compliance leverage point is the on-device versus cloud decision, because on-device inference removes biometric data from sub-processor chains and dramatically compresses audit scope. The EAII team is already aligned on this with EDNA as an SDK.

Section 05

Regulation, ethics, and the can-we-even-sell-this question

EU AI Act Article 5 prohibitions and Annex III high-risk categories. US state and federal stack from BIPA to NYC LL144 to Illinois WOPRA. Sectoral overlays (HIPAA, FERPA, COPPA, FDA SaMD). Five landmines and ten compounding lessons.

Regulatory landmine field Atmospheric composition of three large gradient blooms representing EU AI Act (lavender, left), US state stack (rose, center), and sectoral regulations (sky, right), surrounded by floating pills naming individual statutes. EU AI Act US state stack Sectoral ARTICLE 5(1)(F) ANNEX III ARTICLE 50 BIPA CUBI WOPRA NYC LL144 CO AI ACT MHMDA HIPAA FERPA COPPA FDA SaMD
EU AI Act

Article 5, Annex III, Article 50

Article 5(1)(f) prohibits emotion inference from biometric data in workplace and educational settings. Active since Feb 2, 2025. Penalties: 35M EUR or 7% of global turnover. Two carve-outs: medical and safety. Annex III high-risk categories require conformity assessment, FRIA, EU database registration, CE marking, post-market monitoring (effective August 2, 2026). Article 50 transparency obligations apply to permitted limited-risk emotion AI since August 2025. (Article 5 text, FPF deep dive)

US state and federal

BIPA, CUBI, MHMDA, Colorado AI Act, NYC LL144, WOPRA

Illinois BIPA (private right of action; 2024 SB 2979 amendment limited per-scan exposure but core requirements stand). Texas CUBI + Texas HB 149 (Jan 1, 2026) banning AI behavioral manipulation. Washington My Health My Data Act covers any data that could be used to infer mental health states. California stack: CCPA / CPRA / SB 362 Delete Act / AB 2013 / SB 942 / AB 1008. Colorado AI Act effective Feb 1, 2026. NYC LL144 AEDT bias audit (Dec 2025 NYC Comptroller enforcement wave). Illinois WOPRA (HB 1806, Aug 1, 2025) explicitly prohibits AI emotion detection by licensed mental health professionals in Illinois ($10K per violation).

Sectoral

HIPAA, FERPA, COPPA, FDA SaMD

HIPAA applies if vendor serves a covered entity (BAA mandatory); HIPAA does NOT cover direct-to-consumer wellness apps (the gap that lets Calm / Headspace operate without BAAs unless contracted by a covered entity). FERPA covers student records; emotional inference tied to identifiable students likely qualifies. COPPA covers under-13 (verifiable parental consent; expanded interpretation for biometric and behavioral profiling). FDA SaMD: clinical claims (diagnose, treat, mitigate, prevent depression / anxiety / PTSD) trigger De Novo or 510(k) review. Big Health is the case study.

Landmines and lessons

Five compounding incidents that defined the 2020 to 2026 regulatory posture.

2019 to 2021

EPIC v HireVue

HireVue removed facial analysis January 2021 but kept voice and linguistic. Regulators noticed.

EPIC complaint
May 2025

Replika 5M EUR Garante fine

Tech Justice Law Project FTC complaint Jan 2025; reaffirmed ban June 2025.

EDPB notice
Jan 2025

FTC 6(b) on companion apps

Tech Justice Law Project FTC complaint on Replika opens the 6(b) season.

FTC complaint
Sept 2025

Character.AI Section 6(b) inquiry

Garcia wrongful death lawsuit settled by mediation January 2026; under-18 banned from companion chat November 2024.

Garcia case
Jan 2026

Garcia settlement

Mediated settlement; Google named upstream. Infrastructure liability flows both directions.

CBS News

Lisa Feldman Barrett (Psychological Science in the Public Interest 2019) scientific deconstruction of the universal facial emotion thesis is now the regulatory foundation for the EU AI Act prohibitions. Stochastic Parrots (Bender, Gebru, McMillan-Major, Mitchell 2021) is the academic source for the fluency over-attribution concern that drives consumer companion regulation.

Ten compounding lessons

  1. Never overclaim scientific validity beyond peer-reviewed evidence.
  2. Treat minor and vulnerable-user exposure as existential.
  3. Product liability frameworks (not just privacy) now apply (Garcia).
  4. GDPR Article 9 special-category-data consent must be explicit and granular.
  5. Dependency-by-design is the new regulatory target; ship dependency-dampening features.
  6. Consent architecture must match data sensitivity.
  7. Removing the visible feature is not enough (HireVue removed face, kept voice, regulators noticed).
  8. Maintain a Section 6(b) readiness dossier.
  9. Infrastructure liability flows both upstream and downstream (Google was named in Garcia).
  10. Read the academic literature as a regulatory early warning system.

Net effect on customer segments

SegmentPre-regulation feasibilityPost-2026-regulation feasibilityPosture that unlocks it
HR hiringModerateEffectively closedNone at pre-seed
Workplace monitoring (EU)ModerateProhibitedNone
K-12 student emotionHardNear-paralysisAdult / corporate L&D only
Therapist-side clinical (IL)ModerateClosed by WOPRAPatient-initiated, coaching / EAP framing
AI companion apps (consumer)EasyConditional on opt-inOpt-in plus safety telemetry plus minor exclusion
Mental health coaching (employer EAP)ModerateOpen with carve-outThis is the wedge (Art 5(1)(f) safety / medical)
Automotive driver safetyHardOpen with carve-outUNECE R157 / safety exception
Agent infrastructureEasyEasyDisclose AI, ship audit logs
Section 06

The differentiation question

Nine moat candidates evaluated against pre-seed feasibility. The layered stack sequences DX and compliance first, on-device and consent graph next, modular model-merging in the middle, then cross-app portability, then the proprietary dataset flywheel. Neutrality is the only structural advantage no incumbent can replicate.

Moats stack diagram Five horizontal layers stacked vertically, each labeled with a phase month range and the moat that compounds in that phase. Bottom layer is DX and compliance; top layer is the proprietary dataset flywheel. MONTHS 0 TO 6 DX + compliance architecture Foundation MONTHS 6 TO 18 On-device + consent graph Architecture moat MONTHS 12 TO 24 Modular model-merging (M2N2 / BAR) Technical moat MONTHS 18 TO 36 Cross-app profile portability Network effects begin MONTHS 24 TO 48 Proprietary dataset flywheel Compounds Neutrality. The single structural advantage no incumbent can replicate.

Nine moat candidates

(a) Cross-platform persistence

Of user emotional state

Defensibility: Medium

Time: 9 to 15 mo. Pre-seed: Tight.

Pre-seed move: File patents on consent-graph schema.

(b) Proprietary multi-modal dataset

From customer integrations

Defensibility: Low to Medium at scale

Time: 18 to 36 mo. Pre-seed: Series B moat.

Pre-seed move: Instrument every integration with opt-in telemetry day one.

(c) Vertical lock-in

As beachhead

Defensibility: Low (primary), Medium (beachhead)

Time: 6 to 12 mo. Pre-seed: Yes as beachhead.

Pre-seed move: Pick one compliance-heavy vertical.

(d) Developer experience

SDK ergonomics

Defensibility: Medium

Time: 3 to 6 mo. Pre-seed: Yes (fastest).

Pre-seed move: Ship emotion in 3 lines SDK plus open-source schema.

(e) Safety + compliance + audit

Posture

Defensibility: High

Time: 6 to 24 mo. Pre-seed: Yes (start now).

Pre-seed move: Publish an open Emotion Data Trust Framework spec.

(f) Cross-app network effects

From profile portability

Defensibility: High at scale

Time: 24 to 48 mo. Pre-seed: Series A/B moat.

Pre-seed move: Design the schema portable from day one.

(g) On-device latency

And performance

Defensibility: Medium

Time: 6 to 12 mo. Pre-seed: Yes (18-mo window).

Pre-seed move: Federated learning loop, not just on-device inference.

(h) Pricing and packaging

Architecture matters

Defensibility: Low alone

Time: 1 to 3 mo. Pre-seed: Decide day one.

Pre-seed move: Price per emotional-event, not per API call.

(i) Modular model-merging

Sakana M2N2, Allen BAR

Defensibility: High if executed

Time: 12 to 18 mo. Pre-seed: Yes with ML founder.

Pre-seed move: Publish a benchmark paper before having proprietary data.

Pre-seed moat stack (layered, sequential). Months 0 to 6: DX + Compliance architecture. Months 6 to 18: on-device + consent graph. Months 12 to 24: modular model-merging pipeline (this is where the M2N2 thesis pays off and where Matt's super outline v1.2 has the clearest technical lead over Hume). Months 18 to 36: cross-app profile portability begins generating network effects. Months 24 to 48: proprietary dataset flywheel compounds.

The single structural advantage no incumbent can replicate. Neutrality.

Hume competes with the apps it would serve (EVI is itself a voice agent product). SmartEye is owned by Smart Eye AB with automotive interests. NICE, Cogito, Uniphore are the applications, not the infrastructure. Foundation-model providers have conflict-of-interest constraints on exposing structured emotion state to third parties. A pre-seed neutral B2B vendor is the only party structurally incentivized to be neutral, and that is the Plaid analogy reduced to its essence.

Section 07

Recommended wedge

Three candidates, ranked. Lead with mental health coaching platforms. Sequence into AI agent orchestration middleware at Series A. Treat the consumer wearable emotional memory thesis as a 24 to 48 month outcome of B2B network effects.

Balanced

AI agent orchestration middleware

We help AI agent platform vendors (voice agents, customer service copilots, sales coaching tools) solve emotionally-blind task routing (agents that escalate on keywords rather than affective state) by providing a sub-50ms on-device emotion signal middleware layer that plugs into LangChain, LlamaIndex, CrewAI, Mastra, or any orchestration graph as a node. The wedge is the only emotion signal node that runs on-device (no cloud round-trip latency penalty), outputs structured JSON with confidence intervals and regulatory metadata, and supports model-merging so the platform can blend a generic affect classifier with their own domain-tuned data without retraining from scratch.

First five logo targets
Cognigy, NICE CXone AI Studio, Salesforce Agentforce ISV partners, Leapsome (coaching agents), Intercom Fin
Disqualifying risk
LangChain or LlamaIndex ships a native emotion node primitive that becomes the default, making a standalone vendor redundant.
Most ambitious (Series A+)

Consumer wearable emotional memory

We help consumer wearable platforms (smart rings, earbuds, AR glasses) and quantified-self apps solve the absence of longitudinal emotional memory (inability to correlate biometric signals with affective states across weeks and months) by providing an on-device emotional memory graph SDK that fuses passive biometric streams (HRV, GSR, vocal affect) with explicit opt-in check-ins, stores them locally encrypted, and exposes a cloud-sync API for platform-level insights without raw biometric egress. The wedge is the only SDK that combines on-device emotional memory persistence (Mem0-like but affect-native), biometric-to-affect fusion, and a single compliance layer that satisfies BIPA, Colorado AI Act, and GDPR Article 9.

First five logo targets
Oura Ring, Samsung Health (Galaxy Ring), Mimi Health, Whoop, Nothing Ear
Disqualifying risk
Apple Intelligence 2.0 ships a native on-device emotional memory layer tied to Health app, commoditizing the iOS surface overnight.
Wedge sequence flow Three nodes connected left to right by hairline arrows: mental health coaching, AI agent infrastructure, and consumer wearable. Arrow labels indicate network effects compounding and B2B traction unlocking the consumer layer. Mental health coaching MONTHS 0 TO 24 / PRE-SEED TO SEED Spring Health, Lyra, Calm Agent infrastructure MONTHS 18 TO 36 / SERIES A Cognigy, Agentforce, Intercom Fin Consumer wearable MONTHS 36+ / SERIES B+ Oura, Samsung Health, Whoop NETWORK EFFECTS COMPOUND B2B TRACTION UNLOCKS CONSUMER SEQUENCING MODEL

Start with Candidate 1, sequence into Candidate 2.

Five reasons (under 200 words).

  1. The benefits-procurement buyer (VP Benefits, Chief People Officer, CMO) is exactly the motion Michelle already runs from pet insurance benefits.
  2. Regulatory complexity is the moat, not the obstacle: every coaching platform needs a vendor that has already solved HIPAA BAA plus BIPA opt-in plus FHIR R4 output plus EU AI Act Article 5(1)(f) medical-exemption documentation; the first vendor to ship that is uncatchable for 12 months.
  3. Matt's ML team can publish a clinically validated emotion classifier benchmark (Phi-4-mini or Gemma 3 1B fine-tuned on IEMOCAP / DAIC-WOZ / AVEC) and generate inbound from every coaching platform's ML team.
  4. On-device is a clinical necessity (HIPAA data residency), not a performance argument, which closes legal review faster.
  5. Once 3 to 5 coaching platform logos are live, the natural Series A expansion pitch to AI agent platforms writes itself (we already power emotion-aware coaching agents at Spring Health, same infrastructure for your customer service agents). This sequencing also leaves room for the consumer cross-platform vision to emerge from B2B network effects, which is what the historical analogues say will actually happen.
Connection

How this lines up with the team direction

This research lines up directly with the team's existing direction and helps sharpen several open items.

  • May 11 Slack huddleB2B plus Plaid model is the right call. All 30 queries confirm the consumer cross-platform vision is structurally hard. B2B SDK infrastructure with opt-in core value is exactly the pattern that survives the bear case.
  • Patrick, May 13Opt-in as a core value is structurally compliant. The EU AI Act's Article 5(1)(f) workplace ban explicitly turns on employer-versus-individual initiation. Patient-initiated / individual-initiated emotional inference (with the medical or safety carve-out, or the limited-risk Article 50 disclosure path) is the only viable path. The team's May 11 decision was prescient.
  • Patrick: Engine before EDNAEDNA pushed to Phase 3 fits the layered moat stack. The synthesized recommendation is: ship structured emotional-signal infrastructure first (Phase 1 emotional observatory and Phase 2 engine), then ship persistence (Phase 3 EDNA), then let cross-app portability emerge. Patrick's May 13 Engine before EDNA call is the right sequencing.
  • Super outline v1.2The crazy theory of dual-perspective architecture maps to Observer + Strategist split. The current super outline v1.2 already encodes this (ADR-001 Llama 3 8B Observer + Llama 3 70B Strategist, with ADR-006 DARE-TIES + SLERP session-start merging). The relational-duality framing gives the architecture a publishable narrative that competes with Hume's empathic-voice narrative on first principles, not on features.
  • SDK on-device tierOn-device feasibility is real, but model sizing should drop for the SDK tier. The super outline v1.2 currently specs an 8B Observer for the cloud side. For the on-device EDNA SDK tier, the math says Gemma 3 1B or fine-tuned DistilBERT/DeBERTa-small are more realistic for mass-market mobile distribution. Reserve the 8B Observer for the cloud backbone; ship a sub-1B distilled classifier for on-device. This is consistent with the Phase 1 Pillar 1.5 prosody-distillation training subset already in v1.2.
  • Michelle's networkThe mental-health-coaching wedge fits Michelle's network. Spring Health, Lyra, Brightline, and Sword all sell through employer benefits procurement, the exact category Michelle has run. Her People Forward Network lunch (May 8) and her CEO motion gives the team a credible warm-intro path. This is also consistent with Dustin's two-moats framing (data accumulation plus CMS) because compliance is the wedge.
  • Joann, Phase 1PostgreSQL + Valkey alternate stack is licensing-clean for the SDK side. Anything client-distributed must avoid SSPL / AGPL contamination; her instinct was correct and aligns with the SDK adoption findings (GPL contamination in transitive deps is a disqualifying dealbreaker in 2026 procurement).
  • Hume gapHume positioning gap is exploitable in 2026. Hume has no HIPAA BAA path documented, no FHIR-compatible output, no on-device SDK, no enterprise audit log per developer, and no per-vertical specialist module pipeline. These are the five exact slots a pre-seed neutral infrastructure SDK fills.
  • Naming, May 18Whichever name lands (Human Discovery / EAII / emogens), the pitch should lead with emotional observatory and SDK for emotionally-sensitive AI applications, B2B-first, on-device-first, opt-in by architecture. That language is regulator-friendly, fits the FTC Section 6(b) inquiry posture, and avoids the dependency-by-design language that gets companion apps in trouble.

Risks for Matt to flag with the team

Risk 01

Illinois WOPRA closes one mental-health lane

Licensed mental health professionals in Illinois cannot use AI for emotion detection. Mental-health-coaching customers must be coaching / EAP / digital therapeutic frame, not in-network clinical practice. Spring Health and Lyra are the right framings; Talkiatry (employed psychiatrists, prescribing) is the wrong one.

Risk 02

The 2026 SDK gate is brutal

Privacy Manifest, SBOM, ATT graceful fallback, Google Play Data Safety, performance budgets are all hard gates. Joann's Phase 1 work should bake these in from day one or the SDK literally cannot ship to iOS.

Risk 03

Mem0 is the closest competitor on persistence

They have $24M raised, AI memory as their core, and could pivot affect-native in 6 to 12 months. The countermove is to ship the affect-native primitive plus model-merging plus compliance documentation before they do.

Risk 04

18-month on-device window

Apple could expose on-device emotion via Foundation Models framework at WWDC 2026 or 2027. The team's lead has a clock on it before Apple or Google commoditize the OS-level emotion API.

Caveats

Gaps and caveats

References

Sources

Primary citations woven into the synthesis, followed by the full index of 30 raw Perplexity outputs preserved for traceability.

Citation provenance constellation A field of small ink dots scattered on a pale lavender wash, representing the raw research outputs as a constellation. A subtitle reads 226 searches, one synthesis. 226 searches. One synthesis.

Primary citations woven into the synthesis

Raw Perplexity outputs (30 files)

All 30 outputs are stored verbatim at tools/perplexity-search/ask-perplexity-output/. Generated 2026-05-14.

  1. 01Hume AI deep profile. 2026-05-14-175145-2026-give-complete-profile.md
  2. 02Affectiva / SmartEye profile. 2026-05-14-175300-2026-give-complete-profile.md
  3. 03Cogito / Uniphore / NICE. 2026-05-14-175425-2026-give-detailed-profiles.md
  4. 04Behavioral Signals / Empath / audEERING. 2026-05-14-175548-2026-give-detailed-profiles.md
  5. 05MorphCast / Realeyes / Entropik. 2026-05-14-175721-2026-give-detailed-profiles.md
  6. 06New 2024 to 2026 entrants (Mem0, Humans&, Sanas). 2026-05-14-175834-new-emotional-ai-affective.md
  7. 07EDNA-like persistent products. 2026-05-14-175957-2026-companies-products-offer.md
  8. 08Market crowded vs sparse + Plaid/Twilio/Stripe gap. 2026-05-14-180156-based-current-2026-landscape.md
  9. 09OpenAI emotion surface. 2026-05-14-180255-2026-emotion-aware-sentiment.md
  10. 10Anthropic / Google / Meta / Apple / Amazon / Microsoft. 2026-05-14-180423-2026-emotion-aware-sentiment.md
  11. 11Standards (MCP / W3C / IEEE / OpenAI Agents SDK). 2026-05-14-180544-2026-standards-bodies.md
  12. 12Historical analogues (identity / payments / Plaid / FHIR / Twilio / Segment). 2026-05-14-180715-analogues-summarize-whether.md
  13. 13Bear case against cross-platform thesis. 2026-05-14-180833-strongest-evidence-based.md
  14. 14Dating + AI companion apps as customers. 2026-05-14-181036-2026-buyer-pain-dating-apps.md
  15. 15Mental health / therapy apps as customers. 2026-05-14-181242-2026-mental-health-therapy.md
  16. 16Enterprise CX / contact centers as customers. 2026-05-14-181418-2026-size-budget-reality.md
  17. 17Education + automotive + gaming as customers. 2026-05-14-181636-2026-evaluate-buyer-pain.md
  18. 18HR tech as customers (and regulatory closure). 2026-05-14-181829-2026-regulatory-buyer.md
  19. 19AI agent infrastructure as customers. 2026-05-14-182003-2026-buyer-pain-ai-agent.md
  20. 20Budget owners + lines + 2024 vs 2026 procurement. 2026-05-14-182146-b2b-emotional-intelligence-sdk.md
  21. 21Pre-seed ranked first customers. 2026-05-14-182419-given-pre-seed-ai-startup-00k.md
  22. 22SDK business lessons (Stripe / Twilio / Sentry / Heap fail). 2026-05-14-182648-2026-most-important-adoption.md
  23. 232026 SDK integration friction (Privacy Manifest, SBOM, ATT). 2026-05-14-182842-2026-actually-take-get-new-sdk.md
  24. 24On-device feasibility (Phi / Gemma / Apple Intelligence). 2026-05-14-183053-2026-local-sdk-small.md
  25. 25Privacy posture + certifications (SOC 2 / HIPAA / ISO 27001 / 42001 / EU AI Act). 2026-05-14-183301-2026-privacy-posture-device-vs.md
  26. 26EU AI Act emotion recognition provisions. 2026-05-14-183448-2026-current-state-eu-ai-act.md
  27. 27US state + federal emotion AI laws. 2026-05-14-183649-2026-state-level-federal.md
  28. 28Reputational landmines (HireVue / Replika / Garcia / Barrett / Stochastic Parrots). 2026-05-14-183910-most-consequential-2020-2026.md
  29. 29Defensibility / moat analysis. 2026-05-14-184125-pre-seed-neutral-third-party.md
  30. 30Three wedge candidates ranked. 2026-05-14-184320-given-2026-emotional-ai.md