Sentiment is the most abused field in data models

0
17

1. What sentiment_score really measures

Sentiment score = emotional valence
Positive โ†” Neutral โ†” Negative

It answers:

โ€œHow does the person feel about this topic right now?โ€

Not:

  • How important it is
  • How much effort theyโ€™re putting in
  • Whether theyโ€™ll act

You can have:

  • High engagement + negative sentiment
  • Low engagement + positive sentiment

Thatโ€™s why this field matters.


2. Recommended scale (keep it simple)

Option A โ€” Discrete scale (best for explainability)

ScoreLabelMeaning
-2Strongly NegativeFrustration, anger, resentment
-1NegativeDislike, concern, reluctance
0Neutral / MixedInformational, balanced
+1PositiveEnjoyment, optimism
+2Strongly PositiveExcitement, pride, love

This is human-legible and stable over time.


Option B โ€” Normalized (-1.0 โ†’ +1.0)

Use only if youโ€™re piping NLP outputs directly.

RangeInterpretation
-1.0 to -0.6Strong negative
-0.59 to -0.2Mild negative
-0.19 to +0.19Neutral
+0.2 to +0.59Mild positive
+0.6 to +1.0Strong positive

You can always bucket it later.


3. Examples (this is the important part)

A. Same topic, different sentiment

Topic: Work / Career

Utterancesentiment_scoreWhy
โ€œWork is fine.โ€0Flat, informational
โ€œI like my job.โ€+1Mild positive
โ€œI love what Iโ€™m building.โ€+2Strong positive
โ€œIโ€™m stuck at work.โ€-1Frustration
โ€œI hate my job.โ€-2Strong negative

Engagement could be high in all of these.


B. Same sentiment, different engagement

Topic: Health & Gyms

UtteranceSentimentEngagement
โ€œGyms are great.โ€+11
โ€œI train 5x a week and track PRs.โ€+15

Sentiment = feeling
Engagement = energy


C. Business context examples

Topic: Project Management

Utterancesentiment_score
โ€œWeโ€™re on track.โ€+1
โ€œThis is harder than expected.โ€-1
โ€œThis project is a mess.โ€-2
โ€œChallenging, but solvable.โ€0

Topic: Negotiations & Proposals

Utterancesentiment
โ€œLetโ€™s explore options.โ€0
โ€œIโ€™m excited to move forward.โ€+2
โ€œThis pricing doesnโ€™t work.โ€-1
โ€œThis is unacceptable.โ€-2

D. Personal & emotional topics

Topic: Emotions / Love

Utterancesentiment_score
โ€œIโ€™m okay.โ€0
โ€œI feel close to her.โ€+2
โ€œIโ€™m confused.โ€-1
โ€œIโ€™m heartbroken.โ€-2

This is where sentiment is most valuable.


4. Common modeling mistakes (avoid these)

โŒ Mistake 1: Using sentiment as importance

โ€œThis is a big issueโ€ โ‰  negative sentiment

โŒ Mistake 2: Using sentiment as an outcome

โ€œWe closed the dealโ€ โ‰  positive sentiment

โŒ Mistake 3: Averaging sentiment blindly

A -2 followed by +2 is not โ€œneutralโ€ โ€” itโ€™s volatility.


5. How sentiment works with your existing fields

FieldQuestion it answers
TopicWhat are we talking about
IntentWhy now
Engagement scoreHow invested
Sentiment scoreHow it feels
OutcomeWhat happened

This separation is why your model is actually strong.


6. Design recommendation (this is subtle but important)

Store:

  • sentiment_score
  • sentiment_confidence (low / medium / high)

Why?

Some statements are emotionally clear. Some are ambiguous.

Example:

  • โ€œInteresting.โ€ โ†’ sentiment unclear โ†’ low confidence

TL;DR

  • Sentiment = emotional direction
  • Use -2 to +2
  • Keep it independent of engagement & outcome
  • Anchor it to language, not interpretation

//todo

  • Combine sentiment ร— engagement into a โ€œheat mapโ€
  • Model sentiment drift over time
  • Or detect hidden risk (high engagement + negative sentiment)

Thatโ€™s where this turns into a real signal, not just labels.


1. What engagement_score really measures

Engagement score = how much energy + commitment is present in the interaction.

Not sentiment.
Not importance.
Not outcome.

It answers:

โ€œHow invested is the person in this conversation right now?โ€

Think attention ร— effort ร— continuity.


2. Signal strength (the inputs)

signal_strength is evidence, not judgment.

Common observable signals

SignalExamples
TimeLong messages, long calls, repeat back-and-forth
DepthPersonal detail, specificity, vulnerability
EffortPreparation, documents shared, follow-ups
AgencyDecisions made, commitments stated
ContinuityRefers to past conversations, future plans
RiskDisagreement, asking for advice, asking for help

Each of these increases signal strength.


3. Example scales (practical, not academic)

Option A โ€” Simple 1โ€“5 scale (recommended)

This works shockingly well.

ScoreLabelObservable signals
1PassivePolite replies, small talk, low effort
2LightCasual interest, short responses
3EngagedAsking questions, staying on topic
4InvestedSharing context, opinions, time
5CommittedDecisions, plans, emotional or professional stake

Option B โ€” Expanded 0โ€“100 (only if you need math)

Use if you plan analytics.

RangeMeaning
0โ€“20Noise
21โ€“40Awareness
41โ€“60Interest
61โ€“80Engagement
81โ€“100Commitment

Internally, you can still bucket it to 1โ€“5.


4. Mapping signal strength โ†’ engagement_score

You can model it explicitly.

Example signals โ†’ score

Signals presentengagement_score
Topic hopping, generic replies1
Jokes, light banter2
Asking follow-ups3
Sharing constraints, goals4
Making decisions / asking next steps5

5. Real examples from your domain

Example 1: Salsa Dancing

  • โ€œYeah I dance sometimesโ€ โ†’ 1
  • โ€œI love salsa, where do you dance?โ€ โ†’ 3
  • โ€œIโ€™m training for a festival, practicing twice a weekโ€ โ†’ 5

Topic stayed the same.
Engagement changed drastically.


Example 2: Business โ€” Marketing Campaigns

  • โ€œSend me the deckโ€ โ†’ 2
  • โ€œWhat would success look like?โ€ โ†’ 3
  • โ€œLetโ€™s launch next month, budget is Xโ€ โ†’ 5

Example 3: Personal โ€” Aspirational

  • โ€œIโ€™ve been thinking about my careerโ€ โ†’ 3
  • โ€œIโ€™m unhappy and need to change directionโ€ โ†’ 4
  • โ€œIโ€™m committing to a 90-day pivotโ€ โ†’ 5

6. Where this fits in your model

Think in layers:

  • Topic โ†’ What
  • Intent โ†’ Why now
  • Learning touchpoint โ†’ Where in the arc
  • Engagement score โ†’ How much energy
  • Signal strength โ†’ Why you believe that score

This keeps the model explainable, not magical.


7. Design advice (important)

  • Donโ€™t over-optimize this.
  • Human-readable beats perfect.
  • Engagement is situational, not identity.

A person can be:

  • Engagement = 5 in Salsa
  • Engagement = 1 in Investing

Thatโ€™s not inconsistency โ€” thatโ€™s truth.


TL;DR

  • Signal strength = observable evidence
  • Engagement score = normalized judgment of investment
  • Use 1โ€“5 unless you really need more
  • Anchor every score to something you could point to

//todo

  • Define decay over time
  • Weight engagement by intent
  • design a query like: โ€œWhich topics generate high engagement but low outcomes?โ€

lethal design in a good way.

Engagement is situational, but Energy and Effectiveness is Person Centric

ENERGY ASSESSMENT (Circle 0-10)

  • Pre-interaction mood: Dread [0 1 2 3 4 5 6 7 8 9 10] Anticipation
  • Post-interaction feeling: Drained [0 1 2 3 4 5 6 7 8 9 10] Energized
  • Conversation flow: Strained [0 1 2 3 4 5 6 7 8 9 10] Natural
  • Emotional safety: Unsafe [0 1 2 3 4 5 6 7 8 9 10] Safe

EFFECTIVENESS ASSESSMENT (Circle 0-10)

  • Follow-through: Never [0 1 2 3 4 5 6 7 8 9 10] Always
  • Value created: None [0 1 2 3 4 5 6 7 8 9 10] Transformative
  • Proactivity: Passive [0 1 2 3 4 5 6 7 8 9 10] Initiator
  • Efficiency: Time-waster [0 1 2 3 4 5 6 7 8 9 10] Multiplier
SHARE
Previous articleHow to Create a WORLD-CHAMPION TITLE
Stephen has been leading distributed teams for over 20+ years, delivering software solutions. Stephen is an Expert in Agile PLM ranked by Pluralsight as being in the 97th percentile. He is also a certified AWS solutions architect, SAP business objects architect and an IBM certified DB2 Database Developer since 1999. See his full profile in the link above.