ChatSpot giving incorrect output

[KSieverts]

Hey! 

I was just testing out some prompts to see what's possible and what's not and I noticed some issues with the results it was giving me. 

I asked how many contacts in the system there were with contact owner = myself (There are 5). 

Instead of giving a standard issue with the prompt message, it actually gave me a list of contacts.. However none of them had contact owner = myself.

It's much better if it gives error instead of "lying". I hope this is something that will improve quickly. 

[AMughal]

Giving an inaccuracy rather than "lying" is far better, I'm hoping things will soon start to improve,

[AMughal]

Giving error as opposed to "lying" is much preferable. I'm hoping that things will get better shortly.

[KSieverts]

Hi @Jnix284 ! 

My post was only meant as a bug-report. On the matter of my replies to the prompts, yes I tried "reasoning" with it and provide more clarity. 

Another thing I tried..

1. How many contacts has the contact owner = myself 
A) It replied with our total amount of contacts in the portal. 

2. How many contacts are in the portal?
A) It replied with the total amount of contacts in the portal.

3. How many don't have a contact owner?
A) It replied with the correct amount (Roughly 40%)

I then tried again asking how many with contact owner = myself, where it gave me the total amount of contacts in the portal again (Which is incorrect). 

[kvlschaefer]

Hi @KSieverts,

Thank you for reaching out to the ChatSpot Community Group and for sharing this information with us. 

Because ChatSpot.ai is currently in its alpha stage of development, we are not able to address or follow up with each individual support query. I wanted to share our legal terms and obligations for more information regarding support for beta and alpha features.

Your feedback is greatly appreciated and will be shared with the product team for future development. 

Cheers,

Kristen

[Jnix284]

@KSieverts I don't think it's intentionally lying, but instead it's learning. Did you follow up the prompt to explain what was wrong with the answer given and provide more clarity to see if the right answer could be generated?

ChatSpot is still in alpha, so there are limitations with the prompts and how the answers are provided

[kvlschaefer]

Hi @Jnix284,

Thank you for helping out here! ⭐ 

Best,

Kristen