I was curious to what would happen if I asked a non programming question. I asked "How to change a tire?" And it happily responded with steps on how to change a tire, which I guess is expected (seems strange that a programming related AI would answer that sort of question), but what I didn't expect was to still see a list of Stack Overflow posts. I thought maybe there were some Stack Overflow posts about tires, or something that if found, but nope, it just returned completely unrelated posts.

It may be good to add some guardrails around what sort of questions can be asked. At the very least, there should probably be some certainty factor required before displaying posts.

I was curious to what would happen if I asked a non programming question. I asked "How to change a tire?" And it happily responded with steps on how to change a tire, which I guess is expected (seems strange that a programming related AI would answer that sort of question), but what I didn't expect was to still see a list of Stack Overflow posts. I thought maybe there were some Stack Overflow posts about tires, or something that it found, but nope, it just returned completely unrelated posts.

It may be good to add some guardrails around what sort of questions can be asked. At the very least, there should probably be some certainty factor required before displaying posts.

As pointed out by M--, other tools exist that seem to have gotten this right:

@Amarth it should have a limited scope, an example that comes to my mind, is the Shiny Assistant, e.g. i.sstatic.net/M6tD6yQp.jpg

I was curious to what would happen if I asked a non programming question. I asked "How to change a tire?" and it happily responded with steps on how to change a tire, which I guess is expected (seems strange that an programming related AI would answer that sort of question), but what I didn't expect was to still see a list of SO posts. I thought maybe there were some SO posts about tires, or something that if found, but nope, it just returned completely unrelated posts.

It may be good to add some guardrails around what sort of questions can be asked. At the very least, there should probably be some certainty factor required before displaying posts.

I was curious to what would happen if I asked a non programming question. I asked "How to change a tire?" And it happily responded with steps on how to change a tire, which I guess is expected (seems strange that a programming related AI would answer that sort of question), but what I didn't expect was to still see a list of Stack Overflow posts. I thought maybe there were some Stack Overflow posts about tires, or something that if found, but nope, it just returned completely unrelated posts.

It may be good to add some guardrails around what sort of questions can be asked. At the very least, there should probably be some certainty factor required before displaying posts.