top of page

What does ChatGPT know about MuleSoft's history?

Updated: Mar 1

Hello World! Yesterday, Feb 21, 2023, I got an opportunity to Explore AI tools with Alexandra Martinez - a developer advocate at MuleSoft. It was my first time doing a live stream, and a pretty fun experience. Thanks to all who came out to support and provide valuable prompts.

Flyer for MuleSoft Developer Live Stream entitled Exploring AI tools with Whitney! Tuesday, February 21 at 1pm PT/ 4pm ET/ 10 pm BST. Watch on twitch.tv/mulesoft_community. Whitney Akinola is a Curriculum Developer
Flyer for MuleSoft_Community Twitch Episode

We explored six AI tools; however, this post is strictly a recap of our conversation with ChatGPT Plus about MuleSoft's history. This is constructed with two tests, screenshots of related prompts and answers, followed by my observations.


The purpose of the chosen prompts is to first find out what ChatGPT Plus knows about MuleSoft and then access its accuracy.


Posts about our conversation with ChatGPT Plus about Mule 4 development, DataWeave, and Connectors will be available in the subsequent weeks.


Note: Interested in the ChatGPT MuleSoft and Mule 4 conversation? You can access it here. If you are using a screen reader, I do not place the actual response in text form on this post. You will need to access the link to get the ChatGPT response.


What is ChatGPT Plus?

ChatGPT Plus is a subscription-based conversational chatbot tool powered by Generative AI. It was created by an artificial intelligence company called Open AI. The research version of ChatGPT is free. ChatGPT Plus subscribers can choose between the Default (latest version) and Legacy (Research version) model.


Let's move on. So let's see how much was ChatGPT trained on MuleSoft and its history.


Test 1: What does ChatGPT know about MuleSoft’s History?


We asked the following questions

  • What is MuleSoft?

  • When was it founded?

  • Did MuleSoft have a co-founder?


Whitney Akinola ask CHatGPT, "What is MuleSoft" and ChatGPT responds.
What is MuleSoft?

Whitney Akinola asks ChatGPT, when was it founded and it responds.
When was it founded?

Whitney Akinola asks ChatGPT, "Did MuleSoft have a co-founder?" and it responds.
Did MuleSoft have a co-founder?

Observation

The screenshots above show that the ChatGPT plus default model was trained on MuleSoft’s history. The bot spoke in a confident tone and appeared very knowledgeable about MuleSoft, from a startup to becoming a Salesforce acquisition. During this test, I accepted ChatGPT's response as fact and did not do any fact-checking. The confident tone does make this ChatBot extremely convincing.


I feel like ChatGPT is my super intelligent smart best friend. - Whitney Akinola

Spoiler Alert: Keep reading.


Test 2: What does ChatGPT know about MuleSoft acquisitions?


We asked the following questions

  • Who did MuleSoft acquire?

  • Who acquired Servicetrace?

Whitney Akinola ask ChatGPT, "Who did MuleSoft acquire?" and ChatGPT responds.
Who did MuleSoft acquire?

Observation

This is where ChatGPT Plus gets the answer wrong. Let’s look at the acquisitions listed.


  • ProgrammableWeb - This is true. Unfortunately, I found this fact this year after MuleSoft announced the site’s requirement. ProgrammableWeb had a great run and served its purpose.


  • CloudHub - To my knowledge, MuleSoft has always owned CloudHub. I could not find an acquisition. However, I started to doubt myself due to ChatGPT Plus’ confident tone. Let me know in the comments below if this is accurate.





But what about MuleSoft’s (by Salesforce) Servicetrace acquisition?

Whitney Akinola asks ChatGPT, "Who acquired Servicetrace?" and ChatGPT responds.
Who acquired Servicetrace?

The chatbot does not know about the Servicetrace acquisition because it was not trained. The chatbot mentioned the default model only knows up to September 2021. Servicetrace was acquired by MuleSoft in October 2021. This is a limitation. The world is constantly changing, and I guess that’s the limitation of a pre-trained model. I wonder how a model will be that is trained in real time using Bing search or Google search will work.


Note: MicroSoft has released Bing with the ChatGPT integration in a limited preview. Google is testing its ChatBot tool pre-trained using the laMDA model name, BARD. Style points Google on choosing BARD as the name.


Missed the Twitch Live Stream?

Click Watch Video


My Verdict

I thoroughly enjoyed conversing with ChatGPT Plus. I always get interesting information from this Chatbot. As of February 21, 2023, ChatGPT Plus is inaccurate concerning MuleSoft history. However, I am still optimistic that as users adopt this new tool and start to provide feedback on misinformation and bias, this chatbot will only get better. I encourage you to give it a try. You can try the research version for free.


What are your thoughts? To keep this post short and to the point, I will release subsequent posts on other prompts that came up during the stream.


Be sure to subscribe to my blog to avoid missing a post.




119 views2 comments

Recent Posts

See All
bottom of page