Hi everyone,
I wanted to share a quick progress update. I have successfully set up the current chatbot plugin locally to get a hands-on understanding of the architecture and data workflow. The existing Makefile was a huge help and made the setup process flawless.
Walking through the entire pipeline from converting raw data into chunks to generating embeddings gave me a very clear picture of how the bot currently operates under the hood.
I’ve also tested several chatbot responses. The baseline is working well, but during testing, I did notice high latency in the responses. This might just be due to my local system configuration and GPU limits, but it gave me some ideas for optimization.
I have some additional features in mind to help improve things like response speed, and I am currently drafting a technical map. My goal is to figure out how to implement these smoothly so they fit the current system without breaking the existing codebase.
I have attached some screenshots of my local setup below.
If anyone has suggestions or feedback, please guide me!
Thanks, Aditya
