Name: PRO WORKSHOP (DataWeek): Leveraging Open Source AI Securely and Privately
Start: 2025-09-03T16:00:00-0700
End: 2025-09-03T16:50:00-0700

Wednesday September 3, 2025 4:00pm - 4:50pm PDT

DataWeek -- Main Stage

JJ Asghar, IBM, Developer Advocate

Honestly, you're probably jealous of those people saying "ChatGPT" is making their lives easier. You may think that leveraging AI is this generation's adoption of the calculator. I'm here to say yes, you are right, but let's be honest: we have no idea how the ChatGPTs of the world are trained or if they are secure.
If you run a technology company, your data is your secret sauce; if your boss found out you were leveraging ChatGPT to do your job, would they be happy? Probably not.
In this presentation, we will explore how LLMs work locally through hands-on activities, such as setting up some local open-source private and free LLMs to help you get closer to the promise of generative AI.
Overall, this presentation will start with some basic installation leveraging Ollama and VS Code or any of the JetBrains platforms (and you'll learn what that means and what the differences are!), then pull in AnythingLLM and/or OpenWebUI to help give you a straightforward chat-like interface to your LLM. We will provide you with the knowledge, tools, some generic prompts, and use cases to gain more confidence in your daily life by leveraging LLMs.
You'll walk out of the workshop with a working LLM that you can engage with no fees or usage, all locally and securely.

Speakers

JJ Asghar

Developer Advocate, IBM

JJ works as a Developer Advocate representing IBM worldwide. He mainly focuses on open-source AI and OpenShift, trying to help companies and users successfully onboard to the Cloud-Native ecosystem. He’s also known in the DevOps tooling ecosystem and generalized Linux communities... Read More →

Wednesday September 3, 2025 4:00pm - 4:50pm PDT
DataWeek -- Main Stage

DataWeek

Talk Type PRO Workshop Day (Wed)
Tracks DataWeek, AI Models and Management (DataWeek), Data Tools / Technology and Management (DataWeek)
In-Person/Virtual In Person

API World + CloudX + DataWeek 2025

JJ Asghar

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!