# Composing system prompts ## Slide 1: Composing System Prompts [![CUNY AI Lab](../images/cail-wordmark-white.png)](https://ailab.gc.cuny.edu/) ### Composing System Prompts Led by Zach Muhlbauer New Media Lab · Room 7388.01 CUNY Graduate Center Thursday, September 17, 2026 2:30–4:00 p.m. [https://cuny-ai-lab.github.io/sandbox-series/basics](https://cuny-ai-lab.github.io/sandbox-series/basics) --- ## Slide 2: Workshop Roadmap ### Workshop Roadmap - **Composing System Prompts** Configure model behavior with system prompts. - **[Curating knowledge collections](../knowledge/)** Organize source documents in knowledge collections. Thursday, October 1 - **Configuring skills and tools** Extend model capabilities with skills and tools. Thursday, October 15 [Sandbox documentation https://ailab.gc.cuny.edu/sandbox-docs/](https://ailab.gc.cuny.edu/sandbox-docs/) --- ## Slide 3: Workshop Agenda ### Workshop Agenda - Introduce yourselves - Request access and sign in - Compare model outputs - Revise system prompts - Create custom models Check monthly usage at Model Access. [https://tools.ailab.gc.cuny.edu/model-access](https://tools.ailab.gc.cuny.edu/model-access) --- ## Slide 4: Introductions ### Introductions What is your name, pronouns, and role at CUNY? What brings you to this workshop today? --- ## Slide 5: Sandbox Access ### Sandbox Access ### Request Access - Open [access application](https://ailab.gc.cuny.edu/request-access/). Choose **My own access** and sign in with **CUNY Login**. - Enter your details and intended use, complete verification, and select **Submit Application**. - Watch your verified CUNY email for approval. ### Sign In Already approved? Open [Sandbox](https://chat.ailab.gc.cuny.edu/). - Select **Continue with CUNY Login** and enter your CUNY credentials. - Complete two-factor authentication if prompted. [https://ailab.gc.cuny.edu/request-access/](https://ailab.gc.cuny.edu/request-access/)[https://chat.ailab.gc.cuny.edu/](https://chat.ailab.gc.cuny.edu/)[Access and sign-in https://ailab.gc.cuny.edu/sandbox-docs/getting-started/](https://ailab.gc.cuny.edu/sandbox-docs/getting-started/) --- ## Slide 6: System Prompts ### System Prompts System prompts are setup instructions that describe how a model should behave. ### User Prompts Questions or tasks you enter in chat. ### Custom Models You create a custom model by choosing a base model, such as Gemma, and adding instructions and documents for it to use. [Basic Concepts https://ailab.gc.cuny.edu/sandbox-docs/basic-concepts/](https://ailab.gc.cuny.edu/sandbox-docs/basic-concepts/)[Custom Models https://ailab.gc.cuny.edu/sandbox-docs/models/](https://ailab.gc.cuny.edu/sandbox-docs/models/) --- ## Slide 7: Chat Features ### Chat Features Upload Files (+) Attach images, PDFs, or documents. Integrations Enable tools that perform operations and skills that give reusable instructions. Message actions Find actions beneath each response to copy, edit, or regenerate it. Open More (⋯) for additional actions. [Sandbox Basics https://ailab.gc.cuny.edu/sandbox-docs/sandbox-basics/](https://ailab.gc.cuny.edu/sandbox-docs/sandbox-basics/) --- ## Slide 8: Select Models ### Select Models ![Sandbox logo, message box, and Gateway model selector; enlarged detail shows current model choices with model ID outlined and marked by an arrow.](../images/current/gateway-selector-hidpi-2026-09-16.svg) Find model selector in bottom right of message box, then select Gemma 4 26B A4B IT. [Model Registry https://ailab.gc.cuny.edu/models/](https://ailab.gc.cuny.edu/models/) --- ## Slide 9: Compare Models ### Compare Models ![Sandbox logo, message box, and Gateway model selector; enlarged detail shows Compare beside search field outlined and marked by an arrow.](../images/current/gateway-selector-compare-hidpi-2026-09-16.svg) Reopen model selector and select Compare beside search field. Choose Gemma and another model, such as Mistral Large 3. [Model Registry https://ailab.gc.cuny.edu/models/](https://ailab.gc.cuny.edu/models/) --- ## Slide 10: Who Was Late? ### Who Was Late? Compare how two models interpret this sentence. ```text The nurse yelled at the doctor because she was late. Who was late? ``` Send this question to both models. --- ## Slide 11: Winograd Schema Challenge ### Winograd Schema Challenge This challenge tests how models interpret ambiguous pronouns using context and common-sense reasoning. In our question, either person could be late. - Which person does each model choose? - What assumption supports its answer? [Levesque, Davis, and Morgenstern (2012) https://www.cs.nyu.edu/faculty/davise/papers/WSKR2012.pdf](https://www.cs.nyu.edu/faculty/davise/papers/WSKR2012.pdf) --- ## Slide 12: Compare Outputs ### Compare Outputs Consider this question. ```text The car wash is 50 meters from me. Should I walk or take the car? Explain your reasoning. ``` What do you think this person wants to accomplish? --- ## Slide 13: Gemma vs. Qwen ### Gemma vs. Qwen ### Gemma’s Response ![Gemma 3 27B response recommending walking, with model name and generation time.](../images/showcase/car-wash-gemma-response.png) ### Qwen’s Response ![Qwen3.5 27B response recommending driving, with model name and generation time.](../images/showcase/car-wash-qwen-response.png) --- ## Slide 14: Going to the Car Wash ### Going to the Car Wash Start a new chat, select two models, and send this question. ```text The car wash is 50 meters from me. Should I walk or take the car? Explain your reasoning. ``` --- ## Slide 15: Add System Prompt ### Add System Prompt ![CUNY AI Lab logo, DeepSeek V4 Flash 0731, car wash question in message box, and short instructions in System Prompt; white annotations identify Controls button and populated System Prompt field.](../images/current/chat-controls-populated-annotated-2026-09-17.svg) Select **Controls** at top right of chat. Paste these instructions into **System Prompt**, then close Controls. ```text Identify purpose and separate facts from assumptions. Ask one clarifying question when needed. Answer concisely. ``` [https://ailab.gc.cuny.edu/models/](https://ailab.gc.cuny.edu/models/) --- ## Slide 16: Regenerate Responses ### Regenerate Responses ![Mistral Large 3 response recommending walking, with original question and message box; white annotation marks response controls for Regenerate.](../images/current/regenerate-mistral-context-2026-09-17.svg) ![Enlarged Mistral Large 3 response controls with Regenerate outlined and marked by an arrow.](../images/current/regenerate-mistral-detail-2026-09-17.svg) Select Regenerate beneath each original response, then choose Try Again. Keep your original question, selected models, and other settings unchanged. [Model Registry https://ailab.gc.cuny.edu/models/](https://ailab.gc.cuny.edu/models/) --- ## Slide 17: Debrief Questions ### Debrief Questions - What changed in each model’s answer to your car wash question after you added system prompt instructions? - Did either model ask about your purpose or explain its assumptions before recommending walking or driving? --- ## Slide 18: Explore ### Explore ### Try Examples Choose one example and experiment with it in chat. Teaching ### [STEM Adventure Games](https://chat.ailab.gc.cuny.edu/?model=stem-adventure-games) Explore scientific experiments through a text adventure with numbered choices. Research ### [Compare Wikipedia Edits](https://chat.ailab.gc.cuny.edu/?model=compare-wikipedia-revisions) Compare Wikipedia revisions and examine changes in wording, claims, and citations. ### Review Settings Review **Base Model** and **System Prompt** for your chosen example. - [STEM Adventure Games settings](https://chat.ailab.gc.cuny.edu/workspace/models/edit?id=stem-adventure-games) - [Compare Wikipedia Edits settings](https://chat.ailab.gc.cuny.edu/workspace/models/edit?id=compare-wikipedia-revisions) Find Purpose, Procedure, Constraints, and Format in its instructions. Which instruction explains something you noticed in its response? --- ## Slide 19: Clone Models ### Clone Models ![Workspace Models showing shared workshop examples; white annotation identifies Clone in More menu.](../images/current/workshop-clone-2026-09-17.svg) Select Workspace in left sidebar, then Models. Open ⋯ beside your chosen example and select Clone. - Rename your copy. - Revise one instruction in **System Prompt**; keep **Base Model** and other settings unchanged. - Scroll to bottom and select **Save & Create**. - Open your copy in a new chat and repeat your original request. --- ## Slide 20: Compare Configurations ### Compare Configurations ![Sandbox comparison with tabs for original Compare Wikipedia Edits and its clone; white annotations identify both model names above original response. Message box remains visible.](../images/current/workshop-compare-2026-09-17.svg) Start a new chat. Select model ID on bottom right of message box, then Compare. Choose your original model and your copy. - What did you change? - Did your intended revision prove effective? - How could you imagine testing custom models like this in the future? --- ## Slide 21: Draft System Prompts ### Draft System Prompts Use remaining time to begin drafting instructions for your own teaching or research task. ```text Purpose What should your model help you accomplish? Procedure What steps should it follow? Constraints What limits should it observe? Format How should it present responses? ``` --- ## Slide 22: Create Models ### Create Models ![Workspace Models filtered to shared workshop examples, with Create button outlined and marked by an arrow.](../images/current/workshop-create-2026-09-17.svg) Select Workspace → Models → Create to configure your own model. - Name your configuration. - Select **Base Model** and paste your draft into **System Prompt**. - Scroll to bottom and select **Save & Create**. - Start a new chat with your model and try one request. --- ## Slide 23: Workshop Resources ### Workshop Resources Keep your draft and choose source documents for your next workshop. ### Workshop Materials - [Open Knowledge Collections https://cuny-ai-lab.github.io/sandbox-series/knowledge/](../knowledge/) - [Review workshop copy https://cuny-ai-lab.github.io/sandbox-series/basics/workshop-copy.html](workshop-copy.html) - [Consult Sandbox documentation https://ailab.gc.cuny.edu/sandbox-docs/](https://ailab.gc.cuny.edu/sandbox-docs/) - [Consult Open WebUI Models https://docs.openwebui.com/features/workspace/models/](https://docs.openwebui.com/features/workspace/models/) ### Model Resources - [Check Model Registry https://ailab.gc.cuny.edu/models/](https://ailab.gc.cuny.edu/models/) - [Check monthly usage https://tools.ailab.gc.cuny.edu/model-access](https://tools.ailab.gc.cuny.edu/model-access) - [Consult AI Lab guides https://ailab.gc.cuny.edu/guides/](https://ailab.gc.cuny.edu/guides/) --- ## Slide 24: Next Workshop ### Next Workshop 1 ➳ 2 Curating knowledge collections — reveal workshop link [Open workshop ➳](../knowledge/) [A* · Creative Clawing](https://creative-clawing.com/microblog/entry-45.html)