[2026 kcdc] 6 ways you’re using chatgpt wrong (and how to fix it)

Speaker: Fred Deichler

See live blog table of contents for more posts


Off topic title changed from ScrumMaster to delivery excellent lead. The later is about multiple streams/programms(

Survey

  • Almost everyone uses AI at work
  • Most people use 2+ tools
  • A good number include a tool their employer doesn’t pay for

Item #1: The keyboard isn’t a tool; it’s a toll

  • Filters words before send them.
  • Verbally get possibly unimportant context
  • Speaker works from home using a boom mic. Tried turning headset off and just talking. Felt weird at first
  • Vomit prompt by spewing out everything thinking
  • Voice is faster than fingers on keyboard
  • The fix isn’t speed though; it’s removing the toll

Item #2: <missed the title of this because I was busy unsuccessfully trying to find a copy of the deck online>

  • Context window expanded
  • Don’t want to keep using old prompt because AI can do more. Ex: You can use an MCP server vs upload everything.
  • Spend 15 minutes a month improving your interactions
  • Hit stop if getting wrong answer so stop wasting tokens

Item #3 – You keep finding the answer; but never keep it

  • Don’t save prompts; write skills
  • When get what you need; ask AI to write you the skill
  • Using skills can use less tokens if it give it deterministic things like a python script

Item #4 – Your company bought you AI but you are choosing to use something else

  • Carrying risk
  • Exposing company secrets as training day
  • Violating HR policy
  • Missing opportunity to give company feedback to invest in better tools
  • The company AI isn’t customized the same as your home one

Item #5: Still just googling

  • Partner with AI instead of just asking questions
  • Frame what you want vs asking it. State the problem with context
  • Bring up the real constraint
  • Go back and forth
  • Tell AI what you don’t like about the answer
  • Think of as “we”

Item #6: Late to the party

  • Bring it raw thoughts vs brining something done and ask for cleanup
  • Workbench, not a stylist

Item #7: One setting to rule them alll

  • Choose right model and effort level for each tasks
  • Using same settings is burning money
  • Two dials: model and effort. Not one gear
  • Subagents thrive on lower level models

My take

Content was good, but I feel like I only got half the experience due to the slides. The slides were significantly unreadable (ex: red on black/black on red is hard to read. Same for light gray and black. Only the white on black or really big red on black was readable.). He said multiple times that will share slides after. Which is better than nothing but I want them while listening to presentation. That’s the time I’m dedicating to it and when I want to be able to follow those details. Otherwise why have so much on the slides. I looked for the deck in case it was online. Didn’t find it but did find a video with the same title. https://www.youtube.com/watch?v=KMS-YtWDAAg Not the same mistakes (which makes sense since he said he is covering 6 or 10). But that video would have been perfectly readable on a screen. The covering 6 and having us vote on the other 2 was fun.

[2026 kcdc] mitre att&ck for developers

Speaker: Chris Ayers

See live blog table of contents for more posts


Slides/github: https://github.com/codebytes/mitre-attack-for-devs

Security has changed in last 5 years

  • Patch Tuesday has about a thousand patches. That is about as many as all of last year!
  • MS authenticator – have to type a number vs just clicking approve
  • Growing attack surface – ex: cloud
  • Sophisticated adversaries – nation-states, organized crime, insider threats. Water treatment plans
  • Complex attack chains – multiple techniques chained togehter
  • Traditional defenses – focus on single points of failure
  • Goal today is to protected identity, session and data access

OWASP

  • renamed from Open Web Application Security Project to Open Worldwide Application Security Project
  • community driven security standards
  • top 10
  • vulnerability classification, remediation guidance, prevention focus
  • Focuses on vulnerabilities from point of view of what breaks. Looks at application layer
  • Should use both OWSP and ATT&CK

MITRE ATT&CK

  • MITRE came out of the military.
  • Not community driven
  • Knowledge base
  • 14 tactics, 200+ techniques, 400_ sub techniques
  • Derived from actual cyber attacks and threat intelligence
  • MITRE also does CVEs, ATLAS (ML threats)
  • Focuses on adversary behavior from point of view of what attackers do. Looks at adversary-informed defense across entire attack lifecycle
  • More specific

ATT*CK

https://attack.mitre.org

  • Tactics – focus on the “why” of the attack
  • Techniques – how the attack happens (ex: spear phishing)
  • Sub-techniques – ex: spear phishing over email
  • Procedures – real world examples

Real world

  • Kill chain is not linear
  • Loop backs, paralel activities
  • “crooked line”

Solar winds

  • Backdoor into signed update
  • DDL executes
  • SAML credential threat
  • Command and control via DNS blending
  • Data exit over C2

Initial Access and Credential Attacks

  • Make access decisions explicit
  • SQL Injection vs parameterized queries
    • Detect credential stuffing – too many request too quckly from same IP

Execution and Command injection

  • Command injection vs command whitelisting
  • Unsafe deserialization

Persistence & Session Hijacking

  • Vulnerable session management – that last forever
  • Web shell detection – looking for extension isn’t enough. if do prevew can run JavaScript

Credential Access & Secrets

  • Try to use managed identity instead
  • Rotate secrets; better to use short lived tokens
  • Use key vault
  • Don’t put api keys/tokens in source code
  • GitHub alerts if check in a key to public repo. Can auto expire the checked in token. Even cleaning history not enough because people can subscribe to commits. Need to protected with pre-commit hook on your machine

Defense Evasion & Log Tampering

  • Correlate logs from different sources
  • Log injection
  • Tamper evident logging

Supply chain compromise

  • Malicous packages,
  • event-stream, solarwinds, log4shell, xz utils, sai hulud, notepad+, axios, etc
  • 2021 – Log4Shell was a dependency trust failure. It waa bug. People didn’t know if using because used other things that included. Also needed SBOM for own software.
  • 2024 – XZ Utils – 2 year long con.- “Jian Tan” submitted first patch in 2021. Sock pullets pressure maintainer so Jia becomes co-maintainer. Backdoor in tarballs only in 2024. Found March 29th by accident because SSH was 500ms slower from a Microsoft researcher looking at PostGres performance. Goal was to get this into Fedora so in next major release of Red Hat Linux.
  • 2025 – NotePad++ update hijack – We hosting infrastructure compromised. Web host trojanied the update.exe by adding a side loaded (loading malicious file) DLL.
  • 2026 – Axios NPM Compromise – March 31 for 3 hours there was an extra dependency with a remote access trojan. The post install script downloaded software to allow remote access. It was just a patch release so not looked at closely.

Patching is more than deploying

  • Patch the dependency -> inventory affected services
  • Restart the service -> Verify the critical workflows
  • Close the ticket -> check for prior compromise

Collection & Exfiltration

  • 2015 – anthem – slowly stole data over http request
  • 2022 – LastPass – stole tokens targetting developer’s home PC
  • Helpful to have baseline statistic on how much data usually have so know when unusual
  • API rate limiting with exfil detection

MITRE website

  • Multiple matrixes
  • Can read about details of attacks such as detection/mitigations.

My take

THere were lots of examples including technique names/numbers. I feel like I got a good feel for ATT&CK. I also poked at https://attack.mitre.org as well to get a feel for what it looks like. A lot of different items shown as well both as code and as mapping to ATT&CK. And the recent events examples.

[2026 kcdc] beyond prompting: how skills and playbooks guide ai agents

Speaker: Avindra Fernando

See live blog table of contents for more posts


Survey

  • Most have ai agent writing code
  • Most jave markfown file agent reads
  • About half have written a kskill
  • A handful have a playbook/automated workflow for skill
  • A few have tested whether skill triggers

Reusable intelligence in repo

  • agents.md, claude.md

Skills

  • Prompt tells an agent what to do once
  • A skill tells it how to work here, every time
  • Create skill when see action being repeated over and over

Flow

  • Context
  • Skills
  • Automate skills, make playbooks
  • Prove did work
  • Maintain codebases

When people say “prompt file” it could mean

  • Context file (always gets loaded). Not helpful when file gets too long. Overwhelms the agent
  • Skill – loaded on demand
  • Subagent – roles – ex: planner, tester, reviewer
  • Command – playbook combining context/skill/agent
  • Hook – systematic gates so can restrict access

Learnings

  • Agent will figure out the how. The why is important
  • Want agent to stick with rules
  • Train like a new human teammate, would give them the why
  • Specify hooks – things absolutely don’t want it to do

Open Skills

  • Standard format
  • Name, description, body

Other notes

  • Grill me – takes a vague idea and interviews you to refine it. need to know when to end
  • Found a place it didn’t trigger because nothing run

Agent types

Can choose whether to check in with human after each step.

  • Planner agent – turns story into a plan. Does not do any coding. Good place to use latest models.
  • Implementer/coder agent – takes plan and implements it. No creativity. If problem with plan, that’s on you. Can use less expensive agent.
  • Tester agent – run tests
  • Reviewer agent – code review. Do not fix; just identify issues.
  • Also 3rd party agents can reuse

Playbooks

  • Agents for planning, implementing, testing and reviewing
  • See what generating – give format want plan output in

Failures

  • Capture why
  • Refine skill, figure out if wrong skill files, etc
  • If agent makes mistake, add to agent’s md file so doesn’t make same mistake
  • Surprising changes in cost

Future of reviews

  • Different tools, not looking at code
  • New people will be used to a higher level of abstraction.

War stories

  • The undocumented deployment – wiped out config. Lesson is to create the instructions when inherit an undocumented codbase
  • The queue that woke up – mail queue had dormant key for years. When restarted, all the emails went out, lucky not on prod.
  • When the reviewer goes wrong – memoized when not right answer and caused infinite re-render

Loop

  • Prompt engineering optimizes a message
  • Loop engineering optimizes the pipeline

My take

Avidra has been linking tweets about my live blog so cool he gets a post in it! I missed a few bits of this as I had a moment of panic (I booked the wrong flight home and couldn’t put it out of my mind to fix it later). Overall very good. I learned a bunch and am inspired to make skills/playbooks. Particularly enjoyed the demo.