LLM Governance: Top 12 Metrics for Admins Managing a Prompt Portal
Posted inResearch RID Press

LLM Governance: Top 12 Metrics for Admins Managing a Prompt Portal

I recently spent months in discovery identifying the most meaningful AI prompt evaluation metrics for our work. There are lots of numbers to crunch, but which ones really matter at the uppermost levels of oversight, and where can we find detailed indicators for next steps in the AI lifecycle management system. Adoption was paramount and ease of use for complex tasking was essential for adoption.…
A/B Testing in Prompt Engineering 
Posted inUX Design

A/B Testing in Prompt Engineering 

Best Practices: Start small: Roll out new prompts to 5–10% of users or specific segments (e.g., free-tier users). Use real user metrics (e.g., task completion, click-through rates) as ground truth instead of relying solely on synthetic evaluations. Combine A/B testing with automated and human evaluations for comprehensive assessment. Ensure statistical significance before making decisions and document all changes for traceability. Rigorous, data-driven methodology for optimization…
Waste and Recycling Management – Routing & Dispatch
Posted inProduct Design UX Design

Waste and Recycling Management – Routing & Dispatch

Project Summary Client: Starlight Software Solutions Role: Lead Product Designer – UX Strategy & Systems Design Timeline: Sept 2023 – Jan 2024 Team: Product Manager, Engineering Lead, Dispatch Ops Starlight needed an omni-channel dispatch system for residential and commercial waste services that could scale without compromising reliability. The legacy system presented critical challenges: sluggish routing, limited visibility, and dispatch errors, all of which impeded service expansion. As lead…
The Collaboration Crisis: Why AI Products Expose a Decade of Organizational Failure
Posted inRID Press

The Collaboration Crisis: Why AI Products Expose a Decade of Organizational Failure

By John Holt, Principle Product Designer | UX for AI Systems Design Most technology companies can't build AI products. Not because they lack technical talent or tools, but because they systematically destroyed the collaborative capabilities AI development requires. The design-to-code automation tools emerging today - Figma to Builder.io, Cursor with ChatGPT, generative React components - aren't empowering designers. They're exposing a fundamental organizational dysfunction. From…
Legacy Overhaul for Gordian’s RSMeans Data Online
Posted inProduct Design UX Design

Legacy Overhaul for Gordian’s RSMeans Data Online

  Client: Gordian (RSMeans Data Online) Timeline: January–October 2024 Role: Lead UX Designer (strategy, research, interaction design, prototyping) Team: Product managers, subject matter experts, engineering team Tools: Figma, design system libraries, prototyping frameworks   Project Summary Gordian’s RSMeans Data Online, a construction cost estimating platform, required a full overhaul of its legacy product catalog. Beyond immediate usability gains, I established interaction patterns (floating toolbox, adaptive filters, accessibility compliance) that…
Posted inUX Design

Marc Benioff says Salesforce cut 4,000 support roles because of AI agents

Marc Benioff says Salesforce cut 4,000 support roles because of AI agents. Maybe the wrong people are being replaced. This fear-mongering reveals something else. Regular people still need AI products and access. Pithy comments like this expose the arrogant cynical disregard for the workers: "Don't worry. AI won't take your job. A person using AI will." And, don't forget to consult with George Clooney about…
Backend-as-a-service (BaaS) solutions that provide databases, authentication, APIs, and real-time features
Posted inRID Press

Backend-as-a-service (BaaS) solutions that provide databases, authentication, APIs, and real-time features

OpenAI: Here’s a ranking of Supabase and its main alternatives based on factors like ease of use, features, scalability, community support, and flexibility. Keep in mind that the best choice depends on your specific project needs, but this should give you a general idea: https://raibach.net/backend-as-a-ser…al-time-features/1. Supabase Pros: Open-source, PostgreSQL-based, real-time capabilities, built-in authentication, storage, and auto-generated REST and GraphQL APIs. Ease of Use: High — simple setup and…
Designing Your AI Product Market Fit (PMF)
Posted inRID Press

Designing Your AI Product Market Fit (PMF)

Product-market fit (PMF) for AI products means aligning a solution closely with distinct market needs, delivering clear value that naturally drives ongoing demand. Achieving this can be seen as an art of craftsmanship—a thoughtful design that conveys quality and earns trust. Humans can be unpredictable with technology; many expect some sort of magic from AI if only they could trust it. Building this trust means…
These are my go-to approaches for quality work
Posted inRID Press

These are my go-to approaches for quality work

Most all of my projects follow basic design guidelines from WCAG, which covers a lot of issues for all users. Clear text, correct contrast, etc. is key; the interface should not compete with the task flow or the feedback from the system. You will notice in my portfolio that containers/components are modular/expandable/scalable, they are meant to be grouped, change and guide - not to simply…
Overcoming Design Failures – Personas & Discovery Research – XPO Logistics
Posted inResearch

Overcoming Design Failures – Personas & Discovery Research – XPO Logistics

Client: XPO Logistics Date: 02/2019 Role: Product Design, Lean UX, Researcher, Note Taker. Managed offshore UI designer. Project Summary A delivery exception happens when an ecommerce package is delayed temporarily in transit. When trouble occurs during the package’s progression, resulting in the intervention of the fulfillment process, numerous things can go wrong even with the most complex and robust ecommerce system. Delivery exceptions need to be…