My custom AI Organization and practices that shipped SHRP

Company

Personal work

Built by

Me, solo

Team

3 AI roles: Product Strategist, Developer, Org Strategist

Timeline

May-September 2026

Focus

Automating practice, defining AI roles, building new workflows

What is it?

AI team with defined roles, a shared memory, and a self-optimizing feedback loop to assist my work

I wanted a closed-loop system in which AI could navigate, manage, and improve over time, optimizing for collaborating with me and assisting me.

Why build it?

Expedite production while maintaining total ownership

The production process prior to AI had many aspects that could be automated, based on AI’s current strengths today. I wanted to build a system that allowed me complete control, while handling rule-based work for which my own decisions are not as critical.

What came of it?

A 0→1 product in five months, and a new way of working

I integrated AI into every step of my production process, and found advantages across all of them. Some advantages were speed, some were regarding how thoroughly I could inform decisions, and many areas saw advantages in both.

AI Impact Summary

Discovery

Accelerated

Competitive analysis

AI ran it from my questions across every company in the space.

Design precedent

AI analyzed design mechanics across UI with similar goals.

Problem scope

AI helped size the problem from global and US screen-time data and health research.

Lofi design

Assisted

Critique

AI critiqued UI and flows from the perspective of our defined users.

Collaboration

Weighed in on both high and low level product strategy through discussion.

No actual AI design

AI struggled to design collaboratively via Figma at acceptable speed and consideration quality.

Prototyping

Transformed

Straight from lofi

AI was able to combine my style guidance and lofi spec into working prototypes. No hifi mocks.

Fully functional on device

Prototypes could be tested and felt on device, speeding up evaluation and improvements.

Inside the product codebase

AI built to my development standards in the product repo, so the final version was the product, with nothing to rebuild.

Designing through play

Features could be improvised live in the running prototype, speeding up the feedback-iteration loop.

Build

Transformed

AI produced all code

I provided architecture, modularization, commenting, documentation, and style guidelines. AI built and reviewed everything within those bounds.

Decision documentation system

PRDs, ADRs, in-file comments, and the code itself all act as a documentation system, with guidelines of what is logged and linked where.

Git and tests

AI followed my established guidelines for Git management and testing.

Shipping

Transformed

Release channels

AI assisted me to build out protocols for Dev, Canary, Staging, and Production channels in half a day.

Gated release management

AI runs a series of scripts to ensure the release pipeline is followed. Failed tests or misconfigs can’t make it out.

Store-specific pipelines

AI runs the iOS and Android release pipelines end-to-end, enabling 30 releases in 3 months.

I own every release

Nothing reaches users or proceeds down the pipeline without my sign-off.

User testing

Accelerated

Research methods unchanged

I established strategy, designed the study, ran every interview in my style, and decided what the findings meant.

Automated intake pipeline

AI took 18 hours of audio and screen recordings and transcribed and attributed them.

Affinity generation

AI broke down user interview content into over a thousand usable affinity notes.

Surfacing research in discussion

AI provided relevant affinity findings on-the-fly during design discussion.

Measurement & monitoring

Accelerated

What counts as success

I defined the criteria, qualitative and quantitative, before testing began.

Stack selection

AI assisted me in evaluating analytics and crash-reporting options against our stage and budget, and helped set them up.

What to measure

AI helped define the telemetry events and metrics against my success criteria.

Answering questions with data

AI pulls data from our measured metrics live to inform product discussion.

Daily health check

An AI heartbeat watches production and alerts me when something needs addressed.

Policy & compliance

Transformed

Privacy policy and terms

AI drafted against the requirements of both stores. I verified every claim against the product before signing-off.

Data hosting compliance

AI mapped GDPR and US rules to inform my infrastructure choices: where data lives, and what stays out of the MVP.

Store compliance

AI derived Google and Apple’s data-handling requirements and evaluated our compliance throughout production.

The Question: Could one designer ship a whole product with AI?

Solo practitioner startups were previously unrealistic

After bootstrapping my last startup for multiple years, I knew the limitations and costs of the full production process, even for a smaller app. When I wound down that product, I was certain I’d never attempt a startup by myself again. The sheer scale of work, decisions, and knowledge is a tremendous amount to keep top of mind across all job functions.

The math recently changed, significantly

In Q2 2026, I began reading about the advantages of Claude Code, and after understanding what it was capable of at a high level, it looked like it could be the answer to the challenges of work and knowledge scale of independent production.

In particular, AI could search for relevant information, organize it, reference it, and store it on your file system as a knowledge base. And it could be taught custom ways of operating.

Having no experience prior to this with AI beyond using a chat interface like ChatGPT for debugging work, this was both exciting and relevant. So, I set out to figure out if it was really possible to ship a high quality product independently, supported by a custom AI-org and custom agent team.

Design goals for the org

Based on what AI was proficient at at a glance, I specced out my intentions for the org.

Designing the org around the limits of AI

Over the first few months, most of the org’s practices took shape based on observed limitations and friction of working with AI within the org.

Collaborative session lifecycle: The backbone of the org

Below is a diagram of how AI is used in the org, from the start of a collaborative work session with the org, to its completion. These processes are designed from observing the limitations of AI in practice.

DCBAWind downBoot upOrg filesystem layerCode knowledge graphsOrg knowledge graphCodebasesProduct docsAgent roles Org docsCompany docsSession starts with user defined task, and goal criteria, and AI roleBoots up AI role, and gains context from org based on taskSession proceeds collaborativelySession completes stated goalAI logs full discussion, distills it, finishes pending writes, and pushes to GitAI walks through personal retro with me, discussing and logging friction points, what went well, what should improve, and themes.Retro logs are used later to inform more significant changes to the org and roles.Following sessionoptional handoffAI role gains additional context as neededAll saved durably in the orgAI updates code, docs, etc according to instruction and defined practices.Subagent navigates the org and surfaces relevant context

Drag to explore the full diagram

The fresh session problem, solved with boot protocols

Agents are not like human collaborators. Every new session, an agent arrives with a blank slate.

The design question becomes, “For this session’s goal, what does my AI need to know in order to be most effective in assisting me to reach that goal?”

The answer is in two parts:

  1. Based on the session’s task and goal, the AI should find and load all relevant context from the org’s filesystem.

  2. As the task progresses, the AI should identify when it is missing context that the org has, and load it on the fly.

This approach allows the AI in the session to start from an informed perspective based on established decisions and context. This way, I never have to repeat settled decisions or stories.

The 1M context problem, solved with the AI-navigable org and multi-sessions

Each session can have up to 1M tokens in context. This presents a challenge, as the org itself is over 530M tokens and growing with every conversation, decision, and asset.

The boot protocols solve this problem partially, by only loading relevant context from the org. But to do that, the AI must be able to navigate the org’s filesystem effectively.

To solve this navigation challenge, the org has a few design considerations:

  • It has an enforced folder and file schema, making high level navigation predictable.

  • It has multiple queryable knowledge graphs for the AI to use in different parts of the org.

If a session goes beyond 1M context, the AI compresses information, which can impair its ability to collaborate from an informed perspective.

To address this, the AI will generate handoff instructions for another session to boot from, preserving key context and decisions intentionally without the uncertainty of automatic compression.

Different collaborators are needed for different tasks, solved with roles

Some tasks require operating in different ways. Instead of having one universal AI assistant, I created 3 key roles:

  • Product Strategist, for collaborating on research and design discussion and decisions.

  • Developer, for writing, maintaining, and advising on code and technical considerations.

  • Org Strategist, for maintaining and improving the org itself, and its practices and roles.

By splitting these roles, I was able to improve upon them individually.

Improving the org and roles is time consuming, solved with feedback loops

Early on, I noticed despite corrections the AI would repeat similar mistakes. To address this, I introduced retrospectives to the session wind down procedures.

The goal of this was to log issues and feedback at the end of the session, when the experience was freshest in my mind.

The retrospectives consist of:

  • Friction list the AI noticed within the session, which I respond to.

  • What I felt went well in the session.

  • What I felt went poorly, or was draining.

  • Anything I felt should be carried forward, as far as patterns I’d like the AI to operate in.

These retrospectives would be logged for later “optimization” sessions with the Org Strategist AI role, which had autonomy to change how the org worked, from filesystem schema, to role definitions, to processes.

Balancing AI decision autonomy with cost of misjudgment, solved with autonomy upgrade processes

Initially, I weighed in on all decisions the AI was making. Over time, I provided feedback on where AI was successful in making autonomous decisions, and where it failed to be able to make reliable autonomous decisions.

This resulted in a log of decision types:

I had many early experiences of having too much confidence in an AI role to fully make decisions and deliver on a goal, only to gradually discover (slowly through testing) some assumptions it made to complete the task that were far departed from what I’d advise.

The cost of one wrong product decision can cascade very quickly into product and technical debt, so while development proved it could be relatively autonomous, product decisions proved they largely couldn’t be trusted to AI.

How I ensured I never have to write code

The issue of “vibe coded” apps boils down to spaghetti code. Each session focuses on a new feature, refactors and adds to what is necessary, and that’s it. In that mode of operating, it’s not a surprise that the AI isn’t going out of its way for maintainability, as it wasn’t instructed to.

In order to ensure I didn’t have to manually code, I needed to design the Developer AI role so it emulated an experienced developer.

Choosing languages and stack that Claude was most proficient in

In the early stages of planning, I worked with Claude to understand what languages and technologies it was most proficient at using. The chosen technology stack all consisted of tools and languages where:

The AI developer role had defined practices to follow

Up front, the AI needed guidelines for writing and maintaining code. The developer role followed:

Modularization in particular was important, not only because features are more susceptible to change early in MVP development, but because modular logic in the codebase is less context intensive for the AI to work within.

Documentation of decisions, rationale, and history was easily AI-navigable

To ensure the AI was making development decisions from an informed perspective, the product codebase and its documentation needed to provide a clear picture of what was decided, why, and most importantly what was tried and failed or decided against.

I defined a number of roles and practices for different file types, to provide an AI-navigable system.

Citation linking38 total7 totalADRsTechnical decisionsand full rationalePRDsProduct requirementsand rationaleCode filesFile specificdecisions858 total11 ADRs cite PRDs1 PRD cites ADR70 code filescite PRDs395 of 858 codefiles cite ADRs25 ADRs citespecific files

Drag to explore the full diagram

These files linked to one another when relevant, and allowed the AI developer role to gain relevant context on any file specific or systemic development task it was working on.

Automated test generation and checks

With any feature addition or change, the AI developer role creates tests and adds them to the full testing stack, so that we have some reassurance that recent changes have not had unforeseen impacts or break other parts of the product. The SHRP product currently has about 1,200 tests as of this writing.

How is code quality reviewed?

The AI developer role executes its own code review with Claude’s models. For larger code reviews, I also have it use GPT Sol as an adversarial reviewer, and use Ollama higher end local models for a second opinion.

New code is tested live on device during development. Once a feature is complete, it graduates to Canary track which is a release build on my personal device. Once that is soaked, I graduate it to the Staging track consisting of beta users and monitor its stability via Sentry analytics.

Is this preferable to working with a professional developer?

Absolutely not. Working with a human developer not only brings their experience and expertise, but also common sense, which AI can lack.

I have no doubt the code quality of the SHRP product is below what a senior+ engineer could deliver (even if they’re AI assisted). But given I don’t have the resources for that, the AI Developer role has far exceeded my expectations, and delivered a quality of collaboration and production performance that I am very happy with. There is no way I could have developed this product, of this scope, myself in even 10x the development time.

How I designed before, and how I design now

My design process changed pretty drastically, allowing both greater depth and quality in shorter timeframes.

Code went from the most expensive aspect of production, to the cheapest.

The classical design process front loaded lean research, to derisk initial product decisions as much as possible. Once engineering was involved, implementation was expensive, and changes later added significant cost. Not only accrued time cost, but technical debt, and increased pressure on developers who were managing multiple goals at any given time.

Initial discovery, research, lean testing, and all our usual up front methods as designers are all towards the purpose of making the case for a design as air-tight as possible prior to engineering.

When that flips, there are a huge amount of advantages and opportunities to improve the process.

Change #1: Due diligence research rigor

Competitive analysis, market evaluation, design precedent, problem scope, etc. All that initial research work understanding the playing field took time. Now, it can be strategically automated and explored conversationally.

This allows more data to be taken into account, more quickly, and intentionally. What would take a week or more, can be done in an afternoon.

Change #2: No more high fidelity in Figma

Once I had a low fidelity spec, I could take it and combine it with a loose set of typography and colors, and use AI to play and feel out what aesthetic matched the UI and experience I was trying to create.

Instead of taking a day to mock up a few high fidelity options, I was able to feel out over a dozen high fidelity versions of my UI over an afternoon.

Change #3: Live prototypes over less effective paper prototypes

This is the biggest shift. To get the most accurate feedback from a user, it is ideal to give them the closest experience to the one you want to release. Before, that meant paper prototypes, or shoddy functional prototypes that often were not cost effective.

Now, you can get the actual, fully functional idea in front of the user faster than if you created paper prototypes, or conducted a survey, or any other classical method.

The user is in the position to provide more accurate information, and you’re in the position to experiment freely. An absolute win-win, which makes testing more cost effective for the business, more accurate from the user, and more playful and enjoyable for the designer.

Today, with AIUp front discoveryand due diligenceLow fidelity designand interaction specRapid high fidelityexperimentationProduction-qualityprototype in userhandsRapid iterationUser feedbackBefore, without AIUp front discoveryand due diligenceLow fidelity designand interaction specLean research method(paper prototype,interview, etc)High fidelitydesignEngineering handoffSlow cycle of feedback,research, eng delivery,and repeat

Drag to explore the full diagram

Change #4: Design through play

Using a development build on-device that updated the app live after any codebase change, allowed me to brainstorm with an AI session and design interactions iteratively. I’d try playing with a feature, and come up with ideas for how to change and improve the experience. Then I’d play with the change, and continue tweaking until I was happy with it.

This type of design iteration before AI would have significant time cost, outweighing the UX benefit many of the times, so lots of these tweaks and improvements wouldn’t be viable before AI. With AI, I can have fun iterating, and refine features delivering a much higher UX quality, with comparably negligible additional time cost.

What didn’t change: Ownership, low fidelity design, and interview strategy

AI is most helpful for scoped tasks with clear constraints, context, and criteria. But it has no actual responsibility for success or failure.

As full responsibility fell to me, I ensured at every step involving a product decision, that I either explicitly made that decision, or approved it from a fully informed perspective.

My low fidelity design process was also largely unchanged. While AI was helpful to conduct research and inform my perspective, it was not helpful as an actual designer. A first draft low fidelity spec takes a huge amount of context (problem, user, business, design, etc) and involves structuring a system balancing all that context and the product goals. Every flow, every page hierarchy, every piece of copy, works together to reflect the design intent defined by that context.

Because of the high complexity of reasoning and scale of context required for a new product low fidelity spec, I found AI (as of Q3 2026) consistently unable to make effective decisions of value. Therefore I kept its role as providing critique at this phase.

I also kept my previous interview practices. Interview strategy design is already highly complex; What are we looking to learn? How should it be learned from the user? What are our priorities?

Once you establish your study design and interview strategy, you need to conduct the interview. When should you refocus the user? When should you provide bias or withhold? When should you let the user run and explore an idea?

Getting the most out of a user interview also requires them to be comfortable, to trust you, and to enjoy talking to you. This takes practice, and in no way can be emulated by AI.

When is AI better, and when is a human designer better?

Through the experience of working with AI in the variety of ways required to produce and ship a product, I learned first hand AI’s significant strengths and weaknesses.

Bottom line: AI is strongest on problems it has been trained on, or that fit inside one session; a human is strongest where the decision needs more context than a session can hold.

AI wins: Large dataset, precise distillation, pattern recognition, rule-based labor, teaching

I found AI to be a boon of help executing rule-based thought labor, which would have taken me significant time and energy. Some general examples:

In these areas, some things that AI could do in minutes could have taken me days, weeks, or even months.

Designer wins: High context decisions, design system tradeoffs, product judgement, and in-person interaction

In some cases, I found AI to slow the process down, or to be unable to deliver competitive value vs doing the work myself. This was primarily in regards to decisions that required significant context, across a long timeframe, which considered priorities across domains.

A single design decision, let’s say adding a button on an app homepage, has a large number of considerations. Here is an incomplete potential example list:

These are just some questions that can be asked depending on a single design decision on a single UI.

AI still is assistive for small scope, low complexity design. For example, drafting a confirmation pop-up modal with design and copy. But from my experience so far, I ensure that I explicitly decide or weigh in on every product decision.

A designer also is able to know when to distrust an idea or answer, and challenge the basis of a decision. That is a key design skill, and one that keeps AI assistance value net positive.

Designer vs AI advantage summary

AI wins Designer (me) AI

Precise distillation of large dataset

Hours of review, imperfect recall

Accurate distillation in minutes

Pattern recognition across large dataset

Hours of review, imperfect recall

Accurate patterns in minutes

Manual, rule-based technology labor

Searching for docs, reviewing code, etc.

Slower searching, reading, and time to comprehension

Accurate, fast, and predictable

Assuming given accurate guidance and criteria

Skill breadth

Acting as any requested role; design, legal, dev, etc.

Finite, gradually increasing through experience.

Extremely high breadth

Assuming given accurate guidance and criteria

Designer wins

High context decisions

Spanning weeks or months of learnings

Higher accuracy, given immersed in material

Unable to target recall to relevant key patterns at context scale competitively

Systemic design decisions

Higher first pass accuracy

Thought processes struggle to blend tradeoffs and reason within a product’s UI architecture

Product judgement and feeling

Instant, providing accurate single user datapoint

N/A, incapable of “feeling” full impression of a design

In-person inquiry and user testing

Accurate, utilizing social skills and interview experience

Untested

Identifying incomplete decision basis

Accurate, with known criteria based on decision

Inconsistent, and will assert stances on known incomplete criteria

Despite instruction guards

Conclusions so far: A designer leads and carries responsibility, AI provides enablement, options, and speed.

Going into creating this org system, I was curious how much of my role as a designer could actually be emulated by AI.

Instead, I learned how many opportunities for improvement AI provides, opening up the potential to redefine many ways of how I previously worked.

At the same time, I got a strong dose of AI’s failures in my experimentation with it. I found what could be improved over time, and what it was unable to do.

I’m thrilled to be a designer in this new paradigm, compared to how I previously worked.

Granted, this is as of this writing (October 2026). I’m sure this assessment will be outdated in no time, and my practices will continue changing.

So, can one designer ship a whole product with AI? Yes*

My design experience combined with AI’s breadth of skills and enablement allowed me to produce a validated consumer app on the market.

Based on the scope of the product I delivered, it would have easily taken me 18-24 months or more to produce what I did in 5 with the AI org. Plus, I was building the AI org itself at the same time.

It isn’t without friction

Improving the org, roles, and the AI to perform tasks in ways I found passable is a process. Along that process, the failures and friction in the AI’s work become the data needed to feedback into the org system to improve it. Over time, the org became better and better, as my practices and preferences became learned and encoded in how the org worked.

Along that journey there were countless decisions by the AI I qualified as mistakes. To name a few notable incidents:

Some of these failures were of org processes and instruction, which were improved upon and tightened to be reliable and verifiable. Other failures were from inherent limits of current AI and session constraints, so these failures caused task delegation away from AI to myself.

Can one designer ship any product with AI? No

This is my experience so far at the current scope of the product I produced. SHRP’s scope is a single app, on 2 platforms, whose system is across devices and servers. While the product requirements are design and research heavy, the technical requirements are well within a scope AI can collaboratively manage.

My previous development experience and high level understanding were enough to structure a system that the AI could work within to produce a product of this technical complexity.

This may not be true for a product of higher inherent technical complexity, like Netflix’s data distribution network (as an extreme example). Higher technical complexity would require greater human developer experience to define and guide AI towards technical solutions, beyond my experience.

Where it stands, and what’s next?

I currently use the org to improve SHRP based on user feedback, and monitor the product.

The org handles SHRP’s operations: a daily production health check that alerts me when something needs attention, a weekly analytics review, nightly maintenance jobs, monitoring user feedback submissions, and more.

Looking towards my next design role

The value I bring, more than any one system or technology, is the experience and insight into how AI can be used for greatest benefit, and how to manage and scope it to ensure it produces value.

Producing a product with AI taught me a huge amount of valuable lessons through experience. At this point, my next chapter is to do this within a team; to meet them where they are currently, and help strategically integrate AI into my own practice there, and with the team’s potentially existing practices.

This experience was terrific practice in learning and adapting my own practices, and questioning my own previous ways of doing things. I look forward to bringing my skills to a new team, and continue improving and growing along with them in the future.


Related case studies