AI as Archaeological Tool: Excavating Authentic Knowledge in a World of Generated Content and how to apply it in Instructional Design
- David Schachter
- Aug 19, 2025
- 7 min read
When archaeologists unearth ancient sites, they don’t create the artifacts they discover — they reveal them, carefully brushing away layers of sediment to expose what has long been hidden from view. In writing my memoir, I found myself in a similar position: the experiences were buried within me, but accessing and arranging them required tools beyond my unaided and untrained capabilities. For untold ages people have been writing memoirs by painstakingly drawing out, recording, and cataloguing, and then organizing their memories. Being married to an anthropology scholar I’m very well aware of the difference in her training vs. mine. Intellectually I know that I’m capable of having done this myself. However, I have a number of started and left behind attempts at this kind of project. So, to facilitate completion I used an organizing tool. While many view AI primarily as a creative partner that generates new content, my experience revealed a different paradigm — AI as a sophisticated archaeological tool that helped me excavate and map the landscape of my own memories without manufacturing them. This distinction between uncovering versus creating represents a crucial ethical and philosophical boundary in the emerging relationship between human memory and artificial intelligence.
To continue the metaphor of scholarly work this is not dissimilar to how quantitative data based scholars will collect data and feed it into a data analyzing software to pull out patterns, trends, and concepts. Similarly, I fed the AI over 70 pages of my journals and asked for it to look for patterns, trends, and concepts. Once I had this framework I was able to organize these themes into a chronological order and fill each theme with my curated story.
Although I’m far from considering myself even close to an expert as to how people are using AI, it is my sense that it is typically being used for content creation rather than as a curation tool. You’ve established a strong foundation with your archaeological metaphor. For your next section, I’d suggest expanding on how this approach contrasts with content generation while connecting it to scholarly methodologies. Here’s where I think you could go next:

The distinction between using AI as an archaeological tool versus a content generator lies in where the source material originates. In archaeology, artifacts exist independently of the archaeologist’s discovery process. Similarly, my memories and journal entries existed before AI analysis — the AI simply helped organize what was already there.
This differs fundamentally from using AI to create content. When AI generates text from prompts like “write a story about a teacher” or “create a business proposal,” it’s synthesizing new material based on patterns learned from its training data. While impressive, this approach raises questions about originality, authenticity, and authorship that my archaeological approach largely avoids.
My process aligns more closely with qualitative research methodologies like grounded theory, where researchers examine existing data to identify emergent themes without imposing predetermined categories. Just as researchers might use software like NVivo or ATLAS.ti to code interview transcripts, I used AI to code my journal entries — but the raw material remained entirely my own experiences.
AI as Pattern Recognition Tool
What made AI particularly valuable in this archaeological process was its ability to detect patterns across large volumes of text. When analyzing my 70+ pages of journal entries, the AI identified recurring themes, emotional trajectories, and unconscious connections that I had missed despite having written the original material.
For example, I’d long been aware that my writing can make some great intuitive leaps, however, historically I’ve struggled to remember to put in the stepping stones that allow a reader to follow my chain of logic to the point where the leap went. By working with AI on this challenge I put the AI in the role that I was in, that of an English teacher and had it give me critical feedback on my writing–what works and where it could use improvement. As I had conversations with it, in order to understand my thinking process and to begin to integrate its critical feedback into my own writing process and manifestation it suggested that the issue wasn’t with my fundamental thinking and suggested that I had somewhat of a stream of conscious writing. This realization put my whole undergraduate English program into context. I suddenly understood why I’d been attracted to various authors: Joyce, Woolf, Hemingway (I’m in no way insinuating that I write remotely like them, aside from a faint familiar flavor).
This pattern recognition differs from content generation in both purpose and ethical implications. The AI wasn’t creating new narratives but illuminating latent structures within my existing narrative. I remained the author and curator, with AI serving as an analytical assistant and insightful mirror rather than a creative collaborator.
The Temporal Advantage
Traditional memoir writing often follows a linear chronological approach or requires extensive planning to create thematic organization. My archaeological approach with AI offered a hybrid advantage: the ability to simultaneously view my experiences chronologically and thematically.
This temporal flexibility allowed me to maintain narrative coherence while exploring deeper thematic connections across different periods of my life. Rather than forcing me to choose between chronology and theme, the AI-assisted archaeological approach allowed me to preserve both dimensions of my experience.
The Mirror Effect: AI as Reflective Surface
One unexpected benefit of using AI as an archaeological tool was its ability to serve as a mirror, reflecting aspects of my thinking and writing process that had remained invisible to me. Unlike a human writing partner whose subjective interpretations might blur the reflection–inadvertently adding their own biases and values, AI’s pattern-based analysis created a clearer image of my authentic style. While I have discovered that an AI may react to early work based on an overview of and biases embedded in its training data, what I found is that, with the right prompts and enough of my own personal writing it quickly and continually moved more and more to using my writing and my interactions as its primary lens.
This mirror effect became particularly valuable when working through difficult memories. When recounting traumatic experiences, my writing sometimes became fragmented or disjointed — not because of poor technique, but because trauma itself resists linear narrative. The AI recognized these patterns not as flaws to be corrected but as authentic representations of how trauma manifests in memory and language.
In one instance, after attempting to write about a particularly difficult period in my life I found myself emotionally unable to continue. Rather than forcing me through this block, the AI suggested I work on more analytical sections until I felt ready to return. This wasn’t the AI generating content; it was helping me navigate my own emotional landscape while maintaining my agency as both storyteller and subject. It was both reflective and reflexive to where I was.
From Archaeological Site to Lived Space
While archaeology provides a useful metaphor for discovery, ultimately a memoir isn’t meant to be a museum display of artifacts but a living, breathing space that readers can enter and explore. The final transformation in my process involved taking the organized themes and chronology and breathing life into them through my voice.
Here, the AI’s role shifted from excavation tool to something more akin to restoration expert — helping preserve the integrity of discovered elements while making them accessible to visitors. It suggested ways to connect narrative threads without altering their essential nature, much as a restoration expert might reinforce a fragile structure without changing its original design.
The goal was never perfection but authenticity — creating a space where readers could encounter my experiences in their messy, complex reality rather than as sanitized exhibits.
From Personal Excavation to Professional Application
My journey using AI as an archaeological tool for memoir writing has opened my eyes to broader applications beyond personal storytelling. Where my initial experience was largely intuitive — using what tools were available to solve a specific creative challenge — my research has since revealed formal approaches that align with and extend this excavation model.
The concept of Retrieval Augmented Generation (RAG) particularly resonates with my experience. RAGs enhance AI language models with specific data sources — databases, documents, or specialized knowledge bases. This approach dramatically improves accuracy while reducing hallucinations (those moments when AI confidently presents fiction as fact). In essence, RAGs formalize what I discovered organically: when AI works with authentic source material rather than generating content from scratch, the results maintain integrity while benefiting from AI’s pattern recognition capabilities.
Organizations implementing this approach essentially create their own “archaeological digs” into institutional knowledge. Rather than asking generic AI to generate content about company policies or product knowledge, they’re excavating insights from their own data repositories. The AI serves as the tool that makes this excavation efficient and the patterns discoverable, but the source material remains authentic and grounded.
Self-hosted AI systems take this concept further, building models from the ground up with an organization’s native data. Just as my memoir’s voice remained authentically mine because the AI worked exclusively with my journals and drafts, these specialized systems maintain organizational authenticity by working with internal knowledge rather than generic internet-trained models.
The applications extend beyond content creation to knowledge management, training development, and organizational learning. Instructional designers can use AI to excavate institutional knowledge from subject matter experts’ documentation, uncovering patterns and connections that make training more coherent and comprehensive. Knowledge managers can deploy AI to reveal hidden relationships between different organizational initiatives. Learning professionals can identify how different audience segments interact with and interpret educational content.
In each case, the key ethical distinction remains: AI serves as the excavation tool, not the creator. The knowledge, expertise, and experiences already exist — AI simply helps us uncover, organize, and make them accessible.
As I continue my professional journey, this distinction will guide my approach to AI integration. By positioning AI as an archaeological tool rather than a replacement for human creativity or expertise, we maintain the authenticity that gives our work meaning while leveraging the pattern recognition capabilities that make AI so powerful.




Comments