Agentmark

4 months ago 6

Develop, test, and evalaute your AI Agents using Markdown

AgentMark makes it easy for developers to develop, test, and evaluate Agents.

AgentMark makes prompt engineering intuitive by combining familiar Markdown syntax with JSX components, allowing developers to focus on creating reliable Agents. AgentMark seamlessly integrates with your favorite SDK's using our adapters, and currently works in TypeScript and JavaScript, with Python support coming soon.

AgentMark comes with comprehensive tooling included—featuring full type safety, unified prompt configuration, syntax highlighting, loops and conditionals, custom SDK adapters, and support for text, object, image, and speech generation across multiple model providers, even when they don't support native structured output APIs.

AgentMark prompt file example for generating text

Feature Description

Multimodal Generation	Generate text, objects, images, and speech from a single prompt file, supporting a wide range of model capabilities.
Tools and Agents	Extend prompts with custom tools and agentic workflows, enabling API calls, calculations, and multi-step reasoning.
File Attachments	Attach images and files to prompts for tasks like image analysis, document processing, and more.
Type Safety	Ensure reliable, type-checked inputs and outputs for prompts using JSON Schema and auto-generated TypeScript types.
Conditionals, Loops, Props, Filter Functions	Add logic, dynamic data, and transformations to your prompts with powerful JSX-like syntax.
CLI for running/testing	Run, test, and debug prompts directly from the command line or your editor for rapid iteration.

Get started by first initializing your AgentMark app.

npx @agentmark/cli init

We offer a few ways to run prompts with AgentMark.

Use our AgentMark CLI:

Run .prompt.mdx files directly from the command line using our CLI. This is the quickest way to test and execute your prompts.

# Run a prompt with test props (default) npx @agentmark/cli run-prompt your-prompt.prompt.mdx # Run a prompt with a dataset npx @agentmark/cli run-prompt your-prompt.prompt.mdx -i dataset

Run AgentMark files with your favorite SDK

AgentMark doesn't support any models or calling any LLM providers. Instead, we format the input of your prompt through an adapter to match the input of the SDK you're using.

Adapter Description

Vercel (Recommended)	The Vercel AI SDK.
Default	Turns prompts into raw JSON, adapt manually to your needs
Custom	Allows a user to create their own AgentMark adapter to custom adapter format.
Mastra (Coming Soon)	Coming soon, we'll support the Mastra SDK