Back to browse
GitHub Repository

GenAI prompts as runnable programs

48 starsRust

Execute local LLM prompts in remote SSH shell sessions

by smudgy3746·Mar 15, 2026·2 points·0 comments

AI Analysis

●●SolidBig BrainSolve My ProblemNiche Gem

Executes local LLM prompts on remote SSH shells without installing agents or opening firewalls.

Strengths
  • Zero-install remote execution keeps production servers clean and compliant with security policies.
  • SSH tunneling trick avoids granting LLM tools direct server access credentials.
  • Supports provider load balancing and caching for cost and latency optimization.
Weaknesses
  • Depends on local machine; prompts fail if your laptop sleeps or disconnects.
  • Niche workflow limits appeal to developers who frequently manage remote SSH sessions.
Target Audience

DevOps engineers, SREs, and backend developers managing remote infrastructure

Similar To

llm · ssh-ai · Continue

Post Description

Hi HN,

This is a tool I've worked on the past few months (not vibe-coded).

Instead of giving LLM tools SSH access or installing them on a server, the following command:

$ promptctl ssh user@server

makes a set of locally defined prompts "magically" appear within the remote shell as executable command line programs.

For example, I have locally defined prompts for `llm-analyze-config` and `askai`. Then on (any) remote host I can:

$ promptctl ssh user@host # Now on remote host $ llm-analyze-config /etc/nginx.conf $ cat docker-compose.yml | askai "add a load balancer"

the prompts behind `llm-analyze-config` and `askai` execute on my local computer (even though they're invoked remotely) via the llm of my choosing.

This way LLM tools are never granted SSH access to the server, and nothing needs to be installed to the server. In fact, the server does not even need outbound internet connections to be enabled.

Eager to get feedback!

Github: https://github.com/tgalal/promptcmd/

Similar Projects