AbanteAI/rawdog is a CLI assistant that generates and auto-executes Python scripts to assist with various tasks, such as analyzing directories, running scripts, and interacting in a conversational manner. It offers options for direct prompt execution or ongoing conversation mode. Users can customize the model selection for completions and adjust settings like retries and script approval. Rawdog provides a unique approach to task automation and script generation, with potential for both utility and caution due to its capabilities.


Rawdog
An CLI assistant that responds by generating and auto-executing a Python script.

  
    
    rawdog-demo-4.mp4
    
  

  

  


You'll be surprised how useful this can be:

"How many folders in my home directory are git repos?" ... "Plot them by disk size."
"Give me the pd.describe() for all the csv's in this directory"
"What ports are currently active?" ... "What are the Google ones?" ... "Cancel those please."

Rawdog (Recursive Augmentation With Deterministic Output Generations) is a novel alternative to RAG
(Retrieval Augmented Generation). Rawdog can self-select context by running scripts to print things,
adding the output to the conversation, and then calling itself again.
This works for tasks like:

"Setup the repo per the instructions in the README"
"Look at all these csv's and tell me if they can be merged or not, and why."
"Try that again."

Please proceed with caution. This obviously has the potential to cause harm if so instructed.
Quickstart


Install rawdog with pip:



Export your api key. See Model selection for how to use other providers
export OPENAI_API_KEY=your-api-key



Choose a mode of interaction.
Direct: Execute a single prompt and close
rawdog Plot the size of all the files and directories in cwd

Conversation: Initiate back-and-forth until you close. Rawdog can see its scripts and output.
rawdog
>>> What can I do for you? (Ctrl-C to exit)
>>> > |



Optional Arguments

--leash: (default False) Print and manually approve each script before executing.
--retries: (default 2) If rawdog's script throws an error, review the error and try again.

Model selection
Rawdog uses litellm for completions with 'gpt-4-turbo-preview' as the default. You can adjust the model or
point it to other providers by modifying ~/.rawdog/config.yaml. Some examples:
To use gpt-3.5 turbo a minimal config is:

To run mixtral locally with ollama a minimal config is (assuming you have ollama
installed and a sufficient gpu):
llm_custom_provider: ollama
llm_model: mixtral
To run claude-2.1 set your API key:
export ANTHROPIC_API_KEY=your-api-key
and then set your config:

If you have a model running at a local endpoint (or want to change the baseurl for some other reason)
you can set the llm_base_url. For instance if you have an openai compatible endpoint running at
http://localhost:8000 you can set your config to:
llm_base_url: http://localhost:8000
llm_model: openai/model # So litellm knows it's an openai compatible endpoint

Litellm supports a huge number of providers including Azure, VertexAi and Huggingface. See
their docs for details on what environment variables, model names
and llm_custom_providers you need to use for other providers.


AbanteAI/rawdog: Generate and auto-execute Python scripts in the cli