I38/README.md

I38

Accessibility setup script for the i3 window manager.

i38.sh

Released under the terms of the GPL License Version 3: https://www.gnu.org/licenses/ This is a Stormux project: https://stormux.org

Why the name?

An uppercase I looks like a 1, 3 from i3, and 8 because the song We Are 138 rocks!

Requirements

• acpi: [optional] for battery status. It will still work even without this package, but uses it if it is installed. Required for the battery monitor with sound alerts.
• bc: For the information panel.
• clipster: clipboard manager
• dex: [optional] Alternative method for auto starting applications.
• i3-wm: The i3 window manager.
• jq: for getting the current workspace
• libcanberra: [optional] To play the desktop login sound.
• libnotify: For sending notifications
• lxsession: [optional] For GUI power options like shutdown
• magic-wormhole: [optional] for file sharing with magic-wormhole GUI
• notification-daemon: To handle notifications
• pamixer: for the mute-unmute script
• pandoc or markdown: To generate html files.
• pcmanfm: [optional] Graphical file manager.
• playerctl: music controls
• python-gobject: for applications menu.
• python-i3ipc: for sounds etc.
• python-pillow: For OCR
• python-pytesseract: For OCR
• remind: [optional] For reminder notifications, Requires notify-daemon and notify-send for automatic reminders. scrot: For OCR
• sox: for sounds.
• tesseract: For OCR
• tesseract-data-eng: For OCR
• udiskie: [optional] for automatically mounting removable storage
• x11bell: [optional] Bell support if you do not have a PC speaker. Available from https://github.com/jovanlanik/x11bell
• xbacklight: [optional] for screen brightness adjustment
• xclip: Clipboard support
• xfce4-notifyd: For sending notifications. Replaces notification-daemon
• xorg-setxkbmap: [optional] for multiple keyboard layouts
• yad: For screen reader accessible dialogs

Sway/Wayland Specific Dependencies

When using I38 with Sway instead of i3, the following Wayland-native alternatives are recommended for optimal compatibility. I38 will automatically detect and use these when running with the -s flag:

• Recommended (Wayland-native):

  • mako: Wayland-native notification daemon (preferred over xfce4-notifyd)
  • wl-clipboard: Wayland clipboard utilities (provides wl-copy and wl-paste)
  • clipman: Wayland clipboard manager (works with wl-clipboard)
  • wlr-randr: [optional] Wayland display configuration tool for screen brightness control
  • brightnessctl: [optional] Alternative brightness control tool for Sway

• Not needed on Sway/Wayland (these are X11-only):

  • xbrlapi: X11 braille helper - not needed on Wayland, BRLTTY works directly
  • x11bell: X11 bell support - Wayland has native alternatives
  • clipster: X11 clipboard manager - use clipman/wl-clipboard instead
  • xdotool: X11 window manipulation - Sway uses native IPC instead
  • xprop: X11 window properties - Sway uses native IPC instead
  • xrandr: X11 display configuration - use wlr-randr or brightnessctl instead
  • setxkbmap: X11 keyboard layout - Sway uses native input configuration

• Works on both (via XWayland fallback if Wayland-native not available):

  • xfce4-notifyd: Works via XWayland, but mako is preferred for native Wayland support

Note: On Sway, keyboard layouts must be configured in the Sway config file (~/.config/sway/config) using the input block. The keyboard.sh script will cycle through configured layouts but cannot set layouts directly like on X11.

AI Assistant (Optional)

• python-requests: For Ollama integration
• claude: [optional] Claude Code CLI for Claude AI integration. Install from https://claude.ai/code
• ollama: [optional] Local AI models. Install from https://ollama.ai

Voice Mode (Optional)

• python-speechrecognition: For voice input recognition
• python-pyaudio: For audio recording
• pocketsphinx: [optional] For offline speech recognition fallback
• flac: [optional] For better audio encoding in speech recognition

I38 will try to detect your browser, file manager, and text editor and present you with a list of options to bind to their launch keys. It will also create bindings for pidgin and mumble if they are installed. Additionally, you can now add custom applications with your own keybindings during the setup process. To use the bindings, press your ratpoison mode key which is set when you run the i38.sh script. Next, press the binding for the application you want; w for web browser, e for text editor, f for file manager, m for mumble, etc. To learn all the bindings, find and read the mode ratpoison section of ~/.config/i3/config or use the help binding key, alt or super depending on your settings with Shift+F1.

Ratpoison mode is now enabled by default for better accessibility and ease of use.

Sound themes can be configured using GTK configuration files or gsettings. Replace "name" with the name of the theme you want to use.

Note that if you enable all sound events as shown below, you'll also hear GTK sounds when moving around menus, buttons, etc, if the sound theme has sounds for those events.

To configure the theme name with gsettings, do as follows:

gsettings set org.gnome.desktop.sound theme-name name

If you'd like all sound types enabled:

gsettings set org.gnome.desktop.sound input-feedback-sounds true

gsettings set org.gnome.desktop.sound event-sounds true

To configure with a config file, edit or create ~/.config/gtk-3.0/settings.ini

[Settings]
gtk-enable-event-sounds=1
gtk-enable-input-feedback-sounds=1
gtk-sound-theme-name=name
gtk-modules=canberra-gtk-module

You can apply the same configuration to GTK2 apps. Create or edit ~/.gtkrc-2.0

gtk-enable-event-sounds=1
gtk-enable-input-feedback-sounds=1
gtk-sound-theme-name=name
gtk-modules=canberra-gtk-module

Usage:

• With no arguments, create the i3 configuration.
• -h: Help screen.
• -u: Copy over the latest version of scripts.
• -x: Generate ~/.xinitrc and ~/.xprofile.
• -X: Generate ~/.xprofile only.

Ratpoison Mode

I38 is an adaptation of the old Strychnine project which was based on the Ratpoison window manager. Ratpoison is a screen-like window manager, and the important concept from that, which applies to I38, is adding keyboard shortcuts without conflicting application shortcuts. This is done with an "escape key".

When creating I38, I really wanted to port that functionality over, because it is very powerful and allows for lots and lots of shortcuts while minimizing collisions between shortcuts. So, for example, if you have chosen brave as your web browser, and selected alt+escape as your ratpoison mode key, you can quickly launch brave by pressing alt+escape followed by the letter w.

AI Assistant

I38 includes an integrated AI assistant accessible through ratpoison mode with the 'a' key. The AI assistant provides accessibility-focused AI interaction with support for multiple providers:

Features

• Multiple AI Providers: Support for Claude Code and Ollama
• Voice Input & Output: Hands-free voice interaction with speech recognition and synthesis
• Wake Word Detection: Continuous listening mode with customizable wake phrases
• Contextual Questions: Ask questions about the currently focused window
• File Analysis: Share files with the AI for analysis
• Image Description: Take screenshots and get AI descriptions for accessibility
• Selected Text Analysis: Analyze selected text or screen content using OCR
• Action Confirmation: Optional confirmation dialogs for AI-suggested actions
• Keyboard Shortcuts: F4 for voice input, F5 for continuous listening toggle
• Accessibility First: Full screen reader compatibility with keyboard navigation

Usage

1. Press your ratpoison mode key (e.g., Alt+Escape)

2. Press 'a' to launch the AI assistant

3. Use Tab to navigate between the Interaction and Settings tabs

4. In the Interaction tab:

   • Enter your question in the text area
   • Use "Ask AI Question" for general queries
   • Use "Ask About Focused Window" to include window context
   • Use "Request AI Action" for step-by-step instructions
   • Use "Browse" to select files for analysis
   • Use "Describe Screenshot" for visual content
   • Use "Analyze Selected Text/Screen Content" to analyze selected text or perform OCR

5. Voice Mode (if enabled):

   • Press F4 or click "🎤 Voice Question" to speak your question
   • Toggle continuous listening with F5 or "👂 Continuous Listen"
   • Say your wake phrase (default: "hey assistant") when continuous listening is active
   • Responses are automatically spoken if voice output is enabled

Configuration

The AI assistant stores its configuration in ~/.config/stormux/I38/ai.conf using XDG directory standards. Settings include:

• AI provider selection (Claude Code or Ollama)
• Ollama model selection and host configuration
• Action confirmation preferences
• Voice input/output settings
• Wake word customization
• Voice recognition timeout settings

Providers

Claude Code: Requires the Claude Code CLI to be installed and authenticated. Supports text, code, and image analysis.

Ollama: Requires Ollama service to be running locally. Automatically discovers available models and supports text analysis.

Custom Applications in Ratpoison Mode

I38 now includes a powerful system for adding custom applications to ratpoison mode with user-defined keybindings. During the configuration process, after setting up window event sounds, you'll be prompted to add custom applications that will be accessible through ratpoison mode.

How It Works

The system will prompt you through a series of questions for each application you want to add:

1. Application Name: A descriptive name for the application
2. Execution Command: The full path or command to run the application
3. Command Flags: Optional command-line arguments
4. Keybinding: A custom key combination using I38's notation system

Keybinding Notation System

I38 uses a simple notation system to define keybindings that supports modifiers and special keys:

Modifiers

• ^ = Control (Ctrl)
• ! = Alt
• # = Super (Windows/Cmd key)
• m = Your chosen mod key (configured during setup)
• Uppercase letters automatically add Shift (e.g., C = Shift+c)

Special Keys

• Function Keys: f1, f2, ... f12
• Arrow Keys: up, down, left, right
• Navigation Keys: home, end, pageup, pagedown
• Editing Keys: insert, delete, backspace
• Other Keys: space, tab, return, escape, print

Example Keybindings

• c = Just the 'c' key
• ^c = Control+c
• !f1 = Alt+F1
• mspace = Your mod key + Space
• ^!up = Control+Alt+Up arrow
• #pagedown = Super+Page Down
• C = Shift+c
• ^C = Control+Shift+c

Example Configuration Session

Here's what the configuration prompts look like:

Enter application name (or press enter when finished): Discord
Enter execution path/command for Discord: discord
Enter command line flags for Discord (optional): --no-sandbox
Enter keybinding for Discord (Examples: c, ^c, !f1, mspace, ^!up) or ? for help: d

Another example:

Enter application name (or press enter when finished): Terminal Calculator
Enter execution path/command for Terminal Calculator: gnome-calculator
Enter command line flags for Terminal Calculator (optional): 
Enter keybinding for Terminal Calculator (Examples: c, ^c, !f1, mspace, ^!up) or ? for help: ^#c

Getting Help During Configuration

If you type ? when prompted for a keybinding, I38 will display a comprehensive help screen with:

• Complete modifier notation reference
• List of all supported special keys
• Multiple examples of different keybinding combinations
• Rules about uppercase letters and Shift

Conflict Detection

I38 automatically prevents keybinding conflicts by:

• Maintaining a list of all existing ratpoison mode bindings
• Checking your custom keybinding against reserved keys
• Showing an error message if you try to use a taken keybinding
• Asking you to choose a different key combination

Reserved Keybindings

The following keys are already used in ratpoison mode and cannot be assigned to custom applications:

• c = Terminal
• e = Text editor
• f = File manager
• w = Web browser
• k = Kill window
• m = Mumble (if installed)
• p = Pidgin (if installed)
• g = Game controller status
• Various modifier combinations for volume, music controls, etc.

Using Your Custom Applications

Once configured, access your custom applications by:

1. Press your ratpoison mode key (e.g., Alt+Escape)
2. Press your custom keybinding (e.g., d for Discord)
3. The application launches and ratpoison mode exits

Advanced Examples

Media Applications:

• vlc bound to v for VLC media player
• spotify bound to ^s for Spotify with Control+s

Development Tools:

• code bound to mf2 for VS Code with mod+F2
• gimp bound to !g for GIMP with Alt+g

System Tools:

• htop bound to ^#h for system monitor with Control+Super+h
• pavucontrol bound to !space for audio control with Alt+Space

Tips for Choosing Keybindings

1. Keep it memorable: Use the first letter of the application name when possible
2. Group related apps: Use similar modifiers for related applications
3. Consider frequency: Use simpler keys for frequently used applications
4. Avoid conflicts: The system will warn you, but plan ahead for a logical layout

Panel Mode

Very similar to ratpoison, accessed with Alt+Control+Tab. It contains items that would normally be found in a traditional desktop's panel. For example, it has a simple note app, system information, weather, bluetooth and power options, and remind.

I38 Help

To get help for I38, you can press the top level keybinding alt+shift+F1. It is also available by pressing the ratpoison mode key followed by question mark. A limitation of yad, which is used to display the help text means that the cursor starts at the bottom of the text. Please press control+home to jump to the top. You can navigate with the arrow keys, and use control+f to find text within the document.

The help text is a modified version of the configuration file itself that is intended to be easier to read. I have tried to add in comments that should also serve to make things more clear.