Screen Poking describes techniques that generate mouse and keyboard events to control PC applications through other means. You can generate these on a software level (see JavaRobots), or by connecting hardware that identifies itself to your computer as a mouse/keyboard, or by taking actual mice and keyboards apart and connecting them to your own custom electronics. One of the advantages of screen poking is that you don't have to have any kind of API or source code access to the application you want to control. Disadvantages: brittle, and semantics are not clear from your automation code itself.

• Electronics hardware that generates key presses:
  • Ultimarc iPac PS/2 or USB connection (tested)
  • GroovyGameGear KeyWiz PS/2 Connection (not tested)
  • more at the build your own arcade controls wiki
  • Hack a USB keyboard: Attach your own switches to a salvaged keyboard controller
  • Take a real keyboard and actuate its switches mechanically

• Electronics hardware that generates mouse events:
  • GroovyGameGear OptiWiz (not tested)
  • More at the BYOAC wiki
  • Hack a mouse yourself

• Electronics hardware that generates game controller events
  • GroovyGameGear GPWiz (tested)

• Software that generates key and mouse events:
  • see GUI Automation
  • and Web Browser Automation