Standalone LED Matrix + behavior (No PC intervention)

I want to make an 8×12 RGB LED Matrix, using either separate LEDS, LED strings (via DMX) or a low-res display. I learned I can do this with e.g. Arduino or Raspberry Pi, but most solutions I find online are with the intervention of a computer.

I want to make a standalone object; I don't want to incorporate complex image files but just control the behavior of LEDs using a joystick, and just the Arduino programming language if possible.

Is there anyone who has experience with LED-matrices, or Arduino-DMX conversion? Do you have any advice?

A little more context: afterwards I want to couple these actions to the play/stop of sounds (e.g. by communicating with another, mp3-compatible Arduino)