I2C between Trinkets and Mega not working

#include <TinyWireM.h>
#define SWITCH 3
#define LED 4
void setup()
{
  TinyWireM.begin();
  pinMode(LED, OUTPUT);
  pinMode(SWITCH, INPUT);
  digitalWrite(SWITCH, HIGH);
}

It's writing to the SWITCH instead of the LED.