the cost in doing that is that you lose access to the great wealth of Arduino libraries written by third parties, many/most of which rely on the "wiring" Arduino core libs to some degree.
So, keep using the core library. Everything needed to compile without the IDE is included with the IDE.