If we took material like rock from space and got it back to Earth enough times, would Earth grow as a planet?

As the title says. I'm actually thinking about this hard with my friends because everything that's produced on Earth stays on Earth so it doesn't change size, but what if it's not from Earth but it stays on Earth?