I am running A View that INSERTS into #Temp Table
A view can't insert anything anywhere...
In any case, with the miniscule information you have given, it is very difficult to say anything with certainty. But the most likely explanation is that you get different query plans at different occasions. Recall that the optimizer works with
statistics that is sampled from the data and from this it makes an
estimate of which is the best plan. This is anything but a deterministic process. Even less if the query has "problems" or there are not suitable indexes available.
There could be other reasons as well, as blocking, resource contention etc.
As a start you could post the query, so that we know what you are talking about. For the view, we need to see the view definition - as well as definition of any nested views. Most likely, we will ask for more information, but we start there.