Christian Eriksen implored Manchester United to become more ruthless after racking up three consecutive victories for the first time in 18 months.
Jadon Sancho's 23rd-minute goal was enough to consign Leicester City to a fourth straight defeat and lift United up to fifth in the Premier League.
Eriksen believes that Erik ten Hag's side still have room for improvement despite the upturn in form.
'I think it was similar to Southampton at the weekend - we did very well until we scored,' Eriksen said. 'We have to keep the momentum, we have to kill the game early otherwise it will be a tight game until the end like today.
'We are winning 1-0, we keep it tight. Obviously we want to do better but I think this is a good start. We can take something from this.
'I think from the start we had, we had a lot of things we needed to change. We've done that by winning. It hasn't been beautiful for 90 minutes but we have three wins.'
Brendan Rodgers finally managed to bring in an outfield player on Thursday with the £15million arrival of centre back Wout Faes from Reims but could not hide his frustration at a 'challenging' transfer window, with the Foxes bottom of the pile.
'With the greatest respect, we have not had the help in the transfer market that this team has needed,' Rodgers said.
'We just lack quality and we weren't able to do anything about that in the window. There were enquiries for (Harvey) Barnes and (James) Maddison early in the window. We couldn't lose too many. We were low in terms of depth and quality. Thankfully, they are still here. We needed two centre-halves ideally.'
Leicester were booed off by their supporters and Rodgers added: 'This isn't the club that it was two years ago. That's the reality. We haven't brought any new players in, bar one late on, in the last two windows and that's a replacement. So these players need the supporters. It's a moment that's really important.'
Ten Hag believes it is 'too quick' to suggest that United have turned a corner but praised Sancho's improvement over the summer.
'We should've been up 2-0,' Ten Hag said. 'There was so much space on the pitch. We had opportunities and we have to take them.
'I think Jadon had quite a good pre-season, he has to invest in the physical side and that is what he did.
'Now he can get the reward and I'm sure it's the start for him with his potential.
'There's much more room for improvement, he can be even more important and create with his creativity and with the defending part he can be even more important.'