I claim the ornamental design for a display screen or portion thereof with graphical user interface, as shown and described.
The sole FIGURE is a front view of a display screen or portion thereof with graphical user interface, showing my new design.
The broken lines illustrating the display screen or portion thereof and the remainder of the graphical user interface form no part of the claimed design.