The ornamental design for a displayscreen or portion thereof with icon set, as shown and described.
The FIGURE is a front view of a display screen or portion thereof with icon set showing our new design.
The broken lines in the FIGURE depicts a display screen or portion thereof and forms no part of the claimed design.
The icon set is arranged relatively on the drawing sheet for the convenience of display and the relative positioning of the icons forms no part of the claimed design.