Tested on QGIS 2.18
I can suggest using a "Virtual Layer"
through Layer > Add Layer > Add/Edit Virtual Layer...
Let's assume we have two layers, namely "lines_test"
and "polygons"
With using this query you may achieve the result you are looking for.
SELECT *
FROM polygons
WHERE polygons.id NOT IN (
SELECT polygons.id
FROM polygons, lines_test
WHERE ST_Within(ST_StartPoint(lines_test.geometry), polygons.geometry) OR ST_Within(ST_EndPoint(lines_test.geometry), polygons.geometry)
)
References: