Questions tagged [duplication]
For questions related to creating, finding, or removing duplicate records or features.
119
questions
0
votes
0
answers
33
views
Merging multiple records into 1 record, group by field ‘group’
I have a point geometry file (GeoPackage) which I am working with in QGIS. It contains tens of thousands of records which discuss the topic 'Mineral occurrences'. Within this point file exist ...
- 29
1
vote
0
answers
56
views
Avoiding repeating labels with the same value in QGIS
I would like to know if is possible, maybe with some of the code, to avoid repeating labels of different elements of my layer if these have the same value.
I have attached this example:
These are two ...
- 85
4
votes
1
answer
76
views
Deleting NULL geometries and duplicate nodes from table using PostGIS
I run the command to delete null geometry from a table:
delete from table where geom is null
And delete duplicate nodes by running the command:
update table set geom = ST_Multi(ST_Simplify(geom,0));
...
- 71
1
vote
1
answer
58
views
Duplicating certain features based on symbol in QGIS Attribute table
In QGIS 3.28.8 I have downloaded the data for power lines in different parts of Germany from OSM. Some of these lines and cables have different voltages (see below). I can filter those with several ...
- 51
0
votes
0
answers
72
views
How can I consolidate / deduplicate processed AIS data from different stations?
Context
I have received processed AIS data from different AIS receiver stations from which I need to construct trajectories for each vessel. The data has the following columns:
timestamp
vessel ID
...
4
votes
2
answers
108
views
Duplicating rows according to field values in QGIS
I have a table in a GeoPackage like this
field1 field2
a;b 1
a;b 2
c;d 3
a;d;e 4
a 5
...
What I need is to create a new table in which the records are ...
- 1,059
4
votes
1
answer
64
views
Grouping features with identical values in two fields and deleteing the geometry with the lowest value in the third field using QGIS
I've got a shapefile with three fields: "X", "Y" and "Z" they are the geometries as well but I also have them as field values.
Every line geometry in the shapefile has a ...
- 41
0
votes
1
answer
37
views
Google My Maps visualization doesn't correspond to edit mode
I have created a Google My Maps project with only two layers: one of them is made by points representing schools and the other one is made by lines representing rivers. Some schools, however are ...
- 394
3
votes
1
answer
49
views
Avoiding label identical attributes on duplicate geometries in QGIS
The following expression is used to label duplicate geometries avoiding text overlap:
array_to_string(
array_prepend(
overlay_equals('POINT_LABEL',VALUETEXT),
"VALUETEXT"
...
- 899
0
votes
0
answers
76
views
OL6.3.1 : duplicate features displayed on a map
Despite many posts read here, I can't find a solution to avoid duplicate features in my map.
The url is a WFS from Mapserver based on a PostGis view with an unique gid field.
All the geometries are ...
- 1,194
5
votes
3
answers
201
views
Hiding duplicates from dropdown when using value relation in QGIS Form
I've got a vector layer with a QGIS Form and the column "test" in the attribute table. I have values for the columns e.g: abc, abc, abcd.
I defined a form for this Layer. The type for the ...
- 652
5
votes
1
answer
212
views
Aggregating features values based on name attribute and geometry in QGIS
In QGIS 3.28.1 I have a map with many points (it does not contain polygons and lines), and there are some duplicate points on top of each other in the same geographic location, and I would like to ...
1
vote
0
answers
52
views
How to only check intersection once using PyQGIS
If I've two polygons a and b. If a intersects b, then there is no need to check if b intersects a. How do I check this with the PyQGIS API to ensure I'm not getting duplicate features in my output ...
- 650
1
vote
0
answers
215
views
Get rid of duplicate polygons using OpenLayers
OpenLayers 6, Mapserver 7
I have defined a vector source like this :
const presc = new ol.source.Vector({
format: new ol.format.GeoJSON(),
loader: function(extent, resolution, projection, success,...
- 1,194
1
vote
1
answer
486
views
How do I select features with the same values but different IDs from a layer's attribute table in QGIS?
I have a multipolygon layer with several regions (green circles) that are identified through numerical fids. Within each region are multiple points (orange dots) with individual pointIDs. See example ...
user204024
2
votes
3
answers
183
views
Extract duplicate points
I'd like to know how to extract duplicate points (geometrically overlapped) of a point layer, using field calculator of QGIS.
I can extract one or both the duplicates points, is indifferent. Any ...
- 935
4
votes
2
answers
231
views
Finding duplicates in field depending on another field's values using PyQGIS
I need to identify/select/print the duplicate values in a field depending on the values of another one.
Example:
Field1
Field2
100
1
100
2
200
1
200
2
200
3
200
2
300
1
300
2
300
3
300
4
...
- 516
0
votes
0
answers
145
views
Group By functionality after AddJoin using ArcPy with ArcGIS Pro
I'm making a Python script using ArcPy for ArcGIS Pro and I have joined a Feature Class and a Table View to create a new feature class. All of the fields and rows I need are present, however there are ...
- 1
3
votes
1
answer
391
views
Duplicate layer in QGIS (change data in base-layer does not change data in copy?)
I was wondering for a time what Duplicate a layer in QGIS actually does. Reading this question: Duplicating layers in QGIS 3.4
I was assuming that when duplicating a layer I could style each ...
- 1,121
3
votes
2
answers
5k
views
Removing duplicates from the Attribute table by expression in QGIS
I have some duplicates in my data attribute table, you can see below:
I used the following formula:
count(1, "Site ID") > 1
based on this question: Identifying duplicate attributes in ...
- 4,005
6
votes
1
answer
215
views
Creating duplicate points as many times as it overlap with polygons in QGIS
Let's assume there two layers, see image below
a point layer 'random_points_test' with 10 features
a polygon layer 'test' with three features
I am trying to modify the number of features in the ...
- 31.4k
1
vote
1
answer
110
views
Polygons with same geometry and bbox but can't be aggregated with GROUP BY
I'm trying to create a constraint unique on a geometry column to avoid duplicate ones, following https://dba.stackexchange.com/questions/299098/why-doesnt-my-unique-constraint-trigger/299107#299107
...
- 1,194
5
votes
1
answer
166
views
Why highlighting duplicates does not work in QGIS?
I have used the formula from this query Identifying duplicate attributes in field using QGIS:
count(1, "FieldWithDuplicates") > 1
but it doesn't work in my case, just highlights each ...
- 4,005
6
votes
1
answer
151
views
Selecting duplicate records except the first and last duplicate with Select by expression in QGIS
I'd like to know how to select duplicate records except the first and last one, with the "Select by attribute/expression". On GIS SE I found a solution for selecting duplicates except the ...
3
votes
0
answers
82
views
IDs are being duplicated between different instances of QGIS
Is there a way to create a secondary ID that cannot be duplicated?
Currently using 1 project between multiple instances of QGIS, this is resulting in this secondary field being duplicated which is ...
- 31
2
votes
0
answers
525
views
Duplicating layer properties in ArcGIS Online
I'm very new to ArcGIS. I was wondering if there is a way to duplicate layer properties (drawing style/legend and pop-ups) to another layer. I was thinking, maybe duplicating the layer, then changing ...
- 21
0
votes
1
answer
77
views
Deleting duplicate features with ArcPy based on multiple attributes
I want to write Python code that removes duplicate features from a table based on their attribute value. Within the code, a loop will iterate through multiple attributes to check if the value is Null. ...
1
vote
1
answer
244
views
Removing slightly different overlapping geometries in QGIS/SQL
I am working on a large map in QGIS that is using 40' wide street approximations to visualize a small city. The data is also held on an SQL server that I have access to. I am taking over the work from ...
- 11
0
votes
0
answers
26
views
Attribute form defaults: How to take over the settings directly when duplicating the layer (and not afterwards by copy-paste-styles)
I have a point-shapefile-layer with attribute form defaults for some fields, QGIS 3.16 (see image, red marks). If I now duplicate the layer (by exporting or by duplicating) these attribute form ...
- 487
8
votes
3
answers
700
views
Redistributing duplicated points inside the polygon
I have a point layer with real estate data, obtained after geocoding by addresses. In case of multi apartment housing all points with data for several apartments in one building has identical ...
- 535
2
votes
1
answer
283
views
Find and delete duplicate rows in matrix in QGIS 3.6
I used the OD Matrix to produce a list of the distances between all sites to all other sites via a network. This process produces duplicates, since it makes calculations in both directions, i.e., from ...
- 87
3
votes
1
answer
351
views
Removing duplicate features in QGIS based on two conditions
I have duplicates (maybe triplicates) in an attribute table and would like to remove the duplicate locations based on comparison to the other duplicate. For example:
Scenario 1:
I would like to ...
- 831
2
votes
1
answer
63
views
Duplicates Not Highlighted
Actually I am using Geometry Generator and a small script for displaying duplicate values in the data. But some duplications are not highlighted. Don't know why its happening. can any one suggest any ...
- 839
1
vote
1
answer
116
views
Intersect without duplication (QGIS)
In QGIS 3.16, I have a layer of polygons corresponding to particular ecological habitat zones. I'd like to perform a series of intersections in order to add information to each polygon as to where it ...
- 1,061
4
votes
1
answer
94
views
Automate the selection of duplicate geometries with QGIS3
I have a layer of buffers calculated from watercourses. Each watercourse/buffer has a Strahler Order (0 to 7).
I need to delete overlaps between buffers order 0 and buffers order 1 to start, but ...
- 723
3
votes
1
answer
219
views
Adding duplicate labels within polygon in QGIS
Is there a way to include multiple duplicates of the same label within a single polygon in QGIS?
So a single polygon(s) with a label from a single field, repeated at a set distance within the polygon -...
- 41
2
votes
2
answers
227
views
Duplicating data for use in new ArcMap project
I am using ArcMap 10.8.1.
I wanted to make a new project based on the same data as an existing project, so I duplicated the project file and started editing one of the layers in Editor Mode. I then ...
- 23
1
vote
1
answer
767
views
Deleting duplicate polygon using QGIS
I am using QGIS "Delete Duplicate Geometries" tool, I am trying to delete one of the below two polygons , but failed.
The below two polygons are identical with vertices , but the start of ...
- 11
8
votes
1
answer
262
views
Identifying duplicate geometries in different layers with QGIS
I'm using QGIS 3.16 Hannover under MacOS 10.13 environment. I've got two polygon shapefile layers: 'LIC' and 'ZEPA'. Some polygons (name, code & geometry) are present in both layers and I want to ...
- 3,180
1
vote
2
answers
191
views
Deleting data by location using another shapefile
I have two shapefiles: one is main file and another is a part divided (manually by selecting) from the main file.
Now i want to delete the divided part from the main file with the help of divided part....
- 839
2
votes
0
answers
117
views
Tippecanoe vector tiles duplicating over certain graticules (equator, -90)
I have large geojsons at different scales that I have converted to tiles with tippecanoe. My ultimate goal is for a user to be able to draw a box around the tiles and calculate mean attribute values ...
- 1,842
1
vote
1
answer
183
views
Highlight duplicates at nearest distance
I have a point shapefile with several names and there are a lot of duplicate names in the data.
I want to highlight the nearest duplicates in the data.
How can I solve that in QGIS?
- 839
1
vote
0
answers
101
views
Nearest unique duplicate points
How can I highlight nearest(certain distance) unique duplicates? Actually I tried a process in ArcGIS but only duplicates are pulled out from the entire file without considering distance. How can I do ...
- 11
5
votes
3
answers
867
views
Eliminating duplicates only if data is the same according to attributes
Having duplications in the data is quite natural and removing them is quite hard if we didn't have the same attributes.
In QGIS there are tools to eliminate the duplications but only if the data is ...
0
votes
1
answer
66
views
How to specify from which file duplicates should be deleted after appending two datasets
I am using python script and ArcGIS Desktop 10.8.1 to synchronize two datasets. There are many (thousands) of duplicate features that I would like to drop in an output. How can I specify that, in the ...
- 133
2
votes
1
answer
1k
views
Leaflet: mutually exclusive overlay layers: "overlayadd" event firing twice
LeafletJS. I am trying to have two overlay layers be mutually exclusive. Full example here on jsfiddle
I guess it comes down to this bit of code:
map.on('overlayadd', function(event)
{
...
- 23
0
votes
1
answer
97
views
Snapshot live feed featurelayer by creating a copy of the data in ArcGIS
Let's say we have a feature layer on ArcGIS online that is constantly updated. Examples would be the Recent Conditions in Air Quality (PM2.5), Satellite (VIIRS) Thermal Hotspots and Fire Activity, or ...
- 478
4
votes
1
answer
458
views
Removing intersect or overlap of points in the same vector layer
Is there anyway to remove the intercept part of the vector points?
P.S. Please ignore the red circle, it's not a polygon, it is a hand drawn by me to show the error part
So far I've done: "...
- 137
3
votes
1
answer
263
views
Selecting duplicates records except one in QGIS
I'd like to know how to select duplicates records except one, with the "Select by attribute".
I've attached a picture to explain better the output needed.
- 935
2
votes
1
answer
3k
views
Removing duplicate points in GeoPandas using distance and time
I have a list of of coordinates that have areas mapped out on a map
user_id id latitude longitude requested_at
84 106 13.0472367 77.5022635 12-10-2020 14:59
84 107 13.0472789 77.5024498 ...
- 115