Questions tagged [duplication]

For questions related to creating, finding, or removing duplicate records or features.

Filter by
Sorted by
Tagged with
4 votes
2 answers
97 views

Finding duplicates in field depending on another field's values using PyQGIS

I need to identify/select/print the duplicate values in a field depending on the values of another one. Example: Field1 Field2 100 1 100 2 200 1 200 2 200 3 200 2 300 1 300 2 300 3 300 4 ...
user avatar
  • 304
0 votes
0 answers
16 views

Group By functionality after AddJoin using ArcPy with ArcGIS Pro

I'm making a Python script using ArcPy for ArcGIS Pro and I have joined a Feature Class and a Table View to create a new feature class. All of the fields and rows I need are present, however there are ...
user avatar
  • 1
2 votes
1 answer
76 views

Duplicate layer in QGIS (change data in base-layer does not change data in copy?)

I was wondering for a time what Duplicate a layer in QGIS actually does. Reading this question: Duplicating layers in QGIS 3.4 I was assuming that when duplicating a layer I could style each ...
user avatar
  • 685
2 votes
2 answers
151 views

Removing duplicates from data attribute table by expression in QGIS

I have some duplicates in my data attribute table like you can see below: I used the following formula count(1, "Site ID") > 1 based on this question: Identifying duplicate attributes ...
user avatar
  • 3,554
6 votes
1 answer
79 views

Creating duplicate points as many times as it overlap with polygons in QGIS

Let's assume there two layers, see image below a point layer 'random_points_test' with 10 features a polygon layer 'test' with three features I am trying to modify the number of features in the ...
user avatar
  • 24k
1 vote
1 answer
41 views

Polygons with same geometry and bbox but can't be aggregated with GROUP BY

I'm trying to create a constraint unique on a geometry column to avoid duplicate ones, following https://dba.stackexchange.com/questions/299098/why-doesnt-my-unique-constraint-trigger/299107#299107 ...
user avatar
  • 1,045
5 votes
1 answer
116 views

Why highlighting duplicates does not work in QGIS?

I have used the formula from this query Identifying duplicate attributes in field using QGIS: count(1, "FieldWithDuplicates") > 1 but it doesn't work in my case, just highlights each ...
user avatar
  • 3,554
6 votes
1 answer
88 views

Selecting duplicate records except the first and last duplicate with Select by expression in QGIS

I'd like to know how to select duplicate records except the first and last one, with the "Select by attribute/expression". On GIS SE I found a solution for selecting duplicates except the ...
user avatar
3 votes
0 answers
62 views

IDs are being duplicated between different instances of QGIS

Is there a way to create a secondary ID that cannot be duplicated? Currently using 1 project between multiple instances of QGIS, this is resulting in this secondary field being duplicated which is ...
user avatar
  • 31
2 votes
0 answers
22 views

Duplicating layer properties in ArcGIS Online

I'm very new to ArcGIS. I was wondering if there is a way to duplicate layer properties (drawing style/legend and pop-ups) to another layer. I was thinking, maybe duplicating the layer, then changing ...
user avatar
  • 21
0 votes
1 answer
47 views

Deleting duplicate features with ArcPy based on multiple attributes

I want to write Python code that removes duplicate features from a table based on their attribute value. Within the code, a loop will iterate through multiple attributes to check if the value is Null. ...
user avatar
1 vote
1 answer
87 views

Removing slightly different overlapping geometries in QGIS/SQL

I am working on a large map in QGIS that is using 40' wide street approximations to visualize a small city. The data is also held on an SQL server that I have access to. I am taking over the work from ...
user avatar
0 votes
0 answers
19 views

Attribute form defaults: How to take over the settings directly when duplicating the layer (and not afterwards by copy-paste-styles)

I have a point-shapefile-layer with attribute form defaults for some fields, QGIS 3.16 (see image, red marks). If I now duplicate the layer (by exporting or by duplicating) these attribute form ...
user avatar
  • 447
8 votes
3 answers
374 views

Redistributing duplicated points inside the polygon

I have a point layer with real estate data, obtained after geocoding by addresses. In case of multi apartment housing all points with data for several apartments in one building has identical ...
user avatar
  • 505
2 votes
1 answer
168 views

Find and delete duplicate rows in matrix in QGIS 3.6

I used the OD Matrix to produce a list of the distances between all sites to all other sites via a network. This process produces duplicates, since it makes calculations in both directions, i.e., from ...
user avatar
3 votes
1 answer
131 views

Removing duplicate features in QGIS based on two conditions

I have duplicates (maybe triplicates) in an attribute table and would like to remove the duplicate locations based on comparison to the other duplicate. For example: Scenario 1: I would like to ...
user avatar
  • 203
2 votes
1 answer
54 views

Duplicates Not Highlighted

Actually I am using Geometry Generator and a small script for displaying duplicate values in the data. But some duplications are not highlighted. Don't know why its happening. can any one suggest any ...
user avatar
  • 259
1 vote
1 answer
58 views

Intersect without duplication (QGIS)

In QGIS 3.16, I have a layer of polygons corresponding to particular ecological habitat zones. I'd like to perform a series of intersections in order to add information to each polygon as to where it ...
user avatar
  • 1,001
4 votes
1 answer
67 views

Automate the selection of duplicate geometries with QGIS3

I have a layer of buffers calculated from watercourses. Each watercourse/buffer has a Strahler Order (0 to 7). I need to delete overlaps between buffers order 0 and buffers order 1 to start, but ...
user avatar
3 votes
1 answer
121 views

Adding duplicate labels within polygon in QGIS

Is there a way to include multiple duplicates of the same label within a single polygon in QGIS? So a single polygon(s) with a label from a single field, repeated at a set distance within the polygon -...
user avatar
2 votes
2 answers
102 views

Duplicating data for use in new ArcMap project

I am using ArcMap 10.8.1. I wanted to make a new project based on the same data as an existing project, so I duplicated the project file and started editing one of the layers in Editor Mode. I then ...
user avatar
  • 23
1 vote
1 answer
166 views

Deleting duplicate polygon using QGIS

I am using QGIS "Delete Duplicate Geometries" tool, I am trying to delete one of the below two polygons , but failed. The below two polygons are identical with vertices , but the start of ...
user avatar
8 votes
1 answer
175 views

Identifying duplicate geometries in different layers with QGIS

I'm using QGIS 3.16 Hannover under MacOS 10.13 environment. I've got two polygon shapefile layers: 'LIC' and 'ZEPA'. Some polygons (name, code & geometry) are present in both layers and I want to ...
user avatar
  • 2,283
1 vote
2 answers
44 views

Deleting data by location using another shapefile

I have two shapefiles: one is main file and another is a part divided (manually by selecting) from the main file. Now i want to delete the divided part from the main file with the help of divided part....
user avatar
  • 259
2 votes
0 answers
67 views

Tippecanoe vector tiles duplicating over certain graticules (equator, -90)

I have large geojsons at different scales that I have converted to tiles with tippecanoe. My ultimate goal is for a user to be able to draw a box around the tiles and calculate mean attribute values ...
user avatar
  • 1,764
1 vote
1 answer
112 views

Highlight duplicates at nearest distance

I have a point shapefile with several names and there are a lot of duplicate names in the data. I want to highlight the nearest duplicates in the data. How can I solve that in QGIS?
user avatar
  • 259
1 vote
0 answers
61 views

Nearest unique duplicate points

How can I highlight nearest(certain distance) unique duplicates? Actually I tried a process in ArcGIS but only duplicates are pulled out from the entire file without considering distance. How can I do ...
user avatar
  • 11
5 votes
3 answers
494 views

Eliminating duplicates only if data is the same according to attributes

Having duplications in the data is quite natural and removing them is quite hard if we didn't have the same attributes. In QGIS there are tools to eliminate the duplications but only if the data is ...
user avatar
0 votes
1 answer
41 views

How to specify from which file duplicates should be deleted after appending two datasets

I am using python script and ArcGIS Desktop 10.8.1 to synchronize two datasets. There are many (thousands) of duplicate features that I would like to drop in an output. How can I specify that, in the ...
user avatar
  • 133
2 votes
1 answer
452 views

Leaflet: mutually exclusive overlay layers: "overlayadd" event firing twice

LeafletJS. I am trying to have two overlay layers be mutually exclusive. Full example here on jsfiddle I guess it comes down to this bit of code: map.on('overlayadd', function(event) { ...
user avatar
  • 23
0 votes
1 answer
49 views

Snapshot live feed featurelayer by creating a copy of the data in ArcGIS

Let's say we have a feature layer on ArcGIS online that is constantly updated. Examples would be the Recent Conditions in Air Quality (PM2.5), Satellite (VIIRS) Thermal Hotspots and Fire Activity, or ...
user avatar
4 votes
1 answer
230 views

Removing intersect or overlap of points in the same vector layer

Is there anyway to remove the intercept part of the vector points? P.S. Please ignore the red circle, it's not a polygon, it is a hand drawn by me to show the error part So far I've done: "...
user avatar
3 votes
1 answer
121 views

Selecting duplicates records except one in QGIS

I'd like to know how to select duplicates records except one, with the "Select by attribute". I've attached a picture to explain better the output needed.
user avatar
  • 661
2 votes
1 answer
2k views

Removing duplicate points in GeoPandas using distance and time

I have a list of of coordinates that have areas mapped out on a map user_id id latitude longitude requested_at 84 106 13.0472367 77.5022635 12-10-2020 14:59 84 107 13.0472789 77.5024498 ...
user avatar
  • 93
3 votes
2 answers
629 views

PostGIS - identify duplicate points from polygons/linestrings?

I'm trying to identify polygons/linestrings with duplicate points, using PostGIS. I just want to tell whether the geometry has duplicate points, not remove the extra point. I know there is ...
user avatar
2 votes
1 answer
38 views

Find same names (duplicates) in one field using another feature class field

I have 2 tables (UML, PalmOil) and I would like to check record by record within PalmOil, if there are duplicates intersecting NameUMLwith NamePalmOil UML ID | NameUML | 1 NAME1 2 NAME2 3 ...
user avatar
  • 125
6 votes
1 answer
600 views

Delete duplicate points in QGIS

How to delete duplicate points in QGIS (3.14)? I insert a layer into the project. The layer contains several objects (61 points), some of which are duplicates. In the menu I select "Vector" &...
user avatar
  • 61
2 votes
0 answers
624 views

Select duplicates by attributes in QGIS

I selected my duplicates in my attribute table by Count(1,"ID")>1. Now I just only want to keep the duplicates with the highest areas. Is there a way to directly select them or a work ...
user avatar
  • 171
1 vote
0 answers
34 views

Duplicating Layers to new, independent layers in QGIS 3

I am currently working on a rough freight railway station planning project in QGIS 3 and it's output should be different "alternatives" (as layer groups) with different layers to each. For ...
user avatar
  • 11
2 votes
1 answer
254 views

Merge nearby points from two shapefiles in QGIS

I am working with 2 shapefiles: points from one datasource and another. Some of the features are duplicates. However, since data quality in the second datasource is not as good as in the first one, ...
user avatar
  • 117
0 votes
1 answer
64 views

How to create multiple graduated layers using different attributes/columns? [duplicate]

I have a shapefile for which I'd like to create multiple graduated layers for each attribute/column. At present, I manually duplicate the layer and then change the column from the drop down list, ...
user avatar
  • 21
4 votes
1 answer
293 views

Duplicating of QgsLayoutItemGroup with PyQGIS

I want to programmatically add a header and a footer as I use atlas with multipages for one feature but I can't predict the number of pages for the table depending on the feature. In order to add the ...
user avatar
  • 28.7k
2 votes
1 answer
150 views

PostGIS: Finding duplicate label within a radius

I have data in PostGIS that have value and geometry. If there is a same value within let's say <10 m, I want to detect or remove that value from my table. Here is the small example: create table ...
user avatar
1 vote
2 answers
287 views

Deleting duplicate points from two different layers

I have two layers with the same feature ("Object ID") and same location All lightning strikes Cloud strikes I want to delete the 'Cloud strikes' that are still to be found in the 'All lightning ...
user avatar
  • 796
2 votes
0 answers
40 views

How do you link QGIS legends in different print composers?

I have a long linear QGIS project with about 20 separate print composer layouts. I'd like to link each legend to the original one, so I don't have to copy and paste 20 times every time I need to ...
user avatar
3 votes
2 answers
246 views

Remove duplicate labels for parallel line features in QGIS 3

I've been really struggling to get my highways to label neatly. The idea is to have one route number label every 1 km on the route. The only issue is that there are duplicate separated carriageways ...
user avatar
1 vote
0 answers
61 views

Separating 50 duplicate points by limit in buffer zone using QGIS

I am building a customer database in QGIS. I get GPS coordinates for customers from my staff. Then I convert those GPS coordinates into shapefile points in QGIS. I get a lot of duplicate points. I am ...
user avatar
  • 111
1 vote
1 answer
66 views

Combine duplicate rows but keep class information?

I'm stuck trying to figure out how to avoid combining and deleting duplicate values manually. I'm working with parcel data, and based on some property information, each parcel is either in group a, b, ...
user avatar
  • 13
0 votes
0 answers
107 views

Remove duplicate polygons in a single layer using ogr2ogr? [duplicate]

I have a spatialite database file containing buildings within a country as multipolygons. While trying to use QGIS to delete these duplicate features, QGIS keeps on crashing due to the millions of ...
user avatar
  • 892
1 vote
0 answers
128 views

Proper identification of duplicates using spatial and temporal criteria in PostGIS

I have a table with metadata about sampling locations in the ocean. It includes geographic coordinates, date-time in which sampling was done the number of vertical measurements in each location (...
user avatar
  • 21