Questions tagged [duplication]

For questions related to creating, finding, or removing duplicate records or features.

Filter by
Sorted by
Tagged with
0
votes
0answers
19 views

Remove duplicate polygons in a single layer using ogr2ogr? [duplicate]

I have a spatialite database file containing buildings within a country as multipolygons. While trying to use QGIS to delete these duplicate features, QGIS keeps on crashing due to the millions of ...
1
vote
0answers
107 views

Proper identification of duplicates using spatial and temporal criteria in PostGIS

I have a table with metadata about sampling locations in the ocean. It includes geographic coordinates, date-time in which sampling was done the number of vertical measurements in each location (...
1
vote
0answers
70 views

QGIS Duplicate Labels still appearing despite suggested changes. Do i need to do an expression?

I have one field called Streets. In Streets there are road beds with suffix as Pkwy, Street, Avenue, Expressway and so on. I also want to label some of these road beds. In Layer styling under ...
2
votes
2answers
76 views

Duplicate points and bounding box in PyQGIS?

I am trying to find all points in a vector layer that do not have a duplicate point. To do this, for each point I create a list of features that intersect its bounding box ('candidates') then check ...
1
vote
1answer
35 views

Has anyone experienced duplication issues when exporting large datasets to .CSV on ArcGIS Pro?

I am working with a shapefile in ArcGIS Pro that has 3.2 million observations and about 20 columns. The .shp file is 87MB and the .dbf is just over 2GB. I am attempting to accomplish an export. ...
0
votes
1answer
58 views

Over calculation of area- How do I calculate correct acreage when there are stacked parcels?

I am currently interning for a county in the United States. I am working on the data and mapping needed to fulfill the Open Space Activity of CRS. Stacked parcels are causing me a massive headache. ...
1
vote
1answer
29 views

How to create a new layer with specific data from a large data base of irrelevant data?

I am a complete beginner to QGIS. I am trying to isolate an individual set of data from a very large data base to plot in another layer. I have isolated the piece of data by using the Selection by ...
1
vote
0answers
34 views

Duplicate Records on AGOL

I recently uploaded to AGOL a feature service layer with a relationship table (many to many). While configuring the layer, I found out that for some reason the table counts more records than what ...
4
votes
1answer
47 views

increment column value with an integer when it is a duplicate

I have a layer with around 1000 lines. Some Name are repeated several times and I wish to have every name unique. Thus I try in the field calculator to add an integer at the end of the name only when ...
0
votes
1answer
229 views

Removing duplicate rows created by ST_Intersects in PostGIS?

I want to basically take one spatial table of polygons and determine if any of the polygons interest with another table of polygons and save the results in a new table with a new column saving the ...
3
votes
1answer
66 views

Offsetting Atlas Generated Maps

My aim is to generate maps of polling stations to helps electors find their local polling stations for elections in 2019 and onwards. I've plotted and labelled 80 polling stations on a 'Polling ...
1
vote
0answers
60 views

Distinguishing two streets with the same name?

I am trying to get road data using the Overpass API. I want a user to be able to find a street using its name then retrieve the data for the nodes to draw a line on the map. This is all fine using: [...
1
vote
0answers
179 views

Removing duplicate highway shield symbol labels from ArcMap document

I have highway shield symbols in my map document that are showing duplicate labels in the current map view. When I go to the Properties of the roads layer, then Labels, then Placement Properties and ...
3
votes
0answers
249 views

Dealing with duplicate locations kriging - a method for replacing with a single location taking the mean of the duplicates? (R)

I understand that the existence of duplicate points (locations) when Kriging will result in a singular covariance matrix. The only way I've encountered people dealing with this is to keep the first of ...
3
votes
2answers
79 views

Duplicated Features in point layer

I have duplicated features in point layer (Land Marks) but these duplicate has 2 cases : they might be not all have their center above each other (some have it at center , some is a bit far but its ...
2
votes
1answer
202 views

Delete duplicate features with identic geometry based on attribute with QGIS

I have a vector layer containing landmark buildings in Stockholm. Each landmark building consists out of several features with the same KOM_ID but with different Z-values. When rasterizing this shape ...
5
votes
2answers
1k views

Deleting duplicate points except those with different attributes in QGIS?

I have a question regarding removal of duplicate points, which I did not find answered here yet. In my point shapefile there are some points at the same coordinates. Some of them have the exact same ...
1
vote
1answer
27 views

Creating duplicate records based on overlapping polygons

I have a shapefile of all the counties in one state, I also have a shapefile of a grid map dividing the entire state into 1-mile grids. I need to come up with a list of which grids are in which county,...
2
votes
3answers
125 views

Deselecting original feature from selection of both original and duplicate features?

I have a field which is supposed to hold a unique identifier, however due to issues with Attribute Assistant I have multiple features which have the same unique ID. I want to write a script which will ...
4
votes
1answer
278 views

Deleting duplicate records in the attribute table and keep the minimum value in PyQGIS?

I have two fields: ID_PARCEL and NL. The ID_PARCEL is the field that contains duplicate records. I would like to remove the duplicate record by keeping the minimum NL field value. For example: the ...
2
votes
1answer
137 views

Select all fields from table and use with arcpy.DeleteIdentical_management()?

I would like to use arcpy.DeleteIdentical_management() function without having to specify all fields in the table. Is there a keyword used to select all field in a table? I tried "*" or "ALL" but ...
3
votes
1answer
109 views

PyQGIS Finding duplicates across multiple columns

I have a table with three columns that I'm interested in: X, Y and rotate. These specify the position and angle of a symbol. I want to find duplicates across these columns, so anything with the same X,...
3
votes
1answer
823 views

Identify duplicate attributes (followup)

I am processing a large map with several hundred thousand building polygons in QGIS 2.18. Unfortunately I had to puzzle this map together from several smaller and overlapping pieces and so quite a few ...
1
vote
1answer
346 views

How to duplicate features based on attribute value pyshp?

I have a shapefile in which there are a series of polygons that I have to attribute to the name of a project which are recorded in 6 attribute fields. For each polygon there might be one to 6 ...
4
votes
1answer
165 views

manage qgis rule based styling duplicates

I am new to qgis. When I am using rule based styling, duplicates for some reason show all the matching symbols and not only the first match rule's symbol. How do I make show only one symbol even if it ...
3
votes
2answers
734 views

How to select duplicate records based on multiple fields?

I have a feature class with two fields of interest: "name" and "identifier" (Original Data; Figure 1). Note that there are several duplicate rows in the table and the table may or may not be sorted, ...
2
votes
1answer
226 views

WFS consumed in QGIS generates duplicate features

Problem: When some of my layers are published by Geoserver 2.8.0 and added as WFS layer in QGIS 2.16.0 some of the data are duplicated. The duplicated data do not have geometry. I have observed this ...
5
votes
2answers
233 views

substitue raster values duplicate error

I have a raster (seg) whose values I want to substitute, and am getting an error from function subs from the raster package that I don't understand at all. I get the following error Error in .local(...
1
vote
1answer
84 views

Restricting duplicate attribute values in file geodatabase feature class? [duplicate]

I have created a File Geodatabase with around 9 feature datasets, and each of those have their own feature classes. So for one of the point feature classes in my GDB, I want to restrict the entering ...
0
votes
1answer
147 views

Customized Kml with ArcGIS

I'm using ArcGIS 10 desktop version. I need to customize my kml files as to what they pop up in Google Earth. One of the attributes appears twice even when the field is not enabled. The picture ...
8
votes
2answers
2k views

Duplicating layer in memory using pyqgis?

I have a layer in QGIS, and I want to duplicate it through a plugin so I can use the copy of it as I want, without modifying the original. Of course layer2 = layer1 will not work, because everything ...
1
vote
1answer
94 views

Removing duplicate legend items in QGIS?

I work with several layers that share similar symbology partly. I'm trying to remove duplicate Symbology from the legend: All the layer and their classification are in the map extent. I try to use ...
2
votes
1answer
452 views

OpenLayers 3: Attributions

I have a number of layers which share the same attribution. When more then one of them are visible at the same time I get something like this in my attribution control: Company1 hyperlink1 Company2 ...
3
votes
2answers
382 views

Count duplicates in ArcGIS, ArcMap 10.4

How can I find how many duplicates I have in my dataset (areas, lines, points) using ArcMap? With topology I can find overlapping objects, but I want to find duplicates. Are there any tools from ...
2
votes
1answer
68 views

Identify groups of stacked geometries in PostGIS

I need to create a column in my PostGIS table with values identifying different groups of stacked/duplicate geometries, such that one group of stacked geometries might get a value of 1, another group ...
6
votes
4answers
14k views

Identifying duplicate attributes using ArcGIS Desktop?

I am trying to identify and flag exact duplicate attribute labels (text) in a field. I can't access "Delete Identical" with my Standard ArcGIS license. I have ET Geowizards installed, they have a ...
3
votes
1answer
318 views

Creating duplicate features - many to one - in qgis

Essentially I have a shapefile of polylines and wish to create duplicates and based on attribute data. I have route data for individuals as polylines. Then I have attribute data which tells me the ...
2
votes
1answer
153 views

Virtual fields are lost when duplicate layers

I've just upgraded to QGIS 2.12.3 - and hoped that the issue which was really time-consuming in 2.12. <3 could have been solved ... On duplicating layer - with tons of joined tables and virtual ...
3
votes
1answer
1k views

Count overlapping polygons, including duplicates

I am using ArcMap 10.2.2 (Advanced license, no toolbar add ons/no spatial analyst) on a Windows 7 computer (i7 processor, 8GB RAM). I have used ArcMap for other basic analyses and have only very basic ...
10
votes
1answer
4k views

Identifying overlapping time intervals with two more criteria in R?

I have to check birds observations made over a longer period for duplicate/overlapping entries. Observers from different points (A,B,C) made observations and marked them on paper maps. Those lines ...
2
votes
3answers
570 views

How to remove identical lines from layer in QGIS?

I converted polygon layer to line layer using "Polygons to Lines" tool. Then I used "Split" function of the Networks plugin. What I need to do next is to remove identical lines that were shared ...
1
vote
0answers
54 views

How to avoid field duplication when joining two vector layers?

I have 2 point vector layers wich differ in 2 fields while both of them have the same number of fields (10). What I want to do is produce a new point vector layer with 12 fields. When I join the two ...
1
vote
0answers
62 views

Rasters with duplicated data?

I am working with a number of raster files that suddenly appear to have duplicated records. For example, I have a raster that classifies my study area into aquatic (value = 1) and terrestrial (value = ...
1
vote
1answer
319 views

PostGIS query returns duplicated rows

I'm trying to create a shapefile of a state. I have a map of US zipcodes that I downloaded from the US Census and I want do create a shapefile of zipcodes in Florida. I ran this query which produces ...
2
votes
1answer
238 views

give importance weighting to sample points in an IDW-interpolation

I am trying to make an IDW-interpolation in arcgis 10.1. In my sample file i have points with the same x,y and z values. According the arcgis-resource-site, the points are considered duplicates and ...
2
votes
1answer
111 views

Find lines that have specific distance between them in QGIS

I have a rather large dataset that contains duplicated lines with an offset of 1m-5m and I want to find an efficient way to solve this problem using QGIS. Is there anyway in QGIS to find the lines ...
1
vote
1answer
41 views

How can I remove rows that have duplicate cells in 2 dif files - while choosing which file has the dup removed?

I have 2 files and I merged them together into one file-geodatabase feature class. I want to remove entries from File1, Column C, that also appear in File2, ColumnD. I attempted to use the ...
3
votes
3answers
610 views

How to delete duplicate LiDAR points?

How can I delete duplicate LiDAR points? I incorrectly read the same las twice and saved as a one file resulting in duplicate XY points. How should I delete these duplicate points?
7
votes
2answers
4k views

Delete duplicate geometry in postgis tables

After - I don't know what happend - all my entries in my PostGIS tables are doubled! I tried this to delete them but it does not delete any/all duplicates: DELETE FROM planet_osm_point WHERE ...
1
vote
1answer
87 views

Strategies for managing (and ultimately merging) duplicate business locations in a spatial database

I am working on a project right now that involves using multiple (very large) "location directories" to identify with the highest possible inclusiveness, a diverse set of business locations. These ...