Questions tagged [missing-data]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
2 votes
1 answer
97 views

Fill NaN geometries records with other geometric column

I have a GeoDataFrame with two geometry columns. I want to fill missing values of the one with the other. Both columns contain polygons or multipolygons. I have tried: geo_df['geom_2'].fillna(geo_df['...
user avatar
  • 532
1 vote
0 answers
23 views

Characterizing annual NDVI for small site areas with significant time series gaps

I'm looking at 30 years of growing season Landsat 5 NDVI for small areas (three sites, each with 9 pixels). For some years there are only one or two available images due to cloud cover, other years ...
user avatar
1 vote
1 answer
136 views

Why does Landsat 8 Collection 2 Band 10 data has spots with no values?

We're currently researching urban heat distributions in Germany using Landsat 8 data. As stated in the Collection 2 Level 2 Science Product Guide, Band 10 of this product is the processed data of ...
user avatar
0 votes
0 answers
165 views

How to clip a Spatial Points Data Frame to a raster in R, so that no points correspond to NA raster values

I have a Spatial Points Data Frame and a set of environmental rasters used to build a model with package inlabru. But I get errors which I think may arise from a few points being mislocated 'in the ...
user avatar
2 votes
1 answer
237 views

replacing missing values with the most common pixel closeby [QGIS]

Hi I made classification map which you can see below. Because the original map had text in it and some borders etc that I didn't want to be included in the new map, these got their own class and ...
user avatar
  • 23
0 votes
2 answers
48 views

Trying to apply inlabru:::bru_fill_missing to a SpatialPointsDataFrame to fill in NAs

I'm struggling with a function from the inlabru R package, which could help me fill in the NAs in my data. According to the helpfile, I need: bru_fill_missing( data, where, values) data is a ...
user avatar
5 votes
0 answers
53 views

Hiding missing values on bar charts in QGIS

I'm trying to hide the bars when there are no values available on my bar charts. This, in order to differentiate missing values from values that are existing but are very close to zero or equal to ...
user avatar
0 votes
0 answers
46 views

Sentinel 1 missing data

I´m trying to use the complete descending dataset (VV and VH) for a location in Colombia and must got the same number of scenes by band but it does not; in fact, there are 3 missing years of data for ...
user avatar
0 votes
0 answers
80 views

QGIS Vector Geometry Vanished

I've been working on a project, in QGIS 3.16 Hannover (we started the project a while ago, in the Bonn version, but upgraded during the duration of project). Upon project completion we've been asked ...
user avatar
  • 123
2 votes
1 answer
342 views

Calculating correlation between points and raster values with missing points (need missing as 0s) (QGIS)

I feel like this should be easy but I'm struggling. I have a raster data set of Topographic Wetness Index (TWI) and a point data set of crop yield. I want to see how TWI and yield are correlated by ...
user avatar
0 votes
0 answers
33 views

ArcMap Intersect Tool is missing just one intersect point of two polyline shapefiles?

I'm trying to find the intersect of 2 polyline shapefiles. One shapefile is a long line (of multiparts), the other shapefile is 11 straight lines that "fan out" radially. The ends of the first ...
user avatar
  • 1
0 votes
1 answer
237 views

Sentinel-1 missing data gaps between two images GEE [duplicate]

I am trying to export a Sentinel-1 mosaic with the code below. I keep getting this missing data gap between the two images. Even when I export the images separately, and mosaic them myself in ArcGIS, ...
user avatar
2 votes
2 answers
111 views

Stream Feature generated from DEM is missing data

I tried to search other questions to see if this has been answered but couldn't find anything, so sorry if this is redundant. I use the Hydrology toolset in Spatial Analyst to create a stream feature ...
user avatar
-1 votes
1 answer
52 views

How to convert missing values to the mean of the other values in R? [closed]

I need to convert the missing values of a column in a dataframe with the rest of values of this column, grouped by Districts and Month. This is a sample of my df1: Date Day Month Year ...
user avatar
  • 89
1 vote
0 answers
27 views

Geopackage drops fields during import [closed]

When I use the ogr2ogr -f command to create a geopackage the first layer imports correctly but every layer after that drops fields. Can anybody explain why it does this?
user avatar
4 votes
1 answer
332 views

Interpolating LiDAR intensity images in R?

I'd like to generate 0.5 m intensity images using lidR, but the resulting raster is full of pits. Here's a reproducible example: library(lidR) LASfile <- system.file("extdata", "MixedConifer.laz", ...
user avatar
  • 71
2 votes
2 answers
1k views

Getting a masked raster with no NAs and sum pixels within overlaying polygon?

I have done an IDW interpolation in R for precipitation data following the routine of Manny Gimond (https://mgimond.github.io/Spatial/interpolation-in-r.html) to get precipitation inside a catchment. ...
user avatar
1 vote
1 answer
148 views

Placing Excel Data in ArcMap/ArcScene similar to Image Georeferencing

I have XYZ-dataset of Temperature Data in Excel, with no (Lat, Lon) added. Every time when I try to display the Data in ArcScene the Programm tells me, that a Spacial Reference is missing (of course)....
user avatar
  • 11
1 vote
3 answers
335 views

Missing feature from Shapefile

I have loaded a shapefile into QGIS that has been generated in a third party piece of software. When I view the attributes table, all items are there (20 survey lines), when I view the map only 19 ...
user avatar
2 votes
0 answers
189 views

Only some points visible in CSV layer

I understand that this question has been asked before in one form or another, but unfortunately those answers haven't been able to solve my issue. I've imported a .csv file into QGIS and all the ...
user avatar
  • 21
2 votes
1 answer
298 views

Georeferencer - GDAL is missing on the QGIS 3

OS - ArchLinux 64bits SPECS - i3-3220 - 6gb ram QGIS 3.0.3 installed as follow. $ sudo pacman -S qgis gdal python-gdal python-psycopg2 python-owslib python-yaml python-pygments $ yaourt -S python-...
user avatar
0 votes
0 answers
50 views

Point/Feature to Raster-unwanted Grid of missing Data raster Cells-ArcGIS10.5

I tried to convert some point data (points on a regular grid of 100m by 100m) with the Feature to Raster Tool and the Point to Raster Tool (Rastersize of 100m) but in the resulting Rasterfile there is ...
user avatar
1 vote
1 answer
779 views

QGiS - Values missing from graduated style

I'm trying to do the very simple/standard task of presenting points (and then polygons created from them) as a graduated colour style, however many points are missing, evinced from the lowest number ...
user avatar
  • 1,027
0 votes
1 answer
1k views

Features show on data view, but not in Attribute table?

There are 966 points for tree data that was collected in the field. When I try to open the attribute table only 2 points' data show up. I've tried to create layer from selected, because when I choose ...
user avatar
  • 87
1 vote
0 answers
218 views

Space-Time Principal Component Analysis with Missing Lat/Long Data [closed]

I am looking to run a space-time Principal Component Analysis on Shotspotter data from Brockton, MA: http://justicetechlab.org/data/. Shotspotter sensors record the timing, location, and number of ...
user avatar
  • 11
6 votes
2 answers
5k views

Replace NA's with 0 for large raster data using R?

I want to replace all NA values in a large raster with 0. I found this answer to Replacing NAs with 0 for raster data using R : #getting a raster library(raster) f <- system.file("external/...
user avatar
  • 61
0 votes
1 answer
280 views

Adding missing locations on OpenStreetMap programmatically for Android application?

i am working on android application using osm. Many locations are not on osm that google map providing. But i need to show all missing locations on osm also. what can i do to solve this problem? Can ...
user avatar
1 vote
0 answers
58 views

Missing Values in Crop identification using Python? [closed]

I am developing a Python based process that classify crops via time series analysis. Due to clouds there are many missing values. My problem is how to assign a value to these pixels that would be near ...
user avatar
1 vote
3 answers
738 views

ArcGIS Attribute Table - Latitude, no Longitude

I received a shapefile from an online source, and in the attribute table it shows a column and values for latitude; but there is nothing for longitude. I have not used ArcGIS for some time, and I don'...
user avatar
  • 11
0 votes
1 answer
284 views

Python add-in button tool giving saying missing toolbar when I add it onto my map?

I am looking to create a button that when clicked, clears feature classes and tables created from another tool. I set up the button and installed it but every time I add it to the map with a toolbar ...
user avatar
4 votes
3 answers
2k views

Merging one DEM into another to fill in missing data using QGIS?

I have a LiDAR dataset with some missing data right in the middle of my map. I would like to use a 5m DEM to fill in the missing areas. Is there a way in QGIS to merge the two but only use the 5m ...
user avatar
  • 41
2 votes
1 answer
1k views

R kriging cross validation returns NA for all prediction points?

I'm trying to cross-validate the results of an [auto]Krige output but for some unknown reason the results of both autoKrige.cv (automap package) and krige.cv (gstat package) return NA for all values (...
user avatar
6 votes
1 answer
478 views

Zones missing after running zonal statistics in ArcGIS Spatial Analyst?

I have a problem using zonal statistics in ArcGIS. My raster contains values/data with 30m cells. I had several vector layers, containing administrative subdivisions of Belgium. I have converted the ...
user avatar
  • 399
1 vote
0 answers
75 views

Extracting specific OpenStreetMap tags in ArcGIS Desktop? [duplicate]

The purpose of my research is to look into public ITS (Intelligent Transport System). To do this in a realistic way I need not only the city map but also the public transport routes. I work with ...
user avatar
1 vote
0 answers
76 views

Filling missing pixels of ASTER DEM

I need to perform hydrological analyses and map design purposes (hillshade creation) on a region far north. It is too northern to be covered by the SRTM DEM, therefore I am using the ASTER DEM. ...
user avatar
  • 755
1 vote
0 answers
29 views

Generating missing yearly data, based on a more detailed temporal data set

I have several very large raster data sets of land use classifications (ie. forest, wetland, argicultural, etc). The most comprehensive data spans 2009-2015. I have reclassified this data to match ...
user avatar
0 votes
1 answer
557 views

Filling null attributes with mean attributes of neighboring polygons using ArcGIS Desktop?

I have a layer of polygons, where in some polygons there is missing data (null). I would like to fill these missing attributes by the average attributes in neighboring polygons. Is there a simple way ...
user avatar
  • 347
4 votes
2 answers
2k views

Error gap-filling Landsat 7 SLC-off with QGIS 2.18.3 on Windows 10

I am trying to gap-fill Landsat 7 SLC-off images with open-source software as explained in the comment below this post. I'm new to QGIS and have almost no knowledge with Python (I'm a GIS novice ...
user avatar
2 votes
0 answers
83 views

Missing Observations in Zonal Statistics Tool

I am using zonal statistical tools. I have field boundary shapefile which has 1,062,063 observations. I am using zonal statistical as table tool to obtain precipitation values from raster layer. ...
user avatar
  • 31
2 votes
0 answers
63 views

Finding pre-processed MODIS products?

I am trying to recognize burnt areas based on some MODIS products and I just realized that I am missing a bunch pixels from the coastline masking. As you can understand that is an issue because I am ...
user avatar
  • 439
4 votes
0 answers
181 views

Why do first returns have more blanks than last returns in LiDAR data? [closed]

I'm working on an ASCII LiDAR file that has the first and last pulse returns included. Can anyone tell me why a first pulse return may come back with more blank spaces in the data than a last pulse ...
user avatar
  • 153
1 vote
1 answer
56 views

QGIS - Have spreadsheet with col from 0% to 100% plus null want 100 bin gradient plus one more for null

Newbie alert. Have a spreadsheet with no geo; has a col with values in there from 0% to 100%, plus several blanks/nulls. Ideally would like a 100 step (bin) gradient fill from 0 (100% black) to 100 (...
user avatar
  • 219
4 votes
1 answer
957 views

How to generate missing points in GPS trajectories?

I have some GPS trajectories that include gps locations recorded on variable frequencies (every 1 min ,5 min , 20 min,etc.)using a geographic projection WGS84. In my work, i need a fine-grained GPS ...
user avatar
2 votes
0 answers
2k views

QGIS Polygons missing after saving edits

Right, I am slightly worried. I opened QGIS this morning to discover that part of the work I did yesterday was not there (the attributes where present in the table, but were not digitised anywhere on ...
user avatar
  • 21
0 votes
1 answer
106 views

How can I find the missing data from the downloaded bulk TRMM data?

I have downloaded TRMM daily precipitation estimates for Indian Sub-continent from 1988 to present. I see that there are a lot of missing data days. I was wondering how can I possibly detect the daily ...
user avatar
0 votes
1 answer
409 views

Fusion Tables missing from Google Drive [closed]

Many of my Fusion Tables are missing off my Google Drive account, has anyone else experienced, and hopefully resolved, this issue?
user avatar
1 vote
1 answer
995 views

Parts of geometry disappearing in QGIS export to Illustrator PDF?

I'm having this issue with certain polygons when I export to PDF. Everything looks fine in QGIS, everything fine in print composer, everything fine in the PDF as viewed in Preview or Adobe Reader. ...
user avatar
  • 31
1 vote
2 answers
824 views

Export GRASS raster as GeoTIFF : nodata values exported as -nan (what happens in R?)

I am using the package raster to work with GeoTIFF raster files which I exported from GRASS using r.out.gdal. GRASS assigned the value -nan to some raster files (type FLOAT32) for missing values. ...
user avatar
3 votes
0 answers
460 views

Missing data and negative predictions when kriging daily rainfall? [closed]

I want to perform the interpolation of daily rainfall data for 7 years. I am now working on python using arcpy module. I face several problems while performing interpolation Some day there is no ...
user avatar
  • 401
2 votes
1 answer
796 views

Kriging from raster with missing data in ArcGIS

I have MODIS satellite imagery that depicts a range of surface temperatures. However, many of the cells are missing values. I think I need to perform Kriging in order to obtain an average value for ...
user avatar