Questions tagged [missing-data]
The missing-data tag has no usage guidance.
54
questions
2
votes
1
answer
97
views
Fill NaN geometries records with other geometric column
I have a GeoDataFrame with two geometry columns.
I want to fill missing values of the one with the other.
Both columns contain polygons or multipolygons.
I have tried:
geo_df['geom_2'].fillna(geo_df['...
- 532
1
vote
0
answers
23
views
Characterizing annual NDVI for small site areas with significant time series gaps
I'm looking at 30 years of growing season Landsat 5 NDVI for small areas (three sites, each with 9 pixels). For some years there are only one or two available images due to cloud cover, other years ...
- 11
1
vote
1
answer
136
views
Why does Landsat 8 Collection 2 Band 10 data has spots with no values?
We're currently researching urban heat distributions in Germany using Landsat 8 data.
As stated in the Collection 2 Level 2 Science Product Guide, Band 10 of this product is the processed data of ...
- 13
0
votes
0
answers
165
views
How to clip a Spatial Points Data Frame to a raster in R, so that no points correspond to NA raster values
I have a Spatial Points Data Frame and a set of environmental rasters used to build a model with package inlabru. But I get errors which I think may arise from a few points being mislocated 'in the ...
2
votes
1
answer
237
views
replacing missing values with the most common pixel closeby [QGIS]
Hi I made classification map which you can see below. Because the original map had text in it and some borders etc that I didn't want to be included in the new map, these got their own class and ...
- 23
0
votes
2
answers
48
views
Trying to apply inlabru:::bru_fill_missing to a SpatialPointsDataFrame to fill in NAs
I'm struggling with a function from the inlabru R package, which could help me fill in the NAs in my data.
According to the helpfile, I need:
bru_fill_missing(
data,
where,
values)
data is a ...
5
votes
0
answers
53
views
Hiding missing values on bar charts in QGIS
I'm trying to hide the bars when there are no values available on my bar charts. This, in order to differentiate missing values from values that are existing but are very close to zero or equal to ...
- 51
0
votes
0
answers
46
views
Sentinel 1 missing data
I´m trying to use the complete descending dataset (VV and VH) for a location in Colombia and must got the same number of scenes by band but it does not; in fact, there are 3 missing years of data for ...
0
votes
0
answers
80
views
QGIS Vector Geometry Vanished
I've been working on a project, in QGIS 3.16 Hannover (we started the project a while ago, in the Bonn version, but upgraded during the duration of project). Upon project completion we've been asked ...
- 123
2
votes
1
answer
342
views
Calculating correlation between points and raster values with missing points (need missing as 0s) (QGIS)
I feel like this should be easy but I'm struggling. I have a raster data set of Topographic Wetness Index (TWI) and a point data set of crop yield. I want to see how TWI and yield are correlated by ...
- 43
0
votes
0
answers
33
views
ArcMap Intersect Tool is missing just one intersect point of two polyline shapefiles?
I'm trying to find the intersect of 2 polyline shapefiles. One shapefile is a long line (of multiparts), the other shapefile is 11 straight lines that "fan out" radially. The ends of the first ...
- 1
0
votes
1
answer
237
views
Sentinel-1 missing data gaps between two images GEE [duplicate]
I am trying to export a Sentinel-1 mosaic with the code below. I keep getting this missing data gap between the two images. Even when I export the images separately, and mosaic them myself in ArcGIS, ...
2
votes
2
answers
111
views
Stream Feature generated from DEM is missing data
I tried to search other questions to see if this has been answered but couldn't find anything, so sorry if this is redundant. I use the Hydrology toolset in Spatial Analyst to create a stream feature ...
-1
votes
1
answer
52
views
How to convert missing values to the mean of the other values in R? [closed]
I need to convert the missing values of a column in a dataframe with the rest of values of this column, grouped by Districts and Month.
This is a sample of my df1:
Date Day Month Year ...
- 89
1
vote
0
answers
27
views
Geopackage drops fields during import [closed]
When I use the ogr2ogr -f command to create a geopackage the first layer imports correctly but every layer after that drops fields. Can anybody explain why it does this?
- 189
4
votes
1
answer
332
views
Interpolating LiDAR intensity images in R?
I'd like to generate 0.5 m intensity images using lidR, but the resulting raster is full of pits. Here's a reproducible example:
library(lidR)
LASfile <- system.file("extdata", "MixedConifer.laz", ...
- 71
2
votes
2
answers
1k
views
Getting a masked raster with no NAs and sum pixels within overlaying polygon?
I have done an IDW interpolation in R for precipitation data following the routine of Manny Gimond (https://mgimond.github.io/Spatial/interpolation-in-r.html) to get precipitation inside a catchment.
...
- 57
1
vote
1
answer
148
views
Placing Excel Data in ArcMap/ArcScene similar to Image Georeferencing
I have XYZ-dataset of Temperature Data in Excel, with no (Lat, Lon) added.
Every time when I try to display the Data in ArcScene the Programm tells me, that a Spacial Reference is missing (of course)....
- 11
1
vote
3
answers
335
views
Missing feature from Shapefile
I have loaded a shapefile into QGIS that has been generated in a third party piece of software. When I view the attributes table, all items are there (20 survey lines), when I view the map only 19 ...
2
votes
0
answers
189
views
Only some points visible in CSV layer
I understand that this question has been asked before in one form or another, but unfortunately those answers haven't been able to solve my issue.
I've imported a .csv file into QGIS and all the ...
- 21
2
votes
1
answer
298
views
Georeferencer - GDAL is missing on the QGIS 3
OS - ArchLinux 64bits
SPECS - i3-3220 - 6gb ram
QGIS 3.0.3 installed as follow.
$ sudo pacman -S qgis gdal python-gdal python-psycopg2 python-owslib python-yaml python-pygments
$ yaourt -S python-...
0
votes
0
answers
50
views
Point/Feature to Raster-unwanted Grid of missing Data raster Cells-ArcGIS10.5
I tried to convert some point data (points on a regular grid of 100m by 100m) with the Feature to Raster Tool and the Point to Raster Tool (Rastersize of 100m) but in the resulting Rasterfile there is ...
- 21
1
vote
1
answer
779
views
QGiS - Values missing from graduated style
I'm trying to do the very simple/standard task of presenting points (and then polygons created from them) as a graduated colour style, however many points are missing, evinced from the lowest number ...
- 1,027
0
votes
1
answer
1k
views
Features show on data view, but not in Attribute table?
There are 966 points for tree data that was collected in the field. When I try to open the attribute table only 2 points' data show up. I've tried to create layer from selected, because when I choose ...
- 87
1
vote
0
answers
218
views
Space-Time Principal Component Analysis with Missing Lat/Long Data [closed]
I am looking to run a space-time Principal Component Analysis on Shotspotter data from Brockton, MA: http://justicetechlab.org/data/. Shotspotter sensors record the timing, location, and number of ...
- 11
6
votes
2
answers
5k
views
Replace NA's with 0 for large raster data using R?
I want to replace all NA values in a large raster with 0. I found this answer to Replacing NAs with 0 for raster data using R :
#getting a raster
library(raster)
f <- system.file("external/...
- 61
0
votes
1
answer
280
views
Adding missing locations on OpenStreetMap programmatically for Android application?
i am working on android application using osm. Many locations are not on osm that google map providing. But i need to show all missing locations on osm also.
what can i do to solve this problem?
Can ...
1
vote
0
answers
58
views
Missing Values in Crop identification using Python? [closed]
I am developing a Python based process that classify crops via time series analysis. Due to clouds there are many missing values. My problem is how to assign a value to these pixels that would be near ...
1
vote
3
answers
738
views
ArcGIS Attribute Table - Latitude, no Longitude
I received a shapefile from an online source, and in the attribute table it shows a column and values for latitude; but there is nothing for longitude.
I have not used ArcGIS for some time, and I don'...
- 11
0
votes
1
answer
284
views
Python add-in button tool giving saying missing toolbar when I add it onto my map?
I am looking to create a button that when clicked, clears feature classes and tables created from another tool. I set up the button and installed it but every time I add it to the map with a toolbar ...
- 134
4
votes
3
answers
2k
views
Merging one DEM into another to fill in missing data using QGIS?
I have a LiDAR dataset with some missing data right in the middle of my map. I would like to use a 5m DEM to fill in the missing areas.
Is there a way in QGIS to merge the two but only use the 5m ...
- 41
2
votes
1
answer
1k
views
R kriging cross validation returns NA for all prediction points?
I'm trying to cross-validate the results of an [auto]Krige output but for some unknown reason the results of both autoKrige.cv (automap package) and krige.cv (gstat package) return NA for all values (...
- 173
6
votes
1
answer
478
views
Zones missing after running zonal statistics in ArcGIS Spatial Analyst?
I have a problem using zonal statistics in ArcGIS.
My raster contains values/data with 30m cells.
I had several vector layers, containing administrative subdivisions of Belgium. I have converted the ...
- 399
1
vote
0
answers
75
views
Extracting specific OpenStreetMap tags in ArcGIS Desktop? [duplicate]
The purpose of my research is to look into public ITS (Intelligent Transport System). To do this in a realistic way I need not only the city map but also the public transport routes.
I work with ...
- 11
1
vote
0
answers
76
views
Filling missing pixels of ASTER DEM
I need to perform hydrological analyses and map design purposes (hillshade creation) on a region far north. It is too northern to be covered by the SRTM DEM, therefore I am using the ASTER DEM. ...
- 755
1
vote
0
answers
29
views
Generating missing yearly data, based on a more detailed temporal data set
I have several very large raster data sets of land use classifications (ie. forest, wetland, argicultural, etc).
The most comprehensive data spans 2009-2015. I have reclassified this data to match ...
- 11
0
votes
1
answer
557
views
Filling null attributes with mean attributes of neighboring polygons using ArcGIS Desktop?
I have a layer of polygons, where in some polygons there is missing data (null). I would like to fill these missing attributes by the average attributes in neighboring polygons. Is there a simple way ...
- 347
4
votes
2
answers
2k
views
Error gap-filling Landsat 7 SLC-off with QGIS 2.18.3 on Windows 10
I am trying to gap-fill Landsat 7 SLC-off images with open-source software as explained in the comment below this post.
I'm new to QGIS and have almost no knowledge with Python (I'm a GIS novice ...
- 71
2
votes
0
answers
83
views
Missing Observations in Zonal Statistics Tool
I am using zonal statistical tools. I have field boundary shapefile which has 1,062,063 observations.
I am using zonal statistical as table tool to obtain precipitation values from raster layer. ...
- 31
2
votes
0
answers
63
views
Finding pre-processed MODIS products?
I am trying to recognize burnt areas based on some MODIS products and I just realized that I am missing a bunch pixels from the coastline masking. As you can understand that is an issue because I am ...
- 439
4
votes
0
answers
181
views
Why do first returns have more blanks than last returns in LiDAR data? [closed]
I'm working on an ASCII LiDAR file that has the first and last pulse returns included.
Can anyone tell me why a first pulse return may come back with more blank spaces in the data than a last pulse ...
- 153
1
vote
1
answer
56
views
QGIS - Have spreadsheet with col from 0% to 100% plus null want 100 bin gradient plus one more for null
Newbie alert. Have a spreadsheet with no geo; has a col with values in there from 0% to 100%, plus several blanks/nulls.
Ideally would like a 100 step (bin) gradient fill from 0 (100% black) to 100 (...
- 219
4
votes
1
answer
957
views
How to generate missing points in GPS trajectories?
I have some GPS trajectories that include gps locations recorded on variable frequencies (every 1 min ,5 min , 20 min,etc.)using a geographic projection WGS84. In my work, i need a fine-grained GPS ...
- 173
2
votes
0
answers
2k
views
QGIS Polygons missing after saving edits
Right, I am slightly worried. I opened QGIS this morning to discover that part of the work I did yesterday was not there (the attributes where present in the table, but were not digitised anywhere on ...
- 21
0
votes
1
answer
106
views
How can I find the missing data from the downloaded bulk TRMM data?
I have downloaded TRMM daily precipitation estimates for Indian Sub-continent from 1988 to present. I see that there are a lot of missing data days. I was wondering how can I possibly detect the daily ...
- 1
0
votes
1
answer
409
views
Fusion Tables missing from Google Drive [closed]
Many of my Fusion Tables are missing off my Google Drive account, has anyone else experienced, and hopefully resolved, this issue?
- 21
1
vote
1
answer
995
views
Parts of geometry disappearing in QGIS export to Illustrator PDF?
I'm having this issue with certain polygons when I export to PDF. Everything looks fine in QGIS, everything fine in print composer, everything fine in the PDF as viewed in Preview or Adobe Reader. ...
- 31
1
vote
2
answers
824
views
Export GRASS raster as GeoTIFF : nodata values exported as -nan (what happens in R?)
I am using the package raster to work with GeoTIFF raster files which I exported from GRASS using r.out.gdal. GRASS assigned the value -nan to some raster files (type FLOAT32) for missing values. ...
- 111
3
votes
0
answers
460
views
Missing data and negative predictions when kriging daily rainfall? [closed]
I want to perform the interpolation of daily rainfall data for 7 years. I am now working on python using arcpy module. I face several problems while performing interpolation
Some day there is no ...
- 401
2
votes
1
answer
796
views
Kriging from raster with missing data in ArcGIS
I have MODIS satellite imagery that depicts a range of surface temperatures. However, many of the cells are missing values. I think I need to perform Kriging in order to obtain an average value for ...
- 101