Questions tagged [missing-data]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
0 answers
56 views

Linear interpolation for missing dates in Google Earth Engine

I have missing dates with no data which I want to create data for using linear interpolation. Most examples create a masked layer and replace the masked values but its my understanding that to ...
0 votes
0 answers
33 views

Linear data imputation conversion to bilinear interpolation in Python?

I have a project where the task is to impute missing data values from a modis TIF file using Bilinear interpolation. I tried to use linear interpolation to impute the missing values, but trying to ...
0 votes
0 answers
19 views

missing data in the obatined map of CH4 concentration over India using Sentinel-5P dataset

I obtained the image given below for the CH4 concentration over India from June to August (Spring season) of 2019, 2020, and 2021 respectively. Unlike the images I got for other seasons, the data ...
2 votes
1 answer
253 views

Fill NaN geometries records with other geometric column

I have a GeoDataFrame with two geometry columns. I want to fill missing values of the one with the other. Both columns contain polygons or multipolygons. I have tried: geo_df['geom_2'].fillna(geo_df['...
  • 592
1 vote
0 answers
25 views

Characterizing annual NDVI for small site areas with significant time series gaps

I'm looking at 30 years of growing season Landsat 5 NDVI for small areas (three sites, each with 9 pixels). For some years there are only one or two available images due to cloud cover, other years ...
1 vote
1 answer
191 views

Why does Landsat 8 Collection 2 Band 10 data has spots with no values?

We're currently researching urban heat distributions in Germany using Landsat 8 data. As stated in the Collection 2 Level 2 Science Product Guide, Band 10 of this product is the processed data of ...
2 votes
1 answer
326 views

replacing missing values with the most common pixel closeby [QGIS]

Hi I made classification map which you can see below. Because the original map had text in it and some borders etc that I didn't want to be included in the new map, these got their own class and ...
  • 23
0 votes
2 answers
56 views

Trying to apply inlabru:::bru_fill_missing to a SpatialPointsDataFrame to fill in NAs

I'm struggling with a function from the inlabru R package, which could help me fill in the NAs in my data. According to the helpfile, I need: bru_fill_missing( data, where, values) data is a ...
5 votes
0 answers
62 views

Hiding missing values on bar charts in QGIS

I'm trying to hide the bars when there are no values available on my bar charts. This, in order to differentiate missing values from values that are existing but are very close to zero or equal to ...
0 votes
0 answers
63 views

Sentinel 1 missing data

I´m trying to use the complete descending dataset (VV and VH) for a location in Colombia and must got the same number of scenes by band but it does not; in fact, there are 3 missing years of data for ...
0 votes
0 answers
94 views

QGIS Vector Geometry Vanished

I've been working on a project, in QGIS 3.16 Hannover (we started the project a while ago, in the Bonn version, but upgraded during the duration of project). Upon project completion we've been asked ...
  • 123
2 votes
1 answer
489 views

Calculating correlation between points and raster values with missing points (need missing as 0s) (QGIS)

I feel like this should be easy but I'm struggling. I have a raster data set of Topographic Wetness Index (TWI) and a point data set of crop yield. I want to see how TWI and yield are correlated by ...
0 votes
0 answers
44 views

ArcMap Intersect Tool is missing just one intersect point of two polyline shapefiles?

I'm trying to find the intersect of 2 polyline shapefiles. One shapefile is a long line (of multiparts), the other shapefile is 11 straight lines that "fan out" radially. The ends of the first ...
  • 1
0 votes
1 answer
322 views

Sentinel-1 missing data gaps between two images GEE [duplicate]

I am trying to export a Sentinel-1 mosaic with the code below. I keep getting this missing data gap between the two images. Even when I export the images separately, and mosaic them myself in ArcGIS, ...
2 votes
2 answers
135 views

Stream Feature generated from DEM is missing data

I tried to search other questions to see if this has been answered but couldn't find anything, so sorry if this is redundant. I use the Hydrology toolset in Spatial Analyst to create a stream feature ...
-1 votes
1 answer
54 views

How to convert missing values to the mean of the other values in R? [closed]

I need to convert the missing values of a column in a dataframe with the rest of values of this column, grouped by Districts and Month. This is a sample of my df1: Date Day Month Year ...
  • 89
1 vote
0 answers
29 views

Geopackage drops fields during import [closed]

When I use the ogr2ogr -f command to create a geopackage the first layer imports correctly but every layer after that drops fields. Can anybody explain why it does this?
4 votes
1 answer
380 views

Interpolating LiDAR intensity images in R?

I'd like to generate 0.5 m intensity images using lidR, but the resulting raster is full of pits. Here's a reproducible example: library(lidR) LASfile <- system.file("extdata", "MixedConifer.laz", ...
  • 71
2 votes
2 answers
1k views

Getting a masked raster with no NAs and sum pixels within overlaying polygon?

I have done an IDW interpolation in R for precipitation data following the routine of Manny Gimond (https://mgimond.github.io/Spatial/interpolation-in-r.html) to get precipitation inside a catchment. ...
1 vote
1 answer
155 views

Placing Excel Data in ArcMap/ArcScene similar to Image Georeferencing

I have XYZ-dataset of Temperature Data in Excel, with no (Lat, Lon) added. Every time when I try to display the Data in ArcScene the Programm tells me, that a Spacial Reference is missing (of course)....
  • 11
1 vote
3 answers
376 views

Missing feature from Shapefile

I have loaded a shapefile into QGIS that has been generated in a third party piece of software. When I view the attributes table, all items are there (20 survey lines), when I view the map only 19 ...
2 votes
0 answers
191 views

Only some points visible in CSV layer

I understand that this question has been asked before in one form or another, but unfortunately those answers haven't been able to solve my issue. I've imported a .csv file into QGIS and all the ...
  • 21
2 votes
1 answer
359 views

Georeferencer - GDAL is missing on the QGIS 3

OS - ArchLinux 64bits SPECS - i3-3220 - 6gb ram QGIS 3.0.3 installed as follow. $ sudo pacman -S qgis gdal python-gdal python-psycopg2 python-owslib python-yaml python-pygments $ yaourt -S python-...
0 votes
0 answers
52 views

Point/Feature to Raster-unwanted Grid of missing Data raster Cells-ArcGIS10.5

I tried to convert some point data (points on a regular grid of 100m by 100m) with the Feature to Raster Tool and the Point to Raster Tool (Rastersize of 100m) but in the resulting Rasterfile there is ...
1 vote
1 answer
826 views

QGiS - Values missing from graduated style

I'm trying to do the very simple/standard task of presenting points (and then polygons created from them) as a graduated colour style, however many points are missing, evinced from the lowest number ...
  • 1,037
0 votes
1 answer
1k views

Features show on data view, but not in Attribute table?

There are 966 points for tree data that was collected in the field. When I try to open the attribute table only 2 points' data show up. I've tried to create layer from selected, because when I choose ...
  • 87
1 vote
0 answers
221 views

Space-Time Principal Component Analysis with Missing Lat/Long Data [closed]

I am looking to run a space-time Principal Component Analysis on Shotspotter data from Brockton, MA: http://justicetechlab.org/data/. Shotspotter sensors record the timing, location, and number of ...
  • 11
6 votes
2 answers
5k views

Replace NA's with 0 for large raster data using R?

I want to replace all NA values in a large raster with 0. I found this answer to Replacing NAs with 0 for raster data using R : #getting a raster library(raster) f <- system.file("external/...
  • 61
0 votes
1 answer
299 views

Adding missing locations on OpenStreetMap programmatically for Android application?

i am working on android application using osm. Many locations are not on osm that google map providing. But i need to show all missing locations on osm also. what can i do to solve this problem? Can ...
1 vote
0 answers
60 views

Missing Values in Crop identification using Python? [closed]

I am developing a Python based process that classify crops via time series analysis. Due to clouds there are many missing values. My problem is how to assign a value to these pixels that would be near ...
1 vote
3 answers
771 views

ArcGIS Attribute Table - Latitude, no Longitude

I received a shapefile from an online source, and in the attribute table it shows a column and values for latitude; but there is nothing for longitude. I have not used ArcGIS for some time, and I don'...
  • 11
0 votes
1 answer
287 views

Python add-in button tool giving saying missing toolbar when I add it onto my map?

I am looking to create a button that when clicked, clears feature classes and tables created from another tool. I set up the button and installed it but every time I add it to the map with a toolbar ...
4 votes
2 answers
2k views

Merging one DEM into another to fill in missing data using QGIS?

I have a LiDAR dataset with some missing data right in the middle of my map. I would like to use a 5m DEM to fill in the missing areas. Is there a way in QGIS to merge the two but only use the 5m ...
  • 41
2 votes
1 answer
1k views

R kriging cross validation returns NA for all prediction points?

I'm trying to cross-validate the results of an [auto]Krige output but for some unknown reason the results of both autoKrige.cv (automap package) and krige.cv (gstat package) return NA for all values (...
6 votes
1 answer
495 views

Zones missing after running zonal statistics in ArcGIS Spatial Analyst?

I have a problem using zonal statistics in ArcGIS. My raster contains values/data with 30m cells. I had several vector layers, containing administrative subdivisions of Belgium. I have converted the ...
  • 399
1 vote
0 answers
75 views

Extracting specific OpenStreetMap tags in ArcGIS Desktop? [duplicate]

The purpose of my research is to look into public ITS (Intelligent Transport System). To do this in a realistic way I need not only the city map but also the public transport routes. I work with ...
1 vote
0 answers
79 views

Filling missing pixels of ASTER DEM

I need to perform hydrological analyses and map design purposes (hillshade creation) on a region far north. It is too northern to be covered by the SRTM DEM, therefore I am using the ASTER DEM. ...
  • 765
1 vote
0 answers
29 views

Generating missing yearly data, based on a more detailed temporal data set

I have several very large raster data sets of land use classifications (ie. forest, wetland, argicultural, etc). The most comprehensive data spans 2009-2015. I have reclassified this data to match ...
0 votes
1 answer
570 views

Filling null attributes with mean attributes of neighboring polygons using ArcGIS Desktop?

I have a layer of polygons, where in some polygons there is missing data (null). I would like to fill these missing attributes by the average attributes in neighboring polygons. Is there a simple way ...
  • 357
4 votes
2 answers
2k views

Error gap-filling Landsat 7 SLC-off with QGIS 2.18.3 on Windows 10

I am trying to gap-fill Landsat 7 SLC-off images with open-source software as explained in the comment below this post. I'm new to QGIS and have almost no knowledge with Python (I'm a GIS novice ...
2 votes
0 answers
83 views

Missing Observations in Zonal Statistics Tool

I am using zonal statistical tools. I have field boundary shapefile which has 1,062,063 observations. I am using zonal statistical as table tool to obtain precipitation values from raster layer. ...
  • 31
2 votes
0 answers
63 views

Finding pre-processed MODIS products?

I am trying to recognize burnt areas based on some MODIS products and I just realized that I am missing a bunch pixels from the coastline masking. As you can understand that is an issue because I am ...
  • 449
4 votes
0 answers
191 views

Why do first returns have more blanks than last returns in LiDAR data? [closed]

I'm working on an ASCII LiDAR file that has the first and last pulse returns included. Can anyone tell me why a first pulse return may come back with more blank spaces in the data than a last pulse ...
  • 153
1 vote
1 answer
60 views

QGIS - Have spreadsheet with col from 0% to 100% plus null want 100 bin gradient plus one more for null

Newbie alert. Have a spreadsheet with no geo; has a col with values in there from 0% to 100%, plus several blanks/nulls. Ideally would like a 100 step (bin) gradient fill from 0 (100% black) to 100 (...
  • 219
4 votes
1 answer
999 views

How to generate missing points in GPS trajectories?

I have some GPS trajectories that include gps locations recorded on variable frequencies (every 1 min ,5 min , 20 min,etc.)using a geographic projection WGS84. In my work, i need a fine-grained GPS ...
2 votes
1 answer
2k views

QGIS Polygons missing after saving edits

Right, I am slightly worried. I opened QGIS this morning to discover that part of the work I did yesterday was not there (the attributes where present in the table, but were not digitised anywhere on ...
  • 21
0 votes
1 answer
107 views

How can I find the missing data from the downloaded bulk TRMM data?

I have downloaded TRMM daily precipitation estimates for Indian Sub-continent from 1988 to present. I see that there are a lot of missing data days. I was wondering how can I possibly detect the daily ...
0 votes
1 answer
413 views

Fusion Tables missing from Google Drive [closed]

Many of my Fusion Tables are missing off my Google Drive account, has anyone else experienced, and hopefully resolved, this issue?
1 vote
1 answer
1k views

Parts of geometry disappearing in QGIS export to Illustrator PDF?

I'm having this issue with certain polygons when I export to PDF. Everything looks fine in QGIS, everything fine in print composer, everything fine in the PDF as viewed in Preview or Adobe Reader. ...
  • 31
1 vote
2 answers
847 views

Export GRASS raster as GeoTIFF : nodata values exported as -nan (what happens in R?)

I am using the package raster to work with GeoTIFF raster files which I exported from GRASS using r.out.gdal. GRASS assigned the value -nan to some raster files (type FLOAT32) for missing values. ...