Timeline for R - multicore approach to extract raster values using spatial points
Current License: CC BY-SA 3.0
10 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| Mar 2, 2019 at 18:00 | history | tweeted | twitter.com/StackGIS/status/1101905159133769729 | ||
| Sep 6, 2017 at 20:59 | vote | accept | thiagoveloso | ||
| Sep 6, 2017 at 20:59 | answer | added | thiagoveloso | timeline score: 6 | |
| Aug 29, 2017 at 21:02 | history | edited | PolyGeo♦ | CC BY-SA 3.0 |
deleted 52 characters in body
|
| Aug 29, 2017 at 10:55 | comment | added | Spacedman | Suggest you find some R parallel tutorials, things like this cran.r-project.org/web/packages/doParallel/vignettes/… might get you started. | |
| Aug 29, 2017 at 10:48 | comment | added | thiagoveloso |
@Spacedman I would also appreciate any more detailed suggestion regarding the parallel package. Not very familiar with multicore processing here...
|
|
| Aug 29, 2017 at 10:46 | comment | added | thiagoveloso | @Spacedman my actual raster stack is 100x95 at 0.5 deg resolution with 54750 "layers" (i.e. time slices). Also, I have 32 files like that that I need to extract data from (different climate scenarios and models). I just thought it was too big of an object for users to reproduce here. | |
| Aug 29, 2017 at 10:15 | comment | added | Spacedman |
This is "trivially parallel" over layers in your raster stack and over points in your spatial points. Use functions from the parallel package.
|
|
| Aug 29, 2017 at 10:10 | comment | added | Spacedman | I don't see where your 30Gb comes from. 89 years x 365 days x 655 stations is 21 million. You need to be handling about 1000 bytes for each of those units to get 30Gb, where one temperature measurement is 8 bytes. 160-250Mb maybe, which is easily stored in RAM. | |
| Aug 29, 2017 at 8:56 | history | asked | thiagoveloso | CC BY-SA 3.0 |