I've found when something isn't particularly well documented in GDAL, that looking through their tests can be useful.
The /vsis3 test module has some simple examples, though it doesn't have any examples of actually reading chunks.
I've cobbled together the code below based on the test module, but I'm unable to test as GDAL /vsis3 requires credentials ...
How about firing up an EC2 or rackspace instance and installing the EarthExplorer bulk download application:
You could hit the EarthExplorer service with a POST request to submit jobs programmatically:
You would need to provide standingRequestName, frequency, ...
I saw a blog post from developmentseed for their command line utility landsat-util.
Power tools for Satellite Imagery
The landsat-util can be forked from github and compiled from source unless your OS offers it in a binary ready to go.
The blog describes it simply as:
a command line utility that makes it easy to search, download, and
process Landsat ...
Since /vsis3/ is implemented in GDAL you can also use rasterio to read Windows of S3 datasets. This requires either your credentials to be set up for boto or using rasterios AWS session handler.
with rasterio.open('s3://landsat-pds/L8/139/045/LC81390452014295LGN00/LC81390452014295LGN00_B1.TIF') as ds:
window = ds.read(window=((0, 100), (...
You might be interested in Traccar which does exactly what you are looking for.
Plus it is open source.
Plus it is already a web-server.
Plus you can install it on Amazon Ec2 and link the database with Amazon RDS service.
In order to link Traccar with a database like PostGIS, MySQL) see the Traccar page on MySQL Database
Probably not exactly a GIS question, but since I have some notes about this, I will paste some of it here.
When I need to access amazon services through gui, I use xubuntu (since it is more lightweight) and VNC. The following steps do the install, assuming you have xubuntu-desktop already installed. It comes from several online resources patched together ...
One other possibility that uses AWS:
You may want to look into using the AWS Lambda Tiler method that Seth Fitzsimmons devised. He has been using it for the Open Aerial Map project and I used it for a private client project while working at Stamen Design.
There is a thorough blog post which I wrote that documents how to set up the AWS Lambda Tiler on ...
Depending on what you need to be exposed to the internet, it might be the easiest just to change the connector port of the Connect Tomcat to 80 in
C:\Program Files\Pitney Bowes\SpectrumSpatialAnalyst\Tomcat7\AnalystConnect\conf\server.xml
Below are some further notes (assuming Windows server). You may also contact the PB tech support team if you continue ...
I intend to do the same so I start an Amazon EC-2 instance and install the Bulk Download on it.
But as far as I know it's a graphical application and nothing in the doc Bulk Download Tutorial lets hope that you can use it with the terminal.
I read here about the possibility of using Curl but it returns an 403 access denied
After writing emails to USGS, the ...
Another option that you might find useful is Vagrant, which allows you to set up a virtualbox instance using a scripting language and then deploy it to Amazon after you are happy (though I haven't yet tried this). I have a basic vagrant setup which will get you GeoServer in a tomcat instance on GitHub.
This will at least let you play with linux and get ...
At this point I haven't implemented this stuff myself, but the approach that I am planning on is combining boto with the information on Amazon's page on Landsat on AWS. At first glance, it appears to be a rather doable task. Another option is landsat-util which can be found on github, which is python-based and can interface with AWS.
In your AWS console, look for "Security Groups" on the left. Find out which security groups your instance is already using, and/or create a new one for the port you need to open. Add a new inbound rule to that security group for TCP and the 0.0.0.0/0 source. If you created a new security group for this, add it to your instance.
You may need to also check ...
It's certainly possible to run Desktop on a virtual machine (whether or not it's in the cloud) and we run it on Amazon machines for all of our online training courses. To quote the installation and licensing manual:
FME Desktop can be run on the following virtual platforms:
Amazon Web Services (AWS) Elastic Compute Cloud (EC2)
VMware virtual machines
Before you get down and dirty with implementing a TCP server from scratch, you may want to explore some other options.
Depending on you business requirements and considering that it's a web app then something like a webservice might be sufficient (see what fits better SOAP or REST) and you change the server config to handle whatever load you expect.
I wrote a bash script to do this. Note you can customize the url and mouse locations and button clicks in the segment of code with the xdotool command being utilized. Here is the source code:
via: Everything Awesome YTC in the bash playlist
echo " "
sudo apt-get install xdotool -y
echo " "
echo "# NASA/NOAA/NHC Hurricane Satellite ...
To get detailed pricing for AWS services you can use the online calculator located here:
For a small EC2 instance running Linux, if you are willing to commit to a year, you can buy a Reserved Instance that will cost about $25/month. That is in comparison to about 44/month for on demand pricing, or no-contract ...
Beware of micro instances. Their performance is not consistent.
They may be relatively fast for short periods of time and very slow after it.
I'm unaware if the Server deployed to Amazon would have different available settings. I'd expect these options should be available.
Try the following at your own risk (as it involves modifying files you shouldnt be touching)
Open the following in a text editor: C:\Program Files (x86)\ArcGIS\Desktop10.5\bin\ServerTypes.dat
Find the heading that starts with:...
We are currently supporting about 30 editors across the country on an m1.large machine in the Northern California region. It costs about $350/month. Our plan is to move to a m3.medium in the Oregon region. This should bring our costs down to less than $200/month. We run standard workgroup version of ArcGIS Server with SqlServer Express, SDE, GIS Services, ...
Probably the most simple option is switching to some other distro, they don't limit your choice by just Fedora, even for micro instances. https://aws.amazon.com/amis/ - Try Ubuntu, or OpenSuse
OpenSuse postgis2 package: http://software.opensuse.org/package/postgis2
Ubuntu PPA: https://launchpad.net/~ubuntugis/+archive/ppa?field.series_filter=precise
This script, with some tweaking (indentation issues and some comments/variables were in french) has been extremely helpful to me. However, it can only download the data that's already in the archive. So for data that hasn't been processed, you have to order it. I'm working on automating that now, but off to ...
Here's a tutorial: http://hub.qgis.org/projects/quantum-gis/wiki/QGIS_Server_Tutorial
Here's another: http://docs.qgis.org/2.0/da/docs/user_manual/working_with_ogc/ogc_server_support.html
I'd recommend using Ubuntu 12.04, you can find an EC2 image for that.
(Edit: fixed the second link)
I don't believe we have support in FME Cloud for Amazon EBS, although from the look of it it's something we could well do in the future. Ping an email to our support team and a Server/Cloud expert there will know more than I do.
FME Cloud does have the ability to integrate data from other cloud storage facilities. In particular we have S3Uploader and ...
Thanks @iant, you are right, Tomcat 8.0.24 has apparently some issues. I just tested it with Tomcat 8.0.20 and it worked fine. So now I have GeoServer up and running on Tomcat 8.0.22 using Java 8 (Oracle).
Try using an XML file to store the WMS info in, more details are at the GDAL WMS documentation.
Here's an example WMS XML file to retrieve data from Mapzen's Elevation API:
I have had this problem before, ill see if i can explain what I remember.
The problem existed with Apache.
We had load balancing implemented which enabeld concurrent apache tomcat sessions. This improved performance.
Sometimes we would notice that one of the ports would just stop responding or returning a result.
There was a cache associated with each apache ...
Geoserver supports horizontally and vertically scalled architectures, This is achieved by applying cluster extension on geoserver.
A vertical architecture provides you with some nodes that work alongside a master node and helps you to respond too many requests simultaneously.
You need also a load balancer to manage received requests.
I used it for my ...
Reserved Instance cost savings automatically get applied to an on-demand instance that matches the:
..of the Reserved Instance that you have purchased. So, assuming you have access to your AWS Console, you can go in there, search for and purchase a Reserved Instance that matches the above specs of your on-...