Questions tagged [google-big-query]

BigQuery is a fully-managed, serverless data warehouse that enables scalable analysis over petabytes of data.

Filter by
Sorted by
Tagged with
3 votes
1 answer
332 views

Break down one extremely large Polygon into many smaller polygons using BigQuery only

I have a giant polygon which is part of the UK's open source Flood Zone 2 dataset, found here. At the moment, it is breaking our data pipeline due to its sheer size. As far as I am aware, it is the ...
Max's user avatar
  • 31
1 vote
1 answer
176 views

Loading geospatial data from GCS to BQ - JSON parsing error

I am in the process of loading a jsonl file from Google Cloud Storage (GCS) into Big Query (BQ). When I load in data directly through BQ, I am not having any issues. However, I have moved on to larger ...
MoreMeowbell's user avatar
0 votes
1 answer
1k views

Invalid polygon loop: Edge 0 has duplicate vertex with edge 77 in BigQuery

I am trying to use a ST_GeogFromText and it returns a ST_GeogFromText failed: Invalid polygon loop: Edge 0 has duplicate vertex with edge 77 What does this mean and how to fix it other than using ...
Carter's user avatar
  • 1
1 vote
1 answer
143 views

Switch position of latitude and longitude in polygon using BigQuery [closed]

I have many polygons one example is like so POLYGON ((-6.17635568766753 106.81217949327073, -6.177086740025682 106.81236308865992, -6.177909092611173 106.81256741425203, -6.178459760710375 106....
Jimmy's user avatar
  • 45
3 votes
1 answer
377 views

BigQuery ST_MakeLine vs PostGIS ST_MakeLine

Description I'm trying to move our database from BigQuery to PostgreSQL. The issue that I'm encountering is that calculated distance for a line, built from same GPS traces, are way different in ...
hockeyman's user avatar
  • 131
1 vote
1 answer
223 views

How big geometry are best for BigQuery performance

I make a geospatial analysis, in Google BigQuery, which mostly includes making difference (I mean ST_Difference) between parcels geometry and some objects like woods, buildings etc. Some of objects I ...
Jurek's user avatar
  • 19
1 vote
1 answer
418 views

Representing a route that doubles back on itself in BigQuery with a LineString

I'm trying to represent routes in BigQuery, but running into issues for routes that double back on themselves. Consider the following LineString that proceeds from the southwest to the northeast of ...
mjumbewu's user avatar
  • 133
0 votes
1 answer
307 views

Converting SQL queries from PostGIS to BigQuery

I have a table called drawn_items with columns “the_geom”, “fsrn_db” , & “area” in Carto2 which is queried by SQL. Having recreated the table in Carto 3, in order to use the query, I must ...
williamh's user avatar
0 votes
1 answer
251 views

Clip a shapefile by a line border

I'm trying to generate a clipped file of a sample polygon geography (in this case, zip) and the U.S. coastline. This is the query I currently have: select state_code, zip_code, st_union(st_dump(...
Hanna Haddad's user avatar
0 votes
0 answers
537 views

Big Query: ST_GeogFromText failed: Unexpected 'geometry' at position 0

I'm pretty new to the GIS field, so might be ignoring something obvious here. I'm trying to match Mlab speed test data (each record had lat long attribute) with map of administrative boundaries of ...
LuranLuran's user avatar
4 votes
1 answer
1k views

How to import PostGIS into BigQuery GIS?

I have to import PostGIS data into BigQuery GIS. In order to do this, I dumped the PostGIS data in CSV and import it into BigQuery. This is working for all the columns but not the geometric one. If I ...
ucsky's user avatar
  • 143
3 votes
0 answers
330 views

Which Big Data analytics platform has most extensive GIS support? [closed]

I've recently had to deal with datasets that are simply too large to be efficiently processed using PostgreSQL and so I've turned to Google's BigQuery for those tasks. BigQuery, while offering ...
Encomium's user avatar
  • 3,083