Skip to main content
Geographic Information Systems

Return to Question

added 52 characters in body; edited tags; edited title
Source Link
Taras ♦
Taras ♦
  • 34k
  • 4
  • 73
  • 148

How to write GeoPandas dataframe Writing GeoDataFrame to a GeoJSON without nullNull values in GeoPandas

I have a GeoPandas dataframeGeoDataFrame:

import geopandas as gpd
import numpy as np

df = \
gpd.GeoDataFrame.from_dict(
    dict(
        geometry=gpd.points_from_xy([0,1,2],[3,4,5]),
        col0=["A","B","C"],
        col1=["A","B",np.nan],
        col2=["A",np.nan,np.nan],
        col3=[np.nan,np.nan,np.nan],
    )
).set_crs(4326)

import geopandas as gpd
import numpy as np

df = \
gpd.GeoDataFrame.from_dict(
    dict(
        geometry=gpd.points_from_xy([0,1,2],[3,4,5]),
        col0=["A","B","C"],
        col1=["A","B",np.nan],
        col2=["A",np.nan,np.nan],
        col3=[np.nan,np.nan,np.nan],
    )
).set_crs(4326)

I could create the GeoJSON line by line, but that seems tedious. I could theoretically also create a GeoJSON with the nulls, and then produce another GeoJSON without the nulls. In my real world usecase-world use case, I have a lot of different columns, almost all of them have rows almost exclusively set to null, so this is not very practical. I am also open to using another file format as GeoPandas' output, followed by a convertconversion to GeoJSON by ogr2ogr for example. The naive

df.to_file("test.gpkg")

df.to_file("test.gpkg")

This thread is on a similar topic, asking how to remove nulls from an existing GeoJSON. I would like to create one without the nulls being there in the first place from the GeoPandas dataframeGeoDataFrame.

What is an easy way to achieve the above described result? What is an easy way to achieve the above-described result?

How to write GeoPandas dataframe to a GeoJSON without null values

I have a GeoPandas dataframe:

import geopandas as gpd
import numpy as np

df = \
gpd.GeoDataFrame.from_dict(
    dict(
        geometry=gpd.points_from_xy([0,1,2],[3,4,5]),
        col0=["A","B","C"],
        col1=["A","B",np.nan],
        col2=["A",np.nan,np.nan],
        col3=[np.nan,np.nan,np.nan],
    )
).set_crs(4326)

I could create the GeoJSON line by line, but that seems tedious. I could theoretically also create a GeoJSON with the nulls, and then produce another GeoJSON without the nulls. In my real world usecase, I have a lot of different columns, almost all of them have rows almost exclusively set to null, so this is not very practical. I am also open to using another file format as GeoPandas' output, followed by a convert to GeoJSON by ogr2ogr for example. The naive

df.to_file("test.gpkg")

This thread is on a similar topic, asking how to remove nulls from an existing GeoJSON. I would like to create one without the nulls being there in the first place from the GeoPandas dataframe.

What is an easy way to achieve the above described result?

Writing GeoDataFrame to GeoJSON without Null values in GeoPandas

I have a GeoPandas GeoDataFrame:

import geopandas as gpd
import numpy as np

df = \
gpd.GeoDataFrame.from_dict(
    dict(
        geometry=gpd.points_from_xy([0,1,2],[3,4,5]),
        col0=["A","B","C"],
        col1=["A","B",np.nan],
        col2=["A",np.nan,np.nan],
        col3=[np.nan,np.nan,np.nan],
    )
).set_crs(4326)

I could create the GeoJSON line by line, but that seems tedious. I could theoretically also create a GeoJSON with the nulls, and then produce another GeoJSON without the nulls. In my real-world use case, I have a lot of different columns, almost all of them have rows almost exclusively set to null, so this is not very practical. I am also open to using another file format as GeoPandas' output, followed by a conversion to GeoJSON by ogr2ogr for example. The naive

df.to_file("test.gpkg")

This thread is on a similar topic, asking how to remove nulls from an existing GeoJSON. I would like to create one without the nulls being there in the first place from the GeoDataFrame.

What is an easy way to achieve the above-described result?

added 57 characters in body
Source Link
zabop
zabop
  • 2.7k
  • 14
  • 41
import geopandas as gpd
import numpy as np

df = \
gpd.GeoDataFrame.from_dict(
    dict(
        geometry=gpd.points_from_xy([0,1,2],[3,4,5]),
        col0=["A","B","C"],
        col1=["A","B",np.nan],
        col2=["A",np.nan,np.nan],
        col3=[np.nan,np.nan,np.nan],
    )
).set_crs(4326)

df = \
gpd.GeoDataFrame.from_dict(
    dict(
        geometry=gpd.points_from_xy([0,1,2],[3,4,5]),
        col0=["A","B","C"],
        col1=["A","B",np.nan],
        col2=["A",np.nan,np.nan],
        col3=[np.nan,np.nan,np.nan],
    )
).set_crs(4326)

import geopandas as gpd
import numpy as np

df = \
gpd.GeoDataFrame.from_dict(
    dict(
        geometry=gpd.points_from_xy([0,1,2],[3,4,5]),
        col0=["A","B","C"],
        col1=["A","B",np.nan],
        col2=["A",np.nan,np.nan],
        col3=[np.nan,np.nan,np.nan],
    )
).set_crs(4326)
Source Link
zabop
zabop
  • 2.7k
  • 14
  • 41

How to write GeoPandas dataframe to a GeoJSON without null values

I have a GeoPandas dataframe:

                  geometry col0 col1 col2  col3
0  POINT (0.00000 3.00000)    A    A    A   NaN
1  POINT (1.00000 4.00000)    B    B  NaN   NaN
2  POINT (2.00000 5.00000)    C  NaN  NaN   NaN

Reproducible via:

df = \
gpd.GeoDataFrame.from_dict(
    dict(
        geometry=gpd.points_from_xy([0,1,2],[3,4,5]),
        col0=["A","B","C"],
        col1=["A","B",np.nan],
        col2=["A",np.nan,np.nan],
        col3=[np.nan,np.nan,np.nan],
    )
).set_crs(4326)

I would like to create a GeoJSON file from it, without having the key-value pairs where the value is null. The desired GeoJSON file:

{
"type": "FeatureCollection",
"crs": { "type": "name", "properties": { "name": "urn:ogc:def:crs:OGC:1.3:CRS84" } },
"features": [
{ "type": "Feature", "properties": { "col0": "A", "col1": "A", "col2": "A" }, "geometry": { "type": "Point", "coordinates": [ 0.0, 3.0 ] } },
{ "type": "Feature", "properties": { "col0": "B", "col1": "B" }, "geometry": { "type": "Point", "coordinates": [ 1.0, 4.0 ] } },
{ "type": "Feature", "properties": { "col0": "C" }, "geometry": { "type": "Point", "coordinates": [ 2.0, 5.0 ] } }
]
}

I try to create this file via df.to_file("test.geojson"). The created test.geojson:

{
"type": "FeatureCollection",
"crs": { "type": "name", "properties": { "name": "urn:ogc:def:crs:OGC:1.3:CRS84" } },
"features": [
{ "type": "Feature", "properties": { "col0": "A", "col1": "A", "col2": "A", "col3": null }, "geometry": { "type": "Point", "coordinates": [ 0.0, 3.0 ] } },
{ "type": "Feature", "properties": { "col0": "B", "col1": "B", "col2": null, "col3": null }, "geometry": { "type": "Point", "coordinates": [ 1.0, 4.0 ] } },
{ "type": "Feature", "properties": { "col0": "C", "col1": null, "col2": null, "col3": null }, "geometry": { "type": "Point", "coordinates": [ 2.0, 5.0 ] } }
]
}

This is not what I want, since the properties array contains key-value pairs where the value is null:

"properties": { "col0": "A", "col1": "A", "col2": "A", "col3": null }
"properties": { "col0": "B", "col1": "B", "col2": null, "col3": null }
"properties": { "col0": "C", "col1": null, "col2": null, "col3": null }

I could create the GeoJSON line by line, but that seems tedious. I could theoretically also create a GeoJSON with the nulls, and then produce another GeoJSON without the nulls. In my real world usecase, I have a lot of different columns, almost all of them have rows almost exclusively set to null, so this is not very practical. I am also open to using another file format as GeoPandas' output, followed by a convert to GeoJSON by ogr2ogr for example. The naive

df.to_file("test.gpkg")

followed by

ogr2ogr test.geojson test.gpkg

did not solve the issue (which is expected, I need to write a more specific ogr2ogr command to have the desired output, but I haven't yet figured out what this command is exactly).

This thread is on a similar topic, asking how to remove nulls from an existing GeoJSON. I would like to create one without the nulls being there in the first place from the GeoPandas dataframe.

What is an easy way to achieve the above described result?