Reading gdp datapackage results in ValueError: Cannot cast u'1968' for <Year>

[Fak3]

I just tried to use jsontableschema-pandas, and got an error from jsontableschema:

In [1]: import datapackage

In [2]: storage = datapackage.push_datapackage('http://data.okfn.org/data/core/gdp/datapackage.json', 'pandas')
---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
<ipython-input-2-250f172059bb> in <module>()
----> 1 storage = datapackage.push_datapackage('http://data.okfn.org/data/core/gdp/datapackage.json', 'pandas')

/home/u1/.virtualenvs/pandas/lib/python2.7/site-packages/datapackage/pushpull.pyc in push_datapackage(descriptor, backend, **backend_options)
     74     for table in storage.buckets:
     75         if table in datamap:
---> 76             storage.write(table, datamap[table])
     77     return storage
     78 

/home/u1/.virtualenvs/pandas/lib/python2.7/site-packages/jsontableschema_pandas/storage.pyc in write(self, bucket, rows)
    136         # Prepare
    137         descriptor = self.describe(bucket)
--> 138         new_data_frame = mappers.descriptor_and_rows_to_dataframe(descriptor, rows)
    139 
    140         # Just set new DataFrame if current is empty

/home/u1/.virtualenvs/pandas/lib/python2.7/site-packages/jsontableschema_pandas/mappers.pyc in descriptor_and_rows_to_dataframe(descriptor, rows)
     31     index_rows = []
     32     jtstypes_map = {}
---> 33     for row in rows:
     34         values = []
     35         index = None

/home/u1/.virtualenvs/pandas/lib/python2.7/site-packages/datapackage/pushpull.pyc in values(schema, data)
     53         # TODO: review
     54         def values(schema, data):
---> 55             for item in data:
     56                 row = []
     57                 for field in schema['fields']:

/home/u1/.virtualenvs/pandas/lib/python2.7/site-packages/datapackage/resource.pyc in _iter_from_tabulator(self, table, schema)
    330                     except JsonTableSchemaException as exception:
    331                         message = 'Cannot cast %r for <%s>' % (value, field.name)
--> 332                         six.raise_from(ValueError(message), exception)
    333             yield keyed_row
    334 

/home/u1/.virtualenvs/pandas/lib/python2.7/site-packages/six.pyc in raise_from(value, from_value)
    716 else:
    717     def raise_from(value, from_value):
--> 718         raise value
    719 
    720 

ValueError: Cannot cast u'1968' for <Year>

[Fak3]

Importing country-list datapackage worked just fine.

[Fak3]

Same error with airport-codes:

In [6]: data_url = 'http://data.okfn.org/data/core/airport-codes/datapackage.json'

In [7]: storage = datapackage.push_datapackage(data_url, 'pandas')
---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
<ipython-input-7-e3838b8c6b1f> in <module>()
----> 1 storage = datapackage.push_datapackage(data_url, 'pandas')

/home/u1/.virtualenvs/pandas/lib/python2.7/site-packages/datapackage/pushpull.pyc in push_datapackage(descriptor, backend, **backend_options)
     74     for table in storage.buckets:
     75         if table in datamap:
---> 76             storage.write(table, datamap[table])
     77     return storage
     78 

/home/u1/.virtualenvs/pandas/lib/python2.7/site-packages/jsontableschema_pandas/storage.pyc in write(self, bucket, rows)
    136         # Prepare
    137         descriptor = self.describe(bucket)
--> 138         new_data_frame = mappers.descriptor_and_rows_to_dataframe(descriptor, rows)
    139 
    140         # Just set new DataFrame if current is empty

/home/u1/.virtualenvs/pandas/lib/python2.7/site-packages/jsontableschema_pandas/mappers.pyc in descriptor_and_rows_to_dataframe(descriptor, rows)
     31     index_rows = []
     32     jtstypes_map = {}
---> 33     for row in rows:
     34         values = []
     35         index = None

/home/u1/.virtualenvs/pandas/lib/python2.7/site-packages/datapackage/pushpull.pyc in values(schema, data)
     53         # TODO: review
     54         def values(schema, data):
---> 55             for item in data:
     56                 row = []
     57                 for field in schema['fields']:

/home/u1/.virtualenvs/pandas/lib/python2.7/site-packages/datapackage/resource.pyc in _iter_from_tabulator(self, table, schema)
    330                     except JsonTableSchemaException as exception:
    331                         message = 'Cannot cast %r for <%s>' % (value, field.name)
--> 332                         six.raise_from(ValueError(message), exception)
    333             yield keyed_row
    334 

/home/u1/.virtualenvs/pandas/lib/python2.7/site-packages/six.pyc in raise_from(value, from_value)
    716 else:
    717     def raise_from(value, from_value):
--> 718         raise value
    719 
    720 

ValueError: Cannot cast u'40.07080078' for <latitude_deg>

[Fak3]

Same error on python3

[roll]

Is this format according to spec?

name: "Year",
type: "date",
format: "yyyy"

[roll]

$ goodtables datapackage http://data.okfn.org/data/core/gdp/datapackage.json
DATASET
=======
{'error-count': 999, 'table-count': 1, 'time': 2.588, 'valid': False}

TABLE [1]
=========
{'datapackage': 'http://data.okfn.org/data/core/gdp/datapackage.json',
 'error-count': 999,
 'headers': ['Country Name', 'Country Code', 'Year', 'Value'],
 'row-count': 1000,
 'source': 'https://raw.githubusercontent.com/datasets/gdp/master/data/gdp.csv',
 'time': 1.948,
 'valid': False}
---------
[2,3] [non-castable-value] Row 2 has non castable value in column 3 (type: date, format: yyyy)
[3,3] [non-castable-value] Row 3 has non castable value in column 3 (type: date, format: yyyy)
...

[pwalsh]

Looks like invalid datapackage in reference to spec.

[Fak3]

Should the bug be moved to https://github.com/datasets/gdp repo?

[roll]

MOVED
datasets/gdp#6