Python - Convert JSON object data into a List

Question

I have data in a JSON object with a key:value as shown below in Python. There are two records having same ID 13 for the Hari and 16 for the Liz.

from collections import defaultdict
from itertools import *
from operator import itemgetter

data = [
  {
    "fname": "Abc",
    "lname": "xyz",
    "id": 15,
    "club": "-",
    "date": "-"
  },
  {
    "fname": "Hari",
    "lname": "Lee",
    "id": 13,
    "club": "Manutd",
    "date": "2016-03-20T22:00:00.000Z"
  },
  {
    "fname": "David",
    "lname": "James",
    "id": 14,
    "club": "Barca",
    "date": "-"
  },
  {
    "fname": "Hari",
    "lname": "Lee",
    "id": 13,
    "club": "Chelsea",
    "date": "2012-03-20T22:00:00.000Z"
  },
  {
    "fname": "Liz",
    "lname": "Kiz",
    "id": 16,
    "club": "-",
    "date": "-"
  },
  {
    "fname": "Liz",
    "lname": "Kiz",
    "id": 16,
    "club": "Falkon",
    "date": "2014-03-20T22:00:00.000Z"
  }
]

newdata = []
#for item, value in enumerate(data):
  #for i,v in value.iteritems():
    #print value['id']
    #print value[i]
    #print i,v
    #newdata.append()

I want to reformat JSON data into list without a key and merge duplicated ID as a list of list. The record with same ID's will be mapped into list of list as shown below. How can I achieve this?

newdata = [[["Hari", "Lee", "Manutd", "2016-03-20T22:00:00.000Z"], ["Hari", "Lee", "Chelsea", "2012-03-20T22:00:00.000Z"]], 
    ["David", "James", "Barca", "-"], ["Abc", "xyz", "-" "-"], [["Liz", "Kiz", "-", "-"], ["Liz", "Kiz", "Falkon", "2014-03-20T22:00:00.000Z"]]]

Iterate over the new list data and write each list data as a row in excel (xlwt) file

for i1, v1 in enumerate(newdata):
  for i2,v2 in enumerate(v1):
    if(type(v2) is str):
      print v2
    else:
      for i3,v3 in enumerate(v2):
        print v3

qvpham · Accepted Answer · 2016-05-19 07:54:08Z

2

To check the same ID you need to store data in a dict

ret_dict = {}

But dict isn't ordered. If you want to hold your order, you can you OrderedDict

from collections import OrderedDict
ret_dict = OrderedDict()
for element in data:
    # To remove 'id' from the dict 'element' use element.pop('id')
    # element.pop('id') return the value of id
    ret_dict.setdefault(element.pop('id'), []).append(element.values())

For me ret_dict.values() is already a good result:

>>> print ret_dict.values()
[[['xyz', '-', '-', 'Abc']], [['Lee', 'Manutd', '2016-03-20T22:00:00.000Z', 'Hari'], ['Lee', 'Chelsea', '2012-03-20T22:00:00.000Z', 'Hari']], [['James', 'Barca', '-', 'David']], [['Kiz', '-', '-', 'Liz'], ['Kiz', 'Falkon', '2014-03-20T22:00:00.000Z', 'Liz']]]

But for exactly what you want, you need to build a new list from the values of the last dict:

ret_list = [e[0] if len(e) == 1 else e for e in ret_dict.itervalues()]

itervalues() to get the iterator of values instead of a list like values()
Output:

>>> print ret_list
[['xyz', '-', '-', 'Abc'], [['Lee', 'Manutd', '2016-03-20T22:00:00.000Z', 'Hari'], ['Lee', 'Chelsea', '2012-03-20T22:00:00.000Z', 'Hari']], ['James', 'Barca', '-', 'David'], [['Kiz', '-', '-', 'Liz'], ['Kiz', 'Falkon', '2014-03-20T22:00:00.000Z', 'Liz']]]

edited May 19, 2016 at 7:54

answered May 18, 2016 at 13:38

qvpham

1,94811 silver badges17 bronze badges

Sign up to request clarification or add additional context in comments.

7 Comments

MysticCodes Over a year ago

You're a hero! Thanks!

MysticCodes Over a year ago

How can I append element values in order and remove id value from list?

qvpham Over a year ago

Normal dict isn't ordered. You must use OrderedDict to append element values in order. To remove id from a dict or OrderedDict you can use pop. I have updated my answer.

MysticCodes Over a year ago

I am in order as it was in JSON

qvpham Over a year ago

Do you mind this order {"fname": "Abc", "lname": "xyz", "id": 15, "club": "-", "date": "-"}?

|

Collectives™ on Stack Overflow

Python - Convert JSON object data into a List

1 Answer 1

7 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

7 Comments

Your Answer

Sign up or log in

Post as a guest

Related