I am working with a dictionary obtained from a cURL call in Python 3.8 and my goal is to extract information from just two specific keys to create a list that can be written into a csv file.
The dictionary contains only one key-value pair, where the value is a list of dictionaries that hold the desired information. In these nested dictionaries, I am specifically interested in the 'conceptId' and 'fsn' key-value pairs (with 'fsn' further containing another nested dictionary from which I need the 'term').
Below is an excerpt of the dictionary featuring two relevant 'items', despite its actual size being much larger.
res_json = {'items': [{'conceptId': '15964901000119107', 'active': True, 'definitionStatus': 'PRIMITIVE', 'moduleId': '900000000000207008', 'fsn': {'term': 'Atypical atrial flutter (disorder)', 'lang': 'en'}, 'pt': {'term': 'Atypical atrial flutter', 'lang': 'en'}, 'id': '15964901000119107'}, {'conceptId': '10811961000119109', 'active': True, 'definitionStatus': 'FULLY_DEFINED', 'moduleId': '900000000000207008', 'fsn': {'term': 'Cardiac arrest due to incomplete miscarriage (disorder)', 'lang': 'en'}, 'pt': {'term': 'Cardiac arrest due to incomplete miscarriage', 'lang': 'en'}, 'id': '10811961000119109'}]}
Desired Output:
output = ['15964901000119107', 'Atypical atrial flutter (disorder)'], ['10811961000119109', 'Cardiac arrest due to incomplete miscarriage (disorder)']
Here is the code I have developed so far (flatten_json):
#Flatten json
def flatten_json(y):
out = {}
def flatten(x, name=''):
if type(x) is dict:
for a in x:
flatten(x[a], name + a + '_')
elif type(x) is list:
i = 0
for a in x:
flatten(a, name + str(i) + '_')
i += 1
else:
out[name[:-1]] = x
flatten(y)
return out
flat = flatten_json(res_json)
json_normalize(flat)
output_list = []
for k, v in flat.items():
if "conceptId" in k:
output_list.append(v)
if "fsn_term" in k:
output_list.append(v)
for k, v in flat.items():
if "fsn" in l:
output[k] = v
Although the current code returns a single list with values in alternating order, it does not generate a list of lists that can be directly exported to a csv file.
>>>output_list: ['15964901000119107', 'Atypical atrial flutter (disorder)', '10811961000119109', 'Cardiac arrest due to incomplete miscarriage (disorder)']
How can I enhance the functionality of my existing code?