Navigating through filenames using Python

Question

Navigating through filenames using Python

With a collection of 200 JSON files in Python named "1.json", "2.json", "3.json" and so on, I set out to apply modifications using a loop. Unable to achieve the desired result using "for i in range(1, 200):", I decided to pursue an alternative method.


myList = {"1.json", "2.json", "3.json"}
for toImport in myList:
    with open("path1" + toImport) as f:
        json_response = json.load(f)


for data in json_response:
    try:
        for special_issue in data["specific_issues"]:
            for x in special_issue["bills_by_algo"]:
                resulting_data.append(({"id": x["id"], "committees": x["committees"]}))

    except KeyError as e:
        print(e, "not found in entry.")
        continue

b = pd.DataFrame(resulting_data)
print(b)
b.to_csv(r"path2" +toImport)

Although now devoid of error messages, the files are not being exported. What adjustments should I make?

python json loops path

Answer 1

Answer №1

Upon reviewing your edits, I see that adjustments need to be made to the answer:

It appears that you should indent all of your response handling code within the for loop, as the json_response variable gets overwritten after each iteration.

myList = {"1.json", "2.json", "3.json"}
for toImport in myList:

    with open("path1" + toImport) as f:
        json_response = json.load(f)

    resulting_data = []
    for data in json_response:
        try:
            for special_issue in data["specific_issues"]:
                for x in special_issue["bills_by_algo"]:
                    resulting_data.append(
                        ({"id": x["id"], "committees": x["committees"]})
                    )

        except KeyError as e:
            print(e, "not found in entry.")
            continue

    b = pd.DataFrame(resulting_data)
    print(b)
    b.to_csv(r"path2" + toImport)

Previous answer prior to the edit:

You have a small SyntaxError caused by improper indentation below the for loop.

import pandas as pd
import json

myList = {"1.json", "2.json", "3.json"}
for toImport in myList:
    with open("path" + toImport) as f:
        json_response = json.load(f)

Answer 2

Upon reviewing your edits, I see that adjustments need to be made to the answer:

It appears that you should indent all of your response handling code within the for loop, as the json_response variable gets overwritten after each iteration.

myList = {"1.json", "2.json", "3.json"}
for toImport in myList:

    with open("path1" + toImport) as f:
        json_response = json.load(f)

    resulting_data = []
    for data in json_response:
        try:
            for special_issue in data["specific_issues"]:
                for x in special_issue["bills_by_algo"]:
                    resulting_data.append(
                        ({"id": x["id"], "committees": x["committees"]})
                    )

        except KeyError as e:
            print(e, "not found in entry.")
            continue

    b = pd.DataFrame(resulting_data)
    print(b)
    b.to_csv(r"path2" + toImport)

Previous answer prior to the edit:

You have a small SyntaxError caused by improper indentation below the for loop.

import pandas as pd
import json

myList = {"1.json", "2.json", "3.json"}
for toImport in myList:
    with open("path" + toImport) as f:
        json_response = json.load(f)

Answer 3

Answer №2

Ensure proper indentation for Python code blocks.

In Python, it is important to properly indent your code blocks. For example, if you want to include the 'with' statement within a loop, make sure to indent it along with its related lines of code.

Answer 4

Ensure proper indentation for Python code blocks.

In Python, it is important to properly indent your code blocks. For example, if you want to include the 'with' statement within a loop, make sure to indent it along with its related lines of code.

Answer 5

Answer №3

An issue with indentation has been detected. Below is a corrected version:

import pandas as pd
myList = {'1.json', '2.json', '3.json'}
for toImport in myList:
    with open('path'+toImport) as f:
        json_response = json.load(f)

Answer 6

An issue with indentation has been detected. Below is a corrected version:

import pandas as pd
myList = {'1.json', '2.json', '3.json'}
for toImport in myList:
    with open('path'+toImport) as f:
        json_response = json.load(f)

Answer 7

Answer №4

It has been pointed out that there is an indentation error in the code, but a bigger issue is having to list all files by hand. A better approach would be to loop over a folder and process only JSON files:

import os

folder = os.path.join('.', 'path/to/data')

for r, d, f in os.walk(folder):
    for file in f:
        if '.json' in file:
            with open(file) as f:
                # perform actions on f

Answer 8

It has been pointed out that there is an indentation error in the code, but a bigger issue is having to list all files by hand. A better approach would be to loop over a folder and process only JSON files:

import os

folder = os.path.join('.', 'path/to/data')

for r, d, f in os.walk(folder):
    for file in f:
        if '.json' in file:
            with open(file) as f:
                # perform actions on f

Navigating through filenames using Python

Answer №1

Answer №2

Answer №3

Answer №4

Similar questions

Obtain 2 text values from HTML by extracting with Python Selenium and ChromeDriver

Transforming Python AES into Node JS

Exploring the capabilities of data processing in Node.js

Tips for iterating through both a list and dictionary simultaneously within a for loop at the template level in Django

Utilizing Python's regular expressions for parsing and manipulating Wikipedia text

Utilizing Json and Gson for Android Development

Error encountered when attempting to compile tutorial example using json::object!: identifier expected, keyword found

The jsTree rendering does not properly display the "closed" state of the JSON data nodes

Extracting information from a webpage

Trouble accessing contacts on LinkedIn

Having trouble making JSON work alongside Ajax and jQuery?

Exploring Selenium With Various Network Connections

Jackson utilizes varying deserializers for unique scenarios

The second iteration of the while loop in Selenium throws an error

Using pre-existing CSS state background colors in GTK3

Could anyone provide some insight into this recursive function? I grasp the concept of the function counting down to zero, but I struggle to comprehend how it manages to count back up to

What is the purpose of including localId elements when performing a bulk create issue operation in Jira's API?

Compiling Python 3.4 with emscripten on Linux (encountering linkage errors)

Error in decoding JSON while creating an index in Azure Search

Analyzing PCAP files with Python 2.6