Converting for loop to extract values from a data frame using various lists

Question

Converting for loop to extract values from a data frame using various lists

In the scenario where I have two lists, list1 and list2, along with a single data frame called df1, I am applying filters to append certain from_account values to an empty list p.

Some sample values of list1 are: [128195, 101643, 143865, 59455, 108778, 66042, 138456, 66043]

And here are a few values from list2: [128594, 128599, 128596, 128588, 128168, 125410, 127166, 127078]

p=[]
for i in list1:
    for j in list2:
        ss=df1[df1.to_account==i]
        for k in range(0,len(ss.from_account)):
            if(ss.from_account.values[k]==j):
                p.append(j)

Currently, the execution time using a for loop is quite lengthy. Are there any alternative methods that can produce the same result but more efficiently in terms of execution time?

python python-3.x pandas dataframe

Answer 1

Answer №1

It appears that the variable ss.from_account.values represents a list, so instead of iterating through it using variable k, you can simply verify if the value exists within that list:

result=[]
for item in items_list:
    ss=df1[df1.to_account==item]
    for value in values_list:
        if value in ss.from_account.values:
            result.append(value)

In addition, I have adjusted the position of the declaration of ss outside the inner loop, eliminating unnecessary repetitions. There is potential for further optimization with the following revised code:

results=[]
for item in items_list:
    ss=df1[df1.to_account==item]
    results += [value for value in values_list if value in ss.from_account.values]

Answer 2

It appears that the variable ss.from_account.values represents a list, so instead of iterating through it using variable k, you can simply verify if the value exists within that list:

result=[]
for item in items_list:
    ss=df1[df1.to_account==item]
    for value in values_list:
        if value in ss.from_account.values:
            result.append(value)

In addition, I have adjusted the position of the declaration of ss outside the inner loop, eliminating unnecessary repetitions. There is potential for further optimization with the following revised code:

results=[]
for item in items_list:
    ss=df1[df1.to_account==item]
    results += [value for value in values_list if value in ss.from_account.values]

Converting for loop to extract values from a data frame using various lists

Answer №1

Similar questions

Developing a Python serverless function on Vercel using Next.js is a streamlined

Changeable text. / Programming with Python / Kivy framework

What's causing the no attribute error in Selenium with Python?

Is there a way to automate saving the initial search result link from Google using Selenium?

Unresolved issue with Flask failing to retrieve URL argument from AJAX request

Troubleshooting Routing Problems in Python with Flask

Which is more suited to use in this Python function: a global variable or a parameter?

Using Kivy's TabbedPanel: How can you invoke the switch_to function from a different class?

Is there a way to verify if the viewed file is in .xlsx or .csv format?

Python Selenium: Guide to choosing an option from a SELECT element

What is the best way to replicate a string in python?

Facing Challenges with Python Selenium while Accessing Specific Form Elements in Salesforce

Difficulty locating the element

Is there a way to attach an audio file to a video clip using moviepy without having to re-encode the

Is there a way to include both an extension and its settings in the chrome driver's extensions?

Pressing on item in the command prompt

I am having difficulty locating or clicking on an element on my page using Selenium, Python, findelement, and Xpath methods

Selenium-powered Python Web Scraping

Press on Selenium with Python

Encountering difficulties with resolving captcha through a specific service