Re: get duplicate frames when doing multiprocessing

Yodash <[email protected]> Mon, 5 Apr 2021 05:35:31 -0700 (PDT)
Newsgroups gmane.comp.python.wxpython
Message-ID <[email protected]>
first, thanks for the quick replay :)..
my target is to load data frames in parallel in order to save time (trigger 
for the action is button click on frame)
you are correct, i loaded same df 3 times but its just an example (on my 
production app they are not the same) 

the issue is that whenever I try to perform parallelism using 
multiprocessing..my frame is duplicated as number of child processes I 
declare 

it will be a pity not to be able use parallelism from wx...
Sure I'm missing something

thanks,Yodash
On Sunday, April 4, 2021 at 10:08:43 PM UTC+3 Tim Roberts wrote:

> On 4/4/21 9:39 AM, Yodash wrote:
>
> Hello 
> i'm trying to speed up my data load from pandas dataframe using 
> multiprocessing
>
> I can't tell what you were trying to achieve here.  Your code loads the 
> same file in three different processes but then does nothing with it.  Each 
> process will load the entire file.
>
> Multiprocessing is really only useful in very limited circumstances.  
> Remember that, when you use multiprocessing, you are literally running 
> different processes with different memory spaces.  They are not connected 
> in any way.  You can feed data in and copy data back out at the end.  And, 
> of course, you can only manipulate the UI in your main process.  None of 
> the others have any UI.
>
> IF you are trying to load a single dataframe by splitting the load across 
> three processes, that's impossible.
>
>
> *my problem is that when i do multiprocessing from wx.frame , I 
> surprisingly get duplicates of my frame* -* as the number of processes 
> i'm trying to use*  (*no matter what method i use*...Pool/Pool.apply_sync 
> or Process(target=f_action,) 
>
> it doesn't happen all the time
>
> for example..this code will duplicate the frame 3 times:
>
> The code you showed will certainly do that, because you're loading the 
> same file 3 times.
> -- 
>
> Tim Roberts, [email protected]
> Providenza & Boekelheide, Inc.
>
>

-- 
You received this message because you are subscribed to the Google Groups "wxPython-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [email protected].
To view this discussion on the web visit https://groups.google.com/d/msgid/wxpython-users/8224ee76-b447-4c2e-a39f-65bff32cef41n%40googlegroups.com.