Multiprocessing slowing script down Planned maintenance scheduled April 23, 2019 at 23:30 UTC (7:30pm US/Eastern) Announcing the arrival of Valued Associate #679: Cesar Manara Unicorn Meta Zoo #1: Why another podcast?Project Euler - Problem 54: testing poker handsChinese Poker using classesVIM colors downloader in Python, using multiprocessingFind and display best Poker handWatchdog for multiprocessingLoad balancing consumer and producer with multiprocessingPython tool to reduce number of resistors in circuitSubprocess CSV validator and multiprocessing on PythonDeal three Poker hands of five cards each in PythonForming the best possible poker hand

How to compare two different files line by line in unix?

What to do with repeated rejections for phd position

If Windows 7 doesn't support WSL, then what is "Subsystem for UNIX-based Applications"?

Google .dev domain strangely redirects to https

Is it possible for SQL statements to execute concurrently within a single session in SQL Server?

Draw 4 of the same figure in the same tikzpicture

How many time has Arya actually used Needle?

Antipodal Land Area Calculation

Do wooden building fires get hotter than 600°C?

How does Belgium enforce obligatory attendance in elections?

How long can equipment go unused before powering up runs the risk of damage?

How to identify unknown coordinate type and convert to lat/lon?

Drawing spherical mirrors

Why weren't discrete x86 CPUs ever used in game hardware?

How could we fake a moon landing now?

Strange behavior of Object.defineProperty() in JavaScript

Crossing US/Canada Border for less than 24 hours

Is multiple magic items in one inherently imbalanced?

Why do early math courses focus on the cross sections of a cone and not on other 3D objects?

Would it be easier to apply for a UK visa if there is a host family to sponsor for you in going there?

Amount of permutations on an NxNxN Rubik's Cube

Dyck paths with extra diagonals from valleys (Laser construction)

Tannaka duality for semisimple groups

Has negative voting ever been officially implemented in elections, or seriously proposed, or even studied?



Multiprocessing slowing script down



Planned maintenance scheduled April 23, 2019 at 23:30 UTC (7:30pm US/Eastern)
Announcing the arrival of Valued Associate #679: Cesar Manara
Unicorn Meta Zoo #1: Why another podcast?Project Euler - Problem 54: testing poker handsChinese Poker using classesVIM colors downloader in Python, using multiprocessingFind and display best Poker handWatchdog for multiprocessingLoad balancing consumer and producer with multiprocessingPython tool to reduce number of resistors in circuitSubprocess CSV validator and multiprocessing on PythonDeal three Poker hands of five cards each in PythonForming the best possible poker hand



.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty margin-bottom:0;








0












$begingroup$


I am writing a script to help me analyze and get statistics for poker hands. After a lot of research I was able to work with bit manipulation and get my statistics very efficiently for one hand. I want, thought, to be able to run it for several times (millions) and I don't know how to to this efficiently. I tried using multiprocess map (probably wrong) and it slowed the script down significantly.



This is what I had originally:



def get_best_combination(hand, board):

candidate_hand = []
best_score = 9999
best_rank = -1
for h in itertools.combinations(hand, 2):
for b in itertools.combinations(board,3):
candidate_hand = h + b
score = eval_hand(candidate_hand)
if (score < best_score):
best_score = score
best_rank = hand_rank(best_score)
return best_score, best_rank


What the function is doing:
- It combines 2 cards from hand = [Card1, Card2, Card3, Card4, Card5] and 3 cards from board = [Card1, Card2, Card3, Card4, Card5]
- Evaluates the combination and assign a score for it
- Stores and returns the best score and best rank for all possible combinations between hand and board (total of 100 combinations).



This runs really fast for (1 hand, 1 board) (0.02s) but I want to call this function for a lot of different hands and a lot of different boards for every hand. Tried to implement multiprocessing for this but for my surprise it slowed down to almost 40s.



This is what I tried:



def get_best_combination(hand, board):

candidate_hand = []
best_score = 9999
best_rank = -1
p = Pool()
for h in itertools.combinations(hand, 2):
for b in itertools.combinations(board,3):
candidate_hand.append(h+b)
results = p.map(eval_hand, candidate_hand)
for score in results:
if (score < best_score):
best_score = score
best_rank = hand_rank(best_score)
return best_score, best_rank


What is wrong with it? Whys is it slowing the script down instead of speeding it up?



Thanks!









share







New contributor




Vandré Dreer Bonaite is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.







$endgroup$


















    0












    $begingroup$


    I am writing a script to help me analyze and get statistics for poker hands. After a lot of research I was able to work with bit manipulation and get my statistics very efficiently for one hand. I want, thought, to be able to run it for several times (millions) and I don't know how to to this efficiently. I tried using multiprocess map (probably wrong) and it slowed the script down significantly.



    This is what I had originally:



    def get_best_combination(hand, board):

    candidate_hand = []
    best_score = 9999
    best_rank = -1
    for h in itertools.combinations(hand, 2):
    for b in itertools.combinations(board,3):
    candidate_hand = h + b
    score = eval_hand(candidate_hand)
    if (score < best_score):
    best_score = score
    best_rank = hand_rank(best_score)
    return best_score, best_rank


    What the function is doing:
    - It combines 2 cards from hand = [Card1, Card2, Card3, Card4, Card5] and 3 cards from board = [Card1, Card2, Card3, Card4, Card5]
    - Evaluates the combination and assign a score for it
    - Stores and returns the best score and best rank for all possible combinations between hand and board (total of 100 combinations).



    This runs really fast for (1 hand, 1 board) (0.02s) but I want to call this function for a lot of different hands and a lot of different boards for every hand. Tried to implement multiprocessing for this but for my surprise it slowed down to almost 40s.



    This is what I tried:



    def get_best_combination(hand, board):

    candidate_hand = []
    best_score = 9999
    best_rank = -1
    p = Pool()
    for h in itertools.combinations(hand, 2):
    for b in itertools.combinations(board,3):
    candidate_hand.append(h+b)
    results = p.map(eval_hand, candidate_hand)
    for score in results:
    if (score < best_score):
    best_score = score
    best_rank = hand_rank(best_score)
    return best_score, best_rank


    What is wrong with it? Whys is it slowing the script down instead of speeding it up?



    Thanks!









    share







    New contributor




    Vandré Dreer Bonaite is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
    Check out our Code of Conduct.







    $endgroup$














      0












      0








      0





      $begingroup$


      I am writing a script to help me analyze and get statistics for poker hands. After a lot of research I was able to work with bit manipulation and get my statistics very efficiently for one hand. I want, thought, to be able to run it for several times (millions) and I don't know how to to this efficiently. I tried using multiprocess map (probably wrong) and it slowed the script down significantly.



      This is what I had originally:



      def get_best_combination(hand, board):

      candidate_hand = []
      best_score = 9999
      best_rank = -1
      for h in itertools.combinations(hand, 2):
      for b in itertools.combinations(board,3):
      candidate_hand = h + b
      score = eval_hand(candidate_hand)
      if (score < best_score):
      best_score = score
      best_rank = hand_rank(best_score)
      return best_score, best_rank


      What the function is doing:
      - It combines 2 cards from hand = [Card1, Card2, Card3, Card4, Card5] and 3 cards from board = [Card1, Card2, Card3, Card4, Card5]
      - Evaluates the combination and assign a score for it
      - Stores and returns the best score and best rank for all possible combinations between hand and board (total of 100 combinations).



      This runs really fast for (1 hand, 1 board) (0.02s) but I want to call this function for a lot of different hands and a lot of different boards for every hand. Tried to implement multiprocessing for this but for my surprise it slowed down to almost 40s.



      This is what I tried:



      def get_best_combination(hand, board):

      candidate_hand = []
      best_score = 9999
      best_rank = -1
      p = Pool()
      for h in itertools.combinations(hand, 2):
      for b in itertools.combinations(board,3):
      candidate_hand.append(h+b)
      results = p.map(eval_hand, candidate_hand)
      for score in results:
      if (score < best_score):
      best_score = score
      best_rank = hand_rank(best_score)
      return best_score, best_rank


      What is wrong with it? Whys is it slowing the script down instead of speeding it up?



      Thanks!









      share







      New contributor




      Vandré Dreer Bonaite is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.







      $endgroup$




      I am writing a script to help me analyze and get statistics for poker hands. After a lot of research I was able to work with bit manipulation and get my statistics very efficiently for one hand. I want, thought, to be able to run it for several times (millions) and I don't know how to to this efficiently. I tried using multiprocess map (probably wrong) and it slowed the script down significantly.



      This is what I had originally:



      def get_best_combination(hand, board):

      candidate_hand = []
      best_score = 9999
      best_rank = -1
      for h in itertools.combinations(hand, 2):
      for b in itertools.combinations(board,3):
      candidate_hand = h + b
      score = eval_hand(candidate_hand)
      if (score < best_score):
      best_score = score
      best_rank = hand_rank(best_score)
      return best_score, best_rank


      What the function is doing:
      - It combines 2 cards from hand = [Card1, Card2, Card3, Card4, Card5] and 3 cards from board = [Card1, Card2, Card3, Card4, Card5]
      - Evaluates the combination and assign a score for it
      - Stores and returns the best score and best rank for all possible combinations between hand and board (total of 100 combinations).



      This runs really fast for (1 hand, 1 board) (0.02s) but I want to call this function for a lot of different hands and a lot of different boards for every hand. Tried to implement multiprocessing for this but for my surprise it slowed down to almost 40s.



      This is what I tried:



      def get_best_combination(hand, board):

      candidate_hand = []
      best_score = 9999
      best_rank = -1
      p = Pool()
      for h in itertools.combinations(hand, 2):
      for b in itertools.combinations(board,3):
      candidate_hand.append(h+b)
      results = p.map(eval_hand, candidate_hand)
      for score in results:
      if (score < best_score):
      best_score = score
      best_rank = hand_rank(best_score)
      return best_score, best_rank


      What is wrong with it? Whys is it slowing the script down instead of speeding it up?



      Thanks!







      python multiprocessing





      share







      New contributor




      Vandré Dreer Bonaite is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.










      share







      New contributor




      Vandré Dreer Bonaite is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.








      share



      share






      New contributor




      Vandré Dreer Bonaite is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.









      asked 3 mins ago









      Vandré Dreer BonaiteVandré Dreer Bonaite

      72




      72




      New contributor




      Vandré Dreer Bonaite is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.





      New contributor





      Vandré Dreer Bonaite is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.






      Vandré Dreer Bonaite is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.




















          0






          active

          oldest

          votes












          Your Answer






          StackExchange.ifUsing("editor", function ()
          StackExchange.using("externalEditor", function ()
          StackExchange.using("snippets", function ()
          StackExchange.snippets.init();
          );
          );
          , "code-snippets");

          StackExchange.ready(function()
          var channelOptions =
          tags: "".split(" "),
          id: "196"
          ;
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function()
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled)
          StackExchange.using("snippets", function()
          createEditor();
          );

          else
          createEditor();

          );

          function createEditor()
          StackExchange.prepareEditor(
          heartbeatType: 'answer',
          autoActivateHeartbeat: false,
          convertImagesToLinks: false,
          noModals: true,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: null,
          bindNavPrevention: true,
          postfix: "",
          imageUploader:
          brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
          contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
          allowUrls: true
          ,
          onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          );



          );






          Vandré Dreer Bonaite is a new contributor. Be nice, and check out our Code of Conduct.









          draft saved

          draft discarded


















          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fcodereview.stackexchange.com%2fquestions%2f217761%2fmultiprocessing-slowing-script-down%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown

























          0






          active

          oldest

          votes








          0






          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes








          Vandré Dreer Bonaite is a new contributor. Be nice, and check out our Code of Conduct.









          draft saved

          draft discarded


















          Vandré Dreer Bonaite is a new contributor. Be nice, and check out our Code of Conduct.












          Vandré Dreer Bonaite is a new contributor. Be nice, and check out our Code of Conduct.











          Vandré Dreer Bonaite is a new contributor. Be nice, and check out our Code of Conduct.














          Thanks for contributing an answer to Code Review Stack Exchange!


          • Please be sure to answer the question. Provide details and share your research!

          But avoid


          • Asking for help, clarification, or responding to other answers.

          • Making statements based on opinion; back them up with references or personal experience.

          Use MathJax to format equations. MathJax reference.


          To learn more, see our tips on writing great answers.




          draft saved


          draft discarded














          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fcodereview.stackexchange.com%2fquestions%2f217761%2fmultiprocessing-slowing-script-down%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown





















































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown

































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown







          Popular posts from this blog

          名間水力發電廠 目录 沿革 設施 鄰近設施 註釋 外部連結 导航菜单23°50′10″N 120°42′41″E / 23.83611°N 120.71139°E / 23.83611; 120.7113923°50′10″N 120°42′41″E / 23.83611°N 120.71139°E / 23.83611; 120.71139計畫概要原始内容臺灣第一座BOT 模式開發的水力發電廠-名間水力電廠名間水力發電廠 水利署首件BOT案原始内容《小檔案》名間電廠 首座BOT水力發電廠原始内容名間電廠BOT - 經濟部水利署中區水資源局

          Prove that NP is closed under karp reduction?Space(n) not closed under Karp reductions - what about NTime(n)?Class P is closed under rotation?Prove or disprove that $NL$ is closed under polynomial many-one reductions$mathbfNC_2$ is closed under log-space reductionOn Karp reductionwhen can I know if a class (complexity) is closed under reduction (cook/karp)Check if class $PSPACE$ is closed under polyonomially space reductionIs NPSPACE also closed under polynomial-time reduction and under log-space reduction?Prove PSPACE is closed under complement?Prove PSPACE is closed under union?

          Is my guitar’s action too high? Announcing the arrival of Valued Associate #679: Cesar Manara Planned maintenance scheduled April 23, 2019 at 23:30 UTC (7:30pm US/Eastern)Strings too stiff on a recently purchased acoustic guitar | Cort AD880CEIs the action of my guitar really high?Μy little finger is too weak to play guitarWith guitar, how long should I give my fingers to strengthen / callous?When playing a fret the guitar sounds mutedPlaying (Barre) chords up the guitar neckI think my guitar strings are wound too tight and I can't play barre chordsF barre chord on an SG guitarHow to find to the right strings of a barre chord by feel?High action on higher fret on my steel acoustic guitar