Questions tagged [parallelization]
Questions on parallel computing in Mathematica.
973 questions
4
votes
1
answer
123
views
Catching sequential evaluation in ParallelMap
The documentation of ParallelMap mentions that
A function used that is not known on the parallel kernels may lead to sequential evaluation:
giving this code example
...
- 3,642
3
votes
0
answers
105
views
ParallelMap code doesn't run in parallel on Wolfram Compute Services, but it does on local machine
This question seems related to
this one that hasn't received any answers.
As will result from the minimal reproducible example below, my code, that does polynomial factorizations, when run on Wolfram ...
- 256
2
votes
0
answers
58
views
How can I reduce RAM usage when using ParallelMap with large data?
I’m using ParallelMap on a very large dataset (millions of elements), but it quickly consumes all available RAM.
For example:
...
- 1,457
1
vote
0
answers
68
views
Parallelization on a cluster
I have the unique chance to run several tasks on a cluster with many cores and RAM. The problem is that it seems that my Mathematica code is not using all the power of 64 cores with 1024gb RAM that I ...
- 21
2
votes
0
answers
94
views
0
votes
0
answers
62
views
Configuring parallel kernels
I have Windows 11 and a CPU with 16 cores/32 threads. In Mathematica 14.2, I turn on "Local" and "Localhost" kernels in preferences, such that I have 32 subkernels.
Does it make ...
- 6,123
2
votes
1
answer
105
views
Do functions from a .m file loaded with Get automatically become available on all parallel kernels?
For a package, we use ParallelNeeds to make its functions available on all kernels for ParallelMap. For a ...
- 1,457
5
votes
3
answers
369
views
How does one parallelize WindingPolygon?
Consider this toy model: a list 100,000 simple point sets, and we Map WindingPolygon over it:
...
- 2,072
1
vote
0
answers
101
views
Timeout for subkernels using SLURM
I had previously been using a cluster with SLURM to run parallel computations with ParallelTable. However, it has randomly stopped working and I now receive the error:
...
- 413
0
votes
0
answers
60
views
Unexplained $Aborted in ParallelTable
I am trying to run the code:
ParallelTable[
FMwrapper[small[[i]]],
{i,20},
Method->"CoarsestGrained",
DistributedContexts->Full
]
...
0
votes
0
answers
70
views
Modify list defined globally in module when using ParallelMap
I have the following problem:
In order to use ParallelMap to apply a certain procedure/test to a list Range[0, nval - 1], I ...
- 85
6
votes
1
answer
337
views
How to release memory from parallel kernels?
I'm doing image processing in parallel kernels:
(I'm sorry, but it is impossible to construct a MWE for this, so I am including this code to indicate what I am doing)
...
- 7,674
4
votes
1
answer
174
views
ForeignFunctionLoad and parallel evaluation
Context and Goal: I have a program (written in Fortran, I think we can set it up to use the ForeignFunctionLoad C types) that I would like to run in parallel. The ...
- 872
11
votes
6
answers
507
views
How to stop Map or ParallelMap on first error and get the input that caused it?
I want to run a function using Map or ParallelMap over a large list of inputs, but I would like the evaluation to stop as soon ...
- 1,457
2
votes
0
answers
75
views
Why do plots exported from inside ParallelDo[] have red error overlay but no error?
I am processing some data and exporting the results as plots. It runs faster if I use a ParallelDo loop but then most of the plots get a red error overlay when exported. The plots do not get the ...
- 2,695