Lab book StarPU+Simgrid

Table of Contents

1 README:   @LUKA

1.1 General:

  • This file corresponds to the lab books like the ones used by biologist, chemists etc.
  • It contains explanations of how things are organized, what is the workflow for doing experiments, changes made to the code (as accurate as possible) and the observed behavior in the "* Data" section. Note that this last section is available only in data branch, as we want to keep master branch clean from any results-it contains only source code and the analysis (R code)

1.2 Experiments workflow:

  1. Create a new branch
  2. Make sure everything is commited
  3. Run run_bench_StarPU script with the desired parameters
  4. Run run_inject_StarPUSG script with the desired parameters
  5. Do the analysis
  6. Add to this file into "* Data" section the entry for the results, using the template described below
  7. Commit/push the results of this separate branch
  8. Merge this new branch with the remote "data" branch

1.3 Paul help:   @PAUL

git branch nom_de_branche
git checkout nom_de_branche : aller dans la branche correspondante
./run_bench_StarPU.sh
 -t : testing. ne met rien dans le git
 -d nom_rep_data : ajoute le .org dans le git

 git add data/nom_rep_data
 git commit -am "blabla"
 git push -u origin nom_de_branche : envoie sur le remote les data. Premiere fois.

1.4 Adding histograms to all data files:

for i in {1..90} ; do ./R_add_hist.sh data/dataBord2/SoloStarpuData${i}.org scott && echo $i/90 ; done

1.5 Plotting all histograms of a certain file:

./Rplot_hist.sh data/testing/SoloStarpuData39.org scott

1.6 Extracting all GFlops as .csv and plotting results:

./R_allgflops.sh data/testing

1.7 Example for using run_bench_StarPU.sh:   @LUKA

STARPU_NCPU=0 STARPU_NCUDA=3 STARPU_NOPECL=0 STARPU_SIZE=72000 STARPU_BLK=75 STARPU_SCHED=dmda STARPU_CALIBRATE=1 STARPU_PROGRAM=cholesky ./run_bench_StarPU.sh -d data/dataNew -c -f -v

1.8 Example for using run_inject_StarPUSG.sh:   @LUKA

STARPU_SCHED=dmda STARPU_HOSTNAME=attila STARPU_PROGRAM=cholesky ./run_inject_StarPUSG.sh -n data/dataNew/SoloStarpuData0.org -d data/dataNew -c -f -v

1.9 Example for running benchmarking experiments in a for loop:

for i in {1..3} ; do STARPU_NCPU=0 STARPU_NCUDA=3 STARPU_NOPECL=0 STARPU_SIZE=$(($i*960)) STARPU_BLK=$i STARPU_SCHED=dmda STARPU_CALIBRATE=1 STARPU_PROGRAM=lu ./run_bench_StarPU.sh -t -f -v && echo $i/3 ; done

1.10 Example for running simulation experiments in a for loop:

for i in {0..71} ; do STARPU_SCHED=dmda STARPU_HOSTNAME=attila STARPU_PROGRAM=lu ./run_inject_StarPUSG.sh -n data/dataNew/SoloStarpuData${i}.org -d data/dataNew -f -v && echo $i/71 ; done

1.11 Running qrm benchmarking:

STARPU_NCPU=1 STARPU_CALIBRATE=1 STARPU_PROGRAM=qrm ./run_bench_StarPU.sh -t -c -f -v

1.12 Running qrm simulation:

STARPU_HOSTNAME=fourmi STARPU_PROGRAM=qrm ./run_inject_StarPUSG.sh -n data/testing/SoloStarpuData0.org -t -c -f -v

2 Template for data entry:

** data#
*** git:
#+begin_src sh
git log -1
#+end_src
*** Notes:

3 Organization of git

3.1 remote/origin/master branch:

  • Has all the source, analysis, scripts

3.2 remote/origin/data# branches:

  • Have all the data connected to specific experiments
  • Also some important (not all) .pdf files

3.3 remote/origin/data branch:

  • Merging all the data and source branches
  • It is cloned only on my local machine, never clone it on a remote one

4 Git TAGs:

4.1 Stable versions:

4.1.1 stable1.0:

  • First stable version

4.1.2 stable2.0:

  • Version at the end of the SUD (SUS) in Lyon in June. Should be stable

4.1.3 stable3.0:

  • Stable version before going to Bordeaux in November 2013

4.1.4 stable4.1:

  • Stable version after going to Bordeaux in November 2013

4.1.5 stable4.2

  • Stable version end of February, before going for the new version of Simgrid and StarPU

4.1.6 stable5.0

  • Stable version after Europar article and moving to new StarPU (rev12302 trunk branch) and Simgrid 3.11 (devel 2014-02-26 10:52:32)

4.1.7 stable6.0

StarPU version: trunk r12421 Simgrid: 6683debe0efeb6371e0cbafb4f0d461325dd59a5

4.1.8 stable7.0

StarPU version: trunk r12433 Simgrid: 6683debe0efeb6371e0cbafb4f0d461325dd59a5

4.1.9 stable8.0

StarPU version: trunk r12463 Simgrid: 6683debe0efeb6371e0cbafb4f0d461325dd59a5

4.1.10 stable9.0

StarPU version: trunk r12463 Simgrid: 9a83532b45e512e41210c7784e5ad22adbc7e442

4.1.11 stable10.0

StarPU version: trunk r13041 Simgrid: d3b7c5f480653be317597041a5f9ad36f4186bf3 qrm_starpu: r1226 new_magmamorse: r1799

4.2 starpu_bench:

  • Our changes to StarPU code to have more sophisticated benchmarking

4.3 All tags from git:

git push origin --tags
git tag -n1
T2              Using histogram values
add_footprint   Adding footprint info to the benchmarked kernels
bord1           Adding modified native data for calculating histograms
cholPaje_data   CholPaje with all data
cudabench       Adding platform.xml files from attila
devel_CUDA_mem  Testing different memory size
devel_Fi        Adding Fetching Input state to paje
devel_bk        Hack to investigate influence of "bk" parameter
devel_newStarpu Testing different sleep for new version of StarPU
devel_stairs    A way to disable stairs parameter
first_mumps     Initial try to install qrm_starpu before going to Bordeaux
fix_inject      Fixing issue with injecting "block_id" for all workers
measure_CPU-GPU First measurements with CPU and GPU together
newStarpu       Fixing previous commit
new_counters    Added new counters (printfs), to understand better how communications works
oldChol1306     Tag for old branch dataChol1306, that has no significant results
oldCholeskySUS  Tag for old branch dataCholeskySUS, that has no significant results
oldCholwscripts Tag for old branch dataCholwscripts, that has no significant results
oldCompMeanHist Tag for old branch dataCompMeanHist, that has no significant results
oldLUHannibal   Tag for old branch dataLUHannibal, that has no significant results
oldLUHannibalok Tag for old branch dataLUHannibalok, that has no significant results
oldLUSUS        Tag for old branch dataLUSUS, that has no significant results
size_fix        Alfredo's fix for Size parameter format
sleep3          Updating both analysis
stable10.0      Some additional magma files
stable2.0       Fixing make distclean bug
stable3.0       Using histogram values
stable4.0       Adding analysis of different Histograms
stable4.1       Revert "Adding .pdf report to data"
stable4.2       Stable version before changing to new Starpu and Simgrid code
stable5.0       Resolving the problem with CUDA mem limit introduced with Samuels new implementation
stable6.0       New StarPU: r12421
stable7.0       Going for new stable version of StarPU r12433
stable8.0       Going for new stable version of StarPU r12463
stable8.1       Before updating Simgrid
stable9.0       Merge branch 'master' of git+ssh://scm.gforge.inria.fr//gitroot/mescal/software/expe/starpu_simgrid
stableTIMEDWAIT Using 6.5ms sleep
starpu_bench    Our changes to StarPU
try_magma1      Initial try to install magma/morse with Suraj
try_magma2      Second try to install magma/morse with Suraj
used_size       Finishing analysis for UsedSize

5 Organization of code

5.1 scripts:

5.1.1 DONE run_bench_StarPU.sh [4/4]:   @LUKA

  • Runs benchmarking of StarPU without Simgrid
  • [X] Write a usage/help part, add environment variables
  • [X] Upgrade for interective mode
  • [X] Change verbose
  • [X] Add frequency scaling only if the file exists, otherwise write "unknown

5.1.2 DONE run_inject_StarPUSG.sh [2/2]:   @LUKA

  • [X] Make it work
  • [X] Execute R_add_hist automatically, if needed

5.1.3 Rhist.R: Rscript that produces histogram   DEPRECATED

5.1.4 flags scripts:

  • flags_starpu.sh: Setup flags for running StarPU (run_bench_StarPU)
  • flags_clean.sh: Reset all flags
  • flags_simgrid_starpu.sh: Setup flags for running StarPU with Simgrid (run_inject_StarPUSG.sh)

5.1.5 R_add_hist.sh:

  • Script (calls R script) used for SoloStarpuData files that didn't compute HISTOGRAM, if the machine experiment was executed did have R installed
  • Needs to be used by hand (for now-change it)
  • Example of usage: ./R_add_hist.sh data/dataNew/SoloStarpuData0.org

5.1.6 Rplots_hist.sh:

  • Script for showing .pdf file with plots of all injection histograms for a certain .org file

5.1.7 R_allgflops.sh:

Script for extracting Gflop values from all data files in the folder into .csv and making R figure

5.1.8 Extract_calibration.sh:

  • Script that reads and creates new files from calibration of SoloStarpuData.org. These calibration files are used later for the simulation
  • It is used automatically by run_inject_StarPUSG.sh
  • Creates files: .starpu/sampling/codelets/*.bench_hostname .starpu/sampling/bus/bench_hostname.*
  • Example of usage: ./Extract_calibration.sh data/dataNew/SoloStarpuData.org

5.1.9 get_trace.sh:

  • Script for related to paje traces. It is producing .csv from .org files, more precisely from "* PAJE" part of .org file
  • .csv is later used by Knitr/Org-babel for the analysis
  • Example of usage: ./get_trace.sh data/dataNew/SoloStarpuData0.org analysis/folder/paje_native.csv ./get_trace.sh data/dataNew/SoloStarpuData0.org analysis/folder/paje_simgrid.csv

5.1.10 valgrind:

  • Script to launch execution with valgrind

5.2 src/

5.2.1 simgrid

  1. contrib/benchmarking_code_block

5.2.2 StarPU

  1. build-native
  2. build-simgrid

5.3 analysis/

5.3.1 hist_scripts:

  • R code in charge of computing histograms for injecting pseudo-random values in the StarPU+Simgrid version of execution
  • R code in charge of plotting all histogram of a certain experiment

5.3.2 arnaud_traces:

  • Two Arnaud .Rnw files with the analysis of traces generated by StarPU and StarPU+Simgrid
  • Good examples for future analysis files

5.3.3 comparisonBabel:

  • Knitr and Org-babel examples for analysis and comparison of paje traces generated by native (solo starpu) and simulation (starpu+simgrid)
  • It is still not doing anything much useful, this is more template for development of "real" analysis file

5.3.4 makespan:

  • One of the first analysis for comparing makespans

5.3.5 makespan2:

  • Comparing makespans and paje traces

5.3.6 newpaje:

  • Different babel analysis file, NewPaje.org being the biggest, all for comparing makespans and Paje traces of native and simgrid for differnet matrix size

5.3.7 compare_simulations:

  • For comparing only diffrent simulations

5.3.8 lu_makespans:

  • Analysis based on newpaje, only this time for LU application instead of cholesky

5.3.9 MSG_sleep:

  • Analysis investigating using different MSG_process_sleep just after the trasfer of data in StarPU when using Simgrid

5.3.10 used_size:

  • Investigating used_size of memory when using different CUDA limits on both native and simgrid

5.3.11 bord1:

  • Analysis used in Bordeaux during the visit November 2013 to finally obtain the matching results for large matrix size

5.3.12 hist_analysis:

  • Analysis of different types of histograms

5.4 .starpu/

  • Folder where all StarPU calibrating is stored

5.5 backup/   DEPRECATED

  • Backup of the version that is working

6 Additional feature:

7 Changes:

7.1 2013-02-18

  • Created project and added this file
  • Setting up remote repository
  • Fixing remote branch
  • Adding scripts
  • Creating folders
  • Adding global "gitignore" file
  • Adding branches

7.2 2013-02-19

  • Adding StarPU and Simgrid initial files
  • Adding Paul's and my changes to the files
  • Add local repository exclude list
  • Installing StarPU
  • Installing Simgrid

7.3 2013-03-11

  • Reorganization of code and git repository

7.4 2013-03-12   @PAUL

  • Fixing git repository

7.5 2013-03-13::2013-03-15

  • Fixing scripts, flags and workflow

7.6 2013-03-18

  • Updating LabBook according to the last week changes

7.7 2013-05-27

  • Adding new analysis both with knitr and with org+babel

7.8 2013-06-05::2013-06-07

7.8.1 SUS-Simgrid User Sprint:   @PAUL @LUKA

  • Running R script for computing HISTOGRAM in run_bench_StarPU.sh is now run only if R is installed on that machine. If not it can be executed later, on local machine, before doing simulation
  • Adding HOSTNAME information (org header) to .org data results. Also information about input file (SoloStarpuData.org) for simulation output (SimgridStarpuData*.org)
  • Now simulation (run_inject_StarPUSG.sh) is using calibration and command line parameters from SoloStarpuData*.org. For calibration it creates new files and puts them into .stapu/sampling/
  • Some modification of LU example code from src/starpu in order for that code to be able to work with Simgrid
  • Fixed (hoping now everything will work fine) flags_* scripts, .gitignore and excluded files list
  • Being able to run LU and Cholesky using same script, by using STARPU_PROGRAM="". Add this before ./run_bench_StarPU.sh
  • Changed small things about data.org files (verbose, frequency scaling etc.)

7.9 2014-02-25

  • Going for the new versions of StarPU and Simgrid

8 Data:

8.1 dataFATPIPE   TEST @LUKA _ATTILA _CONAN

8.1.1 Experimentation diary:

We will try here to run everything directly from my LabBook.org file, using org-babel feature. This way we can use literate programming approach both for experiments and analysis directly.

Process will be divided in several phases, that will be represented here as subsections:

  1. Start: Creating new branch

    First lets check if we are in master branch and if there is some uncommited things:

    git status
    

    Everything is fine, the only uncommited changes are related to this (LabBook) file, which we are currently changing. We will commit this text later in exp branch.

    Now lets create a new branch, called expFATPIPE:

    git branch expFATPIPE
    git checkout expFATPIPE
    
    Switched to branch 'expFATPIPE'
    

    Lets verify:

    git branch
    
    data
    * expFATPIPE
      master
    

    Great we are in new branch, now we can save this small text, commit and finally remotely push the changes:

    git commit -am "Started writting experimentation diary in LabBook"
    git push -u origin expFATPIPE
    
    [expFATPIPE 2608ac4] Started writting experimentation diary in LabBook
     1 file changed, 60 insertions(+)
    Counting objects: 20, done.
    Delta compression using up to 8 threads.
    (1/3)   
    Compressing objects:  66% (2/3)   
    Compressing objects: 100% (3/3)   
    Compressing objects: 100% (3/3), done.
    (1/3)   
    Writing objects:  66% (2/3)   
    Writing objects: 100% (3/3)   
    Writing objects: 100% (3/3), 1.04 KiB | 0 bytes/s, done.
    Total 3 (delta 2), reused 0 (delta 0)
    To git+ssh://stanisic_luka@scm.gforge.inria.fr//gitroot/mescal/software/expe/starpu_simgrid.git
    expFATPIPE
    Branch expFATPIPE set up to track remote branch expFATPIPE from origin by rebasing.
    

    Seems like everything went smoothly. Again let's check:

    git branch -a
    
    data
    * expFATPIPE
      master
    origin/master
      remotes/origin/data
      remotes/origin/expFATPIPE
      remotes/origin/master
    

    Everything is fine so far.

  2. Connecting to the remote machine frontend:

    Lets try to connect to remote machine in Bordeaux on which we want to do the experiments:

    ssh dalton
    
    Enter passphrase for key '/home/stanisic/.ssh/id_rsa_paul':
    1 SMP Debian 3.2.54-2 x86_64
    ------------ Processor     Cores  GHz   GB     Notes
    averell[01]  Xeon E5-2650  2*8ht  2.0   2*32   2*TeslaM2075 + IB FDR
    william[01]  Xeon E5-2650  2*8ht  2.0   2*16   1*TeslaM2075 + IB FDR
    jack[01]     Xeon X5650    2*6ht  2.67  2*12   Myri-10G + IB QDR
    joe[01]      Xeon X5460    1*4    3.16  1*4    Myri-10G + IB DDR
    jolly        Opteron 6272  4*16   2.1   8*16
    bertha       Xeon X7460    16*6   2.67  4*48
    conan        Xeon E5-2650  2*8ht  2.0   2*32   3*TeslaM2075
    alaric       Xeon E5-2650  2*8ht  2.0   2*16   2*Radeon7970
    attila       Xeon X5650    2*6ht  2.67  2*24   3*TeslaC2050
    hannibal     Xeon X5550    2*4ht  2.67  2*24   3*QuadroFX5800
    grat         Xeon E5345    2*4    2.33  1*12  
    Available VMs: grat32 (32bits Linux), grat-netbsd, grat-freebsd
    Details about nodes, reservation, powering on, etc.:
      https://wiki.bordeaux.inria.fr/runtime/doku.php?id=les_dalton
    runtime
    Last login: Tue Jul 29 14:58:46 2014 from 194.199.1.28
    

    Great it worked (honestly I had few doubts). So when I executed previous command ("ssh dalton"), in the opened "org-babel shell session" I first got directly connected to the INRIA access machine in Bordeaux (using my "stanisic" account), from where I accesses to the morris(dalton) frontend machine (in Bordeaux) using the account of Paul Renaud-Gaud using his ssh key. Emacs "asked" me for password, which I entered and got connected to morris. Therefore from now on, all shell commands that I enter inside "org-sh" org-babel shell session, we be executed on morris machine. Let me demonstrate:

    ls
    
    activity.data        FxT intel     share         StarPUGre     
    bc     fxtInst  libexec   simgrid       StarPUHan     
    dag.dot              gnuplot  man       SimGrid-3.8.1 StarPUSimGrid 
    distrib.data         hwloc_conan.png        oliv      sisi          testsg        
    doc    hwloc_conan.xml        paje.trace              spusggit      trash         
    f2cdir info     sghan     spusggitatt                               
    fsg    installsSPU.txt        sginstall StarPU
    

    OK the output is quite ugly, but it is definitely different than the one on my machine:

    ls
    
    analysis                 flags_starpu.sh  multiple_qrm.sh   Rplots.pdf
    data                     get_trace.sh     multiple_qrm.sh~  run_bench_StarPU.sh
    Extract_calibration.sh   git_revert.sh    R_add_hist.sh     run_inject_StarPUSG.sh
    flags_magma.sh           git_revert.sh~   R_allgflops.sh    src
    LabBook.org#    Rhist.Rout        valgrind.sh
    flags_simgrid_starpu.sh  LabBook.org      Rplot_hist.sh
    

    We should be careful from now on, in which machine org-babel session are we executing commands.

  3. Connecting to the experimentation machine

    Lets now connect to the remote machine on which we want to do the experiments:

    ssh attila
    
    Enter passphrase for key '/home/prenaudg/.ssh/id_rsa':
    1 SMP Thu Jun 28 09:07:26 UTC 2012 x86_64
    
    The programs included with the Debian GNU/Linux system are free software;
    the exact distribution terms for each program are described in the
    individual files in /usr/share/doc/*/copyright.
    
    Debian GNU/Linux comes with ABSOLUTELY NO WARRANTY, to the extent
    permitted by applicable law.
    Last login: Tue Jul 29 15:07:20 2014 from morris
    
    ls
    
    activity.data  FxT              intel       share          StarPUGre
    bc             fxtInst          libexec     simgrid        StarPUHan
    dag.dot        gnuplot          man         SimGrid-3.8.1  StarPUSimGrid
    distrib.data   hwloc_conan.png  oliv        sisi           testsg
    doc            hwloc_conan.xml  paje.trace  spusggit       trash
    f2cdir         info             sghan       spusggitatt
    fsg            installsSPU.txt  sginstall   StarPU
    

    Navigating through the folders on remote machine is a bit painful, luckily we will not use this that often:

    cd spusggitatt/starpu_simgrid
    ls
    
    activity.data            git_revert.sh    Rhist.Rout
    analysis                 --help.cpu       Rplot_hist.sh
    bus_bck                  --help.eps       Rplots.pdf
    data                     --help.gp        run_bench_StarPU.sh
    Extract_calibration.sh   --help.gpu       run_inject_StarPUSG.sh
    flags_magma.sh           LabBook.org      src
    flags_simgrid_starpu.sh  multiple_qrm.sh  tmp_bench.out
    flags_starpu.sh          R_add_hist.sh    valgrind.sh
    get_trace.sh             R_allgflops.sh
    

    Now we are in the "starpu_simgrid" folder on attila machine

  4. Pulling the right remote branch

    We can now check if there are some important modification:

    git status
    
    On branch master
    Changes not staged for commit:
    (use "git add <file>..." to update what will be committed)
    (use "git checkout -- <file>..." to discard changes in working directory)
    
    modified:   run_inject_StarPUSG.sh
    modified:   src/simgrid/teshsuite/smpi/bcast/bcast_coll
    modified:   src/simgrid/teshsuite/smpi/compute/compute2
    modified:   src/simgrid/teshsuite/smpi/compute/compute3
    modified:   src/simgrid/teshsuite/smpi/pingpong/dsend
    modified:   src/simgrid/teshsuite/smpi/reduce/reduce_coll
    modified:   src/simgrid/teshsuite/smpi/reduce/reduce_scatter_coll
    modified:   src/simgrid/teshsuite/xbt/parmap_test/parmap_test
    
    Untracked files:
    (use "git add <file>..." to include in what will be committed)
    
    --help.cpu
    --help.eps
    --help.gp
    --help.gpu
    .starpu/
    activity.data
    bus_bck/
    src/StarPU/build-native/config.log
    src/StarPU/build-native/doc/doxygen/html/
    src/StarPU/build-native/doc/doxygen/latex/
    src/StarPU/build-native/doc/doxygen/starpu.pdf
    src/StarPU/build-native/doc/doxygen/starpu.tag
    src/StarPU/build-native/doc/doxygen/starpu_config.h
    src/StarPU/build-native/examples/basic_examples/vector_scal_fortran
    src/StarPU/build-native/examples/fortran/
    src/StarPU/build-native/examples/starpu_fortran.mod
    src/StarPU/build-native/examples/starpu_fortran2.mod
    src/StarPU/build-native/gcc-plugin/src/c-expr.c
    src/StarPU/build-native/include/starpu/1.2/starpufft.h
    src/StarPU/build-native/lib/libsocl-1.2.a
    src/StarPU/build-native/lib/libsocl-1.2.so
    src/StarPU/build-native/lib/libsocl-1.2.so.1
    src/StarPU/build-native/lib/libsocl-1.2.so.1.0.0
    src/StarPU/build-native/lib/libstarpu-1.2.so
    src/StarPU/build-native/lib/libstarpufft-1.2.a
    src/StarPU/build-native/lib/libstarpufft-1.2.so
    src/StarPU/build-native/lib/libstarpufft-1.2.so.1
    src/StarPU/build-native/lib/libstarpufft-1.2.so.1.0.0
    src/StarPU/build-native/lib/libstarpumpi-1.2.so
    src/StarPU/build-native/lib/pkgconfig/libstarpufft.pc
    src/StarPU/build-native/lib/pkgconfig/starpufft-1.0.pc
    src/StarPU/build-native/lib/pkgconfig/starpufft-1.1.pc
    src/StarPU/build-native/lib/pkgconfig/starpufft-1.2.pc
    src/StarPU/build-native/lib/starpu/1.2/
    src/StarPU/build-native/lib/starpu/examples/hello
    src/StarPU/build-native/lib/starpu/examples/socl/
    src/StarPU/build-native/lib/starpu/examples/starpufft/
    src/StarPU/build-native/lib/starpu/examples/vector_scal_fortran
    src/StarPU/build-native/lib/starpu/plugin/
    src/StarPU/build-native/share/doc/starpu/starpu.pdf
    src/StarPU/build-native/share/man/
    src/StarPU/build-native/share/starpu/opencl/
    src/StarPU/build-native/socl/examples/basic/
    src/StarPU/build-native/socl/examples/clinfo/
    src/StarPU/build-native/socl/examples/mansched/
    src/StarPU/build-native/socl/examples/matmul/
    src/StarPU/build-native/socl/examples/testmap/
    src/StarPU/build-native/socl/vendors/amdocl64.icd
    src/StarPU/build-native/socl/vendors/intel.icd
    src/StarPU/build-native/socl/vendors/intelocl64.icd
    src/StarPU/build-native/starpu-top/starpu_top.1
    src/StarPU/build-native/starpu_idle_microsec.log
    src/StarPU/build-native/starpufft/examples/
    src/StarPU/build-native/tools/starpu_calibrate_bus.1
    src/StarPU/build-native/tools/starpu_codelet_histo_profile.1
    src/StarPU/build-native/tools/starpu_codelet_profile.1
    src/StarPU/build-native/tools/starpu_fxt_data_trace.1
    src/StarPU/build-native/tools/starpu_fxt_stats.1
    src/StarPU/build-native/tools/starpu_fxt_tool.1
    src/StarPU/build-native/tools/starpu_lp2paje.1
    src/StarPU/build-native/tools/starpu_machine_display.1
    src/StarPU/build-native/tools/starpu_paje_draw_histogram.1
    src/StarPU/build-native/tools/starpu_paje_state_stats.1
    src/StarPU/build-native/tools/starpu_perfmodel_display.1
    src/StarPU/build-native/tools/starpu_perfmodel_plot.1
    src/StarPU/build-native/tools/starpu_workers_activity.1
    src/StarPU/build-simgrid/config.log
    src/StarPU/build-simgrid/doc/doxygen/html/
    src/StarPU/build-simgrid/doc/doxygen/latex/
    src/StarPU/build-simgrid/doc/doxygen/starpu.pdf
    src/StarPU/build-simgrid/doc/doxygen/starpu.tag
    src/StarPU/build-simgrid/doc/doxygen/starpu_config.h
    src/StarPU/build-simgrid/socl/vendors/intelocl64.icd
    src/StarPU/build-simgrid/tools/starpu_calibrate_bus.1
    src/StarPU/build-simgrid/tools/starpu_codelet_histo_profile.1
    src/StarPU/build-simgrid/tools/starpu_codelet_profile.1
    src/StarPU/build-simgrid/tools/starpu_fxt_data_trace.1
    src/StarPU/build-simgrid/tools/starpu_fxt_stats.1
    src/StarPU/build-simgrid/tools/starpu_fxt_tool.1
    src/StarPU/build-simgrid/tools/starpu_lp2paje.1
    src/StarPU/build-simgrid/tools/starpu_machine_display.1
    src/StarPU/build-simgrid/tools/starpu_paje_draw_histogram.1
    src/StarPU/build-simgrid/tools/starpu_paje_state_stats.1
    src/StarPU/build-simgrid/tools/starpu_perfmodel_display.1
    src/StarPU/build-simgrid/tools/starpu_perfmodel_plot.1
    src/StarPU/build-simgrid/tools/starpu_workers_activity.1
    src/cudabench/outbench_attila.csv
    src/cudabench/outbench_conan.csv
    src/cudabench/outbench_hannibal.csv
    src/simgrid/a.out
    src/starpu/
    no changes added to commit (use "git add" and/or "git commit -a")
    

    None of these is really important (it was some previous testings of the code), so we can stash them without any worries:

    git stash
    
    Saved working directory and index state WIP on master: 7d993ad Small fix to simulation script to run it on plafrim nodes
    HEAD is now at 7d993ad Small fix to simulation script to run it on plafrim nodes
    

    OK lets first pull master branch:

    git pull
    

    OK this took some time since last pull was done several months ago. Let's see all remote branches:

    git branch -a
    
    dataTestN                         
    * master 
    origin/master                     
    remotes/origin/data               
    remotes/origin/dataMir2           
    remotes/origin/dataMirT           
    remotes/origin/dataMirT2          
    remotes/origin/dataQall1          
    remotes/origin/dataQt1            
    remotes/origin/dataT4             
    remotes/origin/dataTCPU           
    remotes/origin/dataTestN          
    remotes/origin/expFATPIPE         
    remotes/origin/master
    

    Now we finally pull remote expFATPIPE branch:

    git checkout -b expFATPIPE origin/expFATPIPE
    git status
    
    Branch expFATPIPE set up to track remote branch expFATPIPE from origin.
    Switched to a new branch 'expFATPIPE'
    # On branch expFATPIPE
    Untracked files:
    (use "git add <file>..." to include in what will be committed)
    
    --help.cpu
    --help.eps
    --help.gp
    --help.gpu
    .starpu/
    activity.data
    bus_bck/
    src/cudabench/outbench_attila.csv
    src/cudabench/outbench_conan.csv
    src/cudabench/outbench_hannibal.csv
    src/simgrid/a.out
    src/starpu/
    nothing added to commit but untracked files present (use "git add" to track)
    

    Now we are in the right branch on the right machine.

  5. Testing source code

    Before doing real experiments, it is better to fix verify that source code compiles and that scripts are doing things they are supposed to. To do that, we run a "testing" experiments, to see if there are any bugs:

    STARPU_NCPU=1 STARPU_NCUDA=0 STARPU_NOPECL=0 STARPU_SIZE=960 STARPU_BLK=1 STARPU_SCHED=dmda STARPU_CALIBRATE=1 STARPU_PROGRAM=cholesky ./run_bench_StarPU.sh -t -c -f -v
    
    Make distclean...
    ../configure: line 20791: test: too many arguments
    configure: WARNING: GCC plug-ins not supported; StarPU's GCC plug-in will not be built
    Configure...
    ../configure: line 20791: test: too many arguments
    configure: WARNING: GCC plug-ins not supported; StarPU's GCC plug-in will not be built
    Make...
    ../../src/core/sched_ctx.c: In function '_starpu_worker_gets_into_ctx':
    ../../src/core/sched_ctx.c:50:27: warning: comparison between signed and unsigned integer expressions [-Wsign-compare]
    tmp_sched_ctx == sched_ctx_id)
                               ^
    ../../src/core/sched_ctx.c: In function 'starpu_sched_ctx_set_priority_on_level':
    ../../src/core/sched_ctx.c:764:50: warning: unused parameter 'workers_to_add' [-Wunused-parameter]
     void starpu_sched_ctx_set_priority_on_level(int* workers_to_add, unsigned nworkers_to_add, unsigned sched_ctx, unsigned priority)
                                                      ^
    ../../src/core/sched_ctx.c:764:75: warning: unused parameter 'nworkers_to_add' [-Wunused-parameter]
     void starpu_sched_ctx_set_priority_on_level(int* workers_to_add, unsigned nworkers_to_add, unsigned sched_ctx, unsigned priority)
                                                                               ^
    ../../src/core/sched_ctx.c:764:101: warning: unused parameter 'sched_ctx' [-Wunused-parameter]
     void starpu_sched_ctx_set_priority_on_level(int* workers_to_add, unsigned nworkers_to_add, unsigned sched_ctx, unsigned priority)
                                                                                                         ^
    ../../src/core/sched_ctx.c:764:121: warning: unused parameter 'priority' [-Wunused-parameter]
     void starpu_sched_ctx_set_priority_on_level(int* workers_to_add, unsigned nworkers_to_add, unsigned sched_ctx, unsigned priority)
                                                                                                                             ^
    ../../src/core/sched_ctx.c: In function 'starpu_sched_ctx_get_available_cpuids':
    ../../src/core/sched_ctx.c:1791:25: warning: unused variable 'worker' [-Wunused-variable]
      struct _starpu_worker *worker = NULL;
                             ^
    ../../src/core/sched_ctx.c: In function '_starpu_sched_ctx_wake_these_workers_up':
    ../../src/core/sched_ctx.c:1817:25: warning: unused variable 'worker' [-Wunused-variable]
      struct _starpu_worker *worker = NULL;
                             ^
    ../../src/datawizard/memory_nodes.c: In function '_starpu_memory_node_get_name':
    ../../src/datawizard/memory_nodes.c:137:10: warning: 'prefix' may be used uninitialized in this function [-Wmaybe-uninitialized]
    s %u\n", prefix, descr.devid[node]);
              ^
    ../../src/datawizard/interfaces/void_interface.c: In function 'describe':
    ../../src/datawizard/interfaces/void_interface.c:143:31: warning: unused parameter 'interface' [-Wunused-parameter]
     static ssize_t describe(void *interface, char *buf, size_t size)
                                   ^
    ../../src/debug/traces/starpu_fxt.c: In function 'handle_codelet_data':
    ../../src/debug/traces/starpu_fxt.c:712:82: warning: unused parameter 'options' [-Wunused-parameter]
     static void handle_codelet_data(struct fxt_ev_64 *ev, struct starpu_fxt_options *options)
                                                                                      ^
    ../../src/debug/traces/starpu_paje.c: In function '_starpu_fxt_write_paje_header':
    u' expects a matching 'unsigned int' argument [-Wformat=]
       i, i, i, i, i, i, i, i, i, i);
       ^
    ../../src/worker_collection/worker_list.c: In function '_init_workers':
    ../../src/worker_collection/worker_list.c:177:15: warning: comparison between signed and unsigned integer expressions [-Wsign-compare]
      for(i = 0; i < nworkers; i++)
                   ^
    ../../src/worker_collection/worker_tree.c: In function 'tree_add':
    ../../src/worker_collection/worker_tree.c:163:22: warning: unused variable 'tree' [-Wunused-variable]
    workerids;
                          ^
    ../../src/worker_collection/worker_tree.c: In function 'tree_remove':
    ../../src/worker_collection/worker_tree.c:178:22: warning: unused variable 'tree' [-Wunused-variable]
    workerids;
                          ^
    ../../src/worker_collection/worker_tree.c: In function 'tree_deinit':
    ../../src/worker_collection/worker_tree.c:207:58: warning: unused parameter 'workers' [-Wunused-parameter]
     static void tree_deinit(struct starpu_worker_collection *workers)
                                                              ^
    ../../src/drivers/cpu/driver_cpu.c: In function 'execute_job_on_cpu':
    lx' expects argument of type 'long unsigned int', but argument 5 has type 'uint32_t' [-Wformat=]
    s|%08lx:%d", _starpu_job_get_model_name(j), starpu_task_data_footprint(task), cpu_args->workerid);
       ^
    lx' expects argument of type 'long unsigned int', but argument 5 has type 'uint32_t' [-Wformat=]
    ../../src/drivers/cuda/driver_cuda.c: In function 'start_job_on_cuda':
    lx' expects argument of type 'long unsigned int', but argument 5 has type 'uint32_t' [-Wformat=]
    s|%08lx:%d", _starpu_job_get_model_name(j), starpu_task_data_footprint(task), args->workerid);
       ^
    lx' expects argument of type 'long unsigned int', but argument 5 has type 'uint32_t' [-Wformat=]
    ../../src/drivers/opencl/driver_opencl.c: In function '_starpu_opencl_start_job':
    lx' expects argument of type 'long unsigned int', but argument 5 has type 'uint32_t' [-Wformat=]
    s|%08lx:%d", _starpu_job_get_model_name(j), starpu_task_data_footprint(task), args->workerid);
       ^
    lx' expects argument of type 'long unsigned int', but argument 5 has type 'uint32_t' [-Wformat=]
    ../../tools/starpu_fxt_tool.c: In function ‘usage’:
    ../../tools/starpu_fxt_tool.c:27:26: warning: unused parameter ‘argv’ [-Wunused-parameter]
     static void usage(char **argv)
                              ^
    ../../tools/starpu_perfmodel_display.c: In function ‘main’:
    ../../tools/starpu_perfmodel_display.c:161:10: warning: missing initializer for field ‘type’ of ‘struct starpu_perfmodel’ [-Wmissing-field-initializers]
       struct starpu_perfmodel model = {};
              ^
    In file included from ../../include/starpu.h:52:0,
                     from ../../tools/starpu_perfmodel_display.c:25:
    ../../include/starpu_perfmodel.h:120:29: note: ‘type’ declared here
      enum starpu_perfmodel_type type;
                                 ^
    ../../tools/starpu_fxt_stats.c: In function ‘usage’:
    ../../tools/starpu_fxt_stats.c:40:26: warning: unused parameter ‘argv’ [-Wunused-parameter]
     static void usage(char **argv)
                              ^
    ../../tools/starpu_perfmodel_plot.c: In function ‘main’:
    ../../tools/starpu_perfmodel_plot.c:638:9: warning: missing initializer for field ‘type’ of ‘struct starpu_perfmodel’ [-Wmissing-field-initializers]
      struct starpu_perfmodel model = {};
             ^
    In file included from ../../include/starpu.h:52:0,
                     from ../../src/common/utils.h:21,
                     from ../../src/common/fxt.h:32,
                     from ../../tools/starpu_perfmodel_plot.c:26:
    ../../include/starpu_perfmodel.h:120:29: note: ‘type’ declared here
      enum starpu_perfmodel_type type;
                                 ^
    /usr///usrusr//binbin//binld.bfd.realld.bfd.real/:ld.bfd.real :warning :: warning libbfdwarning::- 2.22 -libbfdsystem.solibbfd-,-2.222.22- -system.sosystem.so,, neededneeded   neededby by  by/// home/home/home//prenaudgprenaudgprenaudg///fxtInstfxtInst/fxtInstlib///libliblibfxt.so/,/libfxt.solibfxt.so.0,,  not not  notfound  found(found  try( try(using  tryusing- rpath  usingor  ---rpathrpathrpath-  oror link -)rpath-
    -/rpathlinkhome)/
    prenaudg-//linkfxtInst)//libhome
    //libfxt.soprenaudg:/ fxtInstundefined/ libreference/ libfxt.so.0/to: home`/bfd_check_formatprenaudg'/ 
    undefined/ homefxtInstreference/ /prenaudglibto/ fxtInst`/bfd_check_format/'libfxt.solib:/ libfxt.soundefined
    :/  /undefinedhomereference  /toprenaudgreference/  to` fxtInst`/bfd_check_formatbfd_initlib''/
    libfxt.so.0/:
    home /undefined/prenaudg /referencefxtInst hometo/ /`prenaudgbfd_init/'
    //home/prenaudg/fxtInstfxtInst//liblib/libfxt.so.0: undefined /referencelibfxt.so to `bfd_openr'
    :/ /undefined reference to home`/bfd_openrprenaudg'/
    fxtInst//homelib//prenaudglibfxt.so.0: undefined reference to/ `bfd_perror'
    //fxtInsthome//libprenaudg//libfxt.so:fxtInst /undefined libreference/ tolibfxt.so.0 :` undefinedbfd_perror reference' 
    to/ home`/bfd_closeprenaudg/'fxtInst
    //lib//homelibfxt.so/prenaudg:/fxtInst /undefinedlib /referencelibfxt.so.0 :to  undefined` bfd_closereference' 
    to/ home`/bfd_set_default_targetprenaudg'/
    fxtInstlib/lib//libfxt.solibfxt.so::  undefinedundefined  referencereference  toto  ``bfd_set_default_targetbfd_init''
    
    /home/prenaudg/fxtInst/libcollect2: error: ld returned 1 exit status
    /libfxt.so: undefined reference to `bfd_openr'
    /home/prenaudg/fxtInst/lib/libfxt.so: collect2: error: ld returned 1 exit status
    undefined reference to `bfd_perror'
    /home/prenaudg/fxtInst/lib/libfxt.so: undefined reference to `bfd_close'
    /home/prenaudg/fxtInst/lib/libfxt.so: undefined reference to `bfd_set_default_target'
    collect2: error: ld returned 1 exit status
    /usr/bin/ld.bfd.real: warning: libbfd-2.22-system.so, needed by /home/prenaudg/fxtInst/lib/libfxt.so, not found (try using -rpath or -rpath-link)
    /home/prenaudg/fxtInst/lib/libfxt.so: undefined reference to `bfd_check_format'
    /home/prenaudg/fxtInst/lib/libfxt.so: undefined reference to `bfd_init'
    /home/prenaudg/fxtInst/lib/libfxt.so: undefined reference to `bfd_openr'
    /home/prenaudg/fxtInst/lib/libfxt.so: undefined reference to `bfd_perror'
    /home/prenaudg/fxtInst/lib/libfxt.so: undefined reference to `bfd_close'
    /home/prenaudg/fxtInst/lib/libfxt.so: undefined reference to `bfd_set_default_target'
    collect2: error: ld returned 1 exit status
    make[2]: *** [starpu_fxt_tool] Error 1
    make[2]: *** Waiting for unfinished jobs....
    make[2]: *** [starpu_perfmodel_display] Error 1
    make[2]: *** [starpu_fxt_data_trace] Error 1
    make[2]: *** [starpu_fxt_stats] Error 1
    /usr/bin/ld.bfd.real: warning: libbfd-2.22-system.so, needed by //home/prenaudg/fxtInst/lib/libfxt.so.0, not found (try using -rpath or -rpath-link)
    //home/prenaudg/fxtInst/lib/libfxt.so.0: undefined reference to `bfd_check_format'
    //home/prenaudg/fxtInst/lib/libfxt.so.0: undefined reference to `bfd_init'
    //home/prenaudg/fxtInst/lib/libfxt.so.0: undefined reference to `bfd_openr'
    //home/prenaudg/fxtInst/lib/libfxt.so.0: undefined reference to `bfd_perror'
    //home/prenaudg/fxtInst/lib/libfxt.so.0: undefined reference to `bfd_close'
    //home/prenaudg/fxtInst/lib/libfxt.so.0: undefined reference to `bfd_set_default_target'
    collect2: error: ld returned 1 exit status
    make[2]: *** [starpu_calibrate_bus] Error 1
    make[1]: *** [all-recursive] Error 1
    make: *** [all-recursive] Error 1
    

    Some bad references regarding "FxT" but since we dont need paje traces in the experiments I want to perform now, let just ignore FxT:

    rm data/testing/*
    STARPU_NCPU=1 STARPU_NCUDA=0 STARPU_NOPECL=0 STARPU_SIZE=960 STARPU_BLK=1 STARPU_SCHED=dmda STARPU_CALIBRATE=1 STARPU_PROGRAM=cholesky ./run_bench_StarPU.sh -t -c
    

    The biggest problem is obviously that running these experiments will block my Emacs completely. We can have the look at the results now:

    tail -5 data/testing/SoloStarpuData0.org
    
    0
    ! End of calibration
    ###########################################
    * BENCHMARKING OUTPUT:
    chol_model_11|617e5fe6:0 1406641689.934785 1406641690.032463 0.097678
    

    Looks like everything went fine.

  6. Looking at platform.xml to use FATPIPE:

    Lets first see the platform.xml generated by StarPU:

    cat .starpu/sampling/bus/attila.platform.xml
    
    | ?xml version='1.0'?| 
     | !DOCTYPE platform SYSTEM 'http://simgrid.gforge.inria.fr/simgrid.dtd'| 
     | platform version='3'| 
     | config id='General'| 
       | prop id='network/TCP_gamma' value='-1'| | /prop| 
       | prop id='network/latency_factor' value='1'| | /prop| 
       | prop id='network/bandwidth_factor' value='1'| | /prop| 
     | /config| 
     | AS  id='AS0'  routing='Full'| 
       | host id='MAIN' power='1'/| 
       | host id='CPU0' power='2000000000'/| 
       | host id='CPU1' power='2000000000'/| 
       | host id='CPU2' power='2000000000'/| 
       | host id='CPU3' power='2000000000'/| 
       | host id='CPU4' power='2000000000'/| 
       | host id='CPU5' power='2000000000'/| 
       | host id='CPU6' power='2000000000'/| 
       | host id='CPU7' power='2000000000'/| 
       | host id='CPU8' power='2000000000'/| 
       | host id='CPU9' power='2000000000'/| 
       | host id='CPU10' power='2000000000'/| 
       | host id='CPU11' power='2000000000'/| 
       | host id='CUDA0' power='2000000000'| 
        | prop id='memsize' value='3220897792'/| 
       | /host| 
       | host id='CUDA1' power='2000000000'| 
        | prop id='memsize' value='3220897792'/| 
       | /host| 
       | host id='CUDA2' power='2000000000'| 
        | prop id='memsize' value='3220897792'/| 
       | /host| 
       | host id='OpenCL0' power='2000000000'| 
        | prop id='memsize' value='3220897792'/| 
       | /host| 
       | host id='OpenCL1' power='2000000000'| 
        | prop id='memsize' value='3220897792'/| 
       | /host| 
       | host id='OpenCL2' power='2000000000'| 
        | prop id='memsize' value='3220897792'/| 
       | /host| 
    
       | host id='RAM' power='1'/| 
    
       | link id='Share' bandwidth='6526502506.530351' latency='0.000000'/| 
    
       | link id='RAM-CUDA0' bandwidth='6023290180.349480' latency='0.000010'/| 
       | link id='CUDA0-RAM' bandwidth='6526502506.530351' latency='0.000010'/| 
       | link id='RAM-CUDA1' bandwidth='6011192934.870083' latency='0.000010'/| 
       | link id='CUDA1-RAM' bandwidth='6526343830.772667' latency='0.000010'/| 
       | link id='RAM-CUDA2' bandwidth='5179895455.767939' latency='0.000011'/| 
       | link id='CUDA2-RAM' bandwidth='4470487579.340049' latency='0.000011'/| 
       | link id='CUDA0-CUDA1' bandwidth='5294323869.631675' latency='0.000017'/| 
       | link id='CUDA0-CUDA2' bandwidth='3735943174.958291' latency='0.000025'/| 
       | link id='CUDA1-CUDA0' bandwidth='5294428291.076200' latency='0.000016'/| 
       | link id='CUDA1-CUDA2' bandwidth='3737884242.195856' latency='0.000025'/| 
       | link id='CUDA2-CUDA0' bandwidth='3020192404.949356' latency='0.000023'/| 
       | link id='CUDA2-CUDA1' bandwidth='3020160548.597531' latency='0.000023'/| 
       | link id='RAM-OpenCL0' bandwidth='2663116208.239292' latency='0.000010'/| 
       | link id='OpenCL0-RAM' bandwidth='1911216230.732502' latency='0.000104'/| 
       | link id='RAM-OpenCL1' bandwidth='3504836871.654263' latency='0.000010'/| 
       | link id='OpenCL1-RAM' bandwidth='1821907811.186981' latency='0.000131'/| 
       | link id='RAM-OpenCL2' bandwidth='3414164156.170383' latency='0.000011'/| 
       | link id='OpenCL2-RAM' bandwidth='1896721846.162543' latency='0.000116'/| 
       | route src='RAM' dst='CUDA0' symmetrical='NO'| | link_ctn id='RAM-CUDA0'/| | link_ctn id='Share'/| | /route| 
       | route src='CUDA0' dst='RAM' symmetrical='NO'| | link_ctn id='CUDA0-RAM'/| | link_ctn id='Share'/| | /route| 
       | route src='RAM' dst='CUDA1' symmetrical='NO'| | link_ctn id='RAM-CUDA1'/| | link_ctn id='Share'/| | /route| 
       | route src='CUDA1' dst='RAM' symmetrical='NO'| | link_ctn id='CUDA1-RAM'/| | link_ctn id='Share'/| | /route| 
       | route src='RAM' dst='CUDA2' symmetrical='NO'| | link_ctn id='RAM-CUDA2'/| | link_ctn id='Share'/| | /route| 
       | route src='CUDA2' dst='RAM' symmetrical='NO'| | link_ctn id='CUDA2-RAM'/| | link_ctn id='Share'/| | /route| 
       | route src='CUDA0' dst='CUDA1' symmetrical='NO'| | link_ctn id='CUDA0-CUDA1'/| | link_ctn id='Share'/| | /route| 
       | route src='CUDA0' dst='CUDA2' symmetrical='NO'| | link_ctn id='CUDA0-CUDA2'/| | link_ctn id='Share'/| | /route| 
       | route src='CUDA1' dst='CUDA0' symmetrical='NO'| | link_ctn id='CUDA1-CUDA0'/| | link_ctn id='Share'/| | /route| 
       | route src='CUDA1' dst='CUDA2' symmetrical='NO'| | link_ctn id='CUDA1-CUDA2'/| | link_ctn id='Share'/| | /route| 
       | route src='CUDA2' dst='CUDA0' symmetrical='NO'| | link_ctn id='CUDA2-CUDA0'/| | link_ctn id='Share'/| | /route| 
       | route src='CUDA2' dst='CUDA1' symmetrical='NO'| | link_ctn id='CUDA2-CUDA1'/| | link_ctn id='Share'/| | /route| 
       | route src='RAM' dst='OpenCL0' symmetrical='NO'| | link_ctn id='RAM-OpenCL0'/| | link_ctn id='Share'/| | /route| 
       | route src='OpenCL0' dst='RAM' symmetrical='NO'| | link_ctn id='OpenCL0-RAM'/| | link_ctn id='Share'/| | /route| 
       | route src='RAM' dst='OpenCL1' symmetrical='NO'| | link_ctn id='RAM-OpenCL1'/| | link_ctn id='Share'/| | /route| 
       | route src='OpenCL1' dst='RAM' symmetrical='NO'| | link_ctn id='OpenCL1-RAM'/| | link_ctn id='Share'/| | /route| 
       | route src='RAM' dst='OpenCL2' symmetrical='NO'| | link_ctn id='RAM-OpenCL2'/| | link_ctn id='Share'/| | /route| 
       | route src='OpenCL2' dst='RAM' symmetrical='NO'| | link_ctn id='OpenCL2-RAM'/| | link_ctn id='Share'/| | /route| 
     | /AS| 
     | /platform|
    

    Here we changed "<" and ">" with "|" not too avoid having trouble with this strange org-babel bug (there is probably some cleaner solution, I'll need to ask on the mailing list).

    We will give a name to this org-babel chunk, so we can later reuse it.

  7. Testing experiments with CUDA

    Lets run a test experiment using 3 CUDA GPU to see the results and platform.xml it produces:

    STARPU_NCPU=0 STARPU_NCUDA=3 STARPU_NOPECL=0 STARPU_SIZE=9600 STARPU_BLK=10 STARPU_SCHED=dmda STARPU_CALIBRATE=1 STARPU_PROGRAM=cholesky ./run_bench_StarPU.sh -t -c -v
    

    The output is very long, but at least it worked. Let's now check the platform.xml:

    <?xml version='1.0'?/>
     <!DOCTYPE platform SYSTEM 'http://simgrid.gforge.inria.fr/simgrid.dtd'/>
     <platform version='3'/>
     <config id='General'/>
       <prop id='network/TCP_gamma' value='-1'></prop/>
       <prop id='network/latency_factor' value='1'></prop/>
       <prop id='network/bandwidth_factor' value='1'></prop/>
     </config/>
     <AS  id='AS0'  routing='Full'/>
       <host id='MAIN' power='1'/>
       <host id='CPU0' power='2000000000'/>
       <host id='CPU1' power='2000000000'/>
       <host id='CPU2' power='2000000000'/>
       <host id='CPU3' power='2000000000'/>
       <host id='CPU4' power='2000000000'/>
       <host id='CPU5' power='2000000000'/>
       <host id='CPU6' power='2000000000'/>
       <host id='CPU7' power='2000000000'/>
       <host id='CPU8' power='2000000000'/>
       <host id='CPU9' power='2000000000'/>
       <host id='CPU10' power='2000000000'/>
       <host id='CPU11' power='2000000000'/>
       <host id='CUDA0' power='2000000000'/>
        <prop id='memsize' value='3220897792'/>
       </host/>
       <host id='CUDA1' power='2000000000'/>
        <prop id='memsize' value='3220897792'/>
       </host/>
       <host id='CUDA2' power='2000000000'/>
        <prop id='memsize' value='3220897792'/>
       </host/>
       <host id='OpenCL0' power='2000000000'/>
        <prop id='memsize' value='3220897792'/>
       </host/>
       <host id='OpenCL1' power='2000000000'/>
        <prop id='memsize' value='3220897792'/>
       </host/>
       <host id='OpenCL2' power='2000000000'/>
        <prop id='memsize' value='3220897792'/>
       </host/>
    
       <host id='RAM' power='1'/>
    
       <link id='Share' bandwidth='6526373581.889518' latency='0.000000'/>
    
       <link id='RAM-CUDA0' bandwidth='6028718106.504889' latency='0.000010'/>
       <link id='CUDA0-RAM' bandwidth='6526314079.927063' latency='0.000010'/>
       <link id='RAM-CUDA1' bandwidth='6009838714.010657' latency='0.000010'/>
       <link id='CUDA1-RAM' bandwidth='6526373581.889517' latency='0.000010'/>
       <link id='RAM-CUDA2' bandwidth='5176517949.818128' latency='0.000011'/>
       <link id='CUDA2-RAM' bandwidth='4470296807.070096' latency='0.000011'/>
       <link id='CUDA0-CUDA1' bandwidth='5289746430.163731' latency='0.000017'/>
       <link id='CUDA0-CUDA2' bandwidth='3733043462.691445' latency='0.000025'/>
       <link id='CUDA1-CUDA0' bandwidth='5294317343.428155' latency='0.000016'/>
       <link id='CUDA1-CUDA2' bandwidth='3738284411.191786' latency='0.000025'/>
       <link id='CUDA2-CUDA0' bandwidth='3019243373.958107' latency='0.000023'/>
       <link id='CUDA2-CUDA1' bandwidth='3019636077.297647' latency='0.000023'/>
       <link id='RAM-OpenCL0' bandwidth='3281020428.804752' latency='0.000010'/>
       <link id='OpenCL0-RAM' bandwidth='1847649808.544166' latency='0.000117'/>
       <link id='RAM-OpenCL1' bandwidth='3669773648.004935' latency='0.000010'/>
       <link id='OpenCL1-RAM' bandwidth='2013568269.860521' latency='0.000115'/>
       <link id='RAM-OpenCL2' bandwidth='3403971062.459184' latency='0.000011'/>
       <link id='OpenCL2-RAM' bandwidth='2119777101.396201' latency='0.000116'/>
       <route src='RAM' dst='CUDA0' symmetrical='NO'><link_ctn id='RAM-CUDA0'/><link_ctn id='Share'/></route/>
       <route src='CUDA0' dst='RAM' symmetrical='NO'><link_ctn id='CUDA0-RAM'/><link_ctn id='Share'/></route/>
       <route src='RAM' dst='CUDA1' symmetrical='NO'><link_ctn id='RAM-CUDA1'/><link_ctn id='Share'/></route/>
       <route src='CUDA1' dst='RAM' symmetrical='NO'><link_ctn id='CUDA1-RAM'/><link_ctn id='Share'/></route/>
       <route src='RAM' dst='CUDA2' symmetrical='NO'><link_ctn id='RAM-CUDA2'/><link_ctn id='Share'/></route/>
       <route src='CUDA2' dst='RAM' symmetrical='NO'><link_ctn id='CUDA2-RAM'/><link_ctn id='Share'/></route/>
       <route src='CUDA0' dst='CUDA1' symmetrical='NO'><link_ctn id='CUDA0-CUDA1'/><link_ctn id='Share'/></route/>
       <route src='CUDA0' dst='CUDA2' symmetrical='NO'><link_ctn id='CUDA0-CUDA2'/><link_ctn id='Share'/></route/>
       <route src='CUDA1' dst='CUDA0' symmetrical='NO'><link_ctn id='CUDA1-CUDA0'/><link_ctn id='Share'/></route/>
       <route src='CUDA1' dst='CUDA2' symmetrical='NO'><link_ctn id='CUDA1-CUDA2'/><link_ctn id='Share'/></route/>
       <route src='CUDA2' dst='CUDA0' symmetrical='NO'><link_ctn id='CUDA2-CUDA0'/><link_ctn id='Share'/></route/>
       <route src='CUDA2' dst='CUDA1' symmetrical='NO'><link_ctn id='CUDA2-CUDA1'/><link_ctn id='Share'/></route/>
       <route src='RAM' dst='OpenCL0' symmetrical='NO'><link_ctn id='RAM-OpenCL0'/><link_ctn id='Share'/></route/>
       <route src='OpenCL0' dst='RAM' symmetrical='NO'><link_ctn id='OpenCL0-RAM'/><link_ctn id='Share'/></route/>
       <route src='RAM' dst='OpenCL1' symmetrical='NO'><link_ctn id='RAM-OpenCL1'/><link_ctn id='Share'/></route/>
       <route src='OpenCL1' dst='RAM' symmetrical='NO'><link_ctn id='OpenCL1-RAM'/><link_ctn id='Share'/></route/>
       <route src='RAM' dst='OpenCL2' symmetrical='NO'><link_ctn id='RAM-OpenCL2'/><link_ctn id='Share'/></route/>
       <route src='OpenCL2' dst='RAM' symmetrical='NO'><link_ctn id='OpenCL2-RAM'/><link_ctn id='Share'/></route/>
     </AS/>
     </platform|
    

    And finally we can run it with higher number of blocks:

    960*75
    
    STARPU_NCPU=0 STARPU_NCUDA=3 STARPU_NOPECL=0 STARPU_SIZE=72000 STARPU_BLK=75 STARPU_SCHED=dmda STARPU_CALIBRATE=0 STARPU_PROGRAM=cholesky ./run_bench_StarPU.sh -t
    
    Configure...
    Make...
    Execute...
    Be careful, R is not installed so HISTOGRAM is not generated
    R script for adding HISTOGRAM...
    ./run_bench_StarPU.sh: line 517: Rscript: command not found
    

    Great now we can do some real changes.

  8. Changing platform description

    So which changes to platform.xml we need to perform:

    <?xml version='1.0'?/>
     <!DOCTYPE platform SYSTEM 'http://simgrid.gforge.inria.fr/simgrid.dtd'/>
     <platform version='3'/>
     <config id='General'/>
       <prop id='network/TCP_gamma' value='-1'></prop/>
       <prop id='network/latency_factor' value='1'></prop/>
       <prop id='network/bandwidth_factor' value='1'></prop/>
     </config/>
     <AS  id='AS0'  routing='Full'/>
       <host id='MAIN' power='1'/>
       <host id='CPU0' power='2000000000'/>
       <host id='CPU1' power='2000000000'/>
       <host id='CPU2' power='2000000000'/>
       <host id='CPU3' power='2000000000'/>
       <host id='CPU4' power='2000000000'/>
       <host id='CPU5' power='2000000000'/>
       <host id='CPU6' power='2000000000'/>
       <host id='CPU7' power='2000000000'/>
       <host id='CPU8' power='2000000000'/>
       <host id='CPU9' power='2000000000'/>
       <host id='CPU10' power='2000000000'/>
       <host id='CPU11' power='2000000000'/>
       <host id='CUDA0' power='2000000000'/>
        <prop id='memsize' value='3220897792'/>
       </host/>
       <host id='CUDA1' power='2000000000'/>
        <prop id='memsize' value='3220897792'/>
       </host/>
       <host id='CUDA2' power='2000000000'/>
        <prop id='memsize' value='3220897792'/>
       </host/>
       <host id='OpenCL0' power='2000000000'/>
        <prop id='memsize' value='3220897792'/>
       </host/>
       <host id='OpenCL1' power='2000000000'/>
        <prop id='memsize' value='3220897792'/>
       </host/>
       <host id='OpenCL2' power='2000000000'/>
        <prop id='memsize' value='3220897792'/>
       </host/>
    
       <host id='RAM' power='1'/>
    
       <link id='Share' bandwidth='6526373581.889518' latency='0.000000'/>
    
       <link id='RAM-CUDA0' bandwidth='6028718106.504889' latency='0.000010'/>
       <link id='CUDA0-RAM' bandwidth='6526314079.927063' latency='0.000010'/>
       <link id='RAM-CUDA1' bandwidth='6009838714.010657' latency='0.000010'/>
       <link id='CUDA1-RAM' bandwidth='6526373581.889517' latency='0.000010'/>
       <link id='RAM-CUDA2' bandwidth='5176517949.818128' latency='0.000011'/>
       <link id='CUDA2-RAM' bandwidth='4470296807.070096' latency='0.000011'/>
       <link id='CUDA0-CUDA1' bandwidth='5289746430.163731' latency='0.000017'/>
       <link id='CUDA0-CUDA2' bandwidth='3733043462.691445' latency='0.000025'/>
       <link id='CUDA1-CUDA0' bandwidth='5294317343.428155' latency='0.000016'/>
       <link id='CUDA1-CUDA2' bandwidth='3738284411.191786' latency='0.000025'/>
       <link id='CUDA2-CUDA0' bandwidth='3019243373.958107' latency='0.000023'/>
       <link id='CUDA2-CUDA1' bandwidth='3019636077.297647' latency='0.000023'/>
       <link id='RAM-OpenCL0' bandwidth='3281020428.804752' latency='0.000010'/>
       <link id='OpenCL0-RAM' bandwidth='1847649808.544166' latency='0.000117'/>
       <link id='RAM-OpenCL1' bandwidth='3669773648.004935' latency='0.000010'/>
       <link id='OpenCL1-RAM' bandwidth='2013568269.860521' latency='0.000115'/>
       <link id='RAM-OpenCL2' bandwidth='3403971062.459184' latency='0.000011'/>
       <link id='OpenCL2-RAM' bandwidth='2119777101.396201' latency='0.000116'/>
       <route src='RAM' dst='CUDA0' symmetrical='NO'><link_ctn id='RAM-CUDA0'/><link_ctn id='Share'/></route/>
       <route src='CUDA0' dst='RAM' symmetrical='NO'><link_ctn id='CUDA0-RAM'/><link_ctn id='Share'/></route/>
       <route src='RAM' dst='CUDA1' symmetrical='NO'><link_ctn id='RAM-CUDA1'/><link_ctn id='Share'/></route/>
       <route src='CUDA1' dst='RAM' symmetrical='NO'><link_ctn id='CUDA1-RAM'/><link_ctn id='Share'/></route/>
       <route src='RAM' dst='CUDA2' symmetrical='NO'><link_ctn id='RAM-CUDA2'/><link_ctn id='Share'/></route/>
       <route src='CUDA2' dst='RAM' symmetrical='NO'><link_ctn id='CUDA2-RAM'/><link_ctn id='Share'/></route/>
       <route src='CUDA0' dst='CUDA1' symmetrical='NO'><link_ctn id='CUDA0-CUDA1'/><link_ctn id='Share'/></route/>
       <route src='CUDA0' dst='CUDA2' symmetrical='NO'><link_ctn id='CUDA0-CUDA2'/><link_ctn id='Share'/></route/>
       <route src='CUDA1' dst='CUDA0' symmetrical='NO'><link_ctn id='CUDA1-CUDA0'/><link_ctn id='Share'/></route/>
       <route src='CUDA1' dst='CUDA2' symmetrical='NO'><link_ctn id='CUDA1-CUDA2'/><link_ctn id='Share'/></route/>
       <route src='CUDA2' dst='CUDA0' symmetrical='NO'><link_ctn id='CUDA2-CUDA0'/><link_ctn id='Share'/></route/>
       <route src='CUDA2' dst='CUDA1' symmetrical='NO'><link_ctn id='CUDA2-CUDA1'/><link_ctn id='Share'/></route/>
       <route src='RAM' dst='OpenCL0' symmetrical='NO'><link_ctn id='RAM-OpenCL0'/><link_ctn id='Share'/></route/>
       <route src='OpenCL0' dst='RAM' symmetrical='NO'><link_ctn id='OpenCL0-RAM'/><link_ctn id='Share'/></route/>
       <route src='RAM' dst='OpenCL1' symmetrical='NO'><link_ctn id='RAM-OpenCL1'/><link_ctn id='Share'/></route/>
       <route src='OpenCL1' dst='RAM' symmetrical='NO'><link_ctn id='OpenCL1-RAM'/><link_ctn id='Share'/></route/>
       <route src='RAM' dst='OpenCL2' symmetrical='NO'><link_ctn id='RAM-OpenCL2'/><link_ctn id='Share'/></route/>
       <route src='OpenCL2' dst='RAM' symmetrical='NO'><link_ctn id='OpenCL2-RAM'/><link_ctn id='Share'/></route/>
     </AS/>
     </platform|
    

    Probably the easiest way to change these lines is the following:

    cp .starpu/sampling/bus/attila_real.platform.xml .starpu/sampling/bus/attila.platform.xml
    cp .starpu/sampling/bus/attila.platform.xml .starpu/sampling/bus/attila_real.platform.xml
    cat .starpu/sampling/bus/attila.platform.xml | sed "s/ bandwidth=.*/ bandwidth='6526373581.889518' latency='0.000000' sharing_policy='FATPIPE'\/>/g" > .starpu/sampling/bus/attila_fatpipe.platform.xml
    cp .starpu/sampling/bus/attila_fatpipe.platform.xml .starpu/sampling/bus/attila.platform.xml
    

    Verifying that the changes were correct:

    <?xml version='1.0'?/>
     <!DOCTYPE platform SYSTEM 'http://simgrid.gforge.inria.fr/simgrid.dtd'/>
     <platform version='3'/>
     <config id='General'/>
       <prop id='network/TCP_gamma' value='-1'></prop/>
       <prop id='network/latency_factor' value='1'></prop/>
       <prop id='network/bandwidth_factor' value='1'></prop/>
     </config/>
     <AS  id='AS0'  routing='Full'/>
       <host id='MAIN' power='1'/>
       <host id='CPU0' power='2000000000'/>
       <host id='CPU1' power='2000000000'/>
       <host id='CPU2' power='2000000000'/>
       <host id='CPU3' power='2000000000'/>
       <host id='CPU4' power='2000000000'/>
       <host id='CPU5' power='2000000000'/>
       <host id='CPU6' power='2000000000'/>
       <host id='CPU7' power='2000000000'/>
       <host id='CPU8' power='2000000000'/>
       <host id='CPU9' power='2000000000'/>
       <host id='CPU10' power='2000000000'/>
       <host id='CPU11' power='2000000000'/>
       <host id='CUDA0' power='2000000000'/>
        <prop id='memsize' value='3220897792'/>
       </host/>
       <host id='CUDA1' power='2000000000'/>
        <prop id='memsize' value='3220897792'/>
       </host/>
       <host id='CUDA2' power='2000000000'/>
        <prop id='memsize' value='3220897792'/>
       </host/>
       <host id='OpenCL0' power='2000000000'/>
        <prop id='memsize' value='3220897792'/>
       </host/>
       <host id='OpenCL1' power='2000000000'/>
        <prop id='memsize' value='3220897792'/>
       </host/>
       <host id='OpenCL2' power='2000000000'/>
        <prop id='memsize' value='3220897792'/>
       </host/>
    
       <host id='RAM' power='1'/>
    
       <link id='Share' bandwidth='6526373581.889518' latency='0.000000' sharing_policy='FATPIPE'/>
    
       <link id='RAM-CUDA0' bandwidth='6526373581.889518' latency='0.000000' sharing_policy='FATPIPE'/>
       <link id='CUDA0-RAM' bandwidth='6526373581.889518' latency='0.000000' sharing_policy='FATPIPE'/>
       <link id='RAM-CUDA1' bandwidth='6526373581.889518' latency='0.000000' sharing_policy='FATPIPE'/>
       <link id='CUDA1-RAM' bandwidth='6526373581.889518' latency='0.000000' sharing_policy='FATPIPE'/>
       <link id='RAM-CUDA2' bandwidth='6526373581.889518' latency='0.000000' sharing_policy='FATPIPE'/>
       <link id='CUDA2-RAM' bandwidth='6526373581.889518' latency='0.000000' sharing_policy='FATPIPE'/>
       <link id='CUDA0-CUDA1' bandwidth='6526373581.889518' latency='0.000000' sharing_policy='FATPIPE'/>
       <link id='CUDA0-CUDA2' bandwidth='6526373581.889518' latency='0.000000' sharing_policy='FATPIPE'/>
       <link id='CUDA1-CUDA0' bandwidth='6526373581.889518' latency='0.000000' sharing_policy='FATPIPE'/>
       <link id='CUDA1-CUDA2' bandwidth='6526373581.889518' latency='0.000000' sharing_policy='FATPIPE'/>
       <link id='CUDA2-CUDA0' bandwidth='6526373581.889518' latency='0.000000' sharing_policy='FATPIPE'/>
       <link id='CUDA2-CUDA1' bandwidth='6526373581.889518' latency='0.000000' sharing_policy='FATPIPE'/>
       <link id='RAM-OpenCL0' bandwidth='6526373581.889518' latency='0.000000' sharing_policy='FATPIPE'/>
       <link id='OpenCL0-RAM' bandwidth='6526373581.889518' latency='0.000000' sharing_policy='FATPIPE'/>
       <link id='RAM-OpenCL1' bandwidth='6526373581.889518' latency='0.000000' sharing_policy='FATPIPE'/>
       <link id='OpenCL1-RAM' bandwidth='6526373581.889518' latency='0.000000' sharing_policy='FATPIPE'/>
       <link id='RAM-OpenCL2' bandwidth='6526373581.889518' latency='0.000000' sharing_policy='FATPIPE'/>
       <link id='OpenCL2-RAM' bandwidth='6526373581.889518' latency='0.000000' sharing_policy='FATPIPE'/>
       <route src='RAM' dst='CUDA0' symmetrical='NO'><link_ctn id='RAM-CUDA0'/><link_ctn id='Share'/></route/>
       <route src='CUDA0' dst='RAM' symmetrical='NO'><link_ctn id='CUDA0-RAM'/><link_ctn id='Share'/></route/>
       <route src='RAM' dst='CUDA1' symmetrical='NO'><link_ctn id='RAM-CUDA1'/><link_ctn id='Share'/></route/>
       <route src='CUDA1' dst='RAM' symmetrical='NO'><link_ctn id='CUDA1-RAM'/><link_ctn id='Share'/></route/>
       <route src='RAM' dst='CUDA2' symmetrical='NO'><link_ctn id='RAM-CUDA2'/><link_ctn id='Share'/></route/>
       <route src='CUDA2' dst='RAM' symmetrical='NO'><link_ctn id='CUDA2-RAM'/><link_ctn id='Share'/></route/>
       <route src='CUDA0' dst='CUDA1' symmetrical='NO'><link_ctn id='CUDA0-CUDA1'/><link_ctn id='Share'/></route/>
       <route src='CUDA0' dst='CUDA2' symmetrical='NO'><link_ctn id='CUDA0-CUDA2'/><link_ctn id='Share'/></route/>
       <route src='CUDA1' dst='CUDA0' symmetrical='NO'><link_ctn id='CUDA1-CUDA0'/><link_ctn id='Share'/></route/>
       <route src='CUDA1' dst='CUDA2' symmetrical='NO'><link_ctn id='CUDA1-CUDA2'/><link_ctn id='Share'/></route/>
       <route src='CUDA2' dst='CUDA0' symmetrical='NO'><link_ctn id='CUDA2-CUDA0'/><link_ctn id='Share'/></route/>
       <route src='CUDA2' dst='CUDA1' symmetrical='NO'><link_ctn id='CUDA2-CUDA1'/><link_ctn id='Share'/></route/>
       <route src='RAM' dst='OpenCL0' symmetrical='NO'><link_ctn id='RAM-OpenCL0'/><link_ctn id='Share'/></route/>
       <route src='OpenCL0' dst='RAM' symmetrical='NO'><link_ctn id='OpenCL0-RAM'/><link_ctn id='Share'/></route/>
       <route src='RAM' dst='OpenCL1' symmetrical='NO'><link_ctn id='RAM-OpenCL1'/><link_ctn id='Share'/></route/>
       <route src='OpenCL1' dst='RAM' symmetrical='NO'><link_ctn id='OpenCL1-RAM'/><link_ctn id='Share'/></route/>
       <route src='RAM' dst='OpenCL2' symmetrical='NO'><link_ctn id='RAM-OpenCL2'/><link_ctn id='Share'/></route/>
       <route src='OpenCL2' dst='RAM' symmetrical='NO'><link_ctn id='OpenCL2-RAM'/><link_ctn id='Share'/></route/>
     </AS/>
     </platform|
    

    Everything is fine. Lost connection to the remote machine, lets reconnect

    ssh attila
    wait
    cd spusggitatt/starpu_simgrid
    echo "Reconnected"
    
    Enter passphrase for key '/home/stanisic/.ssh/id_rsa_paul': 
    Enter passphrase for key '/home/stanisic/.ssh/id_rsa_paul':
    1 SMP Thu Jun 28 09:07:26 UTC 2012 x86_64
    
    The programs included with the Debian GNU/Linux system are free software;
    the exact distribution terms for each program are described in the
    individual files in /usr/share/doc/*/copyright.
    
    Debian GNU/Linux comes with ABSOLUTELY NO WARRANTY, to the extent
    permitted by applicable law.
    Last login: Wed Jul 30 13:52:40 2014 from morris
    prenaudg@attila:~/spusggitatt/starpu_simgrid$ Reconnected
    
  9. Running first real experiment

    First we create a new folder where we will store experiments. Folder name will be "dataFATPIPEatt" (FATPIPE communication on attila). Then we move there platform.xml that will be used for all experiments, as we want to easily access it in future.

    mkdir data/dataFATPIPEatt
    cp .starpu/sampling/bus/attila_fatpipe.platform.xml data/dataFATPIPEatt
    

    Now we can first commit it to the exp branch

    git add data/dataFATPIPEatt
    git commit -m "Adding platform description with FATPIPE"
    git status
    
    [expFATPIPE 7e695b0] Adding platform description with FATPIPE
     1 file changed, 83 insertions(+)
     create mode 100644 data/dataFATPIPEatt/attila_fatpipe.platform.xml
    # On branch expFATPIPE
    Your branch is ahead of 'origin/expFATPIPE' by 1 commit.
    
    Untracked files:
    (use "git add <file>..." to include in what will be committed)
    
    --help.cpu
    --help.eps
    --help.gp
    --help.gpu
    .starpu/
    activity.data
    bus_bck/
    src/cudabench/outbench_attila.csv
    src/cudabench/outbench_conan.csv
    src/cudabench/outbench_hannibal.csv
    src/simgrid/a.out
    src/starpu/
    tmp_bench.out
    nothing added to commit but untracked files present (use "git add" to track)
    

    Great now lets recompile again and do a first measurements with 75 blocks using 3 CUDA GPU and do not recalibrate but use previous starpu calibration results. This way each native experiment will have our new "byhand" platform description.

    STARPU_NCPU=0 STARPU_NCUDA=3 STARPU_NOPECL=0 STARPU_SIZE=72000 STARPU_BLK=75 STARPU_SCHED=dmda STARPU_CALIBRATE=0 STARPU_PROGRAM=cholesky ./run_bench_StarPU.sh -d data/dataFATPIPEatt -c
    
    Now you are in git branch: refs/heads/expFATPIPE
    ERROR-experiments can be done only in specific data branch!
    Use -t option for testing
    

    Ah small detail, I forgot that running script is expecting exp branch to be called "data*". This is should be changed, so lets do it now for both native experiments and simulation scripts

    cat run_bench_StarPU.sh | sed "s/!= \*data\*/== \*master\*/g" > run_bench_StarPU.sh
    cat run_inject_StarPUSG.sh | sed "s/!= \*data\*/== \*master\*/g" > run_inject_StarPUSG.sh
    

    This change is important so it can later be cherry-picked in the master branch. Now we commit it:

    git commit -am "Important change to the script, for the name format of exp branches"
    
    [expFATPIPE 78e141a] Important change to the script, for the name format of exp branches
     2 files changed, 1105 deletions(-)
    )
    )
    

    It seems like I forgot to add chmod:

    chmod 755 run_bench_StarPU.sh
    chmod 755 run_inject_StarPUSG.sh
    
    Enter passphrase for key '/home/stanisic/.ssh/id_rsa_paul': 
    Enter passphrase for key '/home/stanisic/.ssh/id_rsa_paul':
    1 SMP Thu Jun 28 09:07:26 UTC 2012 x86_64
    
    The programs included with the Debian GNU/Linux system are free software;
    the exact distribution terms for each program are described in the
    individual files in /usr/share/doc/*/copyright.
    
    Debian GNU/Linux comes with ABSOLUTELY NO WARRANTY, to the extent
    permitted by applicable law.
    Last login: Wed Jul 30 13:53:42 2014 from morris
    prenaudg@attila:~/spusggitatt/starpu_simgrid$ Reconnected
    

    Hm, seems like the previous commit was completely wrong and I just deleted files. So we revert, and try it again (in a smarter way):

    git reset --hard HEAD~1
    cat run_bench_StarPU.sh | sed "s/!= \*data\*/== \*master\*/g" > foo1
    cat run_inject_StarPUSG.sh | sed "s/!= \*data\*/== \*master\*/g" > foo2
    
    HEAD is now at 7e695b0 Adding platform description with FATPIPE
    
    cp foo1 run_bench_StarPU.sh
    cp foo2 run_inject_StarPUSG.sh
    chmod 755 run_bench_StarPU.sh
    chmod 755 run_inject_StarPUSG.sh
    
    rm foo*
    git commit -am "Important change to the script, for the name format of exp branches"
    
    [expFATPIPE e016766] Important change to the script, for the name format of exp branches
     2 files changed, 2 insertions(+), 2 deletions(-)
    

    Now everything is fine. Lets try to run again first experiment:

    STARPU_NCPU=0 STARPU_NCUDA=3 STARPU_NOPECL=0 STARPU_SIZE=72000 STARPU_BLK=75 STARPU_SCHED=dmda STARPU_CALIBRATE=0 STARPU_PROGRAM=cholesky ./run_bench_StarPU.sh -d data/dataFATPIPEatt -c
    

    Lets check if everything went smoothly

    ls data/dataFATPIPEatt
    
    attila_fatpipe.platform.xml  inject.dat  SoloStarpuData0.org
    
    grep "Makespan" data/dataFATPIPEatt/SoloStarpuData0.org 
    grep "'Share' bandwidth" data/dataFATPIPEatt/SoloStarpuData0.org
    
    Makespan (in ms): 103066.08
    <link id='Share' bandwidth='6526373581.889518' latency='0.000000' sharing_policy='FATPIPE'/>
    

    Great everything went as it was supposed to.

  10. Running all experiments

    Now we can run the rest of the experiments. Since compilation takes a lot of time, we will stop recompiling now (last compilation is already saved in first experiment). And actually, lets better do lu application, since on hannibal we used this one. This will take some time…

    Starting with first 10 exp:

    for i in {1..10} ; do STARPU_NCPU=0 STARPU_NCUDA=3 STARPU_NOPECL=0 STARPU_SIZE=$(($i*960)) STARPU_BLK=$i STARPU_SCHED=dmda STARPU_CALIBRATE=0 STARPU_PROGRAM=lu ./run_bench_StarPU.sh -d data/dataFATPIPEatt && echo $i/90 ; done
    
    Now you are in git branch: refs/heads/expFATPIPE
    Everything is commited
    Configure...
    Make...
    Execute...
    Be careful, R is not installed so HISTOGRAM is not generated
    R script for adding HISTOGRAM...
    ./run_bench_StarPU.sh: line 517: Rscript: command not found
    Now you are in git branch: refs/heads/expFATPIPE
    Everything is commited
    Configure...
    Make...
    Execute...
    Be careful, R is not installed so HISTOGRAM is not generated
    R script for adding HISTOGRAM...
    ./run_bench_StarPU.sh: line 517: Rscript: command not found
    Now you are in git branch: refs/heads/expFATPIPE
    Everything is commited
    Configure...
    Make...
    Execute...
    Be careful, R is not installed so HISTOGRAM is not generated
    R script for adding HISTOGRAM...
    ./run_bench_StarPU.sh: line 517: Rscript: command not found
    Now you are in git branch: refs/heads/expFATPIPE
    Everything is commited
    Configure...
    Make...
    Execute...
    Be careful, R is not installed so HISTOGRAM is not generated
    R script for adding HISTOGRAM...
    ./run_bench_StarPU.sh: line 517: Rscript: command not found
    Now you are in git branch: refs/heads/expFATPIPE
    Everything is commited
    Configure...
    Make...
    Execute...
    Be careful, R is not installed so HISTOGRAM is not generated
    R script for adding HISTOGRAM...
    ./run_bench_StarPU.sh: line 517: Rscript: command not found
    Now you are in git branch: refs/heads/expFATPIPE
    Everything is commited
    Configure...
    Make...
    Execute...
    Be careful, R is not installed so HISTOGRAM is not generated
    R script for adding HISTOGRAM...
    ./run_bench_StarPU.sh: line 517: Rscript: command not found
    Now you are in git branch: refs/heads/expFATPIPE
    Everything is commited
    Configure...
    Make...
    Execute...
    Be careful, R is not installed so HISTOGRAM is not generated
    R script for adding HISTOGRAM...
    ./run_bench_StarPU.sh: line 517: Rscript: command not found
    Now you are in git branch: refs/heads/expFATPIPE
    Everything is commited
    Configure...
    Make...
    Execute...
    Be careful, R is not installed so HISTOGRAM is not generated
    R script for adding HISTOGRAM...
    ./run_bench_StarPU.sh: line 517: Rscript: command not found
    Now you are in git branch: refs/heads/expFATPIPE
    Everything is commited
    Configure...
    Make...
    Execute...
    Be careful, R is not installed so HISTOGRAM is not generated
    R script for adding HISTOGRAM...
    ./run_bench_StarPU.sh: line 517: Rscript: command not found
    Now you are in git branch: refs/heads/expFATPIPE
    Everything is commited
    Configure...
    Make...
    Execute...
    Be careful, R is not installed so HISTOGRAM is not generated
    R script for adding HISTOGRAM...
    ./run_bench_StarPU.sh: line 517: Rscript: command not found
    
    for i in {11..70} ; do STARPU_NCPU=0 STARPU_NCUDA=3 STARPU_NOPECL=0 STARPU_SIZE=$(($i*960)) STARPU_BLK=$i STARPU_SCHED=dmda STARPU_CALIBRATE=0 STARPU_PROGRAM=lu ./run_bench_StarPU.sh -d data/dataFATPIPEatt && echo $i/90 ; done
    
    grep "Makespan" data/dataFATPIPEatt/*
    
    data/dataFATPIPEatt/SoloStarpuData0.org:Makespan (in ms): 103066.08
    data/dataFATPIPEatt/SoloStarpuData10.org:Makespan (in ms): 937.42
    data/dataFATPIPEatt/SoloStarpuData11.org:Makespan (in ms): 1123.67
    data/dataFATPIPEatt/SoloStarpuData12.org:Makespan (in ms): 1300.65
    data/dataFATPIPEatt/SoloStarpuData13.org:Makespan (in ms): 1573.59
    data/dataFATPIPEatt/SoloStarpuData14.org:Makespan (in ms): 1816.76
    data/dataFATPIPEatt/SoloStarpuData15.org:Makespan (in ms): 2086.59
    data/dataFATPIPEatt/SoloStarpuData16.org:Makespan (in ms): 2413.03
    data/dataFATPIPEatt/SoloStarpuData17.org:Makespan (in ms): 2752.90
    data/dataFATPIPEatt/SoloStarpuData18.org:Makespan (in ms): 3069.86
    data/dataFATPIPEatt/SoloStarpuData19.org:Makespan (in ms): 3543.78
    data/dataFATPIPEatt/SoloStarpuData1.org:Makespan (in ms): 62.86
    data/dataFATPIPEatt/SoloStarpuData20.org:Makespan (in ms): 4042.45
    data/dataFATPIPEatt/SoloStarpuData21.org:Makespan (in ms): 4564.13
    data/dataFATPIPEatt/SoloStarpuData22.org:Makespan (in ms): 5040.14
    data/dataFATPIPEatt/SoloStarpuData23.org:Makespan (in ms): 5650.88
    data/dataFATPIPEatt/SoloStarpuData24.org:Makespan (in ms): 6316.00
    data/dataFATPIPEatt/SoloStarpuData25.org:Makespan (in ms): 7076.53
    data/dataFATPIPEatt/SoloStarpuData26.org:Makespan (in ms): 7775.61
    data/dataFATPIPEatt/SoloStarpuData27.org:Makespan (in ms): 8666.16
    data/dataFATPIPEatt/SoloStarpuData28.org:Makespan (in ms): 9387.60
    data/dataFATPIPEatt/SoloStarpuData29.org:Makespan (in ms): 10196.08
    data/dataFATPIPEatt/SoloStarpuData2.org:Makespan (in ms): 120.07
    data/dataFATPIPEatt/SoloStarpuData30.org:Makespan (in ms): 11359.00
    data/dataFATPIPEatt/SoloStarpuData31.org:Makespan (in ms): 12461.96
    data/dataFATPIPEatt/SoloStarpuData32.org:Makespan (in ms): 13368.60
    data/dataFATPIPEatt/SoloStarpuData33.org:Makespan (in ms): 14680.32
    data/dataFATPIPEatt/SoloStarpuData34.org:Makespan (in ms): 15710.59
    data/dataFATPIPEatt/SoloStarpuData35.org:Makespan (in ms): 17125.50
    data/dataFATPIPEatt/SoloStarpuData36.org:Makespan (in ms): 18449.08
    data/dataFATPIPEatt/SoloStarpuData37.org:Makespan (in ms): 20020.44
    data/dataFATPIPEatt/SoloStarpuData38.org:Makespan (in ms): 21523.77
    data/dataFATPIPEatt/SoloStarpuData39.org:Makespan (in ms): 23116.38
    data/dataFATPIPEatt/SoloStarpuData3.org:Makespan (in ms): 195.23
    data/dataFATPIPEatt/SoloStarpuData40.org:Makespan (in ms): 24861.97
    data/dataFATPIPEatt/SoloStarpuData41.org:Makespan (in ms): 26514.75
    data/dataFATPIPEatt/SoloStarpuData42.org:Makespan (in ms): 28452.15
    data/dataFATPIPEatt/SoloStarpuData43.org:Makespan (in ms): 30475.22
    data/dataFATPIPEatt/SoloStarpuData44.org:Makespan (in ms): 32884.69
    data/dataFATPIPEatt/SoloStarpuData45.org:Makespan (in ms): 36437.49
    data/dataFATPIPEatt/SoloStarpuData46.org:Makespan (in ms): 39111.31
    data/dataFATPIPEatt/SoloStarpuData47.org:Makespan (in ms): 43440.22
    data/dataFATPIPEatt/SoloStarpuData48.org:Makespan (in ms): 48266.56
    data/dataFATPIPEatt/SoloStarpuData49.org:Makespan (in ms): 52846.85
    data/dataFATPIPEatt/SoloStarpuData4.org:Makespan (in ms): 265.47
    data/dataFATPIPEatt/SoloStarpuData50.org:Makespan (in ms): 59081.88
    data/dataFATPIPEatt/SoloStarpuData51.org:Makespan (in ms): 63445.10
    data/dataFATPIPEatt/SoloStarpuData52.org:Makespan (in ms): 69113.03
    data/dataFATPIPEatt/SoloStarpuData53.org:Makespan (in ms): 73695.15
    data/dataFATPIPEatt/SoloStarpuData54.org:Makespan (in ms): 81067.88
    data/dataFATPIPEatt/SoloStarpuData55.org:Makespan (in ms): 87052.91
    data/dataFATPIPEatt/SoloStarpuData56.org:Makespan (in ms): 94141.99
    data/dataFATPIPEatt/SoloStarpuData57.org:Makespan (in ms): 99902.82
    data/dataFATPIPEatt/SoloStarpuData58.org:Makespan (in ms): 106568.58
    data/dataFATPIPEatt/SoloStarpuData59.org:Makespan (in ms): 113772.80
    data/dataFATPIPEatt/SoloStarpuData5.org:Makespan (in ms): 363.45
    data/dataFATPIPEatt/SoloStarpuData60.org:Makespan (in ms): 122454.92
    data/dataFATPIPEatt/SoloStarpuData61.org:Makespan (in ms): 132460.89
    data/dataFATPIPEatt/SoloStarpuData62.org:Makespan (in ms): 138065.64
    data/dataFATPIPEatt/SoloStarpuData63.org:Makespan (in ms): 152506.03
    data/dataFATPIPEatt/SoloStarpuData64.org:Makespan (in ms): 166046.99
    data/dataFATPIPEatt/SoloStarpuData65.org:Makespan (in ms): 175485.94
    data/dataFATPIPEatt/SoloStarpuData66.org:Makespan (in ms): 187975.79
    data/dataFATPIPEatt/SoloStarpuData67.org:Makespan (in ms): 202826.97
    data/dataFATPIPEatt/SoloStarpuData68.org:Makespan (in ms): 208163.59
    data/dataFATPIPEatt/SoloStarpuData69.org:Makespan (in ms): 223456.92
    data/dataFATPIPEatt/SoloStarpuData6.org:Makespan (in ms): 468.07
    data/dataFATPIPEatt/SoloStarpuData70.org:Makespan (in ms): 234028.91
    data/dataFATPIPEatt/SoloStarpuData7.org:Makespan (in ms): 561.56
    data/dataFATPIPEatt/SoloStarpuData8.org:Makespan (in ms): 687.50
    data/dataFATPIPEatt/SoloStarpuData9.org:Makespan (in ms): 799.81
    
    for i in {71..90} ; do STARPU_NCPU=0 STARPU_NCUDA=3 STARPU_NOPECL=0 STARPU_SIZE=$(($i*960)) STARPU_BLK=$i STARPU_SCHED=dmda STARPU_CALIBRATE=0 STARPU_PROGRAM=lu ./run_bench_StarPU.sh -d data/dataFATPIPEatt && echo $i/90 ; done
    
    Now you are in git branch: refs/heads/expFATPIPE
    Everything is commited
    Configure...
    Make...
    Execute...
    Be careful, R is not installed so HISTOGRAM is not generated
    R script for adding HISTOGRAM...
    ./run_bench_StarPU.sh: line 517: Rscript: command not found
    Now you are in git branch: refs/heads/expFATPIPE
    Everything is commited
    Configure...
    Make...
    Execute...
    Be careful, R is not installed so HISTOGRAM is not generated
    R script for adding HISTOGRAM...
    ./run_bench_StarPU.sh: line 517: Rscript: command not found
    Now you are in git branch: refs/heads/expFATPIPE
    Everything is commited
    Configure...
    Make...
    Execute...
    Be careful, R is not installed so HISTOGRAM is not generated
    R script for adding HISTOGRAM...
    ./run_bench_StarPU.sh: line 517: Rscript: command not found
    Now you are in git branch: refs/heads/expFATPIPE
    Everything is commited
    Configure...
    Make...
    Execute...
    Be careful, R is not installed so HISTOGRAM is not generated
    R script for adding HISTOGRAM...
    ./run_bench_StarPU.sh: line 517: Rscript: command not found
    Now you are in git branch: refs/heads/expFATPIPE
    Everything is commited
    Configure...
    Make...
    Execute...
    Be careful, R is not installed so HISTOGRAM is not generated
    R script for adding HISTOGRAM...
    ./run_bench_StarPU.sh: line 517: Rscript: command not found
    Now you are in git branch: refs/heads/expFATPIPE
    Everything is commited
    Configure...
    Make...
    Execute...
    Be careful, R is not installed so HISTOGRAM is not generated
    R script for adding HISTOGRAM...
    ./run_bench_StarPU.sh: line 517: Rscript: command not found
    Now you are in git branch: refs/heads/expFATPIPE
    Everything is commited
    Configure...
    Make...
    Execute...
    Be careful, R is not installed so HISTOGRAM is not generated
    R script for adding HISTOGRAM...
    ./run_bench_StarPU.sh: line 517: Rscript: command not found
    Now you are in git branch: refs/heads/expFATPIPE
    Everything is commited
    Configure...
    Make...
    Execute...
    Be careful, R is not installed so HISTOGRAM is not generated
    R script for adding HISTOGRAM...
    ./run_bench_StarPU.sh: line 517: Rscript: command not found
    Now you are in git branch: refs/heads/expFATPIPE
    Everything is commited
    Configure...
    Make...
    Execute...
    Be careful, R is not installed so HISTOGRAM is not generated
    R script for adding HISTOGRAM...
    ./run_bench_StarPU.sh: line 517: Rscript: command not found
    Now you are in git branch: refs/heads/expFATPIPE
    Everything is commited
    Configure...
    Make...
    Execute...
    Be careful, R is not installed so HISTOGRAM is not generated
    R script for adding HISTOGRAM...
    ./run_bench_StarPU.sh: line 517: Rscript: command not found
    Now you are in git branch: refs/heads/expFATPIPE
    Everything is commited
    Configure...
    Make...
    Execute...
    Be careful, R is not installed so HISTOGRAM is not generated
    R script for adding HISTOGRAM...
    ./run_bench_StarPU.sh: line 517: Rscript: command not found
    Now you are in git branch: refs/heads/expFATPIPE
    Everything is commited
    Configure...
    Make...
    Execute...
    Be careful, R is not installed so HISTOGRAM is not generated
    R script for adding HISTOGRAM...
    ./run_bench_StarPU.sh: line 517: Rscript: command not found
    Now you are in git branch: refs/heads/expFATPIPE
    Everything is commited
    Configure...
    Make...
    Execute...
    Be careful, R is not installed so HISTOGRAM is not generated
    R script for adding HISTOGRAM...
    ./run_bench_StarPU.sh: line 517: Rscript: command not found
    Now you are in git branch: refs/heads/expFATPIPE
    Everything is commited
    Configure...
    Make...
    Execute...
    Be careful, R is not installed so HISTOGRAM is not generated
    R script for adding HISTOGRAM...
    ./run_bench_StarPU.sh: line 517: Rscript: command not found
    Now you are in git branch: refs/heads/expFATPIPE
    Everything is commited
    Configure...
    Make...
    Execute...
    Be careful, R is not installed so HISTOGRAM is not generated
    R script for adding HISTOGRAM...
    ./run_bench_StarPU.sh: line 517: Rscript: command not found
    Now you are in git branch: refs/heads/expFATPIPE
    Everything is commited
    Configure...
    Make...
    Execute...
    Be careful, R is not installed so HISTOGRAM is not generated
    R script for adding HISTOGRAM...
    ./run_bench_StarPU.sh: line 517: Rscript: command not found
    Now you are in git branch: refs/heads/expFATPIPE
    Everything is commited
    Configure...
    Make...
    Execute...
    Be careful, R is not installed so HISTOGRAM is not generated
    R script for adding HISTOGRAM...
    ./run_bench_StarPU.sh: line 517: Rscript: command not found
    Now you are in git branch: refs/heads/expFATPIPE
    Everything is commited
    Configure...
    Make...
    Execute...
    Be careful, R is not installed so HISTOGRAM is not generated
    R script for adding HISTOGRAM...
    ./run_bench_StarPU.sh: line 517: Rscript: command not found
    Now you are in git branch: refs/heads/expFATPIPE
    Everything is commited
    Configure...
    Make...
    Execute...
    Be careful, R is not installed so HISTOGRAM is not generated
    R script for adding HISTOGRAM...
    ./run_bench_StarPU.sh: line 517: Rscript: command not found
    Now you are in git branch: refs/heads/expFATPIPE
    Everything is commited
    Configure...
    Make...
    Execute...
    Be careful, R is not installed so HISTOGRAM is not generated
    R script for adding HISTOGRAM...
    ./run_bench_StarPU.sh: line 517: Rscript: command not found
    
    Enter passphrase for key '/home/stanisic/.ssh/id_rsa_paul': 
    Enter passphrase for key '/home/stanisic/.ssh/id_rsa_paul':
    1 SMP Thu Jun 28 09:07:26 UTC 2012 x86_64
    
    The programs included with the Debian GNU/Linux system are free software;
    the exact distribution terms for each program are described in the
    individual files in /usr/share/doc/*/copyright.
    
    Debian GNU/Linux comes with ABSOLUTELY NO WARRANTY, to the extent
    permitted by applicable law.
    Last login: Thu Jul 31 09:31:56 2014 from morris
    prenaudg@attila:~$ prenaudg@attila:~/spusggitatt/starpu_simgrid$ Reconnected
    
    grep "Makespan" data/dataFATPIPEatt/*
    
    data/dataFATPIPEatt/SoloStarpuData0.org:Makespan (in ms): 103066.08
    data/dataFATPIPEatt/SoloStarpuData10.org:Makespan (in ms): 937.42
    data/dataFATPIPEatt/SoloStarpuData11.org:Makespan (in ms): 1123.67
    data/dataFATPIPEatt/SoloStarpuData12.org:Makespan (in ms): 1300.65
    data/dataFATPIPEatt/SoloStarpuData13.org:Makespan (in ms): 1573.59
    data/dataFATPIPEatt/SoloStarpuData14.org:Makespan (in ms): 1816.76
    data/dataFATPIPEatt/SoloStarpuData15.org:Makespan (in ms): 2086.59
    data/dataFATPIPEatt/SoloStarpuData16.org:Makespan (in ms): 2413.03
    data/dataFATPIPEatt/SoloStarpuData17.org:Makespan (in ms): 2752.90
    data/dataFATPIPEatt/SoloStarpuData18.org:Makespan (in ms): 3069.86
    data/dataFATPIPEatt/SoloStarpuData19.org:Makespan (in ms): 3543.78
    data/dataFATPIPEatt/SoloStarpuData1.org:Makespan (in ms): 62.86
    data/dataFATPIPEatt/SoloStarpuData20.org:Makespan (in ms): 4042.45
    data/dataFATPIPEatt/SoloStarpuData21.org:Makespan (in ms): 4564.13
    data/dataFATPIPEatt/SoloStarpuData22.org:Makespan (in ms): 5040.14
    data/dataFATPIPEatt/SoloStarpuData23.org:Makespan (in ms): 5650.88
    data/dataFATPIPEatt/SoloStarpuData24.org:Makespan (in ms): 6316.00
    data/dataFATPIPEatt/SoloStarpuData25.org:Makespan (in ms): 7076.53
    data/dataFATPIPEatt/SoloStarpuData26.org:Makespan (in ms): 7775.61
    data/dataFATPIPEatt/SoloStarpuData27.org:Makespan (in ms): 8666.16
    data/dataFATPIPEatt/SoloStarpuData28.org:Makespan (in ms): 9387.60
    data/dataFATPIPEatt/SoloStarpuData29.org:Makespan (in ms): 10196.08
    data/dataFATPIPEatt/SoloStarpuData2.org:Makespan (in ms): 120.07
    data/dataFATPIPEatt/SoloStarpuData30.org:Makespan (in ms): 11359.00
    data/dataFATPIPEatt/SoloStarpuData31.org:Makespan (in ms): 12461.96
    data/dataFATPIPEatt/SoloStarpuData32.org:Makespan (in ms): 13368.60
    data/dataFATPIPEatt/SoloStarpuData33.org:Makespan (in ms): 14680.32
    data/dataFATPIPEatt/SoloStarpuData34.org:Makespan (in ms): 15710.59
    data/dataFATPIPEatt/SoloStarpuData35.org:Makespan (in ms): 17125.50
    data/dataFATPIPEatt/SoloStarpuData36.org:Makespan (in ms): 18449.08
    data/dataFATPIPEatt/SoloStarpuData37.org:Makespan (in ms): 20020.44
    data/dataFATPIPEatt/SoloStarpuData38.org:Makespan (in ms): 21523.77
    data/dataFATPIPEatt/SoloStarpuData39.org:Makespan (in ms): 23116.38
    data/dataFATPIPEatt/SoloStarpuData3.org:Makespan (in ms): 195.23
    data/dataFATPIPEatt/SoloStarpuData40.org:Makespan (in ms): 24861.97
    data/dataFATPIPEatt/SoloStarpuData41.org:Makespan (in ms): 26514.75
    data/dataFATPIPEatt/SoloStarpuData42.org:Makespan (in ms): 28452.15
    data/dataFATPIPEatt/SoloStarpuData43.org:Makespan (in ms): 30475.22
    data/dataFATPIPEatt/SoloStarpuData44.org:Makespan (in ms): 32884.69
    data/dataFATPIPEatt/SoloStarpuData45.org:Makespan (in ms): 36437.49
    data/dataFATPIPEatt/SoloStarpuData46.org:Makespan (in ms): 39111.31
    data/dataFATPIPEatt/SoloStarpuData47.org:Makespan (in ms): 43440.22
    data/dataFATPIPEatt/SoloStarpuData48.org:Makespan (in ms): 48266.56
    data/dataFATPIPEatt/SoloStarpuData49.org:Makespan (in ms): 52846.85
    data/dataFATPIPEatt/SoloStarpuData4.org:Makespan (in ms): 265.47
    data/dataFATPIPEatt/SoloStarpuData50.org:Makespan (in ms): 59081.88
    data/dataFATPIPEatt/SoloStarpuData51.org:Makespan (in ms): 63445.10
    data/dataFATPIPEatt/SoloStarpuData52.org:Makespan (in ms): 69113.03
    data/dataFATPIPEatt/SoloStarpuData53.org:Makespan (in ms): 73695.15
    data/dataFATPIPEatt/SoloStarpuData54.org:Makespan (in ms): 81067.88
    data/dataFATPIPEatt/SoloStarpuData55.org:Makespan (in ms): 87052.91
    data/dataFATPIPEatt/SoloStarpuData56.org:Makespan (in ms): 94141.99
    data/dataFATPIPEatt/SoloStarpuData57.org:Makespan (in ms): 99902.82
    data/dataFATPIPEatt/SoloStarpuData58.org:Makespan (in ms): 106568.58
    data/dataFATPIPEatt/SoloStarpuData59.org:Makespan (in ms): 113772.80
    data/dataFATPIPEatt/SoloStarpuData5.org:Makespan (in ms): 363.45
    data/dataFATPIPEatt/SoloStarpuData60.org:Makespan (in ms): 122454.92
    data/dataFATPIPEatt/SoloStarpuData61.org:Makespan (in ms): 132460.89
    data/dataFATPIPEatt/SoloStarpuData62.org:Makespan (in ms): 138065.64
    data/dataFATPIPEatt/SoloStarpuData63.org:Makespan (in ms): 152506.03
    data/dataFATPIPEatt/SoloStarpuData64.org:Makespan (in ms): 166046.99
    data/dataFATPIPEatt/SoloStarpuData65.org:Makespan (in ms): 175485.94
    data/dataFATPIPEatt/SoloStarpuData66.org:Makespan (in ms): 187975.79
    data/dataFATPIPEatt/SoloStarpuData67.org:Makespan (in ms): 202826.97
    data/dataFATPIPEatt/SoloStarpuData68.org:Makespan (in ms): 208163.59
    data/dataFATPIPEatt/SoloStarpuData69.org:Makespan (in ms): 223456.92
    data/dataFATPIPEatt/SoloStarpuData6.org:Makespan (in ms): 468.07
    data/dataFATPIPEatt/SoloStarpuData70.org:Makespan (in ms): 234028.91
    data/dataFATPIPEatt/SoloStarpuData71.org:Makespan (in ms): 252612.97
    data/dataFATPIPEatt/SoloStarpuData72.org:Makespan (in ms): 263497.35
    data/dataFATPIPEatt/SoloStarpuData73.org:Makespan (in ms): 270557.80
    data/dataFATPIPEatt/SoloStarpuData74.org:Makespan (in ms): 292494.92
    data/dataFATPIPEatt/SoloStarpuData75.org:Makespan (in ms): 306109.76
    data/dataFATPIPEatt/SoloStarpuData76.org:Makespan (in ms): 323002.46
    data/dataFATPIPEatt/SoloStarpuData77.org:Makespan (in ms): 336154.12
    data/dataFATPIPEatt/SoloStarpuData78.org:Makespan (in ms): 350285.22
    data/dataFATPIPEatt/SoloStarpuData79.org:Makespan (in ms): 358376.57
    data/dataFATPIPEatt/SoloStarpuData7.org:Makespan (in ms): 561.56
    data/dataFATPIPEatt/SoloStarpuData80.org:Makespan (in ms): 392360.09
    data/dataFATPIPEatt/SoloStarpuData81.org:Makespan (in ms): 398584.29
    data/dataFATPIPEatt/SoloStarpuData82.org:Makespan (in ms): 397043.20
    data/dataFATPIPEatt/SoloStarpuData83.org:Makespan (in ms): 441126.29
    data/dataFATPIPEatt/SoloStarpuData84.org:Makespan (in ms): 430057.68
    data/dataFATPIPEatt/SoloStarpuData85.org:Makespan (in ms): 482253.56
    data/dataFATPIPEatt/SoloStarpuData86.org:Makespan (in ms): 491772.20
    data/dataFATPIPEatt/SoloStarpuData87.org:Makespan (in ms): 517352.53
    data/dataFATPIPEatt/SoloStarpuData88.org:Makespan (in ms): 539028.16
    data/dataFATPIPEatt/SoloStarpuData89.org:Makespan (in ms): 530546.17
    data/dataFATPIPEatt/SoloStarpuData8.org:Makespan (in ms): 687.50
    data/dataFATPIPEatt/SoloStarpuData90.org:Makespan (in ms): 581124.54
    data/dataFATPIPEatt/SoloStarpuData9.org:Makespan (in ms): 799.81
    
  11. Adding data files to the repository

    Lets push the previous changes to the remote repository:

    git push
    
    Enter passphrase for key '/home/prenaudg/.ssh/id_rsa': 
    Counting objects: 12, done.
    Delta compression using up to 24 threads.
    (1/8)   
    

    Compressing objects: 25% (2/8) Compressing objects: 37% (3/8) Compressing objects: 50% (4/8) Compressing objects: 62% (5/8) Compressing objects: 75% (6/8) Compressing objects: 87% (7/8) Compressing objects: 100% (8/8) Compressing objects: 100% (8/8), done.

    (1/9)   
    

    Writing objects: 22% (2/9) Writing objects: 33% (3/9) Writing objects: 44% (4/9) Writing objects: 55% (5/9) Writing objects: 66% (6/9) Writing objects: 77% (7/9) Writing objects: 88% (8/9) Writing objects: 100% (9/9) Writing objects: 100% (9/9), 1.48 KiB, done.

    Total 9 (delta 4), reused 0 (delta 0)
    To git+ssh://prenaudg@scm.gforge.inria.fr//gitroot/mescal/software/expe/starpu_simgrid.git
    expFATPIPE
    

    OK now first lets see how much space do this results take:

    du -sh data/dataFATPIPEatt
    
    447M    data/dataFATPIPEatt
    

    Too much for adding them all together, since there could be some problems with network and git could bug. Lets do this group by group:

    git add data/dataFATPIPEatt/SoloStarpuData0.org
    git add data/dataFATPIPEatt/SoloStarpuData1*
    git add data/dataFATPIPEatt/SoloStarpuData2*
    git add data/dataFATPIPEatt/SoloStarpuData3*
    git add data/dataFATPIPEatt/SoloStarpuData4*
    git commit -m "Adding first group of data results"
    git push
    
    prenaudg@attila:~/spusggitatt/starpu_simgrid$ prenaudg@attila:~/spusggitatt/starpu_simgrid$ prenaudg@attila:~/spusggitatt/starpu_simgrid$ prenaudg@attila:~/spusggitatt/starpu_simgrid$ [expFATPIPE 7e99fd6] Adding first group of data results
     45 files changed, 722659 insertions(+)
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData0.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData1.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData10.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData11.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData12.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData13.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData14.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData15.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData16.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData17.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData18.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData19.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData2.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData20.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData21.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData22.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData23.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData24.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData25.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData26.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData27.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData28.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData29.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData3.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData30.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData31.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData32.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData33.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData34.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData35.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData36.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData37.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData38.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData39.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData4.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData40.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData41.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData42.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData43.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData44.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData45.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData46.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData47.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData48.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData49.org
    Enter passphrase for key '/home/prenaudg/.ssh/id_rsa': 
    Counting objects: 52, done.
    Delta compression using up to 24 threads.
    (1/48)   
    Compressing objects:   4% (2/48)   
    Compressing objects:   6% (3/48)   
    Compressing objects:   8% (4/48)   
    Compressing objects:  10% (5/48)   
    Compressing objects:  12% (6/48)   
    Compressing objects:  14% (7/48)   
    Compressing objects:  16% (8/48)   
    Compressing objects:  18% (9/48)   
    Compressing objects:  20% (10/48)   
    Compressing objects:  22% (11/48)   
    Compressing objects:  25% (12/48)   
    Compressing objects:  27% (13/48)   
    Compressing objects:  29% (14/48)   
    Compressing objects:  31% (15/48)   
    Compressing objects:  33% (16/48)   
    Compressing objects:  35% (17/48)   
    Compressing objects:  37% (18/48)   
    Compressing objects:  39% (19/48)   
    Compressing objects:  41% (20/48)   
    Compressing objects:  43% (21/48)   
    Compressing objects:  45% (22/48)   
    Compressing objects:  47% (23/48)   
    Compressing objects:  50% (24/48)   
    Compressing objects:  52% (25/48)   
    Compressing objects:  54% (26/48)   
    Compressing objects:  56% (27/48)   
    Compressing objects:  58% (28/48)   
    Compressing objects:  60% (29/48)   
    Compressing objects:  62% (30/48)   
    Compressing objects:  64% (31/48)   
    Compressing objects:  66% (32/48)   
    Compressing objects:  68% (33/48)   
    Compressing objects:  70% (34/48)   
    Compressing objects:  72% (35/48)   
    Compressing objects:  75% (36/48)   
    Compressing objects:  77% (37/48)   
    Compressing objects:  79% (38/48)   
    Compressing objects:  81% (39/48)   
    Compressing objects:  83% (40/48)   
    Compressing objects:  85% (41/48)   
    Compressing objects:  87% (42/48)   
    Compressing objects:  89% (43/48)   
    Compressing objects:  91% (44/48)   
    Compressing objects:  93% (45/48)   
    Compressing objects:  95% (46/48)   
    Compressing objects:  97% (47/48)   
    Compressing objects: 100% (48/48)   
    Compressing objects: 100% (48/48), done.
    (1/49)   
    Writing objects:   4% (2/49)   
    Writing objects:   6% (3/49)   
    Writing objects:   8% (4/49)   
    Writing objects:  10% (5/49)   
    Writing objects:  16% (8/49)   
    Writing objects:  20% (10/49)   
    Writing objects:  22% (11/49)   
    Writing objects:  24% (12/49)   
    Writing objects:  26% (13/49)   
    Writing objects:  28% (14/49)   
    Writing objects:  32% (16/49)   
    Writing objects:  36% (18/49)   
    Writing objects:  38% (19/49)   
    Writing objects:  40% (20/49)   
    Writing objects:  44% (22/49)   
    Writing objects:  48% (24/49), 1.49 MiB | 2.85 MiB/s   
    Writing objects:  51% (25/49), 1.49 MiB | 2.85 MiB/s   
    Writing objects:  55% (27/49), 1.49 MiB | 2.85 MiB/s   
    Writing objects:  59% (29/49), 1.49 MiB | 2.85 MiB/s   
    Writing objects:  61% (30/49), 1.49 MiB | 2.85 MiB/s   
    Writing objects:  63% (31/49), 1.49 MiB | 2.85 MiB/s   
    Writing objects:  67% (33/49), 1.49 MiB | 2.85 MiB/s   
    Writing objects:  71% (35/49), 2.37 MiB | 2.30 MiB/s   
    Writing objects:  73% (36/49), 2.37 MiB | 2.30 MiB/s   
    Writing objects:  75% (37/49), 2.37 MiB | 2.30 MiB/s   
    Writing objects:  79% (39/49), 2.37 MiB | 2.30 MiB/s   
    Writing objects:  81% (40/49), 2.37 MiB | 2.30 MiB/s   
    Writing objects:  83% (41/49), 3.37 MiB | 2.11 MiB/s   
    Writing objects:  85% (42/49), 3.37 MiB | 2.11 MiB/s   
    Writing objects:  85% (42/49), 4.58 MiB | 2.19 MiB/s   
    Writing objects:  91% (45/49), 4.58 MiB | 2.19 MiB/s   
    Writing objects:  93% (46/49), 4.58 MiB | 2.19 MiB/s   
    Writing objects:  95% (47/49), 4.58 MiB | 2.19 MiB/s   
    Writing objects:  97% (48/49), 5.60 MiB | 2.16 MiB/s   
    Writing objects: 100% (49/49), 5.60 MiB | 2.16 MiB/s   
    Writing objects: 100% (49/49), 6.14 MiB | 2.16 MiB/s, done.
    Total 49 (delta 42), reused 0 (delta 0)
    To git+ssh://prenaudg@scm.gforge.inria.fr//gitroot/mescal/software/expe/starpu_simgrid.git
    expFATPIPE
    
    git add data/dataFATPIPEatt/SoloStarpuData5*
    git add data/dataFATPIPEatt/SoloStarpuData6*
    git add data/dataFATPIPEatt/SoloStarpuData7*
    git commit -m "Adding second group of data results"
    git push
    
    prenaudg@attila:~/spusggitatt/starpu_simgrid$ prenaudg@attila:~/spusggitatt/starpu_simgrid$ [expFATPIPE 2f99d75] Adding second group of data results
     33 files changed, 2987516 insertions(+)
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData5.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData50.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData51.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData52.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData53.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData54.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData55.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData56.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData57.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData58.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData59.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData6.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData60.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData61.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData62.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData63.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData64.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData65.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData66.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData67.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData68.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData69.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData7.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData70.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData71.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData72.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData73.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData74.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData75.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData76.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData77.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData78.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData79.org
    Enter passphrase for key '/home/prenaudg/.ssh/id_rsa': 
    Connection closed by 128.93.193.13
    fatal: The remote end hung up unexpectedly
    
    Enter passphrase for key '/home/prenaudg/.ssh/id_rsa': 
    Counting objects: 40, done.
    Delta compression using up to 24 threads.
    (1/36)   
    

    Compressing objects: 5% (2/36) Compressing objects: 8% (3/36) Compressing objects: 11% (4/36) Compressing objects: 13% (5/36) Compressing objects: 16% (6/36) Compressing objects: 19% (7/36) Compressing objects: 22% (8/36) Compressing objects: 25% (9/36) Compressing objects: 27% (10/36) Compressing objects: 30% (11/36) Compressing objects: 33% (12/36) Compressing objects: 36% (13/36) Compressing objects: 38% (14/36) Compressing objects: 41% (15/36) Compressing objects: 44% (16/36) Compressing objects: 47% (17/36) Compressing objects: 50% (18/36) Compressing objects: 52% (19/36) Compressing objects: 55% (20/36) Compressing objects: 58% (21/36) Compressing objects: 61% (22/36) Compressing objects: 63% (23/36) Compressing objects: 66% (24/36) Compressing objects: 69% (25/36) Compressing objects: 72% (26/36) Compressing objects: 75% (27/36) Compressing objects: 77% (28/36) Compressing objects: 80% (29/36) Compressing objects: 83% (30/36) Compressing objects: 86% (31/36) Compressing objects: 88% (32/36) Compressing objects: 91% (33/36) Compressing objects: 94% (34/36) Compressing objects: 97% (35/36) Compressing objects: 100% (36/36) Compressing objects: 100% (36/36), done.

    (1/37)   
    

    Writing objects: 5% (2/37) Writing objects: 8% (3/37) Writing objects: 10% (4/37) Writing objects: 16% (6/37) Writing objects: 27% (10/37), 1.45 MiB | 1.88 MiB/s Writing objects: 29% (11/37), 3.11 MiB | 2.12 MiB/s Writing objects: 32% (12/37), 3.11 MiB | 2.12 MiB/s Writing objects: 32% (12/37), 4.19 MiB | 2.08 MiB/s Writing objects: 35% (13/37), 4.19 MiB | 2.08 MiB/s Writing objects: 37% (14/37), 4.19 MiB | 2.08 MiB/s Writing objects: 40% (15/37), 5.40 MiB | 2.08 MiB/s Writing objects: 40% (15/37), 6.84 MiB | 2.00 MiB/s Writing objects: 45% (17/37), 6.84 MiB | 2.00 MiB/s Writing objects: 48% (18/37), 6.84 MiB | 2.00 MiB/s Writing objects: 48% (18/37), 7.80 MiB | 2.00 MiB/s Writing objects: 54% (20/37), 7.80 MiB | 2.00 MiB/s Writing objects: 56% (21/37), 9.25 MiB | 1.92 MiB/s Writing objects: 56% (21/37), 10.16 MiB | 1.88 MiB/s Writing objects: 62% (23/37), 10.16 MiB | 1.88 MiB/s Writing objects: 62% (23/37), 12.15 MiB | 1.92 MiB/s Writing objects: 64% (24/37), 12.15 MiB | 1.92 MiB/s Writing objects: 64% (24/37), 13.13 MiB | 1.90 MiB/s Writing objects: 70% (26/37), 14.33 MiB | 1.87 MiB/s Writing objects: 70% (26/37), 15.41 MiB | 1.88 MiB/s Writing objects: 72% (27/37), 15.41 MiB | 1.88 MiB/s Writing objects: 75% (28/37), 16.55 MiB | 1.85 MiB/s Writing objects: 75% (28/37), 17.80 MiB | 1.85 MiB/s Writing objects: 75% (28/37), 19.16 MiB | 1.87 MiB/s Writing objects: 81% (30/37), 19.16 MiB | 1.87 MiB/s Writing objects: 81% (30/37), 21.95 MiB | 1.96 MiB/s Writing objects: 86% (32/37), 21.95 MiB | 1.96 MiB/s Writing objects: 86% (32/37), 23.37 MiB | 1.91 MiB/s Writing objects: 86% (32/37), 24.97 MiB | 1.97 MiB/s Writing objects: 91% (34/37), 24.97 MiB | 1.97 MiB/s Writing objects: 94% (35/37), 26.51 MiB | 1.93 MiB/s Writing objects: 94% (35/37), 28.18 MiB | 1.92 MiB/s Writing objects: 94% (35/37), 29.98 MiB | 1.96 MiB/s Writing objects: 100% (37/37), 29.98 MiB | 1.96 MiB/s Writing objects: 100% (37/37), 31.73 MiB | 1.97 MiB/s, done.

    Total 37 (delta 33), reused 0 (delta 0)
    To git+ssh://prenaudg@scm.gforge.inria.fr//gitroot/mescal/software/expe/starpu_simgrid.git
    expFATPIPE
    
    git add data/dataFATPIPEatt/SoloStarpuData8*
    git add data/dataFATPIPEatt/SoloStarpuData9*
    git commit -m "Adding third group of data results"
    git push
    
    prenaudg@attila:~/spusggitatt/starpu_simgrid$ [expFATPIPE b5537d1] Adding third group of data results
     13 files changed, 2339027 insertions(+)
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData8.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData80.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData81.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData82.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData83.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData84.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData85.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData86.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData87.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData88.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData89.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData9.org
     create mode 100644 data/dataFATPIPEatt/SoloStarpuData90.org
    Enter passphrase for key '/home/prenaudg/.ssh/id_rsa': 
    Counting objects: 20, done.
    Delta compression using up to 24 threads.
    (1/16)   
    Compressing objects:  12% (2/16)   
    Compressing objects:  18% (3/16)   
    Compressing objects:  25% (4/16)   
    Compressing objects:  31% (5/16)   
    Compressing objects:  37% (6/16)   
    Compressing objects:  43% (7/16)   
    Compressing objects:  50% (8/16)   
    Compressing objects:  56% (9/16)   
    Compressing objects:  62% (10/16)   
    Compressing objects:  68% (11/16)   
    Compressing objects:  75% (12/16)   
    Compressing objects:  81% (13/16)   
    Compressing objects:  87% (14/16)   
    Compressing objects:  93% (15/16)   
    Compressing objects: 100% (16/16)   
    Compressing objects: 100% (16/16), done.
    (1/17)   
    Writing objects:  11% (2/17)   
    Writing objects:  17% (3/17)   
    Writing objects:  23% (4/17)   
    Writing objects:  35% (6/17)   
    Writing objects:  35% (6/17), 2.05 MiB | 1.31 MiB/s   
    Writing objects:  35% (6/17), 4.23 MiB | 1.50 MiB/s   
    Writing objects:  52% (9/17), 4.23 MiB | 1.50 MiB/s   
    Writing objects:  52% (9/17), 6.17 MiB | 1.62 MiB/s   
    Writing objects:  52% (9/17), 8.27 MiB | 1.71 MiB/s   
    Writing objects:  64% (11/17), 8.27 MiB | 1.71 MiB/s   
    Writing objects:  64% (11/17), 10.31 MiB | 1.72 MiB/s   
    Writing objects:  64% (11/17), 12.66 MiB | 1.71 MiB/s   
    Writing objects:  76% (13/17), 12.66 MiB | 1.71 MiB/s   
    Writing objects:  76% (13/17), 14.92 MiB | 1.67 MiB/s   
    Writing objects:  82% (14/17), 14.92 MiB | 1.67 MiB/s   
    Writing objects:  82% (14/17), 17.35 MiB | 1.64 MiB/s   
    Writing objects:  82% (14/17), 19.95 MiB | 1.64 MiB/s   
    Writing objects:  94% (16/17), 19.95 MiB | 1.64 MiB/s   
    Writing objects:  94% (16/17), 22.48 MiB | 1.65 MiB/s   
    Writing objects: 100% (17/17), 22.48 MiB | 1.65 MiB/s   
    Writing objects: 100% (17/17), 25.26 MiB | 1.64 MiB/s, done.
    Total 17 (delta 13), reused 0 (delta 0)
    To git+ssh://prenaudg@scm.gforge.inria.fr//gitroot/mescal/software/expe/starpu_simgrid.git
    expFATPIPE
    

    Finally we can pull these results from my local machine (using different org-babel shell session). We also need to stash and then reapply changes made to this file

    git stash
    git pull
    git stash apply
    
  12. Doing experiments on conan machine

    We will now repeat the whole process, only now doing experiments on the conan machine (again lu application)

    exit
    
    logout
    Connection to attila closed.
    
    ssh conan
    wait
    cd spusggitatt/starpu_simgrid
    echo "Reconnected"
    
    Enter passphrase for key '/home/stanisic/.ssh/id_rsa_paul': 
    Enter passphrase for key '/home/stanisic/.ssh/id_rsa_paul':
    1 SMP Debian 3.2.32-1 x86_64
    
    The programs included with the Debian GNU/Linux system are free software;
    the exact distribution terms for each program are described in the
    individual files in /usr/share/doc/*/copyright.
    
    Debian GNU/Linux comes with ABSOLUTELY NO WARRANTY, to the extent
    permitted by applicable law.
    Last login: Thu Jul 31 11:12:00 2014 from morris
    ## Warning: buildbot currently running in buildbot/slaves/starpu/
    ## Report problems to dalton-users@listes.u-bordeaux1.fr or on IRC #runtime
    

    Testing exp

    STARPU_NCPU=0 STARPU_NCUDA=3 STARPU_NOPECL=0 STARPU_SIZE=72000 STARPU_BLK=75 STARPU_SCHED=dmda STARPU_CALIBRATE=1 STARPU_PROGRAM=lu ./run_bench_StarPU.sh -t -c
    
    cat .starpu/sampling/bus/conan.platform.xml | sed "s/</| /g" | sed "s/>/| /g"
    
    <?xml version='1.0'?/>
     <!DOCTYPE platform SYSTEM 'http://simgrid.gforge.inria.fr/simgrid.dtd'/>
     <platform version='3'/>
     <config id='General'/>
       <prop id='network/TCP_gamma' value='-1'></prop/>
       <prop id='network/latency_factor' value='1'></prop/>
       <prop id='network/bandwidth_factor' value='1'></prop/>
     </config/>
     <AS  id='AS0'  routing='Full'/>
       <host id='MAIN' power='1'/>
       <host id='CPU0' power='2000000000'/>
       <host id='CPU1' power='2000000000'/>
       <host id='CPU2' power='2000000000'/>
       <host id='CPU3' power='2000000000'/>
       <host id='CPU4' power='2000000000'/>
       <host id='CPU5' power='2000000000'/>
       <host id='CPU6' power='2000000000'/>
       <host id='CPU7' power='2000000000'/>
       <host id='CPU8' power='2000000000'/>
       <host id='CPU9' power='2000000000'/>
       <host id='CPU10' power='2000000000'/>
       <host id='CPU11' power='2000000000'/>
       <host id='CPU12' power='2000000000'/>
       <host id='CPU13' power='2000000000'/>
       <host id='CPU14' power='2000000000'/>
       <host id='CPU15' power='2000000000'/>
       <host id='CUDA0' power='2000000000'/>
        <prop id='memsize' value='5636554752'/>
       </host/>
       <host id='CUDA1' power='2000000000'/>
        <prop id='memsize' value='5636554752'/>
       </host/>
       <host id='CUDA2' power='2000000000'/>
        <prop id='memsize' value='5636554752'/>
       </host/>
       <host id='OpenCL0' power='2000000000'/>
        <prop id='memsize' value='5636554752'/>
       </host/>
       <host id='OpenCL1' power='2000000000'/>
        <prop id='memsize' value='5636554752'/>
       </host/>
       <host id='OpenCL2' power='2000000000'/>
        <prop id='memsize' value='5636554752'/>
       </host/>
    
       <host id='RAM' power='1'/>
    
       <link id='Share' bandwidth='6513605571.260449' latency='0.000000'/>
    
       <link id='RAM-CUDA0' bandwidth='5093446535.599845' latency='0.000010'/>
       <link id='CUDA0-RAM' bandwidth='6513605571.260449' latency='0.000010'/>
       <link id='RAM-CUDA1' bandwidth='5220930677.182353' latency='0.000019'/>
       <link id='CUDA1-RAM' bandwidth='4642771216.112647' latency='0.000040'/>
       <link id='RAM-CUDA2' bandwidth='4305097189.687334' latency='0.000010'/>
       <link id='CUDA2-RAM' bandwidth='4300101617.331094' latency='0.000009'/>
       <link id='CUDA0-CUDA1' bandwidth='4868103755.439113' latency='0.000023'/>
       <link id='CUDA0-CUDA2' bandwidth='4955803926.365078' latency='0.000023'/>
       <link id='CUDA1-CUDA0' bandwidth='5820472357.627723' latency='0.000020'/>
       <link id='CUDA1-CUDA2' bandwidth='5283083543.469223' latency='0.000014'/>
       <link id='CUDA2-CUDA0' bandwidth='5802543541.024093' latency='0.000020'/>
       <link id='CUDA2-CUDA1' bandwidth='4033374712.285312' latency='0.000014'/>
       <link id='RAM-OpenCL0' bandwidth='2326741640.866454' latency='0.000012'/>
       <link id='OpenCL0-RAM' bandwidth='2375327430.456851' latency='0.000017'/>
       <link id='RAM-OpenCL1' bandwidth='2141222712.787808' latency='0.000011'/>
       <link id='OpenCL1-RAM' bandwidth='1954116048.533424' latency='0.000015'/>
       <link id='RAM-OpenCL2' bandwidth='2089279456.267570' latency='0.000012'/>
       <link id='OpenCL2-RAM' bandwidth='2032189413.797607' latency='0.000032'/>
       <route src='RAM' dst='CUDA0' symmetrical='NO'><link_ctn id='RAM-CUDA0'/><link_ctn id='Share'/></route/>
       <route src='CUDA0' dst='RAM' symmetrical='NO'><link_ctn id='CUDA0-RAM'/><link_ctn id='Share'/></route/>
       <route src='RAM' dst='CUDA1' symmetrical='NO'><link_ctn id='RAM-CUDA1'/><link_ctn id='Share'/></route/>
       <route src='CUDA1' dst='RAM' symmetrical='NO'><link_ctn id='CUDA1-RAM'/><link_ctn id='Share'/></route/>
       <route src='RAM' dst='CUDA2' symmetrical='NO'><link_ctn id='RAM-CUDA2'/><link_ctn id='Share'/></route/>
       <route src='CUDA2' dst='RAM' symmetrical='NO'><link_ctn id='CUDA2-RAM'/><link_ctn id='Share'/></route/>
       <route src='CUDA0' dst='CUDA1' symmetrical='NO'><link_ctn id='CUDA0-CUDA1'/><link_ctn id='Share'/></route/>
       <route src='CUDA0' dst='CUDA2' symmetrical='NO'><link_ctn id='CUDA0-CUDA2'/><link_ctn id='Share'/></route/>
       <route src='CUDA1' dst='CUDA0' symmetrical='NO'><link_ctn id='CUDA1-CUDA0'/><link_ctn id='Share'/></route/>
       <route src='CUDA1' dst='CUDA2' symmetrical='NO'><link_ctn id='CUDA1-CUDA2'/><link_ctn id='Share'/></route/>
       <route src='CUDA2' dst='CUDA0' symmetrical='NO'><link_ctn id='CUDA2-CUDA0'/><link_ctn id='Share'/></route/>
       <route src='CUDA2' dst='CUDA1' symmetrical='NO'><link_ctn id='CUDA2-CUDA1'/><link_ctn id='Share'/></route/>
       <route src='RAM' dst='OpenCL0' symmetrical='NO'><link_ctn id='RAM-OpenCL0'/><link_ctn id='Share'/></route/>
       <route src='OpenCL0' dst='RAM' symmetrical='NO'><link_ctn id='OpenCL0-RAM'/><link_ctn id='Share'/></route/>
       <route src='RAM' dst='OpenCL1' symmetrical='NO'><link_ctn id='RAM-OpenCL1'/><link_ctn id='Share'/></route/>
       <route src='OpenCL1' dst='RAM' symmetrical='NO'><link_ctn id='OpenCL1-RAM'/><link_ctn id='Share'/></route/>
       <route src='RAM' dst='OpenCL2' symmetrical='NO'><link_ctn id='RAM-OpenCL2'/><link_ctn id='Share'/></route/>
       <route src='OpenCL2' dst='RAM' symmetrical='NO'><link_ctn id='OpenCL2-RAM'/><link_ctn id='Share'/></route/>
     </AS/>
     </platform>
    

    Changing platform description

    cp .starpu/sampling/bus/conan_real.platform.xml .starpu/sampling/bus/conan.platform.xml
    cp .starpu/sampling/bus/conan.platform.xml .starpu/sampling/bus/conan_real.platform.xml
    cat .starpu/sampling/bus/conan.platform.xml | sed "s/ bandwidth=.*/ bandwidth='6513605571.260449' latency='0.000000' sharing_policy='FATPIPE'\/>/g" > .starpu/sampling/bus/conan_fatpipe.platform.xml
    cp .starpu/sampling/bus/conan_fatpipe.platform.xml .starpu/sampling/bus/conan.platform.xml
    
    cp: cannot stat `.starpu/sampling/bus/conan_real.platform.xml': No such file or directory
    

    Creating folder

    mkdir data/dataFATPIPEcon
    cp .starpu/sampling/bus/conan_fatpipe.platform.xml data/dataFATPIPEcon
    

    Commiting folder

    git add data/dataFATPIPEcon
    git commit -m "Adding conan platform description with FATPIPE"
    git status
    
    [expFATPIPE 3cf630a] Adding conan platform description with FATPIPE
     1 file changed, 87 insertions(+)
     create mode 100644 data/dataFATPIPEcon/conan_fatpipe.platform.xml
    On branch expFATPIPE
    Your branch is ahead of 'origin/expFATPIPE' by 1 commit.
      (use "git push" to publish your local commits)
    
    Untracked files:
    ..." to include in what will be committed)
    
    	--help.cpu
    	--help.eps
    	--help.gp
    	--help.gpu
    	.starpu/
    	activity.data
    	bus_bck/
    	data/dataFATPIPEatt/inject.dat
    	list.out
    	src/cudabench/outbench_attila.csv
    	src/cudabench/outbench_conan.csv
    	src/cudabench/outbench_hannibal.csv
    	src/simgrid/a.out
    	src/starpu/
    	tmp_bench.out
    
    nothing added to commit but untracked files present (use "git add" to track)
    

    First exp

    STARPU_NCPU=0 STARPU_NCUDA=3 STARPU_NOPECL=0 STARPU_SIZE=9600 STARPU_BLK=10 STARPU_SCHED=dmda STARPU_CALIBRATE=0 STARPU_PROGRAM=cholesky ./run_bench_StarPU.sh -d data/dataFATPIPEcon -c
    

    Verifying

    grep "Makespan" data/dataFATPIPEcon/SoloStarpuData0.org 
    grep "'Share' bandwidth" data/dataFATPIPEcon/SoloStarpuData0.org
    
    Makespan (in ms): 1409.22
    <link id='Share' bandwidth='6513605571.260449' latency='0.000000' sharing_policy='FATPIPE'/>
    

    All exp

    for i in {1..90} ; do STARPU_NCPU=0 STARPU_NCUDA=3 STARPU_NOPECL=0 STARPU_SIZE=$(($i*960)) STARPU_BLK=$i STARPU_SCHED=dmda STARPU_CALIBRATE=0 STARPU_PROGRAM=lu ./run_bench_StarPU.sh -d data/dataFATPIPEcon && echo $i/90 ; done
    

    Verifying

    grep "Makespan" data/dataFATPIPEcon/*
    
    data/dataFATPIPEcon/SoloStarpuData0.org:Makespan (in ms): 1409.22
    data/dataFATPIPEcon/SoloStarpuData10.org:Makespan (in ms): 973.64
    data/dataFATPIPEcon/SoloStarpuData11.org:Makespan (in ms): 1603.03
    data/dataFATPIPEcon/SoloStarpuData12.org:Makespan (in ms): 1567.53
    data/dataFATPIPEcon/SoloStarpuData13.org:Makespan (in ms): 2214.11
    data/dataFATPIPEcon/SoloStarpuData14.org:Makespan (in ms): 3517.14
    data/dataFATPIPEcon/SoloStarpuData15.org:Makespan (in ms): 3276.07
    data/dataFATPIPEcon/SoloStarpuData16.org:Makespan (in ms): 3152.79
    data/dataFATPIPEcon/SoloStarpuData17.org:Makespan (in ms): 3584.26
    data/dataFATPIPEcon/SoloStarpuData18.org:Makespan (in ms): 4283.97
    data/dataFATPIPEcon/SoloStarpuData19.org:Makespan (in ms): 4624.48
    data/dataFATPIPEcon/SoloStarpuData1.org:Makespan (in ms): 119.20
    data/dataFATPIPEcon/SoloStarpuData20.org:Makespan (in ms): 6096.35
    data/dataFATPIPEcon/SoloStarpuData21.org:Makespan (in ms): 4958.50
    data/dataFATPIPEcon/SoloStarpuData22.org:Makespan (in ms): 5506.06
    data/dataFATPIPEcon/SoloStarpuData23.org:Makespan (in ms): 6449.27
    data/dataFATPIPEcon/SoloStarpuData24.org:Makespan (in ms): 7337.58
    data/dataFATPIPEcon/SoloStarpuData25.org:Makespan (in ms): 7124.00
    data/dataFATPIPEcon/SoloStarpuData26.org:Makespan (in ms): 7805.15
    data/dataFATPIPEcon/SoloStarpuData27.org:Makespan (in ms): 8905.41
    data/dataFATPIPEcon/SoloStarpuData28.org:Makespan (in ms): 9492.89
    data/dataFATPIPEcon/SoloStarpuData29.org:Makespan (in ms): 10487.40
    data/dataFATPIPEcon/SoloStarpuData2.org:Makespan (in ms): 300.66
    data/dataFATPIPEcon/SoloStarpuData30.org:Makespan (in ms): 11435.86
    data/dataFATPIPEcon/SoloStarpuData31.org:Makespan (in ms): 12439.23
    data/dataFATPIPEcon/SoloStarpuData32.org:Makespan (in ms): 16904.48
    data/dataFATPIPEcon/SoloStarpuData33.org:Makespan (in ms): 18232.22
    data/dataFATPIPEcon/SoloStarpuData34.org:Makespan (in ms): 19897.05
    data/dataFATPIPEcon/SoloStarpuData35.org:Makespan (in ms): 21367.92
    data/dataFATPIPEcon/SoloStarpuData36.org:Makespan (in ms): 25894.69
    data/dataFATPIPEcon/SoloStarpuData37.org:Makespan (in ms): 29292.58
    data/dataFATPIPEcon/SoloStarpuData38.org:Makespan (in ms): 28404.17
    data/dataFATPIPEcon/SoloStarpuData39.org:Makespan (in ms): 28811.55
    data/dataFATPIPEcon/SoloStarpuData3.org:Makespan (in ms): 295.01
    data/dataFATPIPEcon/SoloStarpuData40.org:Makespan (in ms): 29592.45
    data/dataFATPIPEcon/SoloStarpuData41.org:Makespan (in ms): 27373.52
    data/dataFATPIPEcon/SoloStarpuData42.org:Makespan (in ms): 28804.47
    data/dataFATPIPEcon/SoloStarpuData43.org:Makespan (in ms): 30784.61
    data/dataFATPIPEcon/SoloStarpuData44.org:Makespan (in ms): 38205.16
    data/dataFATPIPEcon/SoloStarpuData45.org:Makespan (in ms): 40271.74
    data/dataFATPIPEcon/SoloStarpuData46.org:Makespan (in ms): 48882.76
    data/dataFATPIPEcon/SoloStarpuData47.org:Makespan (in ms): 51584.97
    data/dataFATPIPEcon/SoloStarpuData48.org:Makespan (in ms): 50984.20
    data/dataFATPIPEcon/SoloStarpuData49.org:Makespan (in ms): 48121.74
    data/dataFATPIPEcon/SoloStarpuData4.org:Makespan (in ms): 508.48
    data/dataFATPIPEcon/SoloStarpuData50.org:Makespan (in ms): 47555.39
    data/dataFATPIPEcon/SoloStarpuData51.org:Makespan (in ms): 54170.25
    data/dataFATPIPEcon/SoloStarpuData52.org:Makespan (in ms): 62751.53
    data/dataFATPIPEcon/SoloStarpuData53.org:Makespan (in ms): 64510.00
    data/dataFATPIPEcon/SoloStarpuData54.org:Makespan (in ms): 58637.41
    data/dataFATPIPEcon/SoloStarpuData55.org:Makespan (in ms): 69540.66
    data/dataFATPIPEcon/SoloStarpuData56.org:Makespan (in ms): 83930.52
    data/dataFATPIPEcon/SoloStarpuData57.org:Makespan (in ms): 77250.69
    data/dataFATPIPEcon/SoloStarpuData58.org:Makespan (in ms): 72770.75
    data/dataFATPIPEcon/SoloStarpuData59.org:Makespan (in ms): 92993.53
    data/dataFATPIPEcon/SoloStarpuData5.org:Makespan (in ms): 609.67
    data/dataFATPIPEcon/SoloStarpuData60.org:Makespan (in ms): 109826.43
    data/dataFATPIPEcon/SoloStarpuData61.org:Makespan (in ms): 99441.75
    data/dataFATPIPEcon/SoloStarpuData62.org:Makespan (in ms): 93052.08
    data/dataFATPIPEcon/SoloStarpuData63.org:Makespan (in ms): 129407.52
    data/dataFATPIPEcon/SoloStarpuData64.org:Makespan (in ms): 164249.93
    data/dataFATPIPEcon/SoloStarpuData65.org:Makespan (in ms): 172609.45
    data/dataFATPIPEcon/SoloStarpuData66.org:Makespan (in ms): 167702.02
    data/dataFATPIPEcon/SoloStarpuData67.org:Makespan (in ms): 138769.95
    data/dataFATPIPEcon/SoloStarpuData68.org:Makespan (in ms): 194540.30
    data/dataFATPIPEcon/SoloStarpuData69.org:Makespan (in ms): 164456.21
    data/dataFATPIPEcon/SoloStarpuData6.org:Makespan (in ms): 908.17
    data/dataFATPIPEcon/SoloStarpuData70.org:Makespan (in ms): 199800.21
    data/dataFATPIPEcon/SoloStarpuData71.org:Makespan (in ms): 214253.29
    data/dataFATPIPEcon/SoloStarpuData72.org:Makespan (in ms): 188671.61
    data/dataFATPIPEcon/SoloStarpuData73.org:Makespan (in ms): 246430.29
    data/dataFATPIPEcon/SoloStarpuData74.org:Makespan (in ms): 210044.49
    data/dataFATPIPEcon/SoloStarpuData75.org:Makespan (in ms): 286923.08
    data/dataFATPIPEcon/SoloStarpuData76.org:Makespan (in ms): 248095.39
    data/dataFATPIPEcon/SoloStarpuData77.org:Makespan (in ms): 289929.68
    data/dataFATPIPEcon/SoloStarpuData78.org:Makespan (in ms): 318949.14
    data/dataFATPIPEcon/SoloStarpuData79.org:Makespan (in ms): 298850.18
    data/dataFATPIPEcon/SoloStarpuData7.org:Makespan (in ms): 952.09
    data/dataFATPIPEcon/SoloStarpuData80.org:Makespan (in ms): 330580.54
    data/dataFATPIPEcon/SoloStarpuData81.org:Makespan (in ms): 321639.22
    data/dataFATPIPEcon/SoloStarpuData82.org:Makespan (in ms): 385733.18
    data/dataFATPIPEcon/SoloStarpuData83.org:Makespan (in ms): 346403.01
    data/dataFATPIPEcon/SoloStarpuData84.org:Makespan (in ms): 394303.00
    data/dataFATPIPEcon/SoloStarpuData85.org:Makespan (in ms): 432195.05
    data/dataFATPIPEcon/SoloStarpuData86.org:Makespan (in ms): 458817.68
    data/dataFATPIPEcon/SoloStarpuData87.org:Makespan (in ms): 455060.37
    data/dataFATPIPEcon/SoloStarpuData88.org:Makespan (in ms): 476476.35
    data/dataFATPIPEcon/SoloStarpuData89.org:Makespan (in ms): 523618.96
    data/dataFATPIPEcon/SoloStarpuData8.org:Makespan (in ms): 1373.25
    data/dataFATPIPEcon/SoloStarpuData90.org:Makespan (in ms): 549210.55
    data/dataFATPIPEcon/SoloStarpuData9.org:Makespan (in ms): 1582.20
    

    Adding data and pushing

    git add data/dataFATPIPEcon/SoloStarpuData0.org
    git add data/dataFATPIPEcon/SoloStarpuData1*
    git add data/dataFATPIPEcon/SoloStarpuData2*
    git add data/dataFATPIPEcon/SoloStarpuData3*
    git add data/dataFATPIPEcon/SoloStarpuData4*
    git commit -m "Adding first group of data results"
    git push
    wait
    git add data/dataFATPIPEcon/SoloStarpuData5*
    git add data/dataFATPIPEcon/SoloStarpuData6*
    git add data/dataFATPIPEcon/SoloStarpuData7*
    git commit -m "Adding second group of data results"
    git push
    
    git add data/dataFATPIPEcon/SoloStarpuData8*
    git add data/dataFATPIPEcon/SoloStarpuData9*
    git commit -m "Adding third group of data results"
    git push
    

    Pull data on my local machine

    git stash
    git pull
    git stash apply
    

    Done with experiments on remote machine, we can close the connections

  13. Try simulations on local machine

    Now we can do simulations on my machine:

    Testing with first experiment

    STARPU_SCHED=dmda STARPU_HOSTNAME=attila STARPU_PROGRAM=lu ./run_inject_StarPUSG.sh -n data/dataFATPIPEatt/SoloStarpuData0.org -t -c
    

    Simgrid is not working since I reinstalled my machine. After installing good packages, lets try to reinstall Simgrid:

    cd src/simgrid
    make -j5
    wait
    make install
    wait
    cd -
    
    Scanning dependencies of target simgrid_update_xml
    Scanning dependencies of target manpages
    Scanning dependencies of target simgrid-colorizer
    Scanning dependencies of target simgrid
    Scanning dependencies of target mtest_c
    ] [  1%] [  1%] Generating manpages
    Install /home/stanisic/Repository/git_gforge/starpu_simgrid/src/simgrid/bin/colorize
    Install /home/stanisic/Repository/git_gforge/starpu_simgrid/src/simgrid/bin/simgrid_update_xml
    ] [  2%] Built target simgrid-colorizer
    ] Built target simgrid_update_xml
    Building C object teshsuite/smpi/mpich3-test/CMakeFiles/mtest_c.dir/util/mtest.c.o
    ] Built target manpages
    ] [  2%] [  3%] [  3%] Building C object CMakeFiles/simgrid.dir/src/msg/instr_msg_vm.c.o
    Building C object CMakeFiles/simgrid.dir/src/bindings/bindings_global.c.o
    Building C object CMakeFiles/simgrid.dir/src/msg/instr_msg_task.c.o
    Building C object CMakeFiles/simgrid.dir/src/msg/instr_msg_process.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/msg/msg_actions.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/msg/msg_deployment.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/msg/msg_environment.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/msg/msg_global.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/msg/msg_gos.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/msg/msg_host.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/msg/msg_io.c.o
    Linking C static library ../../../lib/libmtest_c.a
    ] Built target mtest_c
    ] Building C object CMakeFiles/simgrid.dir/src/msg/msg_mailbox.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/msg/msg_process.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/msg/msg_synchro.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/msg/msg_task.c.o
    ] [  6%] Building C object CMakeFiles/simgrid.dir/src/msg/msg_vm.c.o
    Building C object CMakeFiles/simgrid.dir/src/msg/msg_new_api.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/simdag/instr_sd_task.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/simdag/sd_daxloader.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/simdag/sd_global.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/simdag/sd_link.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/simdag/sd_task.c.o
    ] [  8%] Building C object CMakeFiles/simgrid.dir/src/simdag/sd_workstation.c.o
    Building C object CMakeFiles/simgrid.dir/src/simgrid/sg_config.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/simix/smx_context.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/simix/smx_context_base.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/simix/smx_context_raw.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/simix/smx_deployment.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/simix/smx_environment.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/simix/smx_global.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/simix/smx_host.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/simix/smx_io.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/simix/smx_network.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/simix/smx_process.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/simix/smx_smurf.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/simix/smx_synchro.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/simix/smx_user.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/simix/smx_vm.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/simix/smx_new_api.c.o
    ] Building CXX object CMakeFiles/simgrid.dir/src/surf/cpu_cas01.cpp.o
    ] Building CXX object CMakeFiles/simgrid.dir/src/surf/cpu_interface.cpp.o
    ] Building CXX object CMakeFiles/simgrid.dir/src/surf/cpu_ti.cpp.o
    ] Building CXX object CMakeFiles/simgrid.dir/src/surf/fair_bottleneck.cpp.o
    ] Building C object CMakeFiles/simgrid.dir/src/surf/instr_routing.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/surf/instr_surf.c.o
    ] Building CXX object CMakeFiles/simgrid.dir/src/surf/lagrange.cpp.o
    ] Building CXX object CMakeFiles/simgrid.dir/src/surf/maxmin.cpp.o
    ] Building CXX object CMakeFiles/simgrid.dir/src/surf/network_cm02.cpp.o
    ] Building CXX object CMakeFiles/simgrid.dir/src/surf/network_constant.cpp.o
    ] Building CXX object CMakeFiles/simgrid.dir/src/surf/network_interface.cpp.o
    ] Building CXX object CMakeFiles/simgrid.dir/src/surf/network_smpi.cpp.o
    ] Building C object CMakeFiles/simgrid.dir/src/surf/platf_generator.c.o
    ] Building CXX object CMakeFiles/simgrid.dir/src/surf/plugins/energy.cpp.o
    ] Building C object CMakeFiles/simgrid.dir/src/surf/random_mgr.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/surf/sg_platf.c.o
    ] Building CXX object CMakeFiles/simgrid.dir/src/surf/storage_interface.cpp.o
    ] Building CXX object CMakeFiles/simgrid.dir/src/surf/storage_n11.cpp.o
    ] Building CXX object CMakeFiles/simgrid.dir/src/surf/surf_c_bindings.cpp.o
    ] Building CXX object CMakeFiles/simgrid.dir/src/surf/surf_interface.cpp.o
    ] Building CXX object CMakeFiles/simgrid.dir/src/surf/surf_routing.cpp.o
    ] Building CXX object CMakeFiles/simgrid.dir/src/surf/surf_routing_cluster.cpp.o
    ] Building CXX object CMakeFiles/simgrid.dir/src/surf/surf_routing_cluster_torus.cpp.o
    ] Building CXX object CMakeFiles/simgrid.dir/src/surf/surf_routing_dijkstra.cpp.o
    ] Building CXX object CMakeFiles/simgrid.dir/src/surf/surf_routing_floyd.cpp.o
    ] Building CXX object CMakeFiles/simgrid.dir/src/surf/surf_routing_full.cpp.o
    ] Building CXX object CMakeFiles/simgrid.dir/src/surf/surf_routing_generic.cpp.o
    ] Building CXX object CMakeFiles/simgrid.dir/src/surf/surf_routing_none.cpp.o
    ] Building CXX object CMakeFiles/simgrid.dir/src/surf/surf_routing_vivaldi.cpp.o
    ] Building C object CMakeFiles/simgrid.dir/src/surf/surfxml_parse.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/surf/surfxml_parseplatf.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/surf/trace_mgr.c.o
    ] Building CXX object CMakeFiles/simgrid.dir/src/surf/vm_workstation_hl13.cpp.o
    ] Building CXX object CMakeFiles/simgrid.dir/src/surf/vm_workstation_interface.cpp.o
    ] Building CXX object CMakeFiles/simgrid.dir/src/surf/workstation_clm03.cpp.o
    ] Building CXX object CMakeFiles/simgrid.dir/src/surf/workstation_interface.cpp.o
    ] Building CXX object CMakeFiles/simgrid.dir/src/surf/workstation_ptask_L07.cpp.o
    ] Building C object CMakeFiles/simgrid.dir/src/xbt/xbt_sg_stubs.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/simix/smx_context_thread.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/xbt/xbt_os_thread.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/simix/smx_context_sysv.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/xbt/RngStream.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/xbt/automaton/automaton.c.o
    ] [ 22%] Building C object CMakeFiles/simgrid.dir/src/xbt/automaton/automatonparse_promela.c.o
    Building C object CMakeFiles/simgrid.dir/src/xbt/config.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/xbt/cunit.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/xbt/dict.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/xbt/dict_cursor.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/xbt/dict_elm.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/xbt/dict_multi.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/xbt/dynar.c.o
    ] [ 24%] Building C object CMakeFiles/simgrid.dir/src/xbt/ex.c.o
    Building C object CMakeFiles/simgrid.dir/src/xbt/fifo.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/xbt/graph.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/xbt/graphxml_parse.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/xbt/heap.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/xbt/lib.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/xbt/log.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/xbt/mallocator.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/xbt/parmap.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/xbt/set.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/xbt/setset.c.o
    ] [ 26%] Building C object CMakeFiles/simgrid.dir/src/xbt/snprintf.c.o
    Building C object CMakeFiles/simgrid.dir/src/xbt/swag.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/xbt/xbt_log_appender_file.c.o
    ] [ 27%] Building C object CMakeFiles/simgrid.dir/src/xbt/xbt_log_layout_format.c.o
    Building C object CMakeFiles/simgrid.dir/src/xbt/xbt_log_layout_simple.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/xbt/xbt_main.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/xbt/xbt_matrix.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/xbt/xbt_os_time.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/xbt/xbt_peer.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/xbt/xbt_queue.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/xbt/xbt_replay.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/xbt/xbt_sg_synchro.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/xbt/xbt_sha.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/xbt/xbt_str.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/xbt/xbt_strbuff.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/xbt/xbt_virtu.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/allgather-2dmesh.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/allgather-3dmesh.c.o
    ] [ 30%] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/allgather-GB.c.o
    Building C object CMakeFiles/simgrid.dir/src/smpi/colls/allgather-NTSLR-NB.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/allgather-NTSLR.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/allgather-SMP-NTS.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/allgather-bruck.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/allgather-loosely-lr.c.o
    ] [ 32%] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/allgather-ompi-neighborexchange.c.o
    Building C object CMakeFiles/simgrid.dir/src/smpi/colls/allgather-pair.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/allgather-rdb.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/allgather-rhv.c.o
    ] [ 33%] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/allgather-smp-simple.c.o
    Building C object CMakeFiles/simgrid.dir/src/smpi/colls/allgather-ring.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/allgather-spreading-simple.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/allgatherv-GB.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/allgatherv-mpich-rdb.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/allgatherv-mpich-ring.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/allgatherv-ompi-bruck.c.o
    ] [ 34%] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/allgatherv-ompi-neighborexchange.c.o
    Building C object CMakeFiles/simgrid.dir/src/smpi/colls/allgatherv-pair.c.o
    ] [ 35%] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/allgatherv-ring.c.o
    Building C object CMakeFiles/simgrid.dir/src/smpi/colls/allreduce-lr.c.o
    ] [ 35%] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/allreduce-rab-rdb.c.o
    Building C object CMakeFiles/simgrid.dir/src/smpi/colls/allreduce-ompi-ring-segmented.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/allreduce-rab1.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/allreduce-rab2.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/allreduce-rdb.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/allreduce-redbcast.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/allreduce-smp-binomial-pipeline.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/allreduce-smp-binomial.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/allreduce-smp-rdb.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/allreduce-smp-rsag-lr.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/allreduce-smp-rsag-rab.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/allreduce-smp-rsag.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/alltoall-2dmesh.c.o
    ] [ 38%] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/alltoall-3dmesh.c.o
    Building C object CMakeFiles/simgrid.dir/src/smpi/colls/alltoall-pair-light-barrier.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/alltoall-pair-mpi-barrier.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/alltoall-pair-one-barrier.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/alltoall-pair.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/alltoall-rdb.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/alltoall-ring-light-barrier.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/alltoall-ring-mpi-barrier.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/alltoall-ring-one-barrier.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/alltoall-ring.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/alltoallv-bruck.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/alltoallv-ompi-basic-linear.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/alltoallv-pair-light-barrier.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/alltoallv-pair-mpi-barrier.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/alltoallv-pair-one-barrier.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/alltoallv-pair.c.o
    ] [ 42%] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/alltoallv-ring-light-barrier.c.o
    Building C object CMakeFiles/simgrid.dir/src/smpi/colls/alltoallv-ring-mpi-barrier.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/alltoallv-ring-one-barrier.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/alltoallv-ring.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/barrier-ompi.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/bcast-NTSB.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/bcast-NTSL-Isend.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/bcast-NTSL.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/bcast-SMP-binary.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/bcast-SMP-binomial.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/bcast-SMP-linear.c.o
    ] [ 45%] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/bcast-arrival-pattern-aware-wait.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/bcast-arrival-pattern-aware.c.o
    Building C object CMakeFiles/simgrid.dir/src/smpi/colls/bcast-arrival-scatter.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/bcast-binomial-tree.c.o
    ] [ 46%] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/bcast-flattree-pipeline.c.o
    Building C object CMakeFiles/simgrid.dir/src/smpi/colls/bcast-flattree.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/bcast-ompi-pipeline.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/bcast-ompi-split-bintree.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/bcast-scatter-LR-allgather.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/bcast-scatter-rdb-allgather.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/coll_tuned_topo.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/colls_global.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/gather-ompi.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/reduce-NTSL.c.o
    ] [ 48%] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/reduce-binomial.c.o
    Building C object CMakeFiles/simgrid.dir/src/smpi/colls/reduce-arrival-pattern-aware.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/reduce-flat-tree.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/reduce-ompi.c.o
    ] [ 49%] [ 49%] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/reduce-scatter-gather.c.o
    Building C object CMakeFiles/simgrid.dir/src/smpi/colls/reduce_scatter-ompi.c.o
    Building C object CMakeFiles/simgrid.dir/src/smpi/colls/reduce_scatter-mpich.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/scatter-ompi.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/smpi_automatic_selector.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/smpi_mpich_selector.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/colls/smpi_openmpi_selector.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/instr_smpi.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/smpi_base.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/smpi_bench.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/smpi_c99.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/smpi_coll.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/smpi_comm.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/smpi_deployment.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/smpi_dvfs.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/smpi_global.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/smpi_group.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/smpi_mpi.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/smpi_mpi_dt.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/smpi_pmpi.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/smpi_replay.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/smpi_topo.c.o
    ] Building CXX object CMakeFiles/simgrid.dir/src/surf/surf_routing_cluster_fat_tree.cpp.o
    ] Building C object CMakeFiles/simgrid.dir/src/smpi/smpi_f77.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/instr/instr_TI_trace.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/instr/instr_config.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/instr/instr_interface.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/instr/instr_paje_containers.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/instr/instr_paje_header.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/instr/instr_paje_trace.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/instr/instr_paje_types.c.o
    ] Building C object CMakeFiles/simgrid.dir/src/instr/instr_paje_values.c.o
    ] [ 56%] Building C object CMakeFiles/simgrid.dir/src/instr/instr_resource_utilization.c.o
    Building C object CMakeFiles/simgrid.dir/src/instr/instr_trace.c.o
    Linking CXX shared library lib/libsimgrid.so
    ] Built target simgrid
    ] Scanning dependencies of target bittorrent_platfgen
    Scanning dependencies of target actions
    Scanning dependencies of target bittorrent
    Generating *_units files for testall...
    Scanning dependencies of target chainsend
    ] [ 57%] [ 57%] Building C object examples/msg/actions/CMakeFiles/actions.dir/actions.c.o
    Building C object examples/msg/chainsend/CMakeFiles/chainsend.dir/chainsend.c.o
    ] Building C object examples/msg/bittorrent/CMakeFiles/bittorrent.dir/bittorrent.c.o
    Building C object examples/msg/bittorrent/CMakeFiles/bittorrent_platfgen.dir/bittorrent_platfgen.c.o
    sg_unit_extractor: processing src/xbt/cunit.c (generating /home/stanisic/Repository/git_gforge/starpu_simgrid/src/simgrid/src/cunit_unit.c)...
      Suite cunit: "Testsuite mechanism autotest" (1 tests)
        unit expect: func= test_expected_failure; title= "expected failures"
    sg_unit_extractor: processing src/xbt/ex.c (generating /home/stanisic/Repository/git_gforge/starpu_simgrid/src/simgrid/src/ex_unit.c)...
      Suite xbt_ex: "Exception Handling" (4 tests)
        unit controlflow: func= test_controlflow; title= "basic nested control flow"
        unit value: func= test_value; title= "exception value passing"
        unit variables: func= test_variables; title= "variable value preservation"
        unit cleanup: func= test_cleanup; title= "cleanup handling"
    sg_unit_extractor: processing src/xbt/dynar.c (generating /home/stanisic/Repository/git_gforge/starpu_simgrid/src/simgrid/src/dynar_unit.c)...
      Suite dynar: "Dynar data container" (4 tests)
        unit int: func= test_dynar_int; title= "Dynars of integers"
        unit insert: func=test_dynar_insert; title="Using the xbt_dynar_insert and xbt_dynar_remove functions"
        unit double: func= test_dynar_double; title= "Dynars of doubles"
        unit string: func= test_dynar_string; title= "Dynars of strings"
    sg_unit_extractor: processing src/xbt/dict.c (generating /home/stanisic/Repository/git_gforge/starpu_simgrid/src/simgrid/src/dict_unit.c)...
      Suite dict: "Dict data container" (6 tests)
        unit basic_heterogeneous: func= test_dict_basic_heterogeneous; title= "Basic usage: change, retrieve, traverse: heterogeneous dict"
        unit basic_homogeneous: func= test_dict_basic_homogeneous; title= "Basic usage: change, retrieve, traverse: homogeneous dict"
        unit remove_heterogeneous: func= test_dict_remove_heterogeneous; title= "Removing some values: heterogeneous dict"
        unit remove_homogeneous: func= test_dict_remove_homogeneous; title= "Removing some values: homogeneous dict"
        unit nulldata: func= test_dict_nulldata; title= "NULL data management"
        unit crash: func= test_dict_crash; title= "Crash test"
    sg_unit_extractor: processing src/xbt/set.c (generating /home/stanisic/Repository/git_gforge/starpu_simgrid/src/simgrid/src/set_unit.c)...
      Suite set: "Set data container" (4 tests)
        unit basic: func= test_set_basic; title= "Basic usage"
        unit change: func= test_set_change; title= "Changing some values"
        unit retrieve: func= test_set_retrieve; title= "Retrieving some values"
        unit remove: func= test_set_remove; title= "Removing some values"
    sg_unit_extractor: processing src/xbt/swag.c (generating /home/stanisic/Repository/git_gforge/starpu_simgrid/src/simgrid/src/swag_unit.c)...
      Suite swag: "Swag data container" (1 tests)
        unit basic: func= test_swag_basic; title= "Basic usage"
    sg_unit_extractor: processing src/xbt/xbt_str.c (generating /home/stanisic/Repository/git_gforge/starpu_simgrid/src/simgrid/src/xbt_str_unit.c)...
      Suite xbt_str: "String Handling" (3 tests)
        unit xbt_str_split_quoted: func= test_split_quoted; title= "test the function xbt_str_split_quoted"
        unit xbt_str_split_str: func= test_split_str; title= "test the function xbt_str_split_str"
        unit xbt_str_diff: func= test_diff; title= "test the function xbt_str_diff"
    sg_unit_extractor: processing src/xbt/xbt_strbuff.c (generating /home/stanisic/Repository/git_gforge/starpu_simgrid/src/simgrid/src/xbt_strbuff_unit.c)...
      Suite xbt_strbuff: "String Buffers" (1 tests)
        unit xbt_strbuff_substitute: func= test_strbuff_substitute; title= "test the function xbt_strbuff_substitute"
    sg_unit_extractor: processing src/xbt/xbt_sha.c (generating /home/stanisic/Repository/git_gforge/starpu_simgrid/src/simgrid/src/xbt_sha_unit.c)...
      Suite hash: "Various hash functions" (1 tests)
        unit sha: func= test_crypto_sha; title= "Test of the sha algorithm"
    sg_unit_extractor: processing src/xbt/config.c (generating /home/stanisic/Repository/git_gforge/starpu_simgrid/src/simgrid/src/config_unit.c)...
      Suite config: "Configuration support" (3 tests)
        unit memuse: func= test_config_memuse; title= "Alloc and free a config set"
        unit validation: func= test_config_validation; title= "Validation tests"
        unit use: func= test_config_use; title= "Data retrieving tests"
    Scanning dependencies of target testall
    ] Building C object CMakeFiles/testall.dir/src/cunit_unit.c.o
    ] Building C object examples/msg/chainsend/CMakeFiles/chainsend.dir/iterator.c.o
    ] Building C object examples/msg/bittorrent/CMakeFiles/bittorrent.dir/messages.c.o
    ] Building C object CMakeFiles/testall.dir/src/ex_unit.c.o
    ] Building C object examples/msg/bittorrent/CMakeFiles/bittorrent_platfgen.dir/messages.c.o
    ] Building C object examples/msg/chainsend/CMakeFiles/chainsend.dir/common.c.o
    ] Building C object examples/msg/bittorrent/CMakeFiles/bittorrent.dir/peer.c.o
    ] Building C object CMakeFiles/testall.dir/src/dynar_unit.c.o
    ] Building C object examples/msg/bittorrent/CMakeFiles/bittorrent_platfgen.dir/peer.c.o
    ] Building C object examples/msg/chainsend/CMakeFiles/chainsend.dir/messages.c.o
    ] Building C object examples/msg/chainsend/CMakeFiles/chainsend.dir/broadcaster.c.o
    Linking C executable actions
    ] Building C object examples/msg/chainsend/CMakeFiles/chainsend.dir/peer.c.o
    Linking C executable chainsend
    ] Building C object CMakeFiles/testall.dir/src/dict_unit.c.o
    ] Built target actions
    Scanning dependencies of target chord
    ] Building C object examples/msg/chord/CMakeFiles/chord.dir/chord.c.o
    ] Building C object examples/msg/bittorrent/CMakeFiles/bittorrent_platfgen.dir/tracker.c.o
    ] Building C object CMakeFiles/testall.dir/src/set_unit.c.o
    ] Building C object examples/msg/bittorrent/CMakeFiles/bittorrent.dir/tracker.c.o
    ] Built target chainsend
    Scanning dependencies of target bound
    ] Building C object examples/msg/bittorrent/CMakeFiles/bittorrent_platfgen.dir/connection.c.o
    ] Building C object examples/msg/cloud/CMakeFiles/bound.dir/bound.c.o
    Linking C executable bittorrent_platfgen
    ] [ 64%] Building C object examples/msg/bittorrent/CMakeFiles/bittorrent.dir/connection.c.o
    Building C object CMakeFiles/testall.dir/src/swag_unit.c.o
    Linking C executable bittorrent
    ] Building C object CMakeFiles/testall.dir/src/xbt_str_unit.c.o
    Linking C executable chord
    Linking C executable bound
    ] Building C object CMakeFiles/testall.dir/src/xbt_strbuff_unit.c.o
    ] Built target bound
    ] Building C object CMakeFiles/testall.dir/src/xbt_sha_unit.c.o
    Scanning dependencies of target migrate_vm
    ] Building C object examples/msg/cloud/CMakeFiles/migrate_vm.dir/migrate_vm.c.o
    ] Building C object CMakeFiles/testall.dir/src/config_unit.c.o
    ] Built target chord
    ] Building C object CMakeFiles/testall.dir/src/simgrid_units_main.c.o
    Scanning dependencies of target multicore
    ] Building C object examples/msg/cloud/CMakeFiles/multicore.dir/multicore.c.o
    Linking C executable src/testall
    Linking C executable migrate_vm
    ] Built target migrate_vm
    Scanning dependencies of target scale
    ] Building C object examples/msg/cloud/CMakeFiles/scale.dir/scale.c.o
    Linking C executable multicore
    Linking C executable scale
    ] Built target bittorrent_platfgen
    ] Built target bittorrent
    Scanning dependencies of target simple_vm
    Scanning dependencies of target two_tasks_vm
    ] Building C object examples/msg/cloud/CMakeFiles/simple_vm.dir/simple_vm.c.o
    ] Building C object examples/msg/cloud/CMakeFiles/two_tasks_vm.dir/two_tasks_vm.c.o
    ] Built target scale
    Scanning dependencies of target e1
    ] Building C object examples/msg/energy/e1/CMakeFiles/e1.dir/e1.c.o
    Linking C executable two_tasks_vm
    Linking C executable e1
    Linking C executable simple_vm
    ] Built target two_tasks_vm
    Scanning dependencies of target e2
    ] Building C object examples/msg/energy/e2/CMakeFiles/e2.dir/e2.c.o
    ] Built target multicore
    Scanning dependencies of target e3
    ] Building C object examples/msg/energy/e3/CMakeFiles/e3.dir/e3.c.o
    Linking C executable e2
    ] Built target e1
    Scanning dependencies of target test_MSG_gpu_task_create
    ] Building C object examples/msg/gpu/CMakeFiles/test_MSG_gpu_task_create.dir/test_MSG_gpu_task_create.c.o
    ] Built target simple_vm
    Scanning dependencies of target gtnets
    Linking C executable test_MSG_gpu_task_create
    ] Building C object examples/msg/gtnets/CMakeFiles/gtnets.dir/gtnets.c.o
    Linking C executable e3
    ] Built target e2
    Scanning dependencies of target peer
    ] Building C object examples/msg/icomms/CMakeFiles/peer.dir/peer.c.o
    ] Built target test_MSG_gpu_task_create
    Scanning dependencies of target peer2
    ] Building C object examples/msg/icomms/CMakeFiles/peer2.dir/peer2.c.o
    Linking C executable gtnets
    ] Built target e3
    Scanning dependencies of target peer3
    ] Building C object examples/msg/icomms/CMakeFiles/peer3.dir/peer3.c.o
    Linking C executable peer
    ] Built target testall
    Scanning dependencies of target file
    ] Building C object examples/msg/io/CMakeFiles/file.dir/file.c.o
    Linking C executable peer2
    ] Built target gtnets
    Scanning dependencies of target file_unlink
    ] Building C object examples/msg/io/CMakeFiles/file_unlink.dir/file_unlink.c.o
    Linking C executable peer3
    ] Built target peer
    Scanning dependencies of target storage
    ] [ 69%] Built target peer2
    Building C object examples/msg/io/CMakeFiles/storage.dir/storage.c.o
    Scanning dependencies of target kademlia
    ] Building C object examples/msg/kademlia/CMakeFiles/kademlia.dir/kademlia.c.o
    Linking C executable file
    Linking C executable file_unlink
    ] Built target peer3
    Linking C executable storage
    ] Building C object examples/msg/kademlia/CMakeFiles/kademlia.dir/node.c.o
    ] Built target file
    ] Building C object examples/msg/kademlia/CMakeFiles/kademlia.dir/routing_table.c.o
    ] Built target file_unlink
    Scanning dependencies of target masterslave_arg
    ] Building C object examples/msg/masterslave/CMakeFiles/masterslave_arg.dir/masterslave_arg.c.o
    ] Building C object examples/msg/kademlia/CMakeFiles/kademlia.dir/task.c.o
    ] Built target storage
    Scanning dependencies of target masterslave_bypass
    Scanning dependencies of target masterslave_cluster
    ] [ 71%] Building C object examples/msg/masterslave/CMakeFiles/masterslave_bypass.dir/masterslave_bypass.c.o
    Building C object examples/msg/masterslave/CMakeFiles/masterslave_cluster.dir/masterslave_cluster.c.o
    Scanning dependencies of target masterslave_failure
    ] Building C object examples/msg/masterslave/CMakeFiles/masterslave_failure.dir/masterslave_failure.c.o
    ] Linking C executable masterslave_arg
    Building C object examples/msg/kademlia/CMakeFiles/kademlia.dir/answer.c.o
    Linking C executable kademlia
    ] Built target masterslave_arg
    Scanning dependencies of target masterslave_failure_platfgen
    ] Building C object examples/msg/masterslave/CMakeFiles/masterslave_failure_platfgen.dir/masterslave_failure_platfgen.c.o
    Linking C executable masterslave_bypass
    Linking C executable masterslave_cluster
    Linking C executable masterslave_failure
    ] Built target masterslave_failure
    Linking C executable masterslave_failure_platfgen
    Scanning dependencies of target masterslave_forwarder
    ] Building C object examples/msg/masterslave/CMakeFiles/masterslave_forwarder.dir/masterslave_forwarder.c.o
    ] Built target masterslave_cluster
    ] Built target masterslave_bypass
    Scanning dependencies of target masterslave_mailbox
    Scanning dependencies of target masterslave_kill
    ] [ 72%] Building C object examples/msg/masterslave/CMakeFiles/masterslave_mailbox.dir/masterslave_mailbox.c.o
    Building C object examples/msg/masterslave/CMakeFiles/masterslave_kill.dir/masterslave_kill.c.o
    Linking C executable masterslave_mailbox
    Linking C executable masterslave_kill
    ] Built target kademlia
    Scanning dependencies of target masterslave_platfgen
    ] Building C object examples/msg/masterslave/CMakeFiles/masterslave_platfgen.dir/masterslave_platfgen.c.o
    ] Built target masterslave_failure_platfgen
    Scanning dependencies of target migration
    ] [ 73%] Built target masterslave_mailbox
    Building C object examples/msg/migration/CMakeFiles/migration.dir/migration.c.o
    Scanning dependencies of target parallel_task
    Linking C executable masterslave_forwarder
    ] Building C object examples/msg/parallel_task/CMakeFiles/parallel_task.dir/parallel_task.c.o
    ] Built target masterslave_kill
    Scanning dependencies of target test_ptask
    ] Building C object examples/msg/parallel_task/CMakeFiles/test_ptask.dir/test_ptask.c.o
    Linking C executable migration
    Linking C executable parallel_task
    Linking C executable masterslave_platfgen
    Linking C executable test_ptask
    ] Built target migration
    Scanning dependencies of target pastry
    ] [ 74%] Built target masterslave_forwarder
    Building C object examples/msg/pastry/CMakeFiles/pastry.dir/pastry.c.o
    Scanning dependencies of target msg_pmm
    ] Building C object examples/msg/pmm/CMakeFiles/msg_pmm.dir/msg_pmm.c.o
    ] Built target parallel_task
    Scanning dependencies of target priority
    ] Building C object examples/msg/priority/CMakeFiles/priority.dir/priority.c.o
    ] Built target masterslave_platfgen
    ] Built target test_ptask
    Scanning dependencies of target msg_prop
    Linking C executable priority
    Scanning dependencies of target synchro
    ] Building C object examples/msg/properties/CMakeFiles/msg_prop.dir/msg_prop.c.o
    ] Linking C executable msg_pmm
    Building C object examples/msg/semaphores/CMakeFiles/synchro.dir/synchro.c.o
    ] Built target priority
    Scanning dependencies of target sendrecv
    ] Linking C executable synchro
    Building C object examples/msg/sendrecv/CMakeFiles/sendrecv.dir/sendrecv.c.o
    Linking C executable msg_prop
    ] Built target msg_pmm
    Scanning dependencies of target sk_time
    ] Linking C executable sendrecv
    Building C object examples/msg/start_kill_time/CMakeFiles/sk_time.dir/sk_time.c.o
    ] Built target synchro
    Scanning dependencies of target suspend
    ] Building C object examples/msg/suspend/CMakeFiles/suspend.dir/suspend.c.o
    ] Built target msg_prop
    Linking C executable sk_time
    Scanning dependencies of target token_bypass
    ] Building C object examples/msg/token_ring/CMakeFiles/token_bypass.dir/token_bypass.c.o
    ] Built target sendrecv
    Scanning dependencies of target token_ring
    ] Building C object examples/msg/token_ring/CMakeFiles/token_ring.dir/ring_call.c.o
    Linking C executable suspend
    ] Built target sk_time
    Scanning dependencies of target categories
    ] Building C object examples/msg/tracing/CMakeFiles/categories.dir/categories.c.o
    Linking C executable token_bypass
    Linking C executable pastry
    Linking C executable token_ring
    ] Built target suspend
    Linking C executable categories
    Scanning dependencies of target link_srcdst_user_variables
    ] Building C object examples/msg/tracing/CMakeFiles/link_srcdst_user_variables.dir/link_srcdst_user_variables.c.o
    ] Built target token_bypass
    Scanning dependencies of target link_user_variables
    ] Building C object examples/msg/tracing/CMakeFiles/link_user_variables.dir/link_user_variables.c.o
    ] Built target token_ring
    Scanning dependencies of target ms
    ] Building C object examples/msg/tracing/CMakeFiles/ms.dir/ms.c.o
    Linking C executable link_srcdst_user_variables
    ] Built target categories
    Scanning dependencies of target procmig
    ] Linking C executable link_user_variables
    Building C object examples/msg/tracing/CMakeFiles/procmig.dir/procmig.c.o
    Linking C executable ms
    ] Built target link_srcdst_user_variables
    Scanning dependencies of target simple
    ] Building C object examples/msg/tracing/CMakeFiles/simple.dir/simple.c.o
    Linking C executable procmig
    ] Built target link_user_variables
    Scanning dependencies of target trace_platform
    Linking C executable simple
    ] Building C object examples/msg/tracing/CMakeFiles/trace_platform.dir/trace_platform.c.o
    ] Built target ms
    ] Built target procmig
    Scanning dependencies of target user_variables
    ] Scanning dependencies of target ex_sd_test
    Building C object examples/msg/tracing/CMakeFiles/user_variables.dir/user_variables.c.o
    Linking C executable trace_platform
    ] Building C object examples/simdag/CMakeFiles/ex_sd_test.dir/sd_test.c.o
    ] Built target simple
    Scanning dependencies of target sd_avail
    ] Building C object examples/simdag/CMakeFiles/sd_avail.dir/sd_avail.c.o
    ] Built target trace_platform
    Scanning dependencies of target sd_comm_throttling
    Linking C executable user_variables
    ] Building C object examples/simdag/CMakeFiles/sd_comm_throttling.dir/sd_comm_throttling.c.o
    ] Built target pastry
    Linking C executable sd_avail
    Scanning dependencies of target sd_fail
    ] Building C object examples/simdag/CMakeFiles/sd_fail.dir/sd_fail.c.o
    Linking C executable ex_sd_test
    Linking C executable sd_comm_throttling
    Linking C executable sd_fail
    ] [ 78%] Built target user_variables
    Built target sd_avail
    Scanning dependencies of target sd_seq_access
    Scanning dependencies of target sd_test2
    ] [ 78%] Building C object examples/simdag/CMakeFiles/sd_seq_access.dir/sd_seq_access.c.o
    Building C object examples/simdag/CMakeFiles/sd_test2.dir/sd_test2.c.o
    ] Built target sd_comm_throttling
    Scanning dependencies of target sd_typed_tasks_test
    ] Building C object examples/simdag/CMakeFiles/sd_typed_tasks_test.dir/sd_typed_tasks_test.c.o
    ] Built target ex_sd_test
    Scanning dependencies of target simdag_tracing
    ] Building C object examples/simdag/CMakeFiles/simdag_tracing.dir/simdag_trace.c.o
    Linking C executable sd_seq_access
    ] Built target sd_fail
    Scanning dependencies of target dax_test
    ] Building C object examples/simdag/dax/CMakeFiles/dax_test.dir/dax_test.c.o
    Linking C executable sd_typed_tasks_test
    Linking C executable sd_test2
    Linking C executable simdag_tracing
    ] Built target sd_seq_access
    Scanning dependencies of target goal_test
    Linking C executable dax_test
    ] Building C object examples/simdag/goal/CMakeFiles/goal_test.dir/goal_test.c.o
    ] Built target sd_typed_tasks_test
    Scanning dependencies of target sd_io
    ] Building C object examples/simdag/io/CMakeFiles/sd_io.dir/sd_io.c.o
    ] Built target simdag_tracing
    Scanning dependencies of target sd_meta
    ] Built target sd_test2
    Linking C executable goal_test
    Scanning dependencies of target sd_prop
    ] Building C object examples/simdag/metaxml/CMakeFiles/sd_meta.dir/sd_meta.c.o
    ] Linking C executable sd_io
    Building C object examples/simdag/properties/CMakeFiles/sd_prop.dir/sd_prop.c.o
    ] Built target dax_test
    Scanning dependencies of target minmin_test
    ] Building C object examples/simdag/scheduling/CMakeFiles/minmin_test.dir/minmin_test.c.o
    Linking C executable sd_meta
    ] Built target sd_io
    Linking C executable sd_prop
    Scanning dependencies of target bcbench
    ] [ 82%] Built target goal_test
    Building C object examples/smpi/CMakeFiles/bcbench.dir/bcbench.c.o
    Scanning dependencies of target mvmul
    ] Building C object examples/smpi/CMakeFiles/mvmul.dir/mvmul.c.o
    ] Built target sd_meta
    Scanning dependencies of target smpi_replay
    ] Building C object examples/smpi/CMakeFiles/smpi_replay.dir/replay/replay.c.o
    Linking C executable bcbench
    ] Built target sd_prop
    Scanning dependencies of target smpi_traced
    Linking C executable smpi_replay
    ] Building C object examples/smpi/CMakeFiles/smpi_traced.dir/tracing/smpi_traced.c.o
    Linking C executable mvmul
    Linking C executable minmin_test
    ] Built target bcbench
    Scanning dependencies of target smpi_traced_simple
    ] Building C object examples/smpi/CMakeFiles/smpi_traced_simple.dir/tracing/smpi_traced_simple.c.o
    ] Built target smpi_replay
    Scanning dependencies of target MM_mpi
    ] Building C object examples/smpi/MM/CMakeFiles/MM_mpi.dir/MM_mpi.c.o
    Linking C executable smpi_traced_simple
    Linking C executable smpi_traced
    ] Building C object examples/smpi/MM/CMakeFiles/MM_mpi.dir/2.5D_MM.c.o
    ] Built target mvmul
    Scanning dependencies of target masterslave_mailbox_smpi
    ] Building C object examples/smpi/smpi_msg_masterslave/CMakeFiles/masterslave_mailbox_smpi.dir/masterslave_mailbox_smpi.c.o
    ] Built target smpi_traced_simple
    ] Building C object examples/smpi/MM/CMakeFiles/MM_mpi.dir/Summa.c.o
    ] Built target minmin_test
    ] Building C object examples/smpi/MM/CMakeFiles/MM_mpi.dir/Matrix_init.c.o
    Scanning dependencies of target se
    ] Building C object examples/smpi/energy/CMakeFiles/se.dir/se.c.o
    Scanning dependencies of target sef
    ] [ 83%] Linking C executable masterslave_mailbox_smpi
    Building Fortran object examples/smpi/energy/f77/CMakeFiles/sef.dir/sef.f.o
    Built target smpi_traced
    Scanning dependencies of target sef90
    ] Building Fortran object examples/smpi/energy/f90/CMakeFiles/sef90.dir/sef90.f90.o
    Linking C executable MM_mpi
    /home/stanisic/Repository/git_gforge/starpu_simgrid/src/simgrid/examples/smpi/energy/f77/sef.f_WQUiyVZgTu.f:
       MAIN main:
    Linking C executable se
    Linking Fortran executable sef
    Linking Fortran executable sef90
    ] Built target masterslave_mailbox_smpi
    Scanning dependencies of target get_sender
    ] [ 83%] Built target sef
    Building C object teshsuite/msg/get_sender/CMakeFiles/get_sender.dir/get_sender.c.o
    Scanning dependencies of target host_on_off
    ] [ 83%] Building C object teshsuite/msg/host_on_off/CMakeFiles/host_on_off.dir/host_on_off.c.o
    Built target sef90
    Scanning dependencies of target pid
    ] Building C object teshsuite/msg/pid/CMakeFiles/pid.dir/pid.c.o
    ] Built target se
    Scanning dependencies of target process
    ] Building C object teshsuite/msg/process/CMakeFiles/process.dir/process.c.o
    Linking C executable get_sender
    Linking C executable host_on_off
    Linking C executable pid
    Linking C executable process
    ] Built target get_sender
    Scanning dependencies of target process_join
    ] Building C object teshsuite/msg/process_join/CMakeFiles/process_join.dir/process_join.c.o
    ] Built target host_on_off
    Scanning dependencies of target storage_basic
    ] Built target MM_mpi
    ] Building C object teshsuite/msg/storage/CMakeFiles/storage_basic.dir/storage_basic.c.o
    ] Built target pid
    Scanning dependencies of target task_destroy_cancel
    Scanning dependencies of target test_trace_integration
    ] [ 83%] Building C object teshsuite/msg/task_destroy_cancel/CMakeFiles/task_destroy_cancel.dir/task_destroy_cancel.c.o
    Linking C executable process_join
    Building C object teshsuite/msg/trace/CMakeFiles/test_trace_integration.dir/test_trace_integration.c.o
    ] Built target process
    Scanning dependencies of target availability_test
    ] Building C object teshsuite/simdag/availability/CMakeFiles/availability_test.dir/availability_test.c.o
    Linking C executable test_trace_integration
    Linking C executable task_destroy_cancel
    ] Built target process_join
    Scanning dependencies of target basic0
    ] Building C object teshsuite/simdag/basic/CMakeFiles/basic0.dir/basic0.c.o
    Linking C executable availability_test
    Linking C executable storage_basic
    ] Linking C executable basic0
    Built target test_trace_integration
    Scanning dependencies of target basic1
    ] Building C object teshsuite/simdag/basic/CMakeFiles/basic1.dir/basic1.c.o
    ] Built target availability_test
    ] Built target task_destroy_cancel
    Scanning dependencies of target basic2
    Scanning dependencies of target basic3
    ] [ 84%] Building C object teshsuite/simdag/basic/CMakeFiles/basic2.dir/basic2.c.o
    Building C object teshsuite/simdag/basic/CMakeFiles/basic3.dir/basic3.c.o
    Linking C executable basic1
    ] Built target basic0
    Linking C executable basic2
    Scanning dependencies of target basic4
    Linking C executable basic3
    ] Built target storage_basic
    ] Building C object teshsuite/simdag/basic/CMakeFiles/basic4.dir/basic4.c.o
    Scanning dependencies of target basic5
    ] Building C object teshsuite/simdag/basic/CMakeFiles/basic5.dir/basic5.c.o
    ] Built target basic1
    Scanning dependencies of target basic6
    Linking C executable basic4
    ] Building C object teshsuite/simdag/basic/CMakeFiles/basic6.dir/basic6.c.o
    Linking C executable basic5
    ] Built target basic2
    Scanning dependencies of target incomplete
    ] Built target basic3
    ] Scanning dependencies of target test_reinit_costs
    Building C object teshsuite/simdag/incomplete/CMakeFiles/incomplete.dir/incomplete.c.o
    ] Building C object teshsuite/simdag/network/CMakeFiles/test_reinit_costs.dir/test_reinit_costs.c.o
    Linking C executable basic6
    ] Built target basic4
    Scanning dependencies of target test_intra_all2all
    ] Building C object teshsuite/simdag/network/mxn/CMakeFiles/test_intra_all2all.dir/test_intra_all2all.c.o
    Linking C executable incomplete
    Linking C executable test_reinit_costs
    ] Built target basic5
    Scanning dependencies of target test_intra_independent_comm
    ] Building C object teshsuite/simdag/network/mxn/CMakeFiles/test_intra_independent_comm.dir/test_intra_independent_comm.c.o
    Linking C executable test_intra_all2all
    ] Built target basic6
    Scanning dependencies of target test_intra_scatter
    ] [ 85%] Building C object teshsuite/simdag/network/mxn/CMakeFiles/test_intra_scatter.dir/test_intra_scatter.c.o
    Built target incomplete
    Scanning dependencies of target test_latency1
    ] Linking C executable test_intra_independent_comm
    Building C object teshsuite/simdag/network/p2p/CMakeFiles/test_latency1.dir/test_latency1.c.o
    ] Built target test_reinit_costs
    Scanning dependencies of target test_latency2
    ] [ 86%] Linking C executable test_intra_scatter
    Built target test_intra_all2all
    Building C object teshsuite/simdag/network/p2p/CMakeFiles/test_latency2.dir/test_latency2.c.o
    Scanning dependencies of target test_latency3
    ] Building C object teshsuite/simdag/network/p2p/CMakeFiles/test_latency3.dir/test_latency3.c.o
    Linking C executable test_latency1
    ] Built target test_intra_independent_comm
    Scanning dependencies of target test_latency_bound
    Linking C executable test_latency2
    ] Building C object teshsuite/simdag/network/p2p/CMakeFiles/test_latency_bound.dir/test_latency_bound.c.o
    Linking C executable test_latency3
    ] Built target test_intra_scatter
    Scanning dependencies of target test_comp_only_par
    ] Building C object teshsuite/simdag/partask/CMakeFiles/test_comp_only_par.dir/test_comp_only_par.c.o
    ] Built target test_latency1
    Linking C executable test_latency_bound
    Scanning dependencies of target test_comp_only_seq
    ] Building C object teshsuite/simdag/partask/CMakeFiles/test_comp_only_seq.dir/test_comp_only_seq.c.o
    Linking C executable test_comp_only_par
    ] Built target test_latency2
    Scanning dependencies of target basic_link_test
    ] Built target test_latency3
    Scanning dependencies of target basic_parsing_test
    ] Building C object teshsuite/simdag/platforms/CMakeFiles/basic_link_test.dir/basic_link_test.c.o
    ] Linking C executable test_comp_only_seq
    Building C object teshsuite/simdag/platforms/CMakeFiles/basic_parsing_test.dir/basic_parsing_test.c.o
    ] Built target test_latency_bound
    Scanning dependencies of target basic_tracing
    ] Building C object teshsuite/simdag/platforms/CMakeFiles/basic_tracing.dir/basic_tracing.c.o
    ] Built target test_comp_only_par
    Scanning dependencies of target evaluate_get_route_time
    ] [ 87%] Built target test_comp_only_seq
    Building C object teshsuite/simdag/platforms/CMakeFiles/evaluate_get_route_time.dir/Evaluate_get_route_time.c.o
    Linking C executable basic_link_test
    Scanning dependencies of target evaluate_parse_time
    ] Building C object teshsuite/simdag/platforms/CMakeFiles/evaluate_parse_time.dir/Evaluate_parse_time.c.o
    Linking C executable basic_parsing_test
    Linking C executable basic_tracing
    Linking C executable evaluate_parse_time
    Linking C executable evaluate_get_route_time
    ] Built target basic_link_test
    Scanning dependencies of target flatifier
    ] Building C object teshsuite/simdag/platforms/CMakeFiles/flatifier.dir/flatifier.c.o
    ] Built target basic_parsing_test
    Scanning dependencies of target is_router_test
    ] [ 87%] Building C object teshsuite/simdag/platforms/CMakeFiles/is_router_test.dir/is_router_test.c.o
    Built target basic_tracing
    Scanning dependencies of target bug-17132
    ] Built target evaluate_get_route_time
    ] Built target evaluate_parse_time
    ] Building C object teshsuite/bug-17132/CMakeFiles/bug-17132.dir/bug-17132.c.o
    Scanning dependencies of target stack_overflow
    Scanning dependencies of target check_defaults
    ] [ 87%] Building C object teshsuite/simix/stack_overflow/CMakeFiles/stack_overflow.dir/stack_overflow.c.o
    Building C object teshsuite/simix/check_defaults/CMakeFiles/check_defaults.dir/check_defaults.c.o
    Linking C executable bug-17132
    Linking C executable check_defaults
    Linking C executable is_router_test
    Linking C executable stack_overflow
    Linking C executable flatifier
    ] Built target check_defaults
    Scanning dependencies of target allgather_coll
    ] Built target bug-17132
    Scanning dependencies of target allgatherv_coll
    ] [ 87%] Built target is_router_test
    Building C object teshsuite/smpi/allgather/CMakeFiles/allgather_coll.dir/allgather_coll.c.o
    ] Scanning dependencies of target allreduce
    Building C object teshsuite/smpi/allgatherv/CMakeFiles/allgatherv_coll.dir/allgatherv_coll.c.o
    ] Building C object teshsuite/smpi/allreduce/CMakeFiles/allreduce.dir/allreduce.c.o
    ] Built target stack_overflow
    Scanning dependencies of target allreduce_coll
    ] Building C object teshsuite/smpi/allreduce/CMakeFiles/allreduce_coll.dir/allreduce_coll.c.o
    Linking C executable allgather_coll
    Linking C executable allgatherv_coll
    Linking C executable allreduce
    Linking C executable allreduce_coll
    ] Built target flatifier
    Scanning dependencies of target alltoall2
    ] Building C object teshsuite/smpi/alltoall/CMakeFiles/alltoall2.dir/alltoall2.c.o
    ] Built target allgather_coll
    Scanning dependencies of target alltoall_basic
    ] Built target allreduce
    Scanning dependencies of target alltoall_coll
    ] Building C object teshsuite/smpi/alltoall/CMakeFiles/alltoall_basic.dir/alltoall_basic.c.o
    ] [ 88%] Building C object teshsuite/smpi/alltoall/CMakeFiles/alltoall_coll.dir/alltoall_coll.c.o
    Built target allgatherv_coll
    Scanning dependencies of target alltoallv_coll
    ] Building C object teshsuite/smpi/alltoallv/CMakeFiles/alltoallv_coll.dir/alltoallv_coll.c.o
    Linking C executable alltoall2
    ] Built target allreduce_coll
    Scanning dependencies of target barrier_coll
    ] Building C object teshsuite/smpi/barrier/CMakeFiles/barrier_coll.dir/barrier.c.o
    Linking C executable alltoall_basic
    Linking C executable alltoall_coll
    Linking C executable barrier_coll
    ] Built target alltoall2
    Scanning dependencies of target bcast
    ] Building C object teshsuite/smpi/bcast/CMakeFiles/bcast.dir/bcast.c.o
    ] Built target alltoall_coll
    Linking C executable alltoallv_coll
    ] Built target alltoall_basic
    Scanning dependencies of target bcast_coll
    ] Scanning dependencies of target compute
    Building C object teshsuite/smpi/bcast/CMakeFiles/bcast_coll.dir/bcast_coll.c.o
    ] Built target barrier_coll
    ] Building C object teshsuite/smpi/compute/CMakeFiles/compute.dir/compute.c.o
    Scanning dependencies of target compute2
    ] Building C object teshsuite/smpi/compute/CMakeFiles/compute2.dir/compute2.c.o
    Linking C executable bcast
    Linking C executable compute
    Linking C executable compute2
    Linking C executable bcast_coll
    ] Built target bcast
    Scanning dependencies of target compute3
    ] Building C object teshsuite/smpi/compute/CMakeFiles/compute3.dir/compute3.c.o
    ] Built target compute
    ] Scanning dependencies of target gather_coll
    Built target alltoallv_coll
    ] Scanning dependencies of target hvector_test
    Built target compute2
    ] Building C object teshsuite/smpi/gather/CMakeFiles/gather_coll.dir/gather_coll.c.o
    Scanning dependencies of target indexed_test
    ] Building C object teshsuite/smpi/hvector/CMakeFiles/hvector_test.dir/hvector_test.c.o
    ] Building C object teshsuite/smpi/indexed/CMakeFiles/indexed_test.dir/indexed_test.c.o
    ] Built target bcast_coll
    Scanning dependencies of target dsend
    ] Building C object teshsuite/smpi/pingpong/CMakeFiles/dsend.dir/dsend.c.o
    Linking C executable compute3
    Linking C executable indexed_test
    Linking C executable hvector_test
    Linking C executable gather_coll
    Linking C executable dsend
    ] Built target hvector_test
    ] Built target indexed_test
    Scanning dependencies of target pingpong
    Scanning dependencies of target reduce
    ] Building C object teshsuite/smpi/pingpong/CMakeFiles/pingpong.dir/pingpong.c.o
    ] [ 93%] Built target gather_coll
    Building C object teshsuite/smpi/reduce/CMakeFiles/reduce.dir/reduce.c.o
    ] Built target compute3
    Scanning dependencies of target reduce_scatter_coll
    Scanning dependencies of target reduce_coll
    ] [ 93%] Building C object teshsuite/smpi/reduce/CMakeFiles/reduce_scatter_coll.dir/reduce_scatter_coll.c.o
    Building C object teshsuite/smpi/reduce/CMakeFiles/reduce_coll.dir/reduce_coll.c.o
    ] Built target dsend
    Scanning dependencies of target scatter
    ] Building C object teshsuite/smpi/scatter/CMakeFiles/scatter.dir/scatter.c.o
    Linking C executable pingpong
    Linking C executable reduce_scatter_coll
    Linking C executable reduce_coll
    Linking C executable reduce
    Linking C executable scatter
    ] Built target pingpong
    Scanning dependencies of target shared
    ] Building C object teshsuite/smpi/shared/CMakeFiles/shared.dir/shared.c.o
    ] Built target reduce_coll
    Scanning dependencies of target struct_test
    ] [ 93%] Built target reduce_scatter_coll
    Building C object teshsuite/smpi/struct/CMakeFiles/struct_test.dir/struct_test.c.o
    ] Built target reduce
    Scanning dependencies of target vector_test
    Scanning dependencies of target lmm_usage
    ] Building C object teshsuite/smpi/vector/CMakeFiles/vector_test.dir/vector_test.c.o
    ] Building C object teshsuite/surf/lmm_usage/CMakeFiles/lmm_usage.dir/lmm_usage.c.o
    Linking C executable shared
    ] Built target scatter
    Scanning dependencies of target maxmin_bench
    Linking C executable vector_test
    Linking C executable struct_test
    ] Building C object teshsuite/surf/maxmin_bench/CMakeFiles/maxmin_bench.dir/maxmin_bench.c.o
    ] Built target shared
    Scanning dependencies of target surf_usage
    ] Building C object teshsuite/surf/surf_usage/CMakeFiles/surf_usage.dir/surf_usage.c.o
    ] Built target struct_test
    ] Built target vector_test
    Scanning dependencies of target surf_usage2
    Scanning dependencies of target trace_usage
    Linking C executable maxmin_bench
    ] Building C object teshsuite/surf/surf_usage/CMakeFiles/surf_usage2.dir/surf_usage2.c.o
    ] Building C object teshsuite/surf/trace_usage/CMakeFiles/trace_usage.dir/trace_usage.c.o
    Linking C executable surf_usage
    Linking C executable surf_usage2
    Linking C executable lmm_usage
    Linking C executable trace_usage
    ] Built target maxmin_bench
    Scanning dependencies of target graphxml_usage
    ] Building C object teshsuite/xbt/graphxml_usage/CMakeFiles/graphxml_usage.dir/graphxml_usage.c.o
    ] Built target surf_usage
    Scanning dependencies of target heap_bench
    ] Building C object teshsuite/xbt/heap_bench/CMakeFiles/heap_bench.dir/heap_bench.c.o
    ] [ 97%] Built target trace_usage
    Built target surf_usage2
    Scanning dependencies of target log_large_test
    Scanning dependencies of target log_usage
    ] [ 97%] Linking C executable graphxml_usage
    Building C object teshsuite/xbt/log_usage/CMakeFiles/log_usage.dir/log_usage.c.o
    Building C object teshsuite/xbt/log_large/CMakeFiles/log_large_test.dir/log_large_test.c.o
    Linking C executable heap_bench
    Linking C executable log_large_test
    Linking C executable log_usage
    ] Built target lmm_usage
    Scanning dependencies of target parallel_log_crashtest
    ] [ 97%] Built target graphxml_usage
    Building C object teshsuite/xbt/parallel_log/CMakeFiles/parallel_log_crashtest.dir/parallel_log_crashtest.c.o
    Scanning dependencies of target parmap_bench
    ] [ 98%] Built target log_large_test
    ] Building C object teshsuite/xbt/parmap_bench/CMakeFiles/parmap_bench.dir/parmap_bench.c.o
    Built target log_usage
    Scanning dependencies of target parmap_test
    Scanning dependencies of target graphicator
    ] [ 98%] Building C object tools/graphicator/CMakeFiles/graphicator.dir/graphicator.c.o
    Building C object teshsuite/xbt/parmap_test/CMakeFiles/parmap_test.dir/parmap_test.c.o
    ] Built target heap_bench
    Scanning dependencies of target tesh
    Linking C executable parallel_log_crashtest
    ] Building C object tools/tesh/CMakeFiles/tesh.dir/tesh.c.o
    Linking C executable ../../bin/graphicator
    ] Built target parallel_log_crashtest
    ] Building C object tools/tesh/CMakeFiles/tesh.dir/run_context.c.o
    Linking C executable parmap_bench
    Linking C executable parmap_test
    ] Built target graphicator
    ] Building C object tools/tesh/CMakeFiles/tesh.dir/signal.c.o
    ] Built target parmap_test
    ] Built target parmap_bench
    Linking C executable ../../bin/tesh
    ] Built target tesh
    make: *** No rule to make target `installwait'.  Stop.
    /home/stanisic/Repository/git_gforge/starpu_simgrid
    
    STARPU_SCHED=dmda STARPU_HOSTNAME=attila STARPU_PROGRAM=lu ./run_inject_StarPUSG.sh -n data/dataFATPIPEatt/SoloStarpuData0.org -t -c
    

    Yes and I forgot to create starpu bus folder, now it should work

    mkdir .starpu/sampling/bus
    STARPU_SCHED=dmda STARPU_HOSTNAME=attila STARPU_PROGRAM=lu ./run_inject_StarPUSG.sh -n data/dataFATPIPEatt/SoloStarpuData0.org -t -c
    

    Very strange bug occured! There seems to be a difference between printf and snprintf functions when using %08lx option for parameters. So lets delete l and commit this:

    cd src/StarPU
    find . -type f -print0 | xargs -0 sed -i 's/%s|%08lx/%s|%08x/g'
    cd -
    
    stanisic@winnetou:~/Repository/git_gforge/starpu_simgrid/src/StarPU$ /home/stanisic/Repository/git_gforge/starpu_simgrid
    

    It worked, lets now commit it:

    git add src/StarPU/src/
    git commit -m "StarPU fix for footprint format"
    
    [expFATPIPE e553be3] StarPU fix for footprint format
     4 files changed, 5 insertions(+), 5 deletions(-)
    

    Also one more cosmetic bug was found in script that is running simulation:

    sed -i 's/-name $host/-name $starpu_hostname/g' run_inject_StarPUSG.sh
    sed -i 's/$host -printf/$starpu_hostname -printf/g' run_inject_StarPUSG.sh
    

    Need to commit it as well

    git add run_inject_StarPUSG.sh
    git commit -m "Fixing which calibration is printed in data file"
    
    stanisic@winnetou:~/Repository/git_gforge/starpu_simgrid$ [expFATPIPE 17d20bc] Fixing which calibration is printed in data file
     1 file changed, 2 insertions(+), 2 deletions(-)
    

    Now we can try simulating attila experiments one more time:

    STARPU_SCHED=dmda STARPU_HOSTNAME=attila STARPU_PROGRAM=lu ./run_inject_StarPUSG.sh -n data/dataFATPIPEatt/SoloStarpuData5.org -t
    

    Something is wrong here, the error is the following:

    [0.000000] [xbt_cfg/INFO] Configuration change: Set 'network/TCP_gamma' to '-1'
    [0.000000] [xbt_cfg/INFO] Configuration change: Set 'network/latency_factor' to '1'
    [0.000000] [xbt_cfg/INFO] Configuration change: Set 'network/bandwidth_factor' to '1'
    lt-lu_example_float: ../../src/sched_policies/deque_modeling_policy_data_aware.c:759: _dmda_push_task: Assertion `forced_best != -1 || best != -1' failed.
    ./run_inject_StarPUSG.sh: line 516: 16072 Aborted                 (core dumped) STARPU_HOME=/home/stanisic/Repository/git_gforge/starpu_simgrid STARPU_HOSTNAME=attila STARPU_NCPU=0 STARPU_NCUDA=3 STARPU_NOPENCL=0 STARPU_SCHED=dmda ./examples/lu/lu_example_float -size 4800 -nblocks 5
    

    Lets try lu on conan:

    STARPU_SCHED=dmda STARPU_HOSTNAME=conan STARPU_PROGRAM=lu ./run_inject_StarPUSG.sh -n data/dataFATPIPEcon/SoloStarpuData5.org -t
    

    Again the same problem. Is it the case with cholesky application:

    STARPU_SCHED=dmda STARPU_HOSTNAME=attila STARPU_PROGRAM=cholesky ./run_inject_StarPUSG.sh -n data/dataFATPIPEatt/SoloStarpuData0.org -t
    

    Cholesky worked fine?!

    Something is wrong with simulations of lu application, we will need to point this out to StarPU developers!

  14. Analysis

    Even though we dont have simulation results, lets just plot for now native experiments:

    For attila

    ./R_allgflops.sh data/dataFATPIPEatt
    

    data/dataFATPIPEatt/gflops.pdf

    They look quite fine.

    Now for conan

    ./R_allgflops.sh data/dataFATPIPEcon
    

    data/dataFATPIPEcon/gflops.pdf

    Here we can see that there was some noice. Lets check if we were alone on the machine at that moment:

    sed -n '/** PEOPLE LOGGED.*/,/####/{/####/!p}' data/dataFATPIPEcon/SoloStarpuData50.org
    
    ** PEOPLE LOGGED WHEN EXPERIMENT STARTED:
    prenaudg pts/0        2014-07-31 11:12 (morris)
    prenaudg pts/1        2014-07-31 11:12 (morris)
    nfurmento pts/2        2014-07-31 11:25 (morris)
    

    Natalie Furmento was logged (and probably running something) on the machine. This is probably the reason for this strange disturbance in the results. So we will have to rerun these experiments.

    Nevertheless, lets add this 2 plots to the git repository:

    git add data/
    git commit -m "Adding gflop rates"
    
    stanisic@winnetou:~/Repository/git_gforge/starpu_simgrid$ [expFATPIPE 5c95937] Adding gflop rates
     4 files changed, 185 insertions(+)
     create mode 100644 data/dataFATPIPEatt/gflops.csv
     create mode 100644 data/dataFATPIPEatt/gflops.pdf
     create mode 100644 data/dataFATPIPEcon/gflops.csv
     create mode 100644 data/dataFATPIPEcon/gflops.pdf
    
  15. Reverting

    There have been some changes to the source code, and we dont want them to propagate to the data branch. Therefore we will revert them all:

    git stash
    ./git_revert.sh
    git stash apply
    
    Saved working directory and index state WIP on expFATPIPE: 5c95937 Adding gflop rates
    HEAD is now at 5c95937 Adding gflop rates
    Now you are in git branch: refs/heads/expFATPIPE
    Everything is commited
    All commits and their type:
    Data 5c95937ec469f542e71020c7257a442bcd7040d7
    Src 17d20bc972b7a9aa7fc3a6052e45467683769596
    Src e553be342b2100390a48d9875750cf23d0c83df6
    Data d3e11f95bf9afc48358a2cd3eb671e7fa46cce4c
    Data cf2b959a091423b5f7d5db3c5ec8351039981aee
    Data f752d24cb002073cfde73aac688f8b6b8a260c23
    Data 3cf630ad6d2e3ba945e4465fd791bc3e93499c13
    Data b5537d1fd6781a485d9cfc2ba60cc28b4241bc31
    Data 2f99d752bb17659df0b5cc37e063260f216df2da
    Data 7e99fd69e7b195012ef5790481cfab37c4f0b955
    Src e0167665b27eef9bd8171348c2467b52e7af1cd8
    Data 7e695b07bfdb5af6921f6f61b45de8f2e707b035
    Src 2608ac496c53710a6b4167c4be6d4a937339f2e8
    Revert before merging with data branch
    [expFATPIPE 2c83a01] Revert before merging with data branch-done by git_revert.sh
     7 files changed, 9 insertions(+), 69 deletions(-)
    DONE: Single anti-commit!
    Auto-merging LabBook.org
    CONFLICT (content): Merge conflict in LabBook.org
    

    This conflict came because we already commited some changes to LabBook previously, but this is not important.

  16. Final remarks

    Here we finish this experimentation diary. Although it was supposed to be trivial experimentation campaign, we finished with debugging few of my errors and finally strange StarPU error that we will have to signal to the developers.

    Now we will commit the final version of this diary from outside. Then we will merge this branch with data branch. Finally we can reuse some of the useful code modification commit in the main master branch, by cherry-picking them.

8.1.2 Notes:

  • Conan results are not so important as there is too much noise (since someone else was using the machine at the same time)
  • Attila results are fine
  • Simulation was not possible to perform with lu, although for cholesky it works fine

Author: Luka Stanisic

Created: 2014-11-19 mer. 00:21

Emacs 24.4.1 (Org mode 8.2.7b)

Validate