Logo ROOT  

Reference Guide
 
Loading...
Searching...
No Matches
TMVARegression.C File Reference
Tutorials » TMVA tutorials

Detailed Description

View in nbviewer Open in SWAN
This macro provides examples for the training and testing of the TMVA classifiers.

As input data is used a toy-MC sample consisting of four Gaussian-distributed and linearly correlated input variables.

The methods to be used can be switched on and off by means of booleans, or via the prompt command, for example: 

root -l TMVARegression.C\‍(\"LD,MLP\"\‍)

(note that the backslashes are mandatory) If no method given, a default set is used.

The output file "TMVAReg.root" can be analysed with the use of dedicated macros (simply say: root -l <macro.C>), which can be conveniently invoked through a GUI that will appear at the end of the run of this macro.

  • Project : TMVA - a Root-integrated toolkit for multivariate data analysis
  • Package : TMVA
  • Root Macro: TMVARegression
==> Start TMVARegression
--- TMVARegression : Using input file: /github/home/ROOT-CI/build/tutorials/tmva/data/tmva_reg_example.root
DataSetInfo : [datasetreg] : Added class "Regression"
: Add Tree TreeR of type Regression with 10000 events
: Dataset[datasetreg] : Class index : 0 name : Regression
Factory : Booking method: ␛[1mPDEFoam␛[0m
:
: Rebuilding Dataset datasetreg
: Building event vectors for type 2 Regression
: Dataset[datasetreg] : create input formulas for tree TreeR
DataSetFactory : [datasetreg] : Number of events in input trees
:
: Number of training and testing events
: ---------------------------------------------------------------------------
: Regression -- training events : 1000
: Regression -- testing events : 9000
: Regression -- training and testing events: 10000
:
DataSetInfo : Correlation matrix (Regression):
: ------------------------
: var1 var2
: var1: +1.000 -0.032
: var2: -0.032 +1.000
: ------------------------
DataSetFactory : [datasetreg] :
:
Factory : Booking method: ␛[1mKNN␛[0m
:
Factory : Booking method: ␛[1mLD␛[0m
:
Factory : Booking method: ␛[1mDNN_CPU␛[0m
:
: Parsing option string:
: ... "!H:V:ErrorStrategy=SUMOFSQUARES:VarTransform=G:WeightInitialization=XAVIERUNIFORM:Architecture=CPU:Layout=TANH|50,TANH|50,TANH|50,LINEAR:TrainingStrategy=LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam"
: The following options are set:
: - By User:
: <none>
: - Default:
: Boost_num: "0" [Number of times the classifier will be boosted]
: Parsing option string:
: ... "!H:V:ErrorStrategy=SUMOFSQUARES:VarTransform=G:WeightInitialization=XAVIERUNIFORM:Architecture=CPU:Layout=TANH|50,TANH|50,TANH|50,LINEAR:TrainingStrategy=LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam"
: The following options are set:
: - By User:
: V: "True" [Verbose output (short form of "VerbosityLevel" below - overrides the latter one)]
: VarTransform: "G" [List of variable transformations performed before training, e.g., "D_Background,P_Signal,G,N_AllClasses" for: "Decorrelation, PCA-transformation, Gaussianisation, Normalisation, each for the given class of events ('AllClasses' denotes all events of all classes, if no class indication is given, 'All' is assumed)"]
: H: "False" [Print method-specific help message]
: Layout: "TANH|50,TANH|50,TANH|50,LINEAR" [Layout of the network.]
: ErrorStrategy: "SUMOFSQUARES" [Loss function: Mean squared error (regression) or cross entropy (binary classification).]
: WeightInitialization: "XAVIERUNIFORM" [Weight initialization strategy]
: Architecture: "CPU" [Which architecture to perform the training on.]
: TrainingStrategy: "LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam" [Defines the training strategies.]
: - Default:
: VerbosityLevel: "Default" [Verbosity level]
: CreateMVAPdfs: "False" [Create PDFs for classifier outputs (signal and background)]
: IgnoreNegWeightsInTraining: "False" [Events with negative weights are ignored in the training (but are included for testing and performance evaluation)]
: InputLayout: "0|0|0" [The Layout of the input]
: BatchLayout: "0|0|0" [The Layout of the batch]
: RandomSeed: "0" [Random seed used for weight initialization and batch shuffling]
: ValidationSize: "20%" [Part of the training data to use for validation. Specify as 0.2 or 20% to use a fifth of the data set as validation set. Specify as 100 to use exactly 100 events. (Default: 20%)]
DNN_CPU : [datasetreg] : Create Transformation "G" with events from all classes.
:
: Transformation, Variable selection :
: Input : variable 'var1' <---> Output : variable 'var1'
: Input : variable 'var2' <---> Output : variable 'var2'
: Will now use the CPU architecture with BLAS and IMT support !
Factory : Booking method: ␛[1mBDTG␛[0m
:
<WARNING> : Value for option maxdepth was previously set to 3
: the option NegWeightTreatment=InverseBoostNegWeights does not exist for BoostType=Grad
: --> change to new default NegWeightTreatment=Pray
Factory : ␛[1mTrain all methods␛[0m
Factory : [datasetreg] : Create Transformation "I" with events from all classes.
:
: Transformation, Variable selection :
: Input : variable 'var1' <---> Output : variable 'var1'
: Input : variable 'var2' <---> Output : variable 'var2'
TFHandler_Factory : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3615 1.1815 [ 0.0010317 4.9864 ]
: var2: 2.4456 1.4269 [ 0.0039980 4.9846 ]
: fvalue: 163.04 79.540 [ 1.8147 358.73 ]
: -----------------------------------------------------------
: Ranking input variables (method unspecific)...
IdTransformation : Ranking result (top variable is best ranked)
: --------------------------------------------
: Rank : Variable : |Correlation with target|
: --------------------------------------------
: 1 : var2 : 7.559e-01
: 2 : var1 : 6.143e-01
: --------------------------------------------
IdTransformation : Ranking result (top variable is best ranked)
: -------------------------------------
: Rank : Variable : Mutual information
: -------------------------------------
: 1 : var2 : 2.014e+00
: 2 : var1 : 1.978e+00
: -------------------------------------
IdTransformation : Ranking result (top variable is best ranked)
: ------------------------------------
: Rank : Variable : Correlation Ratio
: ------------------------------------
: 1 : var1 : 6.270e+00
: 2 : var2 : 2.543e+00
: ------------------------------------
IdTransformation : Ranking result (top variable is best ranked)
: ----------------------------------------
: Rank : Variable : Correlation Ratio (T)
: ----------------------------------------
: 1 : var2 : 1.051e+00
: 2 : var1 : 5.263e-01
: ----------------------------------------
Factory : Train method: PDEFoam for Regression
:
: Build mono target regression foam
: Elapsed time: 0.306 sec
: Elapsed time for training with 1000 events: 0.31 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of PDEFoam on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.00292 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights.xml␛[0m
: writing foam MonoTargetRegressionFoam to file
: Foams written to file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights_foams.root␛[0m
Factory : Training finished
:
Factory : Train method: KNN for Regression
:
KNN : <Train> start...
: Reading 1000 events
: Number of signal events 1000
: Number of background events 0
: Creating kd-tree with 1000 events
: Computing scale factor for 1d distributions: (ifrac, bottom, top) = (80%, 10%, 90%)
ModulekNN : Optimizing tree for 2 variables with 1000 values
: <Fill> Class 1 has 1000 events
: Elapsed time for training with 1000 events: 0.000829 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of KNN on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.00446 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_KNN.weights.xml␛[0m
Factory : Training finished
:
Factory : Train method: LD for Regression
:
LD : Results for LD coefficients:
: -----------------------
: Variable: Coefficient:
: -----------------------
: var1: +41.434
: var2: +42.995
: (offset): -81.387
: -----------------------
: Elapsed time for training with 1000 events: 0.000224 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of LD on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.000326 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_LD.weights.xml␛[0m
Factory : Training finished
:
Factory : Train method: DNN_CPU for Regression
:
: Preparing the Gaussian transformation...
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.012251 1.0267 [ -3.3737 5.7307 ]
: var2: 0.011005 1.0329 [ -4.3447 5.7307 ]
: fvalue: 163.04 79.540 [ 1.8147 358.73 ]
: -----------------------------------------------------------
: Start of deep neural network training on CPU using MT, nthreads = 1
:
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.012251 1.0267 [ -3.3737 5.7307 ]
: var2: 0.011005 1.0329 [ -4.3447 5.7307 ]
: fvalue: 163.04 79.540 [ 1.8147 358.73 ]
: -----------------------------------------------------------
: ***** Deep Learning Network *****
DEEP NEURAL NETWORK: Depth = 4 Input = ( 1, 1, 2 ) Batch size = 50 Loss function = R
Layer 0 DENSE Layer: ( Input = 2 , Width = 50 ) Output = ( 1 , 50 , 50 ) Activation Function = Tanh
Layer 1 DENSE Layer: ( Input = 50 , Width = 50 ) Output = ( 1 , 50 , 50 ) Activation Function = Tanh
Layer 2 DENSE Layer: ( Input = 50 , Width = 50 ) Output = ( 1 , 50 , 50 ) Activation Function = Tanh
Layer 3 DENSE Layer: ( Input = 50 , Width = 1 ) Output = ( 1 , 50 , 1 ) Activation Function = Identity
: Using 800 events for training and 200 for testing
: Compute initial loss on the validation data
: Training phase 1 of 1: Optimizer ADAM (beta1=0.9,beta2=0.999,eps=1e-07) Learning rate = 0.001 regularization 0 minimum error = 31557.8
: --------------------------------------------------------------
: Epoch | Train Err. Val. Err. t(s)/epoch t(s)/Loss nEvents/s Conv. Steps
: --------------------------------------------------------------
: Start epoch iteration ...
: 1 Minimum Test error found - save the configuration
: 1 | 33117.6 31102.9 0.00496291 0.000551298 181339 0
: 2 Minimum Test error found - save the configuration
: 2 | 32560.6 30514.5 0.00515327 0.00056146 174223 0
: 3 Minimum Test error found - save the configuration
: 3 | 31806.1 29814.4 0.00595137 0.00063334 150432 0
: 4 Minimum Test error found - save the configuration
: 4 | 31015 29122.6 0.00614931 0.000657452 145670 0
: 5 Minimum Test error found - save the configuration
: 5 | 30203.9 28339.4 0.00538865 0.000581119 166406 0
: 6 Minimum Test error found - save the configuration
: 6 | 29345 27409.4 0.00606757 0.00104673 159336 0
: 7 Minimum Test error found - save the configuration
: 7 | 28664.6 26859.3 0.00633823 0.000572229 138744 0
: 8 Minimum Test error found - save the configuration
: 8 | 28230.8 26496.5 0.00510732 0.00055837 175865 0
: 9 Minimum Test error found - save the configuration
: 9 | 27876.9 26180.3 0.00533354 0.000560519 167609 0
: 10 Minimum Test error found - save the configuration
: 10 | 27558.6 25885.1 0.00527614 0.000570299 170002 0
: 11 Minimum Test error found - save the configuration
: 11 | 27257.6 25605.2 0.0053773 0.000655171 169415 0
: 12 Minimum Test error found - save the configuration
: 12 | 26971.6 25335.2 0.00530693 0.00058339 169365 0
: 13 Minimum Test error found - save the configuration
: 13 | 26693.3 25076 0.00531902 0.000566849 168344 0
: 14 Minimum Test error found - save the configuration
: 14 | 26427.9 24820.7 0.0053066 0.00058475 169425 0
: 15 Minimum Test error found - save the configuration
: 15 | 26163.2 24576.4 0.00526529 0.00056944 170363 0
: 16 Minimum Test error found - save the configuration
: 16 | 25913 24331.1 0.00518717 0.000551228 172565 0
: 17 Minimum Test error found - save the configuration
: 17 | 25660.7 24095.2 0.005227 0.000574179 171939 0
: 18 Minimum Test error found - save the configuration
: 18 | 25416.3 23863.9 0.00522972 0.00056894 171645 0
: 19 Minimum Test error found - save the configuration
: 19 | 25174.7 23638.7 0.00562195 0.000646351 160785 0
: 20 Minimum Test error found - save the configuration
: 20 | 24940.1 23414.8 0.00520402 0.000559789 172257 0
: 21 Minimum Test error found - save the configuration
: 21 | 24707.4 23195.1 0.00521899 0.000571691 172143 0
: 22 Minimum Test error found - save the configuration
: 22 | 24478.7 22978.2 0.00518288 0.00055795 172976 0
: 23 Minimum Test error found - save the configuration
: 23 | 24252.8 22764.9 0.00517939 0.000557619 173094 0
: 24 Minimum Test error found - save the configuration
: 24 | 24033.3 22550.7 0.00518415 0.000557258 172902 0
: 25 Minimum Test error found - save the configuration
: 25 | 23807.8 22348.3 0.00518321 0.000555019 172854 0
: 26 Minimum Test error found - save the configuration
: 26 | 23596.4 22140.8 0.00515472 0.00055998 174112 0
: 27 Minimum Test error found - save the configuration
: 27 | 23382.4 21936.4 0.00530797 0.000625331 170844 0
: 28 Minimum Test error found - save the configuration
: 28 | 23168.9 21738.2 0.00518287 0.000550139 172684 0
: 29 Minimum Test error found - save the configuration
: 29 | 22960.6 21542.2 0.00518131 0.000567229 173382 0
: 30 Minimum Test error found - save the configuration
: 30 | 22753.8 21349.4 0.00519356 0.000557689 172567 0
: 31 Minimum Test error found - save the configuration
: 31 | 22551.4 21156.9 0.00517849 0.00057312 173710 0
: 32 Minimum Test error found - save the configuration
: 32 | 22351.7 20964.3 0.00522329 0.00055847 171497 0
: 33 Minimum Test error found - save the configuration
: 33 | 22152.6 20774.2 0.0052022 0.000547969 171887 0
: 34 Minimum Test error found - save the configuration
: 34 | 21953 20590.4 0.00517025 0.000553919 173298 0
: 35 Minimum Test error found - save the configuration
: 35 | 21761.6 20404 0.00525734 0.000576569 170912 0
: 36 Minimum Test error found - save the configuration
: 36 | 21568.4 20221 0.0052206 0.00059554 172971 0
: 37 Minimum Test error found - save the configuration
: 37 | 21375.7 20043.2 0.00568113 0.00061486 157907 0
: 38 Minimum Test error found - save the configuration
: 38 | 21188 19865.8 0.00550273 0.000577151 162417 0
: 39 Minimum Test error found - save the configuration
: 39 | 21002.1 19688.8 0.00532402 0.00057308 168388 0
: 40 Minimum Test error found - save the configuration
: 40 | 20816.9 19511.7 0.00538433 0.000699473 170763 0
: 41 Minimum Test error found - save the configuration
: 41 | 20632.1 19334.4 0.00530237 0.000583489 169532 0
: 42 Minimum Test error found - save the configuration
: 42 | 20446.7 19163 0.00529028 0.000563949 169265 0
: 43 Minimum Test error found - save the configuration
: 43 | 20266.3 18994.1 0.00527932 0.00056943 169855 0
: 44 Minimum Test error found - save the configuration
: 44 | 20088.1 18824.7 0.00535633 0.000596071 168058 0
: 45 Minimum Test error found - save the configuration
: 45 | 19909.4 18661.7 0.00520656 0.000562189 172252 0
: 46 Minimum Test error found - save the configuration
: 46 | 19736.9 18491.2 0.00528263 0.000569919 169754 0
: 47 Minimum Test error found - save the configuration
: 47 | 19568.8 18330.6 0.00535518 0.000603211 168351 0
: 48 Minimum Test error found - save the configuration
: 48 | 19392 18172.2 0.00525633 0.000557849 170268 0
: 49 Minimum Test error found - save the configuration
: 49 | 19219.3 18009.5 0.0052325 0.000563979 171361 0
: 50 Minimum Test error found - save the configuration
: 50 | 19049.9 17849 0.00535312 0.000637771 169659 0
: 51 Minimum Test error found - save the configuration
: 51 | 18884.6 17690.2 0.00531158 0.000575979 168933 0
: 52 Minimum Test error found - save the configuration
: 52 | 18718.1 17529 0.00535227 0.000576689 167519 0
: 53 Minimum Test error found - save the configuration
: 53 | 18551.6 17374 0.00535178 0.000584151 167798 0
: 54 Minimum Test error found - save the configuration
: 54 | 18388.2 17217.1 0.00534596 0.000569639 167493 0
: 55 Minimum Test error found - save the configuration
: 55 | 18224.5 17063.6 0.00530863 0.000570219 168833 0
: 56 Minimum Test error found - save the configuration
: 56 | 18062.9 16912.6 0.00541137 0.000582811 165681 0
: 57 Minimum Test error found - save the configuration
: 57 | 17904.4 16759.2 0.00569227 0.000721972 160956 0
: 58 Minimum Test error found - save the configuration
: 58 | 17746.3 16606.2 0.00545238 0.000577169 164095 0
: 59 Minimum Test error found - save the configuration
: 59 | 17587.2 16456.5 0.00552738 0.00059617 162232 0
: 60 Minimum Test error found - save the configuration
: 60 | 17430.5 16310.4 0.00536871 0.000577751 166981 0
: 61 Minimum Test error found - save the configuration
: 61 | 17273.9 16162.6 0.0054638 0.00064761 166106 0
: 62 Minimum Test error found - save the configuration
: 62 | 17122.4 16014.2 0.00543161 0.000596871 165469 0
: 63 Minimum Test error found - save the configuration
: 63 | 16968.7 15869.4 0.0054535 0.000580369 164165 0
: 64 Minimum Test error found - save the configuration
: 64 | 16816.2 15724.6 0.0054302 0.000588431 165229 0
: 65 Minimum Test error found - save the configuration
: 65 | 16666.7 15583.4 0.00576777 0.00059035 154517 0
: 66 Minimum Test error found - save the configuration
: 66 | 16516.3 15441.7 0.00555418 0.00058393 160958 0
: 67 Minimum Test error found - save the configuration
: 67 | 16369 15299.6 0.00534216 0.000583919 168129 0
: 68 Minimum Test error found - save the configuration
: 68 | 16220.7 15162.1 0.00538773 0.00058353 166521 0
: 69 Minimum Test error found - save the configuration
: 69 | 16076.2 15024.6 0.00544875 0.000578859 164275 0
: 70 Minimum Test error found - save the configuration
: 70 | 15930 14890.3 0.00536772 0.000604831 167965 0
: 71 Minimum Test error found - save the configuration
: 71 | 15789.7 14754.1 0.00536848 0.000584469 167224 0
: 72 Minimum Test error found - save the configuration
: 72 | 15647.4 14619.8 0.00537508 0.000577699 166758 0
: 73 Minimum Test error found - save the configuration
: 73 | 15509.2 14484 0.00538017 0.00058428 166809 0
: 74 Minimum Test error found - save the configuration
: 74 | 15366.3 14355.7 0.00550523 0.0006133 163535 0
: 75 Minimum Test error found - save the configuration
: 75 | 15231.3 14223.9 0.00576787 0.000667631 156855 0
: 76 Minimum Test error found - save the configuration
: 76 | 15094.3 14094.7 0.00557649 0.00059742 160672 0
: 77 Minimum Test error found - save the configuration
: 77 | 14956.4 13969.7 0.0053818 0.000582299 166684 0
: 78 Minimum Test error found - save the configuration
: 78 | 14827.2 13839.2 0.0054176 0.00057965 165359 0
: 79 Minimum Test error found - save the configuration
: 79 | 14690.7 13715.3 0.00547608 0.000633461 165200 0
: 80 Minimum Test error found - save the configuration
: 80 | 14560.1 13591.1 0.0057684 0.000625451 155553 0
: 81 Minimum Test error found - save the configuration
: 81 | 14429.1 13468.7 0.00574771 0.00061671 155915 0
: 82 Minimum Test error found - save the configuration
: 82 | 14300.4 13346.1 0.00734069 0.000717393 120786 0
: 83 Minimum Test error found - save the configuration
: 83 | 14171.5 13226.3 0.00563241 0.00059152 158702 0
: 84 Minimum Test error found - save the configuration
: 84 | 14045.9 13104.6 0.00555323 0.00060637 161719 0
: 85 Minimum Test error found - save the configuration
: 85 | 13919.1 12985.7 0.00541636 0.000582999 165516 0
: 86 Minimum Test error found - save the configuration
: 86 | 13793.8 12868.7 0.00556508 0.00060381 161249 0
: 87 Minimum Test error found - save the configuration
: 87 | 13670.2 12752.6 0.00544517 0.000585269 164612 0
: 88 Minimum Test error found - save the configuration
: 88 | 13546.9 12638.5 0.00546053 0.00059905 164559 0
: 89 Minimum Test error found - save the configuration
: 89 | 13427 12523.2 0.00542649 0.000600929 165784 0
: 90 Minimum Test error found - save the configuration
: 90 | 13306.7 12408.2 0.00546908 0.000589761 163957 0
: 91 Minimum Test error found - save the configuration
: 91 | 13186.6 12295.5 0.00542445 0.00058676 165368 0
: 92 Minimum Test error found - save the configuration
: 92 | 13065.6 12187.5 0.00545524 0.000591131 164470 0
: 93 Minimum Test error found - save the configuration
: 93 | 12950.9 12076.6 0.00546039 0.00063525 165798 0
: 94 Minimum Test error found - save the configuration
: 94 | 12834.1 11967.4 0.00612933 0.0006336 145567 0
: 95 Minimum Test error found - save the configuration
: 95 | 12718.9 11858.5 0.0055121 0.000588541 162484 0
: 96 Minimum Test error found - save the configuration
: 96 | 12604.6 11750.9 0.00548795 0.000584849 163162 0
: 97 Minimum Test error found - save the configuration
: 97 | 12491.5 11643.8 0.00541958 0.000584461 165456 0
: 98 Minimum Test error found - save the configuration
: 98 | 12378 11539.7 0.00542635 0.000620731 166472 0
: 99 Minimum Test error found - save the configuration
: 99 | 12267.1 11435.5 0.00544816 0.000595271 164850 0
: 100 Minimum Test error found - save the configuration
: 100 | 12157.7 11331 0.00543677 0.000581119 164756 0
: 101 Minimum Test error found - save the configuration
: 101 | 12047.1 11229 0.00562947 0.000595741 158928 0
: 102 Minimum Test error found - save the configuration
: 102 | 11939.5 11126.8 0.00561384 0.00060625 159757 0
: 103 Minimum Test error found - save the configuration
: 103 | 11832.2 11025.2 0.00567637 0.000581329 157015 0
: 104 Minimum Test error found - save the configuration
: 104 | 11725.1 10925.5 0.00549027 0.000597381 163502 0
: 105 Minimum Test error found - save the configuration
: 105 | 11618.5 10828 0.00552794 0.000603069 162441 0
: 106 Minimum Test error found - save the configuration
: 106 | 11515.2 10729.7 0.00543537 0.000612511 165877 0
: 107 Minimum Test error found - save the configuration
: 107 | 11412.1 10631.5 0.00541585 0.00058753 165689 0
: 108 Minimum Test error found - save the configuration
: 108 | 11306.3 10538.4 0.0054314 0.00058568 165094 0
: 109 Minimum Test error found - save the configuration
: 109 | 11207.1 10441.1 0.00538692 0.000579501 166409 0
: 110 Minimum Test error found - save the configuration
: 110 | 11105.7 10345.2 0.00541718 0.000584879 165553 0
: 111 Minimum Test error found - save the configuration
: 111 | 11003.9 10253.1 0.00564534 0.000597831 158494 0
: 112 Minimum Test error found - save the configuration
: 112 | 10905 10161 0.0054221 0.000583909 165351 0
: 113 Minimum Test error found - save the configuration
: 113 | 10808.5 10066.5 0.00548339 0.000616471 164375 0
: 114 Minimum Test error found - save the configuration
: 114 | 10708.1 9976.95 0.00548899 0.00059095 163331 0
: 115 Minimum Test error found - save the configuration
: 115 | 10614.2 9884.99 0.00549013 0.000625881 164465 0
: 116 Minimum Test error found - save the configuration
: 116 | 10517 9794.41 0.00544155 0.00059811 165172 0
: 117 Minimum Test error found - save the configuration
: 117 | 10420.8 9707.67 0.00542014 0.000603221 166081 0
: 118 Minimum Test error found - save the configuration
: 118 | 10327.1 9619.49 0.00539165 0.000576549 166144 0
: 119 Minimum Test error found - save the configuration
: 119 | 10234.4 9530.95 0.0054563 0.00059536 164577 0
: 120 Minimum Test error found - save the configuration
: 120 | 10140.5 9445.83 0.00543952 0.000587139 164867 0
: 121 Minimum Test error found - save the configuration
: 121 | 10049.8 9359.43 0.00552769 0.000598721 162306 0
: 122 Minimum Test error found - save the configuration
: 122 | 9959.48 9272.75 0.00544847 0.00059783 164927 0
: 123 Minimum Test error found - save the configuration
: 123 | 9869.39 9186.86 0.00543426 0.00061071 165853 0
: 124 Minimum Test error found - save the configuration
: 124 | 9777.92 9105.44 0.00543644 0.00058736 164980 0
: 125 Minimum Test error found - save the configuration
: 125 | 9690.98 9021.97 0.00544841 0.000587199 164568 0
: 126 Minimum Test error found - save the configuration
: 126 | 9601.65 8940.25 0.00549646 0.00059387 163179 0
: 127 Minimum Test error found - save the configuration
: 127 | 9515.04 8859.55 0.00543336 0.000588169 165112 0
: 128 Minimum Test error found - save the configuration
: 128 | 9428.94 8778.79 0.00548826 0.000599091 163627 0
: 129 Minimum Test error found - save the configuration
: 129 | 9344.45 8697.11 0.00546934 0.0005945 164108 0
: 130 Minimum Test error found - save the configuration
: 130 | 9258.54 8617.89 0.00554812 0.00058609 161224 0
: 131 Minimum Test error found - save the configuration
: 131 | 9174.76 8539.24 0.00539062 0.000584439 166452 0
: 132 Minimum Test error found - save the configuration
: 132 | 9091.37 8460.36 0.00551703 0.000620751 163389 0
: 133 Minimum Test error found - save the configuration
: 133 | 9007.75 8384.33 0.00545624 0.00058958 164384 0
: 134 Minimum Test error found - save the configuration
: 134 | 8926.91 8307.71 0.00542548 0.000595691 165639 0
: 135 Minimum Test error found - save the configuration
: 135 | 8846.93 8229.11 0.00541478 0.000588059 165744 0
: 136 Minimum Test error found - save the configuration
: 136 | 8765.57 8153.58 0.00543318 0.00059409 165320 0
: 137 Minimum Test error found - save the configuration
: 137 | 8684.48 8079.71 0.00544426 0.00059356 164925 0
: 138 Minimum Test error found - save the configuration
: 138 | 8605.93 8006.77 0.00545514 0.000588399 164381 0
: 139 Minimum Test error found - save the configuration
: 139 | 8528.64 7932.07 0.00545686 0.00060068 164738 0
: 140 Minimum Test error found - save the configuration
: 140 | 8450.68 7859.28 0.00548852 0.00061053 164002 0
: 141 Minimum Test error found - save the configuration
: 141 | 8374.15 7786.19 0.00548372 0.000592121 163546 0
: 142 Minimum Test error found - save the configuration
: 142 | 8296.75 7715.06 0.00548851 0.000592279 163391 0
: 143 Minimum Test error found - save the configuration
: 143 | 8221.28 7644.19 0.00543184 0.00059017 165232 0
: 144 Minimum Test error found - save the configuration
: 144 | 8146.5 7575.12 0.00544832 0.000588979 164631 0
: 145 Minimum Test error found - save the configuration
: 145 | 8072.46 7504.59 0.00557483 0.000595611 160668 0
: 146 Minimum Test error found - save the configuration
: 146 | 7999.21 7434.19 0.00549795 0.00061567 163858 0
: 147 Minimum Test error found - save the configuration
: 147 | 7924.75 7366.76 0.00544089 0.000588061 164852 0
: 148 Minimum Test error found - save the configuration
: 148 | 7853.84 7298.51 0.00550038 0.000596499 163136 0
: 149 Minimum Test error found - save the configuration
: 149 | 7782 7230.61 0.00551219 0.000594831 162689 0
: 150 Minimum Test error found - save the configuration
: 150 | 7710.32 7164.19 0.00545771 0.00059079 164375 0
: 151 Minimum Test error found - save the configuration
: 151 | 7639.52 7099.05 0.00548925 0.000594381 163436 0
: 152 Minimum Test error found - save the configuration
: 152 | 7571.09 7032.77 0.00545032 0.00059035 164610 0
: 153 Minimum Test error found - save the configuration
: 153 | 7500.84 6967.56 0.00551805 0.000618591 163283 0
: 154 Minimum Test error found - save the configuration
: 154 | 7434.53 6900.43 0.00544859 0.000587219 164563 0
: 155 Minimum Test error found - save the configuration
: 155 | 7362.94 6839.5 0.00548011 0.000628481 164893 0
: 156 Minimum Test error found - save the configuration
: 156 | 7297.89 6775.62 0.00544415 0.000580139 164473 0
: 157 Minimum Test error found - save the configuration
: 157 | 7230.55 6712.79 0.00542001 0.000595171 165809 0
: 158 Minimum Test error found - save the configuration
: 158 | 7164.58 6650.47 0.00542564 0.000587919 165367 0
: 159 Minimum Test error found - save the configuration
: 159 | 7099.21 6588.46 0.00551824 0.000629182 163631 0
: 160 Minimum Test error found - save the configuration
: 160 | 7032.92 6528.62 0.00575041 0.00060236 155399 0
: 161 Minimum Test error found - save the configuration
: 161 | 6970.58 6467.73 0.00548396 0.000587981 163399 0
: 162 Minimum Test error found - save the configuration
: 162 | 6904.98 6407.69 0.00541015 0.000585409 165812 0
: 163 Minimum Test error found - save the configuration
: 163 | 6842.61 6348.25 0.005461 0.00059686 164469 0
: 164 Minimum Test error found - save the configuration
: 164 | 6779.86 6289.45 0.00551052 0.000624421 163730 0
: 165 Minimum Test error found - save the configuration
: 165 | 6717.19 6231.95 0.00567806 0.000770944 163029 0
: 166 Minimum Test error found - save the configuration
: 166 | 6655.9 6173.33 0.00549489 0.00058908 163072 0
: 167 Minimum Test error found - save the configuration
: 167 | 6594.62 6117.47 0.00554129 0.000596189 161776 0
: 168 Minimum Test error found - save the configuration
: 168 | 6534.94 6059.05 0.00544014 0.000588259 164884 0
: 169 Minimum Test error found - save the configuration
: 169 | 6474.69 6001.86 0.00554723 0.000594489 161527 0
: 170 Minimum Test error found - save the configuration
: 170 | 6414.73 5946.65 0.00545045 0.000600619 164954 0
: 171 Minimum Test error found - save the configuration
: 171 | 6356.48 5890.5 0.00546715 0.000588821 163990 0
: 172 Minimum Test error found - save the configuration
: 172 | 6296.37 5836.78 0.00546655 0.00060861 164679 0
: 173 Minimum Test error found - save the configuration
: 173 | 6239.97 5782.22 0.00542999 0.000587171 165193 0
: 174 Minimum Test error found - save the configuration
: 174 | 6181.43 5729.09 0.00560293 0.00059331 159693 0
: 175 Minimum Test error found - save the configuration
: 175 | 6125.87 5675.33 0.00548766 0.000651001 165403 0
: 176 Minimum Test error found - save the configuration
: 176 | 6069.37 5621.23 0.00543375 0.000586059 165027 0
: 177 Minimum Test error found - save the configuration
: 177 | 6012.35 5569.95 0.00544686 0.00058918 164688 0
: 178 Minimum Test error found - save the configuration
: 178 | 5957.86 5518.35 0.00546525 0.00059191 164158 0
: 179 Minimum Test error found - save the configuration
: 179 | 5902.25 5466.97 0.00544229 0.00060148 165262 0
: 180 Minimum Test error found - save the configuration
: 180 | 5849 5415.44 0.00548509 0.000595429 163610 0
: 181 Minimum Test error found - save the configuration
: 181 | 5794.78 5364.53 0.00547975 0.000597851 163871 0
: 182 Minimum Test error found - save the configuration
: 182 | 5741.41 5313.96 0.00544834 0.000581599 164381 0
: 183 Minimum Test error found - save the configuration
: 183 | 5687.53 5265.74 0.00549863 0.000603051 163413 0
: 184 Minimum Test error found - save the configuration
: 184 | 5636.64 5215.19 0.00549411 0.00058648 163011 0
: 185 Minimum Test error found - save the configuration
: 185 | 5583.27 5167.61 0.00549668 0.000598381 163322 0
: 186 Minimum Test error found - save the configuration
: 186 | 5532.39 5119.26 0.00574417 0.00059595 155394 0
: 187 Minimum Test error found - save the configuration
: 187 | 5481.41 5071.51 0.00551937 0.000594809 162451 0
: 188 Minimum Test error found - save the configuration
: 188 | 5431.24 5023.31 0.00557255 0.000632641 161946 0
: 189 Minimum Test error found - save the configuration
: 189 | 5379.49 4978.41 0.00546755 0.000591859 164079 0
: 190 Minimum Test error found - save the configuration
: 190 | 5332.02 4930.38 0.0054465 0.000585859 164587 0
: 191 Minimum Test error found - save the configuration
: 191 | 5282.26 4883.96 0.00640776 0.00060621 137894 0
: 192 Minimum Test error found - save the configuration
: 192 | 5232.33 4839.84 0.00548577 0.000588129 163344 0
: 193 Minimum Test error found - save the configuration
: 193 | 5185.07 4793.98 0.00546037 0.00059317 164365 0
: 194 Minimum Test error found - save the configuration
: 194 | 5136.76 4749.75 0.00546974 0.0005944 164091 0
: 195 Minimum Test error found - save the configuration
: 195 | 5089.57 4705.17 0.00545889 0.00059092 164339 0
: 196 Minimum Test error found - save the configuration
: 196 | 5042.85 4661.34 0.00540668 0.00058146 165796 0
: 197 Minimum Test error found - save the configuration
: 197 | 4995.84 4617.7 0.00545857 0.000595631 164510 0
: 198 Minimum Test error found - save the configuration
: 198 | 4950.38 4573.93 0.00538381 0.00058365 166661 0
: 199 Minimum Test error found - save the configuration
: 199 | 4903.96 4531.24 0.00538373 0.00058113 166576 0
: 200 Minimum Test error found - save the configuration
: 200 | 4858.7 4489.27 0.00541077 0.000588 165880 0
: 201 Minimum Test error found - save the configuration
: 201 | 4814.39 4446.91 0.00550974 0.00061302 163375 0
: 202 Minimum Test error found - save the configuration
: 202 | 4769.5 4406.45 0.00550755 0.00059353 162799 0
: 203 Minimum Test error found - save the configuration
: 203 | 4726.04 4364.39 0.00554685 0.000590779 161418 0
: 204 Minimum Test error found - save the configuration
: 204 | 4682.11 4323.87 0.00543766 0.000590261 165037 0
: 205 Minimum Test error found - save the configuration
: 205 | 4638.63 4284.07 0.00539006 0.000579509 166301 0
: 206 Minimum Test error found - save the configuration
: 206 | 4596.25 4244.2 0.00541803 0.000589681 165688 0
: 207 Minimum Test error found - save the configuration
: 207 | 4553.6 4204.87 0.0054339 0.000596009 165361 0
: 208 Minimum Test error found - save the configuration
: 208 | 4512.82 4164.98 0.00542271 0.000592991 165641 0
: 209 Minimum Test error found - save the configuration
: 209 | 4470.67 4125.58 0.00541493 0.000593999 165943 0
: 210 Minimum Test error found - save the configuration
: 210 | 4428.52 4088.29 0.00540187 0.00058028 165920 0
: 211 Minimum Test error found - save the configuration
: 211 | 4389.13 4049.38 0.00545155 0.000590881 164586 0
: 212 Minimum Test error found - save the configuration
: 212 | 4347.73 4012.8 0.0055653 0.0005906 160814 0
: 213 Minimum Test error found - save the configuration
: 213 | 4309.03 3974.37 0.00542595 0.000588941 165391 0
: 214 Minimum Test error found - save the configuration
: 214 | 4268.74 3937.34 0.00545091 0.00058532 164420 0
: 215 Minimum Test error found - save the configuration
: 215 | 4229.47 3900.87 0.00544424 0.000588611 164757 0
: 216 Minimum Test error found - save the configuration
: 216 | 4191.42 3864.42 0.0054134 0.000581809 165577 0
: 217 Minimum Test error found - save the configuration
: 217 | 4152.07 3828.76 0.00547762 0.000603741 164140 0
: 218 Minimum Test error found - save the configuration
: 218 | 4114.02 3793.6 0.0055612 0.00058843 160876 0
: 219 Minimum Test error found - save the configuration
: 219 | 4076.93 3757.66 0.0054664 0.000602201 164467 0
: 220 Minimum Test error found - save the configuration
: 220 | 4038.97 3723.31 0.00547871 0.00059439 163789 0
: 221 Minimum Test error found - save the configuration
: 221 | 4002.64 3688.02 0.00548152 0.0005984 163830 0
: 222 Minimum Test error found - save the configuration
: 222 | 3965.54 3653.93 0.00553409 0.00059407 161943 0
: 223 Minimum Test error found - save the configuration
: 223 | 3929.28 3620.12 0.00548096 0.000604981 164070 0
: 224 Minimum Test error found - save the configuration
: 224 | 3894.1 3585.72 0.00546385 0.00058908 164110 0
: 225 Minimum Test error found - save the configuration
: 225 | 3858.57 3551.51 0.005619 0.000596911 159296 0
: 226 Minimum Test error found - save the configuration
: 226 | 3822.28 3519.31 0.00550054 0.00059543 163095 0
: 227 Minimum Test error found - save the configuration
: 227 | 3787.6 3486.95 0.00549637 0.000593881 163182 0
: 228 Minimum Test error found - save the configuration
: 228 | 3753.35 3454.28 0.00550639 0.00060892 163350 0
: 229 Minimum Test error found - save the configuration
: 229 | 3719.14 3422.51 0.00557367 0.000593319 160631 0
: 230 Minimum Test error found - save the configuration
: 230 | 3685.31 3390.12 0.00568237 0.000635292 158508 0
: 231 Minimum Test error found - save the configuration
: 231 | 3652.15 3358.29 0.00621482 0.000668222 144232 0
: 232 Minimum Test error found - save the configuration
: 232 | 3618.25 3327.54 0.00577821 0.000622081 155155 0
: 233 Minimum Test error found - save the configuration
: 233 | 3585.9 3295.98 0.00569694 0.00059545 156817 0
: 234 Minimum Test error found - save the configuration
: 234 | 3552.79 3265.48 0.00548411 0.00060089 163826 0
: 235 Minimum Test error found - save the configuration
: 235 | 3520.8 3234.85 0.00562221 0.00060404 159421 0
: 236 Minimum Test error found - save the configuration
: 236 | 3488.85 3204.65 0.00547037 0.000593 164023 0
: 237 Minimum Test error found - save the configuration
: 237 | 3456.28 3175.96 0.00556971 0.000617881 161556 0
: 238 Minimum Test error found - save the configuration
: 238 | 3426.06 3146.02 0.00550318 0.000596089 163029 0
: 239 Minimum Test error found - save the configuration
: 239 | 3394.09 3116.96 0.00547266 0.000599181 164154 0
: 240 Minimum Test error found - save the configuration
: 240 | 3363.88 3087.78 0.00551357 0.00059793 162746 0
: 241 Minimum Test error found - save the configuration
: 241 | 3333.07 3058.74 0.00547927 0.000598741 163917 0
: 242 Minimum Test error found - save the configuration
: 242 | 3302.6 3030.33 0.00546529 0.000597609 164349 0
: 243 Minimum Test error found - save the configuration
: 243 | 3272.81 3002.24 0.00566876 0.000602931 157921 0
: 244 Minimum Test error found - save the configuration
: 244 | 3242.78 2974.54 0.00551028 0.000595649 162779 0
: 245 Minimum Test error found - save the configuration
: 245 | 3213.74 2946.66 0.00554387 0.000605121 161984 0
: 246 Minimum Test error found - save the configuration
: 246 | 3184.06 2919.51 0.00560788 0.00059917 159722 0
: 247 Minimum Test error found - save the configuration
: 247 | 3155.27 2892.52 0.00553702 0.00059641 161923 0
: 248 Minimum Test error found - save the configuration
: 248 | 3126.84 2865.62 0.00554651 0.000592959 161500 0
: 249 Minimum Test error found - save the configuration
: 249 | 3098.24 2839.11 0.00552703 0.00059647 162253 0
: 250 Minimum Test error found - save the configuration
: 250 | 3070.02 2813.06 0.0054462 0.000587219 164644 0
: 251 Minimum Test error found - save the configuration
: 251 | 3042.55 2786.53 0.00543963 0.00060639 165520 0
: 252 Minimum Test error found - save the configuration
: 252 | 3014.59 2760.74 0.00545451 0.000589129 164427 0
: 253 Minimum Test error found - save the configuration
: 253 | 2987.02 2735.55 0.00553787 0.00059745 161929 0
: 254 Minimum Test error found - save the configuration
: 254 | 2960.5 2710.03 0.00548067 0.000603489 164029 0
: 255 Minimum Test error found - save the configuration
: 255 | 2933.21 2685.01 0.00546292 0.000596781 164401 0
: 256 Minimum Test error found - save the configuration
: 256 | 2907.31 2659.39 0.00590995 0.000648492 152049 0
: 257 Minimum Test error found - save the configuration
: 257 | 2879.81 2635.6 0.0057259 0.000629471 156973 0
: 258 Minimum Test error found - save the configuration
: 258 | 2854.57 2610.87 0.00546657 0.00059246 164132 0
: 259 Minimum Test error found - save the configuration
: 259 | 2828.88 2586.37 0.00547216 0.00058908 163831 0
: 260 Minimum Test error found - save the configuration
: 260 | 2802.9 2562.28 0.00557986 0.00062143 161341 0
: 261 Minimum Test error found - save the configuration
: 261 | 2777.38 2538.75 0.00565268 0.000716573 162071 0
: 262 Minimum Test error found - save the configuration
: 262 | 2752.07 2515.54 0.0055289 0.00059175 162037 0
: 263 Minimum Test error found - save the configuration
: 263 | 2727.48 2492.24 0.00549898 0.000599951 163298 0
: 264 Minimum Test error found - save the configuration
: 264 | 2702.73 2469.26 0.00550081 0.00059353 163023 0
: 265 Minimum Test error found - save the configuration
: 265 | 2678.16 2446.5 0.00549519 0.00060627 163635 0
: 266 Minimum Test error found - save the configuration
: 266 | 2654.48 2423.5 0.00562775 0.00060425 159251 0
: 267 Minimum Test error found - save the configuration
: 267 | 2629.9 2401.99 0.00557005 0.000590169 160646 0
: 268 Minimum Test error found - save the configuration
: 268 | 2606.22 2379.83 0.00546751 0.000621 165067 0
: 269 Minimum Test error found - save the configuration
: 269 | 2583.13 2356.65 0.00544721 0.000588129 164640 0
: 270 Minimum Test error found - save the configuration
: 270 | 2558.85 2335.67 0.00545664 0.00059014 164389 0
: 271 Minimum Test error found - save the configuration
: 271 | 2535.48 2314.91 0.00543937 0.000588161 164907 0
: 272 Minimum Test error found - save the configuration
: 272 | 2513.28 2292.71 0.00561396 0.00059576 159420 0
: 273 Minimum Test error found - save the configuration
: 273 | 2489.54 2272.65 0.00552018 0.00059574 162455 0
: 274 Minimum Test error found - save the configuration
: 274 | 2467.77 2250.97 0.0056083 0.000625631 160557 0
: 275 Minimum Test error found - save the configuration
: 275 | 2444.83 2230.43 0.005873 0.00062754 152513 0
: 276 Minimum Test error found - save the configuration
: 276 | 2423.03 2209.41 0.00564028 0.00058601 158282 0
: 277 Minimum Test error found - save the configuration
: 277 | 2401.02 2189.15 0.0055172 0.000626921 163590 0
: 278 Minimum Test error found - save the configuration
: 278 | 2378.34 2169.55 0.00549978 0.000588459 162889 0
: 279 Minimum Test error found - save the configuration
: 279 | 2356.76 2150.34 0.0054999 0.000599861 163264 0
: 280 Minimum Test error found - save the configuration
: 280 | 2335.86 2130.9 0.00553248 0.00059813 162129 0
: 281 Minimum Test error found - save the configuration
: 281 | 2314.4 2110.68 0.0055303 0.000614371 162736 0
: 282 Minimum Test error found - save the configuration
: 282 | 2293.54 2091.37 0.00554743 0.000591549 161424 0
: 283 Minimum Test error found - save the configuration
: 283 | 2272.66 2071.5 0.00543099 0.000591151 165295 0
: 284 Minimum Test error found - save the configuration
: 284 | 2251.34 2052.48 0.00566657 0.00061655 158415 0
: 285 Minimum Test error found - save the configuration
: 285 | 2230.51 2033.75 0.00556659 0.00060555 161256 0
: 286 Minimum Test error found - save the configuration
: 286 | 2210.1 2015.18 0.00552848 0.000633402 163429 0
: 287 Minimum Test error found - save the configuration
: 287 | 2189.39 1997.59 0.00551519 0.00059341 162543 0
: 288 Minimum Test error found - save the configuration
: 288 | 2170.19 1978.71 0.00550578 0.000598971 163039 0
: 289 Minimum Test error found - save the configuration
: 289 | 2150.24 1960.15 0.00557357 0.00062446 161645 0
: 290 Minimum Test error found - save the configuration
: 290 | 2129.58 1942.67 0.00554179 0.000605411 162062 0
: 291 Minimum Test error found - save the configuration
: 291 | 2110.49 1924.42 0.0056471 0.000640051 159775 0
: 292 Minimum Test error found - save the configuration
: 292 | 2090.87 1906.73 0.00985031 0.000975976 90147.7 0
: 293 Minimum Test error found - save the configuration
: 293 | 2071.62 1889.56 0.00742758 0.000747743 119763 0
: 294 Minimum Test error found - save the configuration
: 294 | 2052.58 1871.85 0.00703282 0.000747204 127275 0
: 295 Minimum Test error found - save the configuration
: 295 | 2033.55 1854.79 0.00714263 0.000765083 125440 0
: 296 Minimum Test error found - save the configuration
: 296 | 2014.77 1837.31 0.00783962 0.000693773 111953 0
: 297 Minimum Test error found - save the configuration
: 297 | 1996.04 1820.27 0.00652706 0.000673951 136680 0
: 298 Minimum Test error found - save the configuration
: 298 | 1976.86 1804.51 0.00631764 0.000661922 141450 0
: 299 Minimum Test error found - save the configuration
: 299 | 1959.42 1787.59 0.00668779 0.000812413 136161 0
: 300 Minimum Test error found - save the configuration
: 300 | 1941.02 1770.91 0.00753307 0.000724653 117502 0
: 301 Minimum Test error found - save the configuration
: 301 | 1922.42 1755 0.00682098 0.000683112 130338 0
: 302 Minimum Test error found - save the configuration
: 302 | 1904.9 1738.96 0.00629084 0.000737942 144069 0
: 303 Minimum Test error found - save the configuration
: 303 | 1886.96 1722.89 0.00589264 0.00063071 152035 0
: 304 Minimum Test error found - save the configuration
: 304 | 1869.16 1707.59 0.00584881 0.000626591 153192 0
: 305 Minimum Test error found - save the configuration
: 305 | 1851.81 1692.3 0.00586011 0.000610181 152383 0
: 306 Minimum Test error found - save the configuration
: 306 | 1834.64 1676.88 0.00599997 0.000660202 149819 0
: 307 Minimum Test error found - save the configuration
: 307 | 1817.57 1660.99 0.00575998 0.000596269 154927 0
: 308 Minimum Test error found - save the configuration
: 308 | 1800.42 1645.65 0.00548099 0.000591259 163608 0
: 309 Minimum Test error found - save the configuration
: 309 | 1783.56 1630.33 0.00545391 0.000589999 164477 0
: 310 Minimum Test error found - save the configuration
: 310 | 1766.23 1615.94 0.00550038 0.000596151 163124 0
: 311 Minimum Test error found - save the configuration
: 311 | 1750.25 1600.54 0.00554095 0.00059544 161763 0
: 312 Minimum Test error found - save the configuration
: 312 | 1733.05 1586.52 0.00562569 0.00060625 159380 0
: 313 Minimum Test error found - save the configuration
: 313 | 1717.05 1571.8 0.00574047 0.000771534 161000 0
: 314 Minimum Test error found - save the configuration
: 314 | 1700.46 1557.65 0.00560406 0.000594579 159697 0
: 315 Minimum Test error found - save the configuration
: 315 | 1684.38 1543.74 0.00577092 0.0006188 155276 0
: 316 Minimum Test error found - save the configuration
: 316 | 1668.88 1529.2 0.00577054 0.000655751 156409 0
: 317 Minimum Test error found - save the configuration
: 317 | 1652.68 1515.17 0.00573023 0.000603831 156055 0
: 318 Minimum Test error found - save the configuration
: 318 | 1636.95 1501.67 0.00571636 0.00063456 157425 0
: 319 Minimum Test error found - save the configuration
: 319 | 1621.98 1487.04 0.00582861 0.00061221 153363 0
: 320 Minimum Test error found - save the configuration
: 320 | 1605.89 1473.79 0.00617041 0.000618 144081 0
: 321 Minimum Test error found - save the configuration
: 321 | 1591.21 1459.68 0.00583672 0.000683591 155246 0
: 322 Minimum Test error found - save the configuration
: 322 | 1575.39 1446.79 0.00596211 0.00063696 150231 0
: 323 Minimum Test error found - save the configuration
: 323 | 1560.36 1433.7 0.00573855 0.0006169 156200 0
: 324 Minimum Test error found - save the configuration
: 324 | 1545.53 1420.58 0.00606073 0.000675621 148558 0
: 325 Minimum Test error found - save the configuration
: 325 | 1530.98 1408.02 0.00585135 0.00063295 153304 0
: 326 Minimum Test error found - save the configuration
: 326 | 1516.42 1394.46 0.00571849 0.00060389 156415 0
: 327 Minimum Test error found - save the configuration
: 327 | 1501.65 1381.95 0.00571055 0.00062728 157379 0
: 328 Minimum Test error found - save the configuration
: 328 | 1487.33 1368.97 0.00581008 0.00061328 153941 0
: 329 Minimum Test error found - save the configuration
: 329 | 1472.83 1356.3 0.00718633 0.0005994 121453 0
: 330 Minimum Test error found - save the configuration
: 330 | 1458.77 1343.64 0.00570677 0.00063285 157669 0
: 331 Minimum Test error found - save the configuration
: 331 | 1444.93 1331.3 0.00574525 0.000670251 157636 0
: 332 Minimum Test error found - save the configuration
: 332 | 1430.73 1319.12 0.0060046 0.000638341 149080 0
: 333 Minimum Test error found - save the configuration
: 333 | 1417.58 1306.66 0.00559663 0.00059675 160004 0
: 334 Minimum Test error found - save the configuration
: 334 | 1403.45 1294.38 0.00552847 0.00059674 162215 0
: 335 Minimum Test error found - save the configuration
: 335 | 1389.94 1282.44 0.00560893 0.000621161 160392 0
: 336 Minimum Test error found - save the configuration
: 336 | 1376.83 1270.56 0.00565529 0.00059696 158155 0
: 337 Minimum Test error found - save the configuration
: 337 | 1363.64 1258.3 0.00575342 0.000597309 155156 0
: 338 Minimum Test error found - save the configuration
: 338 | 1350.07 1246.83 0.00559822 0.000613861 160502 0
: 339 Minimum Test error found - save the configuration
: 339 | 1337.21 1235.55 0.00563117 0.0006422 160354 0
: 340 Minimum Test error found - save the configuration
: 340 | 1324.17 1224.54 0.00593585 0.0006169 150406 0
: 341 Minimum Test error found - save the configuration
: 341 | 1312.02 1212.3 0.00563602 0.000616229 159369 0
: 342 Minimum Test error found - save the configuration
: 342 | 1298.88 1201.2 0.00570516 0.000620711 157343 0
: 343 Minimum Test error found - save the configuration
: 343 | 1286.34 1189.83 0.00571452 0.00059394 156232 0
: 344 Minimum Test error found - save the configuration
: 344 | 1273.83 1178.95 0.00550282 0.000592171 162911 0
: 345 Minimum Test error found - save the configuration
: 345 | 1261.57 1167.98 0.00561846 0.000606021 159603 0
: 346 Minimum Test error found - save the configuration
: 346 | 1249.39 1157.08 0.00595013 0.00061756 150021 0
: 347 Minimum Test error found - save the configuration
: 347 | 1237.31 1146.35 0.00582966 0.00061964 153550 0
: 348 Minimum Test error found - save the configuration
: 348 | 1225.28 1135.56 0.00561427 0.00059367 159343 0
: 349 Minimum Test error found - save the configuration
: 349 | 1213.76 1124.72 0.00558541 0.000595831 160334 0
: 350 Minimum Test error found - save the configuration
: 350 | 1202.19 1113.62 0.00559944 0.000595529 159875 0
: 351 Minimum Test error found - save the configuration
: 351 | 1189.79 1103.75 0.00565582 0.000612281 158619 0
: 352 Minimum Test error found - save the configuration
: 352 | 1178.36 1093.48 0.00591941 0.000642682 151609 0
: 353 Minimum Test error found - save the configuration
: 353 | 1166.99 1083.5 0.00606548 0.000709173 149357 0
: 354 Minimum Test error found - save the configuration
: 354 | 1156.07 1072.81 0.00617766 0.000740402 147133 0
: 355 Minimum Test error found - save the configuration
: 355 | 1144.84 1062.55 0.00611519 0.000643231 146200 0
: 356 Minimum Test error found - save the configuration
: 356 | 1133.32 1052.76 0.00577826 0.00062891 155360 0
: 357 Minimum Test error found - save the configuration
: 357 | 1122.78 1042.93 0.00580659 0.000610571 153964 0
: 358 Minimum Test error found - save the configuration
: 358 | 1111.57 1032.76 0.00560828 0.0006025 159815 0
: 359 Minimum Test error found - save the configuration
: 359 | 1100.71 1023.02 0.00575488 0.000632521 156178 0
: 360 Minimum Test error found - save the configuration
: 360 | 1090.05 1013.56 0.00568876 0.000631041 158174 0
: 361 Minimum Test error found - save the configuration
: 361 | 1079.48 1004.07 0.00614289 0.00061186 144638 0
: 362 Minimum Test error found - save the configuration
: 362 | 1069.1 994.111 0.00578785 0.000678553 156577 0
: 363 Minimum Test error found - save the configuration
: 363 | 1058.41 984.551 0.00578426 0.000655441 155981 0
: 364 Minimum Test error found - save the configuration
: 364 | 1048.04 975.365 0.00640609 0.00061933 138247 0
: 365 Minimum Test error found - save the configuration
: 365 | 1037.79 965.828 0.00560323 0.00059549 159753 0
: 366 Minimum Test error found - save the configuration
: 366 | 1028.05 956.319 0.00599574 0.000637831 149312 0
: 367 Minimum Test error found - save the configuration
: 367 | 1017.36 947.512 0.00578506 0.00063888 155455 0
: 368 Minimum Test error found - save the configuration
: 368 | 1007.49 938.982 0.00579866 0.000642971 155168 0
: 369 Minimum Test error found - save the configuration
: 369 | 997.807 930.074 0.00580207 0.00061996 154377 0
: 370 Minimum Test error found - save the configuration
: 370 | 988.096 921.374 0.00566114 0.000636661 159221 0
: 371 Minimum Test error found - save the configuration
: 371 | 978.699 912.059 0.00567964 0.00061578 157982 0
: 372 Minimum Test error found - save the configuration
: 372 | 968.574 903.31 0.00555952 0.000594989 161143 0
: 373 Minimum Test error found - save the configuration
: 373 | 959.437 894.757 0.00552511 0.00059755 162352 0
: 374 Minimum Test error found - save the configuration
: 374 | 949.871 886.459 0.00556063 0.00060679 161491 0
: 375 Minimum Test error found - save the configuration
: 375 | 940.645 877.534 0.00608322 0.000687201 148257 0
: 376 Minimum Test error found - save the configuration
: 376 | 931.24 868.6 0.00591522 0.000604009 150625 0
: 377 Minimum Test error found - save the configuration
: 377 | 921.958 860.271 0.00555948 0.000628641 162244 0
: 378 Minimum Test error found - save the configuration
: 378 | 912.91 852.047 0.00562717 0.0005921 158885 0
: 379 Minimum Test error found - save the configuration
: 379 | 904.164 843.601 0.0056313 0.000604311 159141 0
: 380 Minimum Test error found - save the configuration
: 380 | 894.998 835.358 0.00567406 0.000615451 158146 0
: 381 Minimum Test error found - save the configuration
: 381 | 885.967 827.191 0.00571457 0.00059697 156323 0
: 382 Minimum Test error found - save the configuration
: 382 | 877.536 818.712 0.00569053 0.000659401 159010 0
: 383 Minimum Test error found - save the configuration
: 383 | 868.56 811.149 0.0061416 0.000687861 146688 0
: 384 Minimum Test error found - save the configuration
: 384 | 860.047 803.366 0.00623954 0.000655651 143269 0
: 385 Minimum Test error found - save the configuration
: 385 | 851.322 795.709 0.00575303 0.00060307 155341 0
: 386 Minimum Test error found - save the configuration
: 386 | 842.86 787.991 0.0057282 0.000628522 156873 0
: 387 Minimum Test error found - save the configuration
: 387 | 834.646 780.308 0.00597969 0.000637731 149758 0
: 388 Minimum Test error found - save the configuration
: 388 | 826.455 772.318 0.00558844 0.00059831 160316 0
: 389 Minimum Test error found - save the configuration
: 389 | 818.31 764.197 0.00593016 0.000610459 150384 0
: 390 Minimum Test error found - save the configuration
: 390 | 809.738 756.948 0.00573228 0.000631501 156839 0
: 391 Minimum Test error found - save the configuration
: 391 | 802.119 749.542 0.00600644 0.00062377 148625 0
: 392 Minimum Test error found - save the configuration
: 392 | 793.742 742.487 0.00562729 0.000622141 159836 0
: 393 Minimum Test error found - save the configuration
: 393 | 785.992 735.177 0.005571 0.00061158 161309 0
: 394 Minimum Test error found - save the configuration
: 394 | 778.495 727.283 0.00562555 0.00061851 159775 0
: 395 Minimum Test error found - save the configuration
: 395 | 770.228 720.106 0.0056743 0.000617451 158201 0
: 396 Minimum Test error found - save the configuration
: 396 | 762.61 712.872 0.00560011 0.000598309 159942 0
: 397 Minimum Test error found - save the configuration
: 397 | 754.699 706.336 0.00576395 0.000663061 156836 0
: 398 Minimum Test error found - save the configuration
: 398 | 747.638 698.704 0.0059656 0.00062879 149902 0
: 399 Minimum Test error found - save the configuration
: 399 | 739.848 691.587 0.00576507 0.000617601 155416 0
: 400 Minimum Test error found - save the configuration
: 400 | 732.688 683.907 0.00561871 0.00060361 159518 0
: 401 Minimum Test error found - save the configuration
: 401 | 724.598 677.585 0.00560262 0.00060199 159980 0
: 402 Minimum Test error found - save the configuration
: 402 | 717.792 670.557 0.00575093 0.000708282 158647 0
: 403 Minimum Test error found - save the configuration
: 403 | 710.511 664.054 0.00566679 0.00060222 157960 0
: 404 Minimum Test error found - save the configuration
: 404 | 703.245 656.903 0.00558565 0.00059979 160454 0
: 405 Minimum Test error found - save the configuration
: 405 | 696.059 650.584 0.00555712 0.000611051 161744 0
: 406 Minimum Test error found - save the configuration
: 406 | 689.199 643.646 0.00559251 0.00060493 160398 0
: 407 Minimum Test error found - save the configuration
: 407 | 682.041 637.224 0.00555682 0.000603261 161500 0
: 408 Minimum Test error found - save the configuration
: 408 | 675.209 630.592 0.00558285 0.00060153 160600 0
: 409 Minimum Test error found - save the configuration
: 409 | 668.125 624.523 0.00565889 0.00059524 157989 0
: 410 Minimum Test error found - save the configuration
: 410 | 662.137 617.567 0.00573585 0.000640481 157005 0
: 411 Minimum Test error found - save the configuration
: 411 | 654.627 611.604 0.00563654 0.00061814 159413 0
: 412 Minimum Test error found - save the configuration
: 412 | 648.338 605.184 0.00564397 0.000600189 158611 0
: 413 Minimum Test error found - save the configuration
: 413 | 641.448 599.05 0.00564523 0.000600031 158567 0
: 414 Minimum Test error found - save the configuration
: 414 | 635.172 592.821 0.00567537 0.00063515 158723 0
: 415 Minimum Test error found - save the configuration
: 415 | 628.816 586.746 0.0056154 0.00059542 159363 0
: 416 Minimum Test error found - save the configuration
: 416 | 622.204 580.446 0.00585352 0.000669811 154330 0
: 417 Minimum Test error found - save the configuration
: 417 | 615.607 574.795 0.00749621 0.000814664 119733 0
: 418 Minimum Test error found - save the configuration
: 418 | 609.488 569.088 0.00592432 0.000626261 150999 0
: 419 Minimum Test error found - save the configuration
: 419 | 603.316 562.928 0.0057306 0.00061798 156476 0
: 420 Minimum Test error found - save the configuration
: 420 | 597.149 556.575 0.00559801 0.00060599 160256 0
: 421 Minimum Test error found - save the configuration
: 421 | 590.742 551.212 0.00556355 0.000594619 161000 0
: 422 Minimum Test error found - save the configuration
: 422 | 584.754 545.441 0.00581017 0.00063705 154646 0
: 423 Minimum Test error found - save the configuration
: 423 | 578.954 539.836 0.00567049 0.000626801 158614 0
: 424 Minimum Test error found - save the configuration
: 424 | 572.981 534.409 0.00562941 0.000599739 159056 0
: 425 Minimum Test error found - save the configuration
: 425 | 567.129 529.232 0.00572251 0.00061511 156636 0
: 426 Minimum Test error found - save the configuration
: 426 | 561.308 522.901 0.00577211 0.00060964 154965 0
: 427 Minimum Test error found - save the configuration
: 427 | 555.617 516.982 0.00555968 0.000619751 161946 0
: 428 Minimum Test error found - save the configuration
: 428 | 549.252 511.769 0.00593163 0.00063599 151068 0
: 429 Minimum Test error found - save the configuration
: 429 | 544.099 506.836 0.00562901 0.00060567 159256 0
: 430 Minimum Test error found - save the configuration
: 430 | 538.589 500.691 0.00555097 0.000604401 161728 0
: 431 Minimum Test error found - save the configuration
: 431 | 532.466 496.453 0.00574824 0.000761023 160410 0
: 432 Minimum Test error found - save the configuration
: 432 | 527.333 491.367 0.00588016 0.00061593 151969 0
: 433 Minimum Test error found - save the configuration
: 433 | 521.919 485.169 0.0056924 0.000650621 158674 0
: 434 Minimum Test error found - save the configuration
: 434 | 516.336 480.635 0.00589459 0.000656441 152726 0
: 435 Minimum Test error found - save the configuration
: 435 | 511.048 474.543 0.00604225 0.000813833 153010 0
: 436 Minimum Test error found - save the configuration
: 436 | 505.527 469.643 0.00615076 0.00063355 145001 0
: 437 Minimum Test error found - save the configuration
: 437 | 500.385 464.351 0.0056937 0.00061271 157450 0
: 438 Minimum Test error found - save the configuration
: 438 | 494.927 459.792 0.0056617 0.0006062 158243 0
: 439 Minimum Test error found - save the configuration
: 439 | 490.221 454.798 0.0056696 0.000598609 157760 0
: 440 Minimum Test error found - save the configuration
: 440 | 484.905 450.288 0.00575419 0.00061862 155776 0
: 441 Minimum Test error found - save the configuration
: 441 | 479.771 445.078 0.00571329 0.000612411 156836 0
: 442 Minimum Test error found - save the configuration
: 442 | 474.883 440.51 0.00568035 0.00060061 157488 0
: 443 Minimum Test error found - save the configuration
: 443 | 469.9 435.429 0.00562003 0.00060813 159620 0
: 444 Minimum Test error found - save the configuration
: 444 | 465.152 430.399 0.0058476 0.000796244 158373 0
: 445 Minimum Test error found - save the configuration
: 445 | 459.956 426.203 0.00564807 0.000603791 158595 0
: 446 Minimum Test error found - save the configuration
: 446 | 455.144 421.814 0.00561935 0.00059979 159376 0
: 447 Minimum Test error found - save the configuration
: 447 | 450.649 416.762 0.00563807 0.000632511 159822 0
: 448 Minimum Test error found - save the configuration
: 448 | 445.787 412.689 0.00564337 0.00062656 159464 0
: 449 Minimum Test error found - save the configuration
: 449 | 441.085 407.95 0.00563285 0.00061095 159302 0
: 450 Minimum Test error found - save the configuration
: 450 | 436.702 403.521 0.00568273 0.000614341 157841 0
: 451 Minimum Test error found - save the configuration
: 451 | 431.923 399.135 0.00557177 0.00059588 160775 0
: 452 Minimum Test error found - save the configuration
: 452 | 427.352 394.469 0.0055053 0.000602431 163170 0
: 453 Minimum Test error found - save the configuration
: 453 | 422.896 390.592 0.00557027 0.000601519 161006 0
: 454 Minimum Test error found - save the configuration
: 454 | 418.503 386.316 0.00584483 0.00061776 153049 0
: 455 Minimum Test error found - save the configuration
: 455 | 414.37 382.492 0.00560448 0.000600369 159868 0
: 456 Minimum Test error found - save the configuration
: 456 | 409.791 378.509 0.00553709 0.000593349 161821 0
: 457 Minimum Test error found - save the configuration
: 457 | 405.866 373.533 0.00573368 0.000596499 155728 0
: 458 Minimum Test error found - save the configuration
: 458 | 400.929 369.184 0.00552343 0.000604821 162647 0
: 459 Minimum Test error found - save the configuration
: 459 | 396.817 365.006 0.00555779 0.00058954 161022 0
: 460 Minimum Test error found - save the configuration
: 460 | 392.711 360.878 0.0057328 0.0006209 156498 0
: 461 Minimum Test error found - save the configuration
: 461 | 388.444 357.228 0.00578076 0.000633771 155431 0
: 462 Minimum Test error found - save the configuration
: 462 | 384.461 353.258 0.00600846 0.000645972 149184 0
: 463 Minimum Test error found - save the configuration
: 463 | 380.357 349.156 0.00594501 0.000636951 150714 0
: 464 Minimum Test error found - save the configuration
: 464 | 376.408 345.389 0.00583648 0.000638941 153919 0
: 465 Minimum Test error found - save the configuration
: 465 | 372.208 341.657 0.0061288 0.000752433 148799 0
: 466 Minimum Test error found - save the configuration
: 466 | 368.449 337.743 0.00581253 0.000622581 154144 0
: 467 Minimum Test error found - save the configuration
: 467 | 364.575 334.064 0.00606509 0.000668452 148240 0
: 468 Minimum Test error found - save the configuration
: 468 | 360.697 329.882 0.0065356 0.000634031 135557 0
: 469 Minimum Test error found - save the configuration
: 469 | 356.823 326.436 0.00580435 0.0006133 154111 0
: 470 Minimum Test error found - save the configuration
: 470 | 353.124 323.022 0.00560696 0.000613631 160214 0
: 471 Minimum Test error found - save the configuration
: 471 | 349.48 319.682 0.00581495 0.000650751 154913 0
: 472 Minimum Test error found - save the configuration
: 472 | 345.752 315.313 0.00631418 0.000669132 141717 0
: 473 Minimum Test error found - save the configuration
: 473 | 341.69 312.102 0.00599481 0.000637871 149339 0
: 474 Minimum Test error found - save the configuration
: 474 | 338.255 308.928 0.00586817 0.000683902 154313 0
: 475 Minimum Test error found - save the configuration
: 475 | 334.998 304.995 0.00568308 0.00061709 157916 0
: 476 Minimum Test error found - save the configuration
: 476 | 331.274 301.949 0.00569824 0.000633901 157967 0
: 477 Minimum Test error found - save the configuration
: 477 | 327.439 298.834 0.00564436 0.000623041 159321 0
: 478 Minimum Test error found - save the configuration
: 478 | 323.948 294.86 0.00567039 0.000596671 157675 0
: 479 Minimum Test error found - save the configuration
: 479 | 320.447 290.983 0.00574659 0.00061531 155907 0
: 480 Minimum Test error found - save the configuration
: 480 | 316.877 288.226 0.00552743 0.000605821 162548 0
: 481 Minimum Test error found - save the configuration
: 481 | 313.485 284.781 0.00561911 0.000594429 159214 0
: 482 Minimum Test error found - save the configuration
: 482 | 310.136 281.127 0.00548783 0.00060306 163774 0
: 483 Minimum Test error found - save the configuration
: 483 | 306.661 278.243 0.00565151 0.000597061 158277 0
: 484 Minimum Test error found - save the configuration
: 484 | 303.422 275.242 0.00551161 0.00059263 162635 0
: 485 Minimum Test error found - save the configuration
: 485 | 300.174 272.168 0.00555845 0.000594061 161148 0
: 486 Minimum Test error found - save the configuration
: 486 | 297.176 268.659 0.00566467 0.00061525 158434 0
: 487 Minimum Test error found - save the configuration
: 487 | 293.773 265.698 0.00561184 0.00060374 159741 0
: 488 Minimum Test error found - save the configuration
: 488 | 290.77 262.642 0.00555724 0.000592891 161149 0
: 489 Minimum Test error found - save the configuration
: 489 | 287.446 259.685 0.00563012 0.00061135 159401 0
: 490 Minimum Test error found - save the configuration
: 490 | 284.214 257.662 0.00563171 0.000641511 160314 0
: 491 Minimum Test error found - save the configuration
: 491 | 281.532 254.176 0.00556431 0.00060248 161231 0
: 492 Minimum Test error found - save the configuration
: 492 | 278.241 250.833 0.00604849 0.00062355 147467 0
: 493 Minimum Test error found - save the configuration
: 493 | 275.351 248.111 0.0056249 0.00060016 159212 0
: 494 Minimum Test error found - save the configuration
: 494 | 272.076 245.36 0.00555761 0.000593481 161156 0
: 495 Minimum Test error found - save the configuration
: 495 | 269.161 242.712 0.00561536 0.00060131 159552 0
: 496 Minimum Test error found - save the configuration
: 496 | 266.247 239.989 0.0057333 0.00061388 156268 0
: 497 Minimum Test error found - save the configuration
: 497 | 263.573 236.593 0.00617614 0.000637251 144433 0
: 498 Minimum Test error found - save the configuration
: 498 | 260.465 233.716 0.00629536 0.000653171 141789 0
: 499 Minimum Test error found - save the configuration
: 499 | 257.738 231.288 0.00649706 0.000857544 141856 0
: 500 Minimum Test error found - save the configuration
: 500 | 254.775 228.703 0.00693101 0.000709431 128585 0
: 501 Minimum Test error found - save the configuration
: 501 | 252.02 225.911 0.00626441 0.00061268 141549 0
: 502 Minimum Test error found - save the configuration
: 502 | 249.3 223 0.00675221 0.00063807 130844 0
: 503 Minimum Test error found - save the configuration
: 503 | 246.451 220.738 0.00795961 0.000945215 114051 0
: 504 Minimum Test error found - save the configuration
: 504 | 243.854 218.916 0.00858144 0.000919005 104405 0
: 505 Minimum Test error found - save the configuration
: 505 | 241.143 215.403 0.00685573 0.000595379 127788 0
: 506 Minimum Test error found - save the configuration
: 506 | 238.553 213.445 0.00554254 0.000597299 161772 0
: 507 Minimum Test error found - save the configuration
: 507 | 235.836 210.954 0.00546713 0.0005908 164058 0
: 508 Minimum Test error found - save the configuration
: 508 | 233.343 208.637 0.00547679 0.00059987 164038 0
: 509 Minimum Test error found - save the configuration
: 509 | 230.814 206.49 0.00546653 0.00059601 164253 0
: 510 Minimum Test error found - save the configuration
: 510 | 228.434 204.111 0.00546808 0.000599471 164318 0
: 511 Minimum Test error found - save the configuration
: 511 | 225.889 201.259 0.00563062 0.0006343 160118 0
: 512 Minimum Test error found - save the configuration
: 512 | 223.119 198.318 0.00575676 0.000690871 157919 0
: 513 Minimum Test error found - save the configuration
: 513 | 220.854 195.917 0.00559414 0.000634841 161313 0
: 514 Minimum Test error found - save the configuration
: 514 | 218.61 194.557 0.00564013 0.000637191 159906 0
: 515 Minimum Test error found - save the configuration
: 515 | 216.068 191.708 0.00566469 0.00059773 157885 0
: 516 Minimum Test error found - save the configuration
: 516 | 213.683 189.608 0.00573359 0.000701462 158979 0
: 517 Minimum Test error found - save the configuration
: 517 | 211.534 187.535 0.00569466 0.000622652 157729 0
: 518 Minimum Test error found - save the configuration
: 518 | 209.104 185.002 0.00561553 0.00060286 159595 0
: 519 Minimum Test error found - save the configuration
: 519 | 206.434 182.597 0.00565928 0.00062703 158974 0
: 520 Minimum Test error found - save the configuration
: 520 | 204.193 180.614 0.00560138 0.000621021 160631 0
: 521 Minimum Test error found - save the configuration
: 521 | 202.265 178.378 0.00555868 0.000593149 161111 0
: 522 Minimum Test error found - save the configuration
: 522 | 200.368 176.938 0.00549131 0.000598591 163508 0
: 523 Minimum Test error found - save the configuration
: 523 | 197.765 174.365 0.00551528 0.000596949 162657 0
: 524 Minimum Test error found - save the configuration
: 524 | 195.513 172.228 0.00548995 0.00059276 163359 0
: 525 Minimum Test error found - save the configuration
: 525 | 193.333 170.245 0.00553808 0.000628 162930 0
: 526 Minimum Test error found - save the configuration
: 526 | 191.216 168.378 0.00558746 0.000604621 160551 0
: 527 Minimum Test error found - save the configuration
: 527 | 189.074 166.066 0.00563406 0.000628061 159808 0
: 528 Minimum Test error found - save the configuration
: 528 | 186.864 164.149 0.00565687 0.00063075 159168 0
: 529 Minimum Test error found - save the configuration
: 529 | 184.862 162.623 0.00573608 0.000623181 156467 0
: 530 Minimum Test error found - save the configuration
: 530 | 182.774 160.618 0.00564881 0.00062738 159317 0
: 531 Minimum Test error found - save the configuration
: 531 | 180.487 159.003 0.00606444 0.000664081 148138 0
: 532 Minimum Test error found - save the configuration
: 532 | 178.875 156.821 0.00566459 0.00061961 158573 0
: 533 Minimum Test error found - save the configuration
: 533 | 176.452 154.717 0.00573128 0.00062226 156586 0
: 534 Minimum Test error found - save the configuration
: 534 | 174.806 153.08 0.0070077 0.00065862 126003 0
: 535 Minimum Test error found - save the configuration
: 535 | 172.585 151.148 0.00573361 0.000627242 156667 0
: 536 Minimum Test error found - save the configuration
: 536 | 170.558 149.606 0.00608005 0.000741773 149861 0
: 537 Minimum Test error found - save the configuration
: 537 | 168.678 147.787 0.00806811 0.000638731 107681 0
: 538 Minimum Test error found - save the configuration
: 538 | 166.604 145.855 0.00581285 0.000642941 154742 0
: 539 Minimum Test error found - save the configuration
: 539 | 164.675 143.862 0.00560157 0.000585889 159500 0
: 540 Minimum Test error found - save the configuration
: 540 | 162.788 141.977 0.00571876 0.000677381 158687 0
: 541 Minimum Test error found - save the configuration
: 541 | 160.881 140.848 0.00568325 0.000630991 158345 0
: 542 Minimum Test error found - save the configuration
: 542 | 159.317 138.641 0.00553976 0.000584719 161452 0
: 543 Minimum Test error found - save the configuration
: 543 | 157.544 137.317 0.00575995 0.0006174 155565 0
: 544 Minimum Test error found - save the configuration
: 544 | 155.75 136.479 0.00566572 0.000627071 158773 0
: 545 Minimum Test error found - save the configuration
: 545 | 153.994 134.574 0.00554376 0.00058475 161322 0
: 546 Minimum Test error found - save the configuration
: 546 | 151.943 132.366 0.00751693 0.000635151 116249 0
: 547 Minimum Test error found - save the configuration
: 547 | 150.246 131.378 0.00576979 0.00060111 154779 0
: 548 Minimum Test error found - save the configuration
: 548 | 148.602 129.037 0.00553595 0.00061924 162710 0
: 549 Minimum Test error found - save the configuration
: 549 | 146.915 127.88 0.0057598 0.000653821 156679 0
: 550 Minimum Test error found - save the configuration
: 550 | 145.267 126.247 0.00602363 0.00060529 147647 0
: 551 Minimum Test error found - save the configuration
: 551 | 143.421 124.862 0.00557904 0.00059593 160542 0
: 552 Minimum Test error found - save the configuration
: 552 | 141.571 123.048 0.00562697 0.00061683 159676 0
: 553 Minimum Test error found - save the configuration
: 553 | 139.929 121.625 0.00559259 0.000625141 161048 0
: 554 Minimum Test error found - save the configuration
: 554 | 138.468 120.554 0.00570388 0.000676141 159117 0
: 555 Minimum Test error found - save the configuration
: 555 | 136.984 119.054 0.0057076 0.00061903 157215 0
: 556 Minimum Test error found - save the configuration
: 556 | 135.474 118.207 0.00574192 0.00062033 156202 0
: 557 Minimum Test error found - save the configuration
: 557 | 134.228 116.274 0.00567817 0.000599851 157533 0
: 558 Minimum Test error found - save the configuration
: 558 | 132.408 115.292 0.00556758 0.000599979 161043 0
: 559 Minimum Test error found - save the configuration
: 559 | 130.857 113.479 0.00564366 0.000707202 162059 0
: 560 Minimum Test error found - save the configuration
: 560 | 129.191 111.846 0.00552405 0.000593459 162252 0
: 561 Minimum Test error found - save the configuration
: 561 | 127.643 110.795 0.00554336 0.00060849 162112 0
: 562 Minimum Test error found - save the configuration
: 562 | 126.191 109.096 0.00554089 0.000623901 162701 0
: 563 Minimum Test error found - save the configuration
: 563 | 124.709 107.594 0.00611431 0.000670152 146946 0
: 564 Minimum Test error found - save the configuration
: 564 | 123.158 106.843 0.00578426 0.00060306 154404 0
: 565 Minimum Test error found - save the configuration
: 565 | 121.53 105.873 0.00581064 0.000608069 153770 0
: 566 Minimum Test error found - save the configuration
: 566 | 120.337 103.857 0.00578968 0.000649581 155639 0
: 567 Minimum Test error found - save the configuration
: 567 | 118.778 103.701 0.00608452 0.000728912 149376 0
: 568 Minimum Test error found - save the configuration
: 568 | 117.534 101.121 0.00605343 0.00062141 147275 0
: 569 Minimum Test error found - save the configuration
: 569 | 115.723 100.181 0.00572561 0.00060438 156213 0
: 570 Minimum Test error found - save the configuration
: 570 | 114.452 98.6064 0.00576288 0.000603621 155061 0
: 571 Minimum Test error found - save the configuration
: 571 | 112.938 97.5254 0.00549299 0.00059362 163286 0
: 572 Minimum Test error found - save the configuration
: 572 | 111.773 96.6256 0.00567376 0.00061457 158128 0
: 573 Minimum Test error found - save the configuration
: 573 | 110.523 95.0848 0.00560335 0.000613421 160323 0
: 574 Minimum Test error found - save the configuration
: 574 | 109.113 93.6677 0.00565326 0.00065373 160015 0
: 575 Minimum Test error found - save the configuration
: 575 | 107.832 92.5561 0.00558413 0.000616851 161054 0
: 576 Minimum Test error found - save the configuration
: 576 | 106.867 92.4423 0.00577959 0.000637232 155571 0
: 577 Minimum Test error found - save the configuration
: 577 | 105.206 90.2676 0.0058934 0.00060927 151397 0
: 578 Minimum Test error found - save the configuration
: 578 | 104.064 89.5297 0.00550934 0.00059756 162874 0
: 579 Minimum Test error found - save the configuration
: 579 | 102.736 88.0406 0.0055555 0.000598401 161385 0
: 580 Minimum Test error found - save the configuration
: 580 | 101.629 87.1277 0.00556875 0.00061576 161519 0
: 581 Minimum Test error found - save the configuration
: 581 | 100.569 86.5347 0.00580736 0.000635771 154691 0
: 582 Minimum Test error found - save the configuration
: 582 | 99.3396 85.2275 0.00572168 0.000601661 156250 0
: 583 Minimum Test error found - save the configuration
: 583 | 97.9707 84.1643 0.00593024 0.000703252 153052 0
: 584 Minimum Test error found - save the configuration
: 584 | 96.9417 83.0504 0.00556816 0.000605809 161214 0
: 585 Minimum Test error found - save the configuration
: 585 | 95.8923 81.5509 0.00549508 0.00058895 163061 0
: 586 Minimum Test error found - save the configuration
: 586 | 94.4225 80.6639 0.00546354 0.00059037 164164 0
: 587 Minimum Test error found - save the configuration
: 587 | 93.5451 79.6196 0.00549569 0.000588831 163037 0
: 588 Minimum Test error found - save the configuration
: 588 | 92.5104 78.5263 0.00556167 0.000618 161823 0
: 589 Minimum Test error found - save the configuration
: 589 | 91.2178 78 0.00583039 0.0005991 152926 0
: 590 Minimum Test error found - save the configuration
: 590 | 90.418 77.0184 0.00564033 0.000609061 159005 0
: 591 Minimum Test error found - save the configuration
: 591 | 89.2851 75.7201 0.00557393 0.000605309 161010 0
: 592 Minimum Test error found - save the configuration
: 592 | 88.1416 74.8625 0.00557441 0.00060829 161091 0
: 593 Minimum Test error found - save the configuration
: 593 | 87.1159 74.0622 0.00561556 0.000603141 159604 0
: 594 Minimum Test error found - save the configuration
: 594 | 86.075 73.8569 0.00569227 0.000599289 157079 0
: 595 Minimum Test error found - save the configuration
: 595 | 85.1815 73.1507 0.00547314 0.000602171 164238 0
: 596 Minimum Test error found - save the configuration
: 596 | 84.1401 71.1503 0.00574117 0.00060273 155689 0
: 597 Minimum Test error found - save the configuration
: 597 | 83.0407 70.8872 0.00579303 0.000645311 155409 0
: 598 Minimum Test error found - save the configuration
: 598 | 82.1365 69.3588 0.00583546 0.00062054 153406 0
: 599 Minimum Test error found - save the configuration
: 599 | 81.3205 68.4108 0.00562214 0.000612031 159677 0
: 600 Minimum Test error found - save the configuration
: 600 | 80.4389 68.2222 0.00562259 0.00059737 159197 0
: 601 Minimum Test error found - save the configuration
: 601 | 79.6576 67.4139 0.00556248 0.00061057 161554 0
: 602 Minimum Test error found - save the configuration
: 602 | 78.5132 65.6988 0.00571052 0.000629941 157462 0
: 603 Minimum Test error found - save the configuration
: 603 | 77.4102 65.0733 0.00572554 0.00062464 156835 0
: 604 Minimum Test error found - save the configuration
: 604 | 76.469 64.1821 0.00573392 0.000662901 157759 0
: 605 Minimum Test error found - save the configuration
: 605 | 75.6096 63.4945 0.00575265 0.00061186 155618 0
: 606 Minimum Test error found - save the configuration
: 606 | 74.6881 63.252 0.00556922 0.000596131 160866 0
: 607 Minimum Test error found - save the configuration
: 607 | 73.8624 62.325 0.00619137 0.000618001 143540 0
: 608 Minimum Test error found - save the configuration
: 608 | 72.9421 60.6346 0.00731133 0.000740032 121742 0
: 609 Minimum Test error found - save the configuration
: 609 | 72.049 60.2368 0.00730642 0.00061356 119530 0
: 610 Minimum Test error found - save the configuration
: 610 | 71.1157 59.868 0.00565247 0.00060074 158361 0
: 611 Minimum Test error found - save the configuration
: 611 | 70.4474 59.4236 0.00569329 0.000748033 161771 0
: 612 Minimum Test error found - save the configuration
: 612 | 69.8774 58.414 0.0056006 0.000596169 159858 0
: 613 Minimum Test error found - save the configuration
: 613 | 68.9091 57.6798 0.00549596 0.00059865 163355 0
: 614 Minimum Test error found - save the configuration
: 614 | 68.1957 56.0729 0.00565812 0.000617131 158699 0
: 615 Minimum Test error found - save the configuration
: 615 | 67.2209 55.7292 0.00557118 0.000603389 161037 0
: 616 Minimum Test error found - save the configuration
: 616 | 66.2478 55.2261 0.00583183 0.00060931 153183 0
: 617 Minimum Test error found - save the configuration
: 617 | 65.5179 54.1248 0.00557357 0.000594191 160662 0
: 618 Minimum Test error found - save the configuration
: 618 | 64.6489 53.3631 0.00546209 0.00059017 164206 0
: 619 Minimum Test error found - save the configuration
: 619 | 64.2513 52.9644 0.00546105 0.0005858 164094 0
: 620 | 63.8734 53.0492 0.00543296 0.000554539 163987 1
: 621 Minimum Test error found - save the configuration
: 621 | 62.7493 52.4607 0.00545388 0.000586971 164375 0
: 622 Minimum Test error found - save the configuration
: 622 | 62.1171 50.8286 0.0054614 0.00059613 164431 0
: 623 | 61.139 50.8325 0.00540446 0.000542458 164541 1
: 624 Minimum Test error found - save the configuration
: 624 | 60.3855 49.6232 0.00545313 0.0005909 164533 0
: 625 Minimum Test error found - save the configuration
: 625 | 59.7549 48.4373 0.00546542 0.00059055 164107 0
: 626 Minimum Test error found - save the configuration
: 626 | 58.8256 48.341 0.00556911 0.000636831 162197 0
: 627 Minimum Test error found - save the configuration
: 627 | 58.0689 47.5151 0.00574084 0.000720873 159364 0
: 628 Minimum Test error found - save the configuration
: 628 | 57.6802 47.1131 0.00576435 0.000589139 154583 0
: 629 Minimum Test error found - save the configuration
: 629 | 56.7551 45.858 0.00549889 0.00061139 163683 0
: 630 Minimum Test error found - save the configuration
: 630 | 56.1272 45.2051 0.00554162 0.00061125 162259 0
: 631 Minimum Test error found - save the configuration
: 631 | 55.4404 44.3673 0.00556358 0.00060367 161293 0
: 632 Minimum Test error found - save the configuration
: 632 | 54.6576 43.9418 0.00552809 0.00059068 162028 0
: 633 Minimum Test error found - save the configuration
: 633 | 53.9573 43.6626 0.00555156 0.000595439 161416 0
: 634 Minimum Test error found - save the configuration
: 634 | 53.4055 43.1383 0.00565478 0.000599001 158235 0
: 635 Minimum Test error found - save the configuration
: 635 | 52.7743 41.7625 0.00570894 0.000601701 156641 0
: 636 | 52.1855 41.7698 0.00554203 0.000560089 160580 1
: 637 Minimum Test error found - save the configuration
: 637 | 51.6267 41.4175 0.00564235 0.000603811 158776 0
: 638 Minimum Test error found - save the configuration
: 638 | 51.0023 40.4194 0.00556769 0.000601409 161086 0
: 639 Minimum Test error found - save the configuration
: 639 | 50.3686 40.2795 0.00591622 0.00060767 150700 0
: 640 Minimum Test error found - save the configuration
: 640 | 49.5271 39.6689 0.00573612 0.00061436 156196 0
: 641 Minimum Test error found - save the configuration
: 641 | 48.9757 38.6007 0.00566866 0.000595121 157681 0
: 642 Minimum Test error found - save the configuration
: 642 | 48.5679 38.2285 0.00583716 0.0006074 152971 0
: 643 Minimum Test error found - save the configuration
: 643 | 48.1042 37.7131 0.00566103 0.00060382 158190 0
: 644 Minimum Test error found - save the configuration
: 644 | 47.169 37.6061 0.00557631 0.000600831 160788 0
: 645 Minimum Test error found - save the configuration
: 645 | 46.6694 36.6518 0.00556491 0.00059753 161051 0
: 646 Minimum Test error found - save the configuration
: 646 | 46.2845 36.1457 0.00557932 0.00061033 160998 0
: 647 Minimum Test error found - save the configuration
: 647 | 45.6382 35.9866 0.00556662 0.00060158 161126 0
: 648 Minimum Test error found - save the configuration
: 648 | 44.9913 35.2155 0.00556385 0.00060949 161474 0
: 649 Minimum Test error found - save the configuration
: 649 | 44.5198 34.814 0.00559672 0.00061219 160496 0
: 650 | 43.8985 34.8682 0.00554027 0.000559269 160610 1
: 651 Minimum Test error found - save the configuration
: 651 | 43.4353 33.4062 0.00578288 0.00060996 154652 0
: 652 | 42.9575 33.6362 0.00586989 0.000636211 152856 1
: 653 Minimum Test error found - save the configuration
: 653 | 42.2913 32.7775 0.00568191 0.0005983 157369 0
: 654 Minimum Test error found - save the configuration
: 654 | 42.1621 32.3182 0.00578914 0.00062356 154871 0
: 655 | 41.6903 32.8892 0.00573696 0.00056562 154699 1
: 656 Minimum Test error found - save the configuration
: 656 | 40.8418 31.8407 0.00585067 0.00064047 153545 0
: 657 Minimum Test error found - save the configuration
: 657 | 40.39 31.2729 0.00567686 0.00059519 157429 0
: 658 | 40.1007 31.4349 0.00574815 0.000556519 154094 1
: 659 Minimum Test error found - save the configuration
: 659 | 39.5332 30.3503 0.00578163 0.00060339 154493 0
: 660 Minimum Test error found - save the configuration
: 660 | 39.0265 29.6617 0.00572571 0.0006109 156409 0
: 661 | 38.5144 30.1727 0.00573633 0.000678002 158155 1
: 662 Minimum Test error found - save the configuration
: 662 | 38.1871 29.5757 0.00572302 0.000589549 155840 0
: 663 Minimum Test error found - save the configuration
: 663 | 37.6966 28.7539 0.00569773 0.00059629 156819 0
: 664 Minimum Test error found - save the configuration
: 664 | 37.2175 28.2472 0.00554161 0.00059343 161676 0
: 665 Minimum Test error found - save the configuration
: 665 | 36.7142 28.1719 0.00555713 0.000604519 161531 0
: 666 Minimum Test error found - save the configuration
: 666 | 36.4074 27.0868 0.00549414 0.00058947 163110 0
: 667 Minimum Test error found - save the configuration
: 667 | 35.8781 27.0208 0.00562819 0.00063909 160349 0
: 668 Minimum Test error found - save the configuration
: 668 | 35.5023 26.7891 0.0057735 0.000599359 154615 0
: 669 Minimum Test error found - save the configuration
: 669 | 35.0941 26.6481 0.00570845 0.000631101 157563 0
: 670 | 34.8674 26.6813 0.00543219 0.000549789 163854 1
: 671 Minimum Test error found - save the configuration
: 671 | 34.0939 25.3853 0.00547371 0.00059839 164092 0
: 672 Minimum Test error found - save the configuration
: 672 | 33.6067 24.9373 0.00552308 0.00062002 163163 0
: 673 | 33.4144 25.0793 0.00550256 0.0005685 162138 1
: 674 Minimum Test error found - save the configuration
: 674 | 32.9207 24.5333 0.00550847 0.00062738 163898 0
: 675 Minimum Test error found - save the configuration
: 675 | 32.3316 23.9875 0.00593458 0.00061935 150511 0
: 676 Minimum Test error found - save the configuration
: 676 | 32.1983 23.2388 0.00554706 0.00060172 161768 0
: 677 Minimum Test error found - save the configuration
: 677 | 31.8258 23.1697 0.005643 0.00062735 159501 0
: 678 | 31.2325 23.2591 0.00563836 0.000549009 157191 1
: 679 Minimum Test error found - save the configuration
: 679 | 30.9087 22.4828 0.00556094 0.000613141 161688 0
: 680 Minimum Test error found - save the configuration
: 680 | 30.4275 22.4522 0.00558495 0.000594829 160317 0
: 681 Minimum Test error found - save the configuration
: 681 | 30.0545 22.1487 0.00559846 0.00060532 160220 0
: 682 Minimum Test error found - save the configuration
: 682 | 29.517 21.4836 0.00563334 0.000594021 158752 0
: 683 Minimum Test error found - save the configuration
: 683 | 29.2894 21.0924 0.00571107 0.00061989 157135 0
: 684 Minimum Test error found - save the configuration
: 684 | 28.8729 20.4783 0.0054821 0.000596161 163735 0
: 685 Minimum Test error found - save the configuration
: 685 | 28.4223 20.2443 0.00548784 0.00059985 163666 0
: 686 Minimum Test error found - save the configuration
: 686 | 28.2849 20.1262 0.00549149 0.000601161 163588 0
: 687 | 27.7632 20.1865 0.00563245 0.000586349 158538 1
: 688 Minimum Test error found - save the configuration
: 688 | 27.5273 19.8991 0.00590791 0.00064612 152040 0
: 689 Minimum Test error found - save the configuration
: 689 | 27.3344 19.3014 0.00578356 0.0006676 156374 0
: 690 Minimum Test error found - save the configuration
: 690 | 26.8702 18.7858 0.00612424 0.000714312 147876 0
: 691 Minimum Test error found - save the configuration
: 691 | 26.3454 18.4396 0.00598234 0.00060454 148760 0
: 692 | 26.1285 18.9609 0.00632758 0.000646702 140823 1
: 693 | 25.7881 18.5437 0.00569066 0.000554938 155772 2
: 694 Minimum Test error found - save the configuration
: 694 | 25.2836 17.4837 0.00590089 0.000689282 153504 0
: 695 | 24.9961 17.6915 0.00576196 0.000591759 154733 1
: 696 Minimum Test error found - save the configuration
: 696 | 24.9755 16.9771 0.00547663 0.000590191 163718 0
: 697 Minimum Test error found - save the configuration
: 697 | 24.3614 16.583 0.00547072 0.000597949 164178 0
: 698 Minimum Test error found - save the configuration
: 698 | 23.9527 16.5048 0.00568329 0.000662572 159340 0
: 699 Minimum Test error found - save the configuration
: 699 | 23.6569 16.2664 0.00589 0.000666122 153143 0
: 700 | 23.3287 16.6773 0.00579739 0.000647501 155343 1
: 701 Minimum Test error found - save the configuration
: 701 | 23.1491 15.963 0.00611637 0.000664631 146742 0
: 702 Minimum Test error found - save the configuration
: 702 | 22.8136 15.7629 0.00624602 0.000626741 142367 0
: 703 Minimum Test error found - save the configuration
: 703 | 22.5705 15.6745 0.00621889 0.000685861 144586 0
: 704 Minimum Test error found - save the configuration
: 704 | 22.3036 15.3511 0.00576338 0.000625301 155700 0
: 705 | 21.9064 15.6699 0.00572374 0.00058746 155755 1
: 706 Minimum Test error found - save the configuration
: 706 | 21.5839 14.6814 0.00554947 0.000593919 161435 0
: 707 | 21.2107 14.8825 0.00540776 0.00054307 164450 1
: 708 Minimum Test error found - save the configuration
: 708 | 21.1178 13.8308 0.00548597 0.000600279 163743 0
: 709 | 20.8239 14.4389 0.00553871 0.00058088 161361 1
: 710 Minimum Test error found - save the configuration
: 710 | 20.6089 13.4139 0.00552868 0.00059557 162169 0
: 711 Minimum Test error found - save the configuration
: 711 | 20.3348 13.0364 0.00573541 0.000606621 155982 0
: 712 Minimum Test error found - save the configuration
: 712 | 19.9597 12.837 0.005508 0.000589089 162638 0
: 713 | 19.7729 13.3126 0.0054756 0.000598991 164048 1
: 714 Minimum Test error found - save the configuration
: 714 | 19.4637 12.8008 0.00546304 0.000587149 164073 0
: 715 Minimum Test error found - save the configuration
: 715 | 19.1593 12.5422 0.00563986 0.000640971 160036 0
: 716 | 18.9307 12.6994 0.00556001 0.000569491 160304 1
: 717 Minimum Test error found - save the configuration
: 717 | 18.7629 12.2512 0.00554125 0.000593 161673 0
: 718 Minimum Test error found - save the configuration
: 718 | 18.5167 12.0868 0.00553605 0.000607731 162327 0
: 719 Minimum Test error found - save the configuration
: 719 | 18.3195 11.6712 0.00553243 0.00059531 162038 0
: 720 Minimum Test error found - save the configuration
: 720 | 17.8393 11.4256 0.00554479 0.0006138 162239 0
: 721 Minimum Test error found - save the configuration
: 721 | 17.7634 10.8972 0.00571282 0.00064945 157998 0
: 722 Minimum Test error found - save the configuration
: 722 | 17.4316 10.6059 0.00584271 0.000681941 155016 0
: 723 | 17.2412 10.7827 0.00594978 0.000560449 148441 1
: 724 | 16.95 10.698 0.00557037 0.00056051 159685 2
: 725 | 16.8566 10.9591 0.00552059 0.000577829 161853 3
: 726 Minimum Test error found - save the configuration
: 726 | 16.8463 10.5496 0.00556169 0.00061026 161569 0
: 727 Minimum Test error found - save the configuration
: 727 | 16.5125 10.1344 0.00562444 0.000641681 160553 0
: 728 Minimum Test error found - save the configuration
: 728 | 16.1944 9.70408 0.00583053 0.00060011 152951 0
: 729 Minimum Test error found - save the configuration
: 729 | 16.2302 9.26959 0.00587746 0.000672611 153703 0
: 730 | 15.9506 9.89084 0.00595299 0.000669171 151406 1
: 731 | 15.4263 9.30871 0.00558268 0.000561049 159311 2
: 732 | 15.2198 9.54473 0.00580825 0.00054964 152132 3
: 733 Minimum Test error found - save the configuration
: 733 | 15.2982 9.24998 0.0057092 0.000673761 158874 0
: 734 Minimum Test error found - save the configuration
: 734 | 15.0237 8.68042 0.00570824 0.000611379 156959 0
: 735 Minimum Test error found - save the configuration
: 735 | 14.6496 8.14007 0.00558286 0.000624771 161352 0
: 736 | 14.4899 8.4161 0.00558696 0.000572609 159542 1
: 737 | 14.1854 8.19426 0.00553205 0.000561899 160961 2
: 738 Minimum Test error found - save the configuration
: 738 | 13.9452 7.91962 0.00608651 0.000644131 146994 0
: 739 | 13.8774 7.97033 0.00588335 0.000559459 150266 1
: 740 Minimum Test error found - save the configuration
: 740 | 13.723 7.76332 0.00574204 0.000610841 155909 0
: 741 | 13.8956 8.27387 0.00592718 0.000647782 151532 1
: 742 | 13.4509 8.20745 0.00592312 0.00058702 149922 2
: 743 Minimum Test error found - save the configuration
: 743 | 13.3315 7.65602 0.00557577 0.00059537 160630 0
: 744 Minimum Test error found - save the configuration
: 744 | 12.944 7.41348 0.00578392 0.00060992 154619 0
: 745 | 12.7606 7.93499 0.00578292 0.00054928 152857 1
: 746 Minimum Test error found - save the configuration
: 746 | 12.6152 7.26126 0.00574458 0.000610379 155818 0
: 747 | 12.362 7.30227 0.00580128 0.000559019 152606 1
: 748 Minimum Test error found - save the configuration
: 748 | 12.1465 6.9374 0.00611925 0.000939086 154435 0
: 749 | 12.2723 7.09391 0.00579092 0.000554129 152765 1
: 750 | 12.2352 7.37599 0.00577676 0.000788023 160361 2
: 751 Minimum Test error found - save the configuration
: 751 | 11.8294 6.68291 0.00605462 0.00062395 147311 0
: 752 | 11.5779 6.83845 0.00596643 0.000577569 148454 1
: 753 | 11.3048 6.74725 0.00585241 0.00061619 152782 2
: 754 | 11.2632 6.71768 0.00612033 0.000561279 143909 3
: 755 | 11.1586 6.95306 0.00577568 0.000558029 153326 4
: 756 | 10.9507 7.16181 0.0057568 0.000569571 154225 5
: 757 Minimum Test error found - save the configuration
: 757 | 10.7882 6.65891 0.00564492 0.00060888 158855 0
: 758 | 10.764 7.11314 0.0056033 0.000565779 158808 1
: 759 Minimum Test error found - save the configuration
: 759 | 10.9376 6.20396 0.0056508 0.000610441 158719 0
: 760 | 10.6636 6.70618 0.00554139 0.000560019 160598 1
: 761 Minimum Test error found - save the configuration
: 761 | 10.3248 6.03534 0.00559179 0.00060358 160378 0
: 762 Minimum Test error found - save the configuration
: 762 | 10.0767 5.8619 0.00610383 0.000607471 145551 0
: 763 Minimum Test error found - save the configuration
: 763 | 10.0556 5.74094 0.00552531 0.00060022 162433 0
: 764 | 10.2009 7.18313 0.00714083 0.000895675 128099 1
: 765 | 10.0621 6.09266 0.00674173 0.000587449 129991 2
: 766 | 9.61834 6.30496 0.0072201 0.000708582 122859 3
: 767 | 9.55354 5.90655 0.00816867 0.000816455 108811 4
: 768 Minimum Test error found - save the configuration
: 768 | 9.53148 5.68098 0.00585578 0.00060035 152224 0
: 769 | 9.38235 6.03098 0.00555998 0.00059038 160979 1
: 770 Minimum Test error found - save the configuration
: 770 | 9.16468 5.47768 0.00566563 0.000627541 158790 0
: 771 | 8.99121 6.24216 0.00567695 0.00057062 156668 1
: 772 | 9.02503 5.81682 0.00575973 0.000580179 154454 2
: 773 | 9.13623 5.82339 0.00557269 0.000566969 159817 3
: 774 | 8.84221 5.57995 0.00561987 0.00056263 158189 4
: 775 Minimum Test error found - save the configuration
: 775 | 8.5299 5.04888 0.00572063 0.00061651 156736 0
: 776 | 8.39646 5.5056 0.00560234 0.000574459 159113 1
: 777 | 8.20659 5.65344 0.00564507 0.00056573 157501 2
: 778 | 8.08039 5.37456 0.00574459 0.000558149 154248 3
: 779 Minimum Test error found - save the configuration
: 779 | 8.004 4.79902 0.00587201 0.000745802 156061 0
: 780 | 7.9615 5.23891 0.00781621 0.000967277 116806 1
: 781 | 7.79943 5.23872 0.00757327 0.000598261 114695 2
: 782 | 7.74949 5.69923 0.00559241 0.00058796 159858 3
: 783 | 7.62795 5.05218 0.00564152 0.000575529 157916 4
: 784 | 7.48954 5.52441 0.00554273 0.00054741 160150 5
: 785 | 7.68916 5.48366 0.00558796 0.000567889 159360 6
: 786 | 7.4165 5.52765 0.00576859 0.000572409 153959 7
: 787 | 7.34635 5.20493 0.00558752 0.00055162 158860 8
: 788 | 7.26926 5.19653 0.00575468 0.00057087 154327 9
: 789 | 7.25527 5.04093 0.0056074 0.00058499 159286 10
: 790 | 7.13408 4.9515 0.00560237 0.00056002 158656 11
: 791 Minimum Test error found - save the configuration
: 791 | 6.93786 4.53606 0.00617888 0.000626951 144094 0
: 792 | 6.8242 5.04357 0.00566943 0.000549439 156250 1
: 793 | 6.75029 4.62548 0.00573484 0.000588079 155438 2
: 794 | 6.59601 4.6056 0.00578976 0.00060391 154266 3
: 795 | 6.67622 4.63565 0.00559997 0.00056036 158743 4
: 796 | 6.49637 4.57494 0.00598817 0.00061476 148881 5
: 797 Minimum Test error found - save the configuration
: 797 | 6.40817 4.047 0.00610662 0.000649171 146589 0
: 798 | 6.34008 4.5315 0.00596296 0.000614611 149579 1
: 799 | 6.26787 4.82185 0.00594718 0.000615441 150045 2
: 800 | 6.08719 4.41848 0.00674053 0.000592539 130124 3
: 801 | 5.99534 4.40186 0.0064243 0.00059231 137175 4
: 802 | 6.01678 4.37837 0.00652243 0.000686921 137092 5
: 803 | 5.87915 4.70115 0.00629986 0.000609951 140600 6
: 804 | 5.86706 4.7219 0.00693927 0.000879795 132025 7
: 805 | 5.83166 4.52883 0.00742325 0.000601409 117270 8
: 806 | 5.75936 4.43027 0.00567661 0.000578161 156911 9
: 807 | 5.71129 4.82034 0.00619708 0.0006343 143813 10
: 808 | 5.60774 4.792 0.00595005 0.000629241 150353 11
: 809 | 5.48056 4.25993 0.00599395 0.00064349 149520 12
: 810 | 5.40997 4.44622 0.00582442 0.000640051 154310 13
: 811 | 5.52498 4.27372 0.00606727 0.00060952 146580 14
: 812 | 5.47392 4.42058 0.00585081 0.00058627 151960 15
: 813 | 5.32654 4.17462 0.00557556 0.00055085 159213 16
: 814 | 5.29728 4.37852 0.00560381 0.00057391 159049 17
: 815 | 5.381 6.13948 0.00564902 0.00057597 157696 18
: 816 | 5.62232 4.0938 0.00583376 0.000618552 153398 19
: 817 | 5.29336 4.93937 0.00589024 0.000590341 150946 20
: 818 | 5.35776 4.29481 0.00612036 0.000628431 145668 21
:
: Elapsed time for training with 1000 events: 4.68 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of DNN_CPU on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.011 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_DNN_CPU.weights.xml␛[0m
Factory : Training finished
:
Factory : Train method: BDTG for Regression
:
: Regression Loss Function: Huber
: Training 2000 Decision Trees ... patience please
: Elapsed time for training with 1000 events: 0.98 sec
: Dataset[datasetreg] : Create results for training
: Dataset[datasetreg] : Evaluation of BDTG on training sample
: Dataset[datasetreg] : Elapsed time for evaluation of 1000 events: 0.167 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
: Creating xml weight file: ␛[0;36mdatasetreg/weights/TMVARegression_BDTG.weights.xml␛[0m
: TMVAReg.root:/datasetreg/Method_BDT/BDTG
Factory : Training finished
:
TH1.Print Name = TrainingHistory_DNN_CPU_trainingError, Entries= 0, Total sum= 3.27847e+06
TH1.Print Name = TrainingHistory_DNN_CPU_valError, Entries= 0, Total sum= 3.05478e+06
Factory : === Destroy and recreate all methods via weight files for testing ===
:
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights.xml␛[0m
: Read foams from file: ␛[0;36mdatasetreg/weights/TMVARegression_PDEFoam.weights_foams.root␛[0m
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_KNN.weights.xml␛[0m
: Creating kd-tree with 1000 events
: Computing scale factor for 1d distributions: (ifrac, bottom, top) = (80%, 10%, 90%)
ModulekNN : Optimizing tree for 2 variables with 1000 values
: <Fill> Class 1 has 1000 events
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_LD.weights.xml␛[0m
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_DNN_CPU.weights.xml␛[0m
: Reading weight file: ␛[0;36mdatasetreg/weights/TMVARegression_BDTG.weights.xml␛[0m
Factory : ␛[1mTest all methods␛[0m
Factory : Test method: PDEFoam for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of PDEFoam on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.0373 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: KNN for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of KNN on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.0428 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: LD for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of LD on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.00149 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: DNN_CPU for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of DNN_CPU on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 0.0782 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : Test method: BDTG for Regression performance
:
: Dataset[datasetreg] : Create results for testing
: Dataset[datasetreg] : Evaluation of BDTG on testing sample
: Dataset[datasetreg] : Elapsed time for evaluation of 9000 events: 1 sec
: Create variable histograms
: Create regression target histograms
: Create regression average deviation
: Results created
Factory : ␛[1mEvaluate all methods␛[0m
: Evaluate regression method: PDEFoam
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.0253 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.00325 sec
TFHandler_PDEFoam : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: KNN
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.0445 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.00567 sec
TFHandler_KNN : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: LD
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.00195 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.000356 sec
TFHandler_LD : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: DNN_CPU
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.0773 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.00898 sec
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.024550 1.1432 [ -3.3781 5.7307 ]
: var2: 0.069724 1.0759 [ -5.7307 5.7307 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
TFHandler_DNN_CPU : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 0.024550 1.1432 [ -3.3781 5.7307 ]
: var2: 0.069724 1.0759 [ -5.7307 5.7307 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
: Evaluate regression method: BDTG
: TestRegression (testing)
: Calculate regression for all events
: Elapsed time for evaluation of 9000 events: 0.99 sec
: TestRegression (training)
: Calculate regression for all events
: Elapsed time for evaluation of 1000 events: 0.108 sec
TFHandler_BDTG : Variable Mean RMS [ Min Max ]
: -----------------------------------------------------------
: var1: 3.3370 1.1877 [ 0.00020069 5.0000 ]
: var2: 2.4902 1.4378 [ 0.00071490 5.0000 ]
: fvalue: 164.24 84.217 [ 1.6186 394.84 ]
: -----------------------------------------------------------
:
: Evaluation results ranked by smallest RMS on test sample:
: ("Bias" quotes the mean deviation of the regression from true target.
: "MutInf" is the "Mutual Information" between regression and target.
: Indicated by "_T" are the corresponding "truncated" quantities ob-
: tained when removing events deviating more than 2sigma from average.)
: --------------------------------------------------------------------------------------------------
: --------------------------------------------------------------------------------------------------
: datasetreg BDTG : 0.0726 0.0940 2.42 1.85 | 3.152 3.185
: datasetreg DNN_CPU : -1.23 -0.178 6.84 1.70 | 3.194 3.212
: datasetreg KNN : -1.25 0.0612 7.84 4.47 | 2.870 2.864
: datasetreg PDEFoam : -1.10 -0.585 10.2 8.00 | 2.281 2.331
: datasetreg LD : -0.301 1.50 19.9 17.9 | 1.984 1.960
: --------------------------------------------------------------------------------------------------
:
: Evaluation results ranked by smallest RMS on training sample:
: (overtraining check)
: --------------------------------------------------------------------------------------------------
: DataSet Name: MVA Method: <Bias> <Bias_T> RMS RMS_T | MutInf MutInf_T
: --------------------------------------------------------------------------------------------------
: datasetreg BDTG : 0.0303 0.00204 0.468 0.243 | 3.467 3.492
: datasetreg DNN_CPU : -0.358 -0.103 2.39 1.16 | 3.367 3.359
: datasetreg KNN : -0.486 0.354 5.18 3.61 | 2.948 2.988
: datasetreg PDEFoam :-3.12e-07 0.265 7.58 6.09 | 2.514 2.592
: datasetreg LD :-9.54e-07 1.31 19.0 17.5 | 2.081 2.113
: --------------------------------------------------------------------------------------------------
:
Dataset:datasetreg : Created tree 'TestTree' with 9000 events
:
Dataset:datasetreg : Created tree 'TrainTree' with 1000 events
:
Factory : ␛[1mThank you for using TMVA!␛[0m
: ␛[1mFor citation information, please visit: http://tmva.sf.net/citeTMVA.html␛[0m
==> Wrote root file: TMVAReg.root
==> TMVARegression is done!
#include <cstdlib>
#include <iostream>
#include <map>
#include <string>
#include "TChain.h"
#include "TFile.h"
#include "TTree.h"
#include "TString.h"
#include "TObjString.h"
#include "TSystem.h"
#include "TROOT.h"
#include "TMVA/Tools.h"
#include "TMVA/Factory.h"
#include "TMVA/DataLoader.h"
#include "TMVA/TMVARegGui.h"
using namespace TMVA;
void TMVARegression( TString myMethodList = "" )
{
// The explicit loading of the shared libTMVA is done in TMVAlogon.C, defined in .rootrc
// if you use your private .rootrc, or run from a different directory, please copy the
// corresponding lines from .rootrc
// methods to be processed can be given as an argument; use format:
//
// mylinux~> root -l TMVARegression.C\‍(\"myMethod1,myMethod2,myMethod3\"\‍)
//
//---------------------------------------------------------------
// This loads the library
TMVA::Tools::Instance();
// Default MVA methods to be trained + tested
std::map<std::string,int> Use;
// Mutidimensional likelihood and Nearest-Neighbour methods
Use["PDERS"] = 0;
Use["PDEFoam"] = 1;
Use["KNN"] = 1;
//
// Linear Discriminant Analysis
Use["LD"] = 1;
//
// Function Discriminant analysis
Use["FDA_GA"] = 0;
Use["FDA_MC"] = 0;
Use["FDA_MT"] = 0;
Use["FDA_GAMT"] = 0;
//
// Neural Network
Use["MLP"] = 0;
// Deep neural network (with CPU or GPU)
#ifdef R__HAS_TMVAGPU
Use["DNN_GPU"] = 1;
Use["DNN_CPU"] = 0;
#else
Use["DNN_GPU"] = 0;
#ifdef R__HAS_TMVACPU
Use["DNN_CPU"] = 1;
#else
Use["DNN_CPU"] = 0;
#endif
#endif
//
// Support Vector Machine
Use["SVM"] = 0;
//
// Boosted Decision Trees
Use["BDT"] = 0;
Use["BDTG"] = 1;
// ---------------------------------------------------------------
std::cout << std::endl;
std::cout << "==> Start TMVARegression" << std::endl;
// Select methods (don't look at this code - not of interest)
if (myMethodList != "") {
for (std::map<std::string,int>::iterator it = Use.begin(); it != Use.end(); it++) it->second = 0;
std::vector<TString> mlist = gTools().SplitString( myMethodList, ',' );
for (UInt_t i=0; i<mlist.size(); i++) {
std::string regMethod(mlist[i].Data());
if (Use.find(regMethod) == Use.end()) {
std::cout << "Method \"" << regMethod << "\" not known in TMVA under this name. Choose among the following:" << std::endl;
for (std::map<std::string,int>::iterator it = Use.begin(); it != Use.end(); it++) std::cout << it->first << " ";
std::cout << std::endl;
return;
}
Use[regMethod] = 1;
}
}
// --------------------------------------------------------------------------------------------------
// Here the preparation phase begins
// Create a new root output file
TString outfileName( "TMVAReg.root" );
TFile* outputFile = TFile::Open( outfileName, "RECREATE" );
// Create the factory object. Later you can choose the methods
// whose performance you'd like to investigate. The factory will
// then run the performance analysis for you.
//
// The first argument is the base of the name of all the
// weightfiles in the directory weight/
//
// The second argument is the output file for the training results
// All TMVA output can be suppressed by removing the "!" (not) in
// front of the "Silent" argument in the option string
TMVA::Factory *factory = new TMVA::Factory( "TMVARegression", outputFile,
"!V:!Silent:Color:DrawProgressBar:AnalysisType=Regression" );
TMVA::DataLoader *dataloader=new TMVA::DataLoader("datasetreg");
// If you wish to modify default settings
// (please check "src/Config.h" to see all available global options)
//
// (TMVA::gConfig().GetVariablePlotting()).fTimesRMS = 8.0;
// (TMVA::gConfig().GetIONames()).fWeightFileDir = "myWeightDirectory";
// Define the input variables that shall be used for the MVA training
// note that you may also use variable expressions, such as: "3*var1/var2*abs(var3)"
// [all types of expressions that can also be parsed by TTree::Draw( "expression" )]
dataloader->AddVariable( "var1", "Variable 1", "units", 'F' );
dataloader->AddVariable( "var2", "Variable 2", "units", 'F' );
// You can add so-called "Spectator variables", which are not used in the MVA training,
// but will appear in the final "TestTree" produced by TMVA. This TestTree will contain the
// input variables, the response values of all trained MVAs, and the spectator variables
dataloader->AddSpectator( "spec1:=var1*2", "Spectator 1", "units", 'F' );
dataloader->AddSpectator( "spec2:=var1*3", "Spectator 2", "units", 'F' );
// Add the variable carrying the regression target
dataloader->AddTarget( "fvalue" );
// It is also possible to declare additional targets for multi-dimensional regression, ie:
// factory->AddTarget( "fvalue2" );
// BUT: this is currently ONLY implemented for MLP
// Read training and test data (see TMVAClassification for reading ASCII files)
// load the signal and background event samples from ROOT trees
TFile *input(nullptr);
TString fname = gROOT->GetTutorialDir() + "/tmva/data/tmva_reg_example.root";
if (!gSystem->AccessPathName( fname )) {
input = TFile::Open( fname ); // check if file in local directory exists
}
if (!input) {
std::cout << "ERROR: could not open data file" << std::endl;
exit(1);
}
std::cout << "--- TMVARegression : Using input file: " << input->GetName() << std::endl;
// Register the regression tree
TTree *regTree = (TTree*)input->Get("TreeR");
// global event weights per tree (see below for setting event-wise weights)
Double_t regWeight = 1.0;
// You can add an arbitrary number of regression trees
dataloader->AddRegressionTree( regTree, regWeight );
// This would set individual event weights (the variables defined in the
// expression need to exist in the original TTree)
dataloader->SetWeightExpression( "var1", "Regression" );
// Apply additional cuts on the signal and background samples (can be different)
TCut mycut = ""; // for example: TCut mycut = "abs(var1)<0.5 && abs(var2-0.5)<1";
// tell the DataLoader to use all remaining events in the trees after training for testing:
dataloader->PrepareTrainingAndTestTree( mycut,
"nTrain_Regression=1000:nTest_Regression=0:SplitMode=Random:NormMode=NumEvents:!V" );
//
// dataloader->PrepareTrainingAndTestTree( mycut,
// "nTrain_Regression=0:nTest_Regression=0:SplitMode=Random:NormMode=NumEvents:!V" );
// If no numbers of events are given, half of the events in the tree are used
// for training, and the other half for testing:
//
// dataloader->PrepareTrainingAndTestTree( mycut, "SplitMode=random:!V" );
// Book MVA methods
//
// Please lookup the various method configuration options in the corresponding cxx files, eg:
// src/MethoCuts.cxx, etc, or here: http://tmva.sourceforge.net/old_site/optionRef.html
// it is possible to preset ranges in the option string in which the cut optimisation should be done:
// "...:CutRangeMin[2]=-1:CutRangeMax[2]=1"...", where [2] is the third input variable
// PDE - RS method
if (Use["PDERS"])
factory->BookMethod( dataloader, TMVA::Types::kPDERS, "PDERS",
"!H:!V:NormTree=T:VolumeRangeMode=Adaptive:KernelEstimator=Gauss:GaussSigma=0.3:NEventsMin=40:NEventsMax=60:VarTransform=None" );
// And the options strings for the MinMax and RMS methods, respectively:
//
// "!H:!V:VolumeRangeMode=MinMax:DeltaFrac=0.2:KernelEstimator=Gauss:GaussSigma=0.3" );
// "!H:!V:VolumeRangeMode=RMS:DeltaFrac=3:KernelEstimator=Gauss:GaussSigma=0.3" );
if (Use["PDEFoam"])
factory->BookMethod( dataloader, TMVA::Types::kPDEFoam, "PDEFoam",
"!H:!V:MultiTargetRegression=F:TargetSelection=Mpv:TailCut=0.001:VolFrac=0.0666:nActiveCells=500:nSampl=2000:nBin=5:Compress=T:Kernel=None:Nmin=10:VarTransform=None" );
// K-Nearest Neighbour classifier (KNN)
if (Use["KNN"])
factory->BookMethod( dataloader, TMVA::Types::kKNN, "KNN",
"nkNN=20:ScaleFrac=0.8:SigmaFact=1.0:Kernel=Gaus:UseKernel=F:UseWeight=T:!Trim" );
// Linear discriminant
if (Use["LD"])
factory->BookMethod( dataloader, TMVA::Types::kLD, "LD",
"!H:!V:VarTransform=None" );
// Function discrimination analysis (FDA) -- test of various fitters - the recommended one is Minuit (or GA or SA)
if (Use["FDA_MC"])
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_MC",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100):FitMethod=MC:SampleSize=100000:Sigma=0.1:VarTransform=D" );
if (Use["FDA_GA"]) // can also use Simulated Annealing (SA) algorithm (see Cuts_SA options) .. the formula of this example is good for parabolas
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_GA",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100):FitMethod=GA:PopSize=100:Cycles=3:Steps=30:Trim=True:SaveBestGen=1:VarTransform=Norm" );
if (Use["FDA_MT"])
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_MT",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100);(-10,10):FitMethod=MINUIT:ErrorLevel=1:PrintLevel=-1:FitStrategy=2:UseImprove:UseMinos:SetBatch" );
if (Use["FDA_GAMT"])
factory->BookMethod( dataloader, TMVA::Types::kFDA, "FDA_GAMT",
"!H:!V:Formula=(0)+(1)*x0+(2)*x1:ParRanges=(-100,100);(-100,100);(-100,100):FitMethod=GA:Converger=MINUIT:ErrorLevel=1:PrintLevel=-1:FitStrategy=0:!UseImprove:!UseMinos:SetBatch:Cycles=1:PopSize=5:Steps=5:Trim" );
// Neural network (MLP)
if (Use["MLP"])
factory->BookMethod( dataloader, TMVA::Types::kMLP, "MLP", "!H:!V:VarTransform=Norm:NeuronType=tanh:NCycles=20000:HiddenLayers=N+20:TestRate=6:TrainingMethod=BFGS:Sampling=0.3:SamplingEpoch=0.8:ConvergenceImprove=1e-6:ConvergenceTests=15:!UseRegulator" );
if (Use["DNN_CPU"] || Use["DNN_GPU"]) {
TString archOption = Use["DNN_GPU"] ? "GPU" : "CPU";
TString layoutString("Layout=TANH|50,TANH|50,TANH|50,LINEAR");
TString trainingStrategyString("TrainingStrategy=");
trainingStrategyString +="LearningRate=1e-3,Momentum=0.3,ConvergenceSteps=20,BatchSize=50,TestRepetitions=1,WeightDecay=0.0,Regularization=None,Optimizer=Adam";
TString nnOptions("!H:V:ErrorStrategy=SUMOFSQUARES:VarTransform=G:WeightInitialization=XAVIERUNIFORM:Architecture=");
nnOptions.Append(archOption);
nnOptions.Append(":");
nnOptions.Append(layoutString);
nnOptions.Append(":");
nnOptions.Append(trainingStrategyString);
TString methodName = TString("DNN_") + archOption;
factory->BookMethod(dataloader, TMVA::Types::kDL, methodName, nnOptions); // NN
}
// Support Vector Machine
if (Use["SVM"])
factory->BookMethod( dataloader, TMVA::Types::kSVM, "SVM", "Gamma=0.25:Tol=0.001:VarTransform=Norm" );
// Boosted Decision Trees
if (Use["BDT"])
factory->BookMethod( dataloader, TMVA::Types::kBDT, "BDT",
"!H:!V:NTrees=100:MinNodeSize=1.0%:BoostType=AdaBoostR2:SeparationType=RegressionVariance:nCuts=20:PruneMethod=CostComplexity:PruneStrength=30" );
if (Use["BDTG"])
factory->BookMethod( dataloader, TMVA::Types::kBDT, "BDTG",
"!H:!V:NTrees=2000::BoostType=Grad:Shrinkage=0.1:UseBaggedBoost:BaggedSampleFraction=0.5:nCuts=20:MaxDepth=3:MaxDepth=4" );
// --------------------------------------------------------------------------------------------------
// Now you can tell the factory to train, test, and evaluate the MVAs
// Train MVAs using the set of training events
factory->TrainAllMethods();
// Evaluate all MVAs using the set of test events
factory->TestAllMethods();
// Evaluate and compare performance of all configured MVAs
factory->EvaluateAllMethods();
// --------------------------------------------------------------
// Save the output
outputFile->Close();
std::cout << "==> Wrote root file: " << outputFile->GetName() << std::endl;
std::cout << "==> TMVARegression is done!" << std::endl;
delete factory;
delete dataloader;
// Launch the GUI for the root macros
if (!gROOT->IsBatch()) TMVA::TMVARegGui( outfileName );
}
int main( int argc, char** argv )
{
// Select methods (don't look at this code - not of interest)
TString methodList;
for (int i=1; i<argc; i++) {
TString regMethod(argv[i]);
if(regMethod=="-b" || regMethod=="--batch") continue;
if (!methodList.IsNull()) methodList += TString(",");
methodList += regMethod;
}
TMVARegression(methodList);
return 0;
}
main
int main()
Definition Prototype.cxx:12
UInt_t
unsigned int UInt_t
Definition RtypesCore.h:46
Double_t
double Double_t
Definition RtypesCore.h:59
TRangeDynCast
ROOT::Detail::TRangeCast< T, true > TRangeDynCast
TRangeDynCast is an adapter class that allows the typed iteration through a TCollection.
Definition TCollection.h:358
input
Option_t Option_t TPoint TPoint const char GetTextMagnitude GetFillStyle GetLineColor GetLineWidth GetMarkerStyle GetTextAlign GetTextColor GetTextSize void input
Definition TGWin32VirtualXProxy.cxx:142
gROOT
#define gROOT
Definition TROOT.h:414
gSystem
R__EXTERN TSystem * gSystem
Definition TSystem.h:572
TCut
A specialized string object used for TTree selections.
Definition TCut.h:25
TFile
A ROOT file is an on-disk file, usually with extension .root, that stores objects in a file-system-li...
Definition TFile.h:53
TFile::Open
static TFile * Open(const char *name, Option_t *option="", const char *ftitle="", Int_t compress=ROOT::RCompressionSetting::EDefaults::kUseCompiledDefault, Int_t netopt=0)
Create / open a file.
Definition TFile.cxx:4094
TMVA::Factory
This is the main MVA steering class.
Definition Factory.h:80
TMVA::Factory::TrainAllMethods
void TrainAllMethods()
Iterates through all booked methods and calls training.
Definition Factory.cxx:1114
TMVA::Factory::BookMethod
MethodBase * BookMethod(DataLoader *loader, TString theMethodName, TString methodTitle, TString theOption="")
Book a classifier or regression method.
Definition Factory.cxx:352
TMVA::Factory::TestAllMethods
void TestAllMethods()
Evaluates all booked methods on the testing data and adds the output to the Results in the corresponi...
Definition Factory.cxx:1271
TMVA::Factory::EvaluateAllMethods
void EvaluateAllMethods(void)
Iterates over all MVAs that have been booked, and calls their evaluation methods.
Definition Factory.cxx:1376
TMVA::Tools::Instance
static Tools & Instance()
Definition Tools.cxx:71
TMVA::Tools::SplitString
std::vector< TString > SplitString(const TString &theOpt, const char separator) const
splits the option string at 'separator' and fills the list 'splitV' with the primitive strings
Definition Tools.cxx:1199
TMVA::Types::kPDEFoam
@ kPDEFoam
Definition Types.h:94
TString
Basic string class.
Definition TString.h:139
TSystem::AccessPathName
virtual Bool_t AccessPathName(const char *path, EAccessMode mode=kFileExists)
Returns FALSE if one can access a file using the specified access mode.
Definition TSystem.cxx:1296
TTree
A TTree represents a columnar dataset.
Definition TTree.h:79
TMVA
create variable transformations
Definition GeneticMinimizer.h:22
TMVA::TMVARegGui
void TMVARegGui(const char *fName="TMVAReg.root", TString dataset="")
Author
Andreas Hoecker

Definition in file TMVARegression.C.