See details for description.

show_sig_bootstrap_exposure(
  bt_result,
  sample = NULL,
  signatures = NULL,
  methods = "QP",
  plot_fun = c("boxplot", "violin"),
  agg_fun = c("mean", "median", "min", "max"),
  highlight = "auto",
  highlight_size = 4,
  palette = "aaas",
  title = NULL,
  xlab = FALSE,
  ylab = "Signature exposure",
  width = 0.3,
  dodge_width = 0.8,
  outlier.shape = NA,
  add = "jitter",
  add.params = list(alpha = 0.3),
  ...
)

show_sig_bootstrap_error(
  bt_result,
  sample = NULL,
  methods = "QP",
  plot_fun = c("boxplot", "violin"),
  agg_fun = c("mean", "median"),
  highlight = "auto",
  highlight_size = 4,
  palette = "aaas",
  title = NULL,
  xlab = FALSE,
  ylab = "Reconstruction error (L2 norm)",
  width = 0.3,
  dodge_width = 0.8,
  outlier.shape = NA,
  add = "jitter",
  add.params = list(alpha = 0.3),
  legend = "none",
  ...
)

show_sig_bootstrap_stability(
  bt_result,
  signatures = NULL,
  measure = c("RMSE", "CV", "MAE", "AbsDiff"),
  methods = "QP",
  plot_fun = c("boxplot", "violin"),
  palette = "aaas",
  title = NULL,
  xlab = FALSE,
  ylab = "Signature instability",
  width = 0.3,
  outlier.shape = NA,
  add = "jitter",
  add.params = list(alpha = 0.3),
  ...
)

Arguments

bt_result

result object from sig_fit_bootstrap_batch.

sample

a sample id.

signatures

signatures to show.

methods

a subset of c("NNLS", "QP", "SA").

plot_fun

set the plot function.

agg_fun

set the aggregation function when sample is NULL.

highlight

set the color for optimal solution. Default is "auto", which use the same color as bootstrap results, you can set it to color like "red", "gold", etc.

highlight_size

size for highlighting triangle, default is 4.

palette

the color palette to be used for coloring or filling by groups. Allowed values include "grey" for grey color palettes; brewer palettes e.g. "RdBu", "Blues", ...; or custom color palette e.g. c("blue", "red"); and scientific journal palettes from ggsci R package, e.g.: "npg", "aaas", "lancet", "jco", "ucscgb", "uchicago", "simpsons" and "rickandmorty".

title

plot main title.

xlab

character vector specifying x axis labels. Use xlab = FALSE to hide xlab.

ylab

character vector specifying y axis labels. Use ylab = FALSE to hide ylab.

width

numeric value between 0 and 1 specifying box width.

dodge_width

dodge width.

outlier.shape

point shape of outlier. Default is 19. To hide outlier, specify outlier.shape = NA. When jitter is added, then outliers will be automatically hidden.

add

character vector for adding another plot element (e.g.: dot plot or error bars). Allowed values are one or the combination of: "none", "dotplot", "jitter", "boxplot", "point", "mean", "mean_se", "mean_sd", "mean_ci", "mean_range", "median", "median_iqr", "median_hilow", "median_q1q3", "median_mad", "median_range"; see ?desc_statby for more details.

add.params

parameters (color, shape, size, fill, linetype) for the argument 'add'; e.g.: add.params = list(color = "red").

...

other parameters passing to ggpubr::ggboxplot or ggpubr::ggviolin.

legend

character specifying legend position. Allowed values are one of c("top", "bottom", "left", "right", "none"). To remove the legend use legend = "none". Legend position can be also specified using a numeric vector c(x, y); see details section.

measure

measure to estimate the exposure instability, can be one of 'RMSE', 'CV', 'MAE' and 'AbsDiff'.

Value

a ggplot object

Details

Functions:

  • show_sig_bootstrap_exposure - this function plots exposures from bootstrap samples with both dotted boxplot. The optimal exposure (the exposure from original input) is shown as triangle point. Only one sample can be plotted.

  • show_sig_bootstrap_error - this function plots decomposition errors from bootstrap samples with both dotted boxplot. The error from optimal solution (the decomposition error from original input) is shown as triangle point. Only one sample can be plotted.

  • show_sig_bootstrap_stability - this function plots the signature exposure instability for specified signatures. Currently, the instability measure supports 3 types:

    • 'RMSE' for Mean Root Squared Error (default) of bootstrap exposures and original exposures for each sample.

    • 'CV' for Coefficient of Variation (CV) based on RMSE (i.e. RMSE / btExposure_mean).

    • 'MAE' for Mean Absolute Error of bootstrap exposures and original exposures for each sample.

    • 'AbsDiff' for Absolute Difference between mean bootstram exposure and original exposure.

References

Huang X, Wojtowicz D, Przytycka TM. Detecting presence of mutational signatures in cancer with confidence. Bioinformatics. 2018;34(2):330–337. doi:10.1093/bioinformatics/btx604

Examples

# \donttest{
if (require("BSgenome.Hsapiens.UCSC.hg19")) {
  laml.maf <- system.file("extdata", "tcga_laml.maf.gz", package = "maftools")
  laml <- read_maf(maf = laml.maf)
  mt_tally <- sig_tally(
    laml,
    ref_genome = "BSgenome.Hsapiens.UCSC.hg19",
    use_syn = TRUE
  )

  library(NMF)
  mt_sig <- sig_extract(mt_tally$nmf_matrix,
    n_sig = 3,
    nrun = 2,
    cores = 1
  )

  mat <- t(mt_tally$nmf_matrix)
  mat <- mat[, colSums(mat) > 0]
  bt_result <- sig_fit_bootstrap_batch(mat, sig = mt_sig, n = 10)
  ## Parallel computation
  ## bt_result = sig_fit_bootstrap_batch(mat, sig = mt_sig, n = 10, use_parallel = TRUE)

  ## At default, mean bootstrap exposure for each sample has been calculated
  p <- show_sig_bootstrap_exposure(bt_result, methods = c("QP"))
  ## Show bootstrap exposure (optimal exposure is shown as triangle)
  p1 <- show_sig_bootstrap_exposure(bt_result, methods = c("QP"), sample = "TCGA-AB-2802")
  p1
  p2 <- show_sig_bootstrap_exposure(bt_result,
    methods = c("QP"),
    sample = "TCGA-AB-3012",
    signatures = c("Sig1", "Sig2")
  )
  p2

  ## Show bootstrap error
  ## Similar to exposure above
  p <- show_sig_bootstrap_error(bt_result, methods = c("QP"))
  p
  p3 <- show_sig_bootstrap_error(bt_result, methods = c("QP"), sample = "TCGA-AB-2802")
  p3

  ## Show exposure (in)stability
  p4 <- show_sig_bootstrap_stability(bt_result, methods = c("QP"))
  p4
  p5 <- show_sig_bootstrap_stability(bt_result, methods = c("QP"), measure = "MAE")
  p5
  p6 <- show_sig_bootstrap_stability(bt_result, methods = c("QP"), measure = "AbsDiff")
  p6
  p7 <- show_sig_bootstrap_stability(bt_result, methods = c("QP"), measure = "CV")
  p7
} else {
  message("Please install package 'BSgenome.Hsapiens.UCSC.hg19' firstly!")
}
#> -Reading
#> -Validating
#> -Silent variants: 475 
#> -Summarizing
#> -Processing clinical data
#> --Missing clinical data
#> -Finished in 0.222s elapsed (0.262s cpu) 
#>  [2024-03-13 10:48:21.518163]: Started.
#>  [2024-03-13 10:48:21.522936]: We would assume you marked all variants' position in + strand.
#>  [2024-03-13 10:48:21.524829]: Reference genome loaded.
#>  [2024-03-13 10:48:21.52942]: Variants from MAF object queried.
#>  [2024-03-13 10:48:21.531925]: Chromosome names checked.
#>  [2024-03-13 10:48:21.535142]: Sex chromosomes properly handled.
#>  [2024-03-13 10:48:21.536951]: Only variants located in standard chromosomes (1:22, X, Y, M/MT) are kept.
#>  [2024-03-13 10:48:21.542449]: Variant start and end position checked.
#>  [2024-03-13 10:48:21.546583]: Variant data for matrix generation preprocessed.
#>  [2024-03-13 10:48:21.548131]: SBS matrix generation - start.
#>  [2024-03-13 10:48:21.550008]: Extracting 5' and 3' adjacent bases.
#>  [2024-03-13 10:48:21.853179]: Extracting +/- 20bp around mutated bases for background C>T estimation.
#>  [2024-03-13 10:48:22.226192]: Estimating APOBEC enrichment scores.
#>  [2024-03-13 10:48:22.228699]: Performing one-way Fisher's test for APOBEC enrichment.
#>  [2024-03-13 10:48:22.311208]: APOBEC related mutations are enriched in 3.297% of samples (APOBEC enrichment score > 2; 6 of 182 samples)
#>  [2024-03-13 10:48:22.314861]: Creating SBS sample-by-component matrices.
#>  [2024-03-13 10:48:22.319444]: SBS-6 matrix created.
#>  [2024-03-13 10:48:22.324813]: SBS-96 matrix created.
#>  [2024-03-13 10:48:22.340769]: SBS-1536 matrix created.
#>  [2024-03-13 10:48:22.342319]: Return SBS-96 as major matrix.
#>  [2024-03-13 10:48:22.344906]: Done.
#>  [2024-03-13 10:48:22.346388]: 0.828 secs elapsed.
#> The follow samples dropped due to null catalogue:
#> 	TCGA-AB-2823, TCGA-AB-2840, TCGA-AB-2848, TCGA-AB-2909, TCGA-AB-2942
#> NMF algorithm: 'brunet'
#> Multiple runs: 2
#> Mode: sequential [foreach:doParallelMC]
#> 
Runs: |                                                        
Runs: |                                                  |   0%
Runs: |                                                        
Runs: |=================                                 |  33%
Runs: |                                                        
Runs: |=================================                 |  67%
Runs: |                                                        
Runs: |==================================================| 100%
#> System time:
#>    user  system elapsed 
#>   6.722   0.056   6.778 
#>  [2024-03-13 10:48:30.799862]: Batch Bootstrap Signature Exposure Analysis Started.
#>  [2024-03-13 10:48:30.801665]: Samples to be filtered out: TCGA-AB-2825,TCGA-AB-2834,TCGA-AB-2866,TCGA-AB-2873,TCGA-AB-2880,TCGA-AB-2883,TCGA-AB-2892,TCGA-AB-2896,TCGA-AB-2903,TCGA-AB-2918,TCGA-AB-2933,TCGA-AB-2948,TCGA-AB-2954
#>  [2024-03-13 10:48:30.803106]: Finding optimal exposures (&errors) for different methods.
#>  [2024-03-13 10:48:30.804568]: Calling method `QP`.
#>  [2024-03-13 10:48:30.807838]: Started.
#>  [2024-03-13 10:48:30.80918]: Signature index not detected.
#>  [2024-03-13 10:48:30.810529]: Signature object detected.
#>  [2024-03-13 10:48:30.811922]: Database and index checked.
#>  [2024-03-13 10:48:30.813348]: Signature normalized.
#>  [2024-03-13 10:48:30.814682]: Checking row number for catalog matrix and signature matrix.
#>  [2024-03-13 10:48:30.816035]: Checked.
#>  [2024-03-13 10:48:30.817352]: Checking rownames for catalog matrix and signature matrix.
#>  [2024-03-13 10:48:30.818673]: Checked.
#>  [2024-03-13 10:48:30.820034]: Method 'QP' detected.
#>  [2024-03-13 10:48:30.82137]: Corresponding function generated.
#>  [2024-03-13 10:48:30.822682]: Calling function.
#>  [2024-03-13 10:48:30.824826]: Fitting sample: TCGA-AB-2802
#>  [2024-03-13 10:48:30.826288]: Fitting sample: TCGA-AB-2803
#>  [2024-03-13 10:48:30.827714]: Fitting sample: TCGA-AB-2804
#>  [2024-03-13 10:48:30.829106]: Fitting sample: TCGA-AB-2805
#>  [2024-03-13 10:48:30.830505]: Fitting sample: TCGA-AB-2806
#>  [2024-03-13 10:48:30.831959]: Fitting sample: TCGA-AB-2807
#>  [2024-03-13 10:48:30.833358]: Fitting sample: TCGA-AB-2808
#>  [2024-03-13 10:48:30.834749]: Fitting sample: TCGA-AB-2809
#>  [2024-03-13 10:48:30.836165]: Fitting sample: TCGA-AB-2810
#>  [2024-03-13 10:48:30.837558]: Fitting sample: TCGA-AB-2812
#>  [2024-03-13 10:48:30.83894]: Fitting sample: TCGA-AB-2813
#>  [2024-03-13 10:48:30.840361]: Fitting sample: TCGA-AB-2814
#>  [2024-03-13 10:48:30.841776]: Fitting sample: TCGA-AB-2816
#>  [2024-03-13 10:48:30.843155]: Fitting sample: TCGA-AB-2817
#>  [2024-03-13 10:48:30.844571]: Fitting sample: TCGA-AB-2818
#>  [2024-03-13 10:48:30.845967]: Fitting sample: TCGA-AB-2819
#>  [2024-03-13 10:48:30.847394]: Fitting sample: TCGA-AB-2820
#>  [2024-03-13 10:48:30.848784]: Fitting sample: TCGA-AB-2821
#>  [2024-03-13 10:48:30.850185]: Fitting sample: TCGA-AB-2822
#>  [2024-03-13 10:48:30.851603]: Fitting sample: TCGA-AB-2824
#>  [2024-03-13 10:48:30.852997]: Fitting sample: TCGA-AB-2826
#>  [2024-03-13 10:48:30.854386]: Fitting sample: TCGA-AB-2827
#>  [2024-03-13 10:48:30.855832]: Fitting sample: TCGA-AB-2828
#>  [2024-03-13 10:48:30.857234]: Fitting sample: TCGA-AB-2829
#>  [2024-03-13 10:48:30.858634]: Fitting sample: TCGA-AB-2830
#>  [2024-03-13 10:48:30.860049]: Fitting sample: TCGA-AB-2831
#>  [2024-03-13 10:48:30.861454]: Fitting sample: TCGA-AB-2832
#>  [2024-03-13 10:48:30.862847]: Fitting sample: TCGA-AB-2833
#>  [2024-03-13 10:48:30.864254]: Fitting sample: TCGA-AB-2835
#>  [2024-03-13 10:48:30.865627]: Fitting sample: TCGA-AB-2836
#>  [2024-03-13 10:48:30.867034]: Fitting sample: TCGA-AB-2838
#>  [2024-03-13 10:48:30.868504]: Fitting sample: TCGA-AB-2839
#>  [2024-03-13 10:48:30.869888]: Fitting sample: TCGA-AB-2841
#>  [2024-03-13 10:48:30.871297]: Fitting sample: TCGA-AB-2842
#>  [2024-03-13 10:48:30.87269]: Fitting sample: TCGA-AB-2843
#>  [2024-03-13 10:48:30.874075]: Fitting sample: TCGA-AB-2844
#>  [2024-03-13 10:48:30.875483]: Fitting sample: TCGA-AB-2845
#>  [2024-03-13 10:48:30.876861]: Fitting sample: TCGA-AB-2846
#>  [2024-03-13 10:48:30.878256]: Fitting sample: TCGA-AB-2847
#>  [2024-03-13 10:48:30.879667]: Fitting sample: TCGA-AB-2849
#>  [2024-03-13 10:48:30.881047]: Fitting sample: TCGA-AB-2850
#>  [2024-03-13 10:48:30.882433]: Fitting sample: TCGA-AB-2851
#>  [2024-03-13 10:48:30.883872]: Fitting sample: TCGA-AB-2853
#>  [2024-03-13 10:48:30.885279]: Fitting sample: TCGA-AB-2854
#>  [2024-03-13 10:48:30.88668]: Fitting sample: TCGA-AB-2855
#>  [2024-03-13 10:48:30.888106]: Fitting sample: TCGA-AB-2857
#>  [2024-03-13 10:48:30.889502]: Fitting sample: TCGA-AB-2858
#>  [2024-03-13 10:48:30.890888]: Fitting sample: TCGA-AB-2859
#>  [2024-03-13 10:48:30.892309]: Fitting sample: TCGA-AB-2860
#>  [2024-03-13 10:48:30.893691]: Fitting sample: TCGA-AB-2861
#>  [2024-03-13 10:48:30.895073]: Fitting sample: TCGA-AB-2862
#>  [2024-03-13 10:48:30.896488]: Fitting sample: TCGA-AB-2863
#>  [2024-03-13 10:48:30.897871]: Fitting sample: TCGA-AB-2864
#>  [2024-03-13 10:48:30.899273]: Fitting sample: TCGA-AB-2865
#>  [2024-03-13 10:48:30.900663]: Fitting sample: TCGA-AB-2867
#>  [2024-03-13 10:48:30.902046]: Fitting sample: TCGA-AB-2868
#>  [2024-03-13 10:48:30.903447]: Fitting sample: TCGA-AB-2869
#>  [2024-03-13 10:48:30.904837]: Fitting sample: TCGA-AB-2870
#>  [2024-03-13 10:48:30.906224]: Fitting sample: TCGA-AB-2871
#>  [2024-03-13 10:48:30.907637]: Fitting sample: TCGA-AB-2872
#>  [2024-03-13 10:48:30.909029]: Fitting sample: TCGA-AB-2874
#>  [2024-03-13 10:48:30.910415]: Fitting sample: TCGA-AB-2875
#>  [2024-03-13 10:48:30.911846]: Fitting sample: TCGA-AB-2876
#>  [2024-03-13 10:48:30.913231]: Fitting sample: TCGA-AB-2877
#>  [2024-03-13 10:48:30.914606]: Fitting sample: TCGA-AB-2878
#>  [2024-03-13 10:48:30.916017]: Fitting sample: TCGA-AB-2879
#>  [2024-03-13 10:48:30.917394]: Fitting sample: TCGA-AB-2881
#>  [2024-03-13 10:48:30.918784]: Fitting sample: TCGA-AB-2882
#>  [2024-03-13 10:48:30.920204]: Fitting sample: TCGA-AB-2884
#>  [2024-03-13 10:48:30.921611]: Fitting sample: TCGA-AB-2885
#>  [2024-03-13 10:48:30.923004]: Fitting sample: TCGA-AB-2886
#>  [2024-03-13 10:48:30.924439]: Fitting sample: TCGA-AB-2887
#>  [2024-03-13 10:48:30.925827]: Fitting sample: TCGA-AB-2888
#>  [2024-03-13 10:48:30.927209]: Fitting sample: TCGA-AB-2889
#>  [2024-03-13 10:48:30.928622]: Fitting sample: TCGA-AB-2890
#>  [2024-03-13 10:48:30.930004]: Fitting sample: TCGA-AB-2891
#>  [2024-03-13 10:48:30.931421]: Fitting sample: TCGA-AB-2894
#>  [2024-03-13 10:48:30.932824]: Fitting sample: TCGA-AB-2895
#>  [2024-03-13 10:48:30.93421]: Fitting sample: TCGA-AB-2897
#>  [2024-03-13 10:48:30.93562]: Fitting sample: TCGA-AB-2898
#>  [2024-03-13 10:48:30.937007]: Fitting sample: TCGA-AB-2899
#>  [2024-03-13 10:48:30.938393]: Fitting sample: TCGA-AB-2900
#>  [2024-03-13 10:48:30.939823]: Fitting sample: TCGA-AB-2901
#>  [2024-03-13 10:48:30.941224]: Fitting sample: TCGA-AB-2904
#>  [2024-03-13 10:48:30.942617]: Fitting sample: TCGA-AB-2905
#>  [2024-03-13 10:48:30.944029]: Fitting sample: TCGA-AB-2906
#>  [2024-03-13 10:48:30.945412]: Fitting sample: TCGA-AB-2907
#>  [2024-03-13 10:48:30.946808]: Fitting sample: TCGA-AB-2908
#>  [2024-03-13 10:48:30.948218]: Fitting sample: TCGA-AB-2910
#>  [2024-03-13 10:48:30.949598]: Fitting sample: TCGA-AB-2911
#>  [2024-03-13 10:48:30.950983]: Fitting sample: TCGA-AB-2912
#>  [2024-03-13 10:48:30.952399]: Fitting sample: TCGA-AB-2913
#>  [2024-03-13 10:48:30.953786]: Fitting sample: TCGA-AB-2914
#>  [2024-03-13 10:48:30.955167]: Fitting sample: TCGA-AB-2915
#>  [2024-03-13 10:48:30.956586]: Fitting sample: TCGA-AB-2916
#>  [2024-03-13 10:48:30.957992]: Fitting sample: TCGA-AB-2917
#>  [2024-03-13 10:48:30.959402]: Fitting sample: TCGA-AB-2919
#>  [2024-03-13 10:48:30.960802]: Fitting sample: TCGA-AB-2920
#>  [2024-03-13 10:48:30.962214]: Fitting sample: TCGA-AB-2921
#>  [2024-03-13 10:48:30.963623]: Fitting sample: TCGA-AB-2922
#>  [2024-03-13 10:48:30.96501]: Fitting sample: TCGA-AB-2923
#>  [2024-03-13 10:48:30.966413]: Fitting sample: TCGA-AB-2924
#>  [2024-03-13 10:48:30.967845]: Fitting sample: TCGA-AB-2925
#>  [2024-03-13 10:48:30.969237]: Fitting sample: TCGA-AB-2926
#>  [2024-03-13 10:48:30.970619]: Fitting sample: TCGA-AB-2927
#>  [2024-03-13 10:48:30.972035]: Fitting sample: TCGA-AB-2928
#>  [2024-03-13 10:48:30.973426]: Fitting sample: TCGA-AB-2929
#>  [2024-03-13 10:48:30.974818]: Fitting sample: TCGA-AB-2930
#>  [2024-03-13 10:48:30.976248]: Fitting sample: TCGA-AB-2931
#>  [2024-03-13 10:48:30.977659]: Fitting sample: TCGA-AB-2932
#>  [2024-03-13 10:48:30.979059]: Fitting sample: TCGA-AB-2934
#>  [2024-03-13 10:48:30.980508]: Fitting sample: TCGA-AB-2935
#>  [2024-03-13 10:48:30.981914]: Fitting sample: TCGA-AB-2936
#>  [2024-03-13 10:48:30.983318]: Fitting sample: TCGA-AB-2937
#>  [2024-03-13 10:48:30.984713]: Fitting sample: TCGA-AB-2938
#>  [2024-03-13 10:48:30.986096]: Fitting sample: TCGA-AB-2939
#>  [2024-03-13 10:48:30.98752]: Fitting sample: TCGA-AB-2940
#>  [2024-03-13 10:48:30.988911]: Fitting sample: TCGA-AB-2941
#>  [2024-03-13 10:48:30.990299]: Fitting sample: TCGA-AB-2943
#>  [2024-03-13 10:48:30.991732]: Fitting sample: TCGA-AB-2945
#>  [2024-03-13 10:48:30.993125]: Fitting sample: TCGA-AB-2946
#>  [2024-03-13 10:48:30.994531]: Fitting sample: TCGA-AB-2947
#>  [2024-03-13 10:48:30.995939]: Fitting sample: TCGA-AB-2949
#>  [2024-03-13 10:48:30.997321]: Fitting sample: TCGA-AB-2950
#>  [2024-03-13 10:48:31.009848]: Fitting sample: TCGA-AB-2952
#>  [2024-03-13 10:48:31.011318]: Fitting sample: TCGA-AB-2955
#>  [2024-03-13 10:48:31.012742]: Fitting sample: TCGA-AB-2956
#>  [2024-03-13 10:48:31.014132]: Fitting sample: TCGA-AB-2957
#>  [2024-03-13 10:48:31.015532]: Fitting sample: TCGA-AB-2959
#>  [2024-03-13 10:48:31.016974]: Fitting sample: TCGA-AB-2963
#>  [2024-03-13 10:48:31.018379]: Fitting sample: TCGA-AB-2964
#>  [2024-03-13 10:48:31.019806]: Fitting sample: TCGA-AB-2965
#>  [2024-03-13 10:48:31.021215]: Fitting sample: TCGA-AB-2966
#>  [2024-03-13 10:48:31.02264]: Fitting sample: TCGA-AB-2967
#>  [2024-03-13 10:48:31.024052]: Fitting sample: TCGA-AB-2968
#>  [2024-03-13 10:48:31.025478]: Fitting sample: TCGA-AB-2970
#>  [2024-03-13 10:48:31.026876]: Fitting sample: TCGA-AB-2971
#>  [2024-03-13 10:48:31.028288]: Fitting sample: TCGA-AB-2972
#>  [2024-03-13 10:48:31.029672]: Fitting sample: TCGA-AB-2973
#>  [2024-03-13 10:48:31.031057]: Fitting sample: TCGA-AB-2974
#>  [2024-03-13 10:48:31.032475]: Fitting sample: TCGA-AB-2975
#>  [2024-03-13 10:48:31.033864]: Fitting sample: TCGA-AB-2976
#>  [2024-03-13 10:48:31.035247]: Fitting sample: TCGA-AB-2977
#>  [2024-03-13 10:48:31.036654]: Fitting sample: TCGA-AB-2978
#>  [2024-03-13 10:48:31.038036]: Fitting sample: TCGA-AB-2979
#>  [2024-03-13 10:48:31.03946]: Fitting sample: TCGA-AB-2980
#>  [2024-03-13 10:48:31.040849]: Fitting sample: TCGA-AB-2981
#>  [2024-03-13 10:48:31.042254]: Fitting sample: TCGA-AB-2982
#>  [2024-03-13 10:48:31.043682]: Fitting sample: TCGA-AB-2983
#>  [2024-03-13 10:48:31.045069]: Fitting sample: TCGA-AB-2984
#>  [2024-03-13 10:48:31.046449]: Fitting sample: TCGA-AB-2985
#>  [2024-03-13 10:48:31.047881]: Fitting sample: TCGA-AB-2986
#>  [2024-03-13 10:48:31.049341]: Fitting sample: TCGA-AB-2987
#>  [2024-03-13 10:48:31.050745]: Fitting sample: TCGA-AB-2988
#>  [2024-03-13 10:48:31.052161]: Fitting sample: TCGA-AB-2989
#>  [2024-03-13 10:48:31.053543]: Fitting sample: TCGA-AB-2990
#>  [2024-03-13 10:48:31.054925]: Fitting sample: TCGA-AB-2991
#>  [2024-03-13 10:48:31.056361]: Fitting sample: TCGA-AB-2992
#>  [2024-03-13 10:48:31.057746]: Fitting sample: TCGA-AB-2993
#>  [2024-03-13 10:48:31.05914]: Fitting sample: TCGA-AB-2994
#>  [2024-03-13 10:48:31.060569]: Fitting sample: TCGA-AB-2995
#>  [2024-03-13 10:48:31.061971]: Fitting sample: TCGA-AB-2996
#>  [2024-03-13 10:48:31.063381]: Fitting sample: TCGA-AB-2997
#>  [2024-03-13 10:48:31.064784]: Fitting sample: TCGA-AB-2998
#>  [2024-03-13 10:48:31.066194]: Fitting sample: TCGA-AB-2999
#>  [2024-03-13 10:48:31.067609]: Fitting sample: TCGA-AB-3000
#>  [2024-03-13 10:48:31.068998]: Fitting sample: TCGA-AB-3001
#>  [2024-03-13 10:48:31.070377]: Fitting sample: TCGA-AB-3002
#>  [2024-03-13 10:48:31.071809]: Fitting sample: TCGA-AB-3005
#>  [2024-03-13 10:48:31.073231]: Fitting sample: TCGA-AB-3006
#>  [2024-03-13 10:48:31.074645]: Fitting sample: TCGA-AB-3007
#>  [2024-03-13 10:48:31.07607]: Fitting sample: TCGA-AB-3008
#>  [2024-03-13 10:48:31.077458]: Fitting sample: TCGA-AB-3009
#>  [2024-03-13 10:48:31.078855]: Fitting sample: TCGA-AB-3011
#>  [2024-03-13 10:48:31.080265]: Fitting sample: TCGA-AB-3012
#>  [2024-03-13 10:48:31.08169]: Done.
#>  [2024-03-13 10:48:31.083035]: Generating output signature exposures.
#>  [2024-03-13 10:48:31.096095]: Done.
#>  [2024-03-13 10:48:31.097506]: Calculating errors (Frobenius Norm).
#>  [2024-03-13 10:48:31.11865]: Done.
#>  [2024-03-13 10:48:31.120221]: 0.312 secs elapsed.
#>  [2024-03-13 10:48:31.123379]: Getting bootstrap exposures (&errors/similarity) for different methods.
#>  [2024-03-13 10:48:31.124774]: This step is time consuming, please be patient.
#>  [2024-03-13 10:48:31.126741]: Processing sample `TCGA-AB-2802`.
#>  [2024-03-13 10:48:32.395966]: Processing sample `TCGA-AB-2803`.
#>  [2024-03-13 10:48:33.655948]: Processing sample `TCGA-AB-2804`.
#>  [2024-03-13 10:48:34.960143]: Processing sample `TCGA-AB-2805`.
#>  [2024-03-13 10:48:36.24868]: Processing sample `TCGA-AB-2806`.
#>  [2024-03-13 10:48:37.570496]: Processing sample `TCGA-AB-2807`.
#>  [2024-03-13 10:48:38.905095]: Processing sample `TCGA-AB-2808`.
#>  [2024-03-13 10:48:40.251413]: Processing sample `TCGA-AB-2809`.
#>  [2024-03-13 10:48:41.551707]: Processing sample `TCGA-AB-2810`.
#>  [2024-03-13 10:48:42.919298]: Processing sample `TCGA-AB-2812`.
#>  [2024-03-13 10:48:44.208806]: Processing sample `TCGA-AB-2813`.
#>  [2024-03-13 10:48:45.543766]: Processing sample `TCGA-AB-2814`.
#>  [2024-03-13 10:48:46.845868]: Processing sample `TCGA-AB-2816`.
#>  [2024-03-13 10:48:48.192296]: Processing sample `TCGA-AB-2817`.
#>  [2024-03-13 10:48:49.518848]: Processing sample `TCGA-AB-2818`.
#>  [2024-03-13 10:48:50.860689]: Processing sample `TCGA-AB-2819`.
#>  [2024-03-13 10:48:52.207212]: Processing sample `TCGA-AB-2820`.
#>  [2024-03-13 10:48:53.545728]: Processing sample `TCGA-AB-2821`.
#>  [2024-03-13 10:48:54.909579]: Processing sample `TCGA-AB-2822`.
#>  [2024-03-13 10:48:56.259956]: Processing sample `TCGA-AB-2824`.
#>  [2024-03-13 10:48:57.612445]: Processing sample `TCGA-AB-2826`.
#>  [2024-03-13 10:48:58.956361]: Processing sample `TCGA-AB-2827`.
#>  [2024-03-13 10:49:00.29764]: Processing sample `TCGA-AB-2828`.
#>  [2024-03-13 10:49:01.651678]: Processing sample `TCGA-AB-2829`.
#>  [2024-03-13 10:49:02.988061]: Processing sample `TCGA-AB-2830`.
#>  [2024-03-13 10:49:04.348278]: Processing sample `TCGA-AB-2831`.
#>  [2024-03-13 10:49:05.688132]: Processing sample `TCGA-AB-2832`.
#>  [2024-03-13 10:49:07.018557]: Processing sample `TCGA-AB-2833`.
#>  [2024-03-13 10:49:08.322914]: Processing sample `TCGA-AB-2835`.
#>  [2024-03-13 10:49:09.655106]: Processing sample `TCGA-AB-2836`.
#>  [2024-03-13 10:49:11.004648]: Processing sample `TCGA-AB-2838`.
#>  [2024-03-13 10:49:12.3325]: Processing sample `TCGA-AB-2839`.
#>  [2024-03-13 10:49:13.656049]: Processing sample `TCGA-AB-2841`.
#>  [2024-03-13 10:49:14.975343]: Processing sample `TCGA-AB-2842`.
#>  [2024-03-13 10:49:16.297359]: Processing sample `TCGA-AB-2843`.
#>  [2024-03-13 10:49:17.647246]: Processing sample `TCGA-AB-2844`.
#>  [2024-03-13 10:49:18.952904]: Processing sample `TCGA-AB-2845`.
#>  [2024-03-13 10:49:20.298514]: Processing sample `TCGA-AB-2846`.
#>  [2024-03-13 10:49:21.635396]: Processing sample `TCGA-AB-2847`.
#>  [2024-03-13 10:49:22.975652]: Processing sample `TCGA-AB-2849`.
#>  [2024-03-13 10:49:24.29361]: Processing sample `TCGA-AB-2850`.
#>  [2024-03-13 10:49:25.617163]: Processing sample `TCGA-AB-2851`.
#>  [2024-03-13 10:49:26.953113]: Processing sample `TCGA-AB-2853`.
#>  [2024-03-13 10:49:28.31169]: Processing sample `TCGA-AB-2854`.
#>  [2024-03-13 10:49:29.627376]: Processing sample `TCGA-AB-2855`.
#>  [2024-03-13 10:49:30.985345]: Processing sample `TCGA-AB-2857`.
#>  [2024-03-13 10:49:32.325152]: Processing sample `TCGA-AB-2858`.
#>  [2024-03-13 10:49:33.63411]: Processing sample `TCGA-AB-2859`.
#>  [2024-03-13 10:49:34.9546]: Processing sample `TCGA-AB-2860`.
#>  [2024-03-13 10:49:36.240198]: Processing sample `TCGA-AB-2861`.
#>  [2024-03-13 10:49:37.531909]: Processing sample `TCGA-AB-2862`.
#>  [2024-03-13 10:49:38.813399]: Processing sample `TCGA-AB-2863`.
#>  [2024-03-13 10:49:40.101139]: Processing sample `TCGA-AB-2864`.
#>  [2024-03-13 10:49:41.383459]: Processing sample `TCGA-AB-2865`.
#>  [2024-03-13 10:49:42.666143]: Processing sample `TCGA-AB-2867`.
#>  [2024-03-13 10:49:43.960484]: Processing sample `TCGA-AB-2868`.
#>  [2024-03-13 10:49:45.249294]: Processing sample `TCGA-AB-2869`.
#>  [2024-03-13 10:49:46.520141]: Processing sample `TCGA-AB-2870`.
#>  [2024-03-13 10:49:47.813735]: Processing sample `TCGA-AB-2871`.
#>  [2024-03-13 10:49:49.120808]: Processing sample `TCGA-AB-2872`.
#>  [2024-03-13 10:49:50.445767]: Processing sample `TCGA-AB-2874`.
#>  [2024-03-13 10:49:51.754527]: Processing sample `TCGA-AB-2875`.
#>  [2024-03-13 10:49:53.073076]: Processing sample `TCGA-AB-2876`.
#>  [2024-03-13 10:49:54.373675]: Processing sample `TCGA-AB-2877`.
#>  [2024-03-13 10:49:55.695214]: Processing sample `TCGA-AB-2878`.
#>  [2024-03-13 10:49:56.99732]: Processing sample `TCGA-AB-2879`.
#>  [2024-03-13 10:49:58.32365]: Processing sample `TCGA-AB-2881`.
#>  [2024-03-13 10:49:59.647551]: Processing sample `TCGA-AB-2882`.
#>  [2024-03-13 10:50:00.969243]: Processing sample `TCGA-AB-2884`.
#>  [2024-03-13 10:50:02.291619]: Processing sample `TCGA-AB-2885`.
#>  [2024-03-13 10:50:03.632535]: Processing sample `TCGA-AB-2886`.
#>  [2024-03-13 10:50:04.949602]: Processing sample `TCGA-AB-2887`.
#>  [2024-03-13 10:50:06.272891]: Processing sample `TCGA-AB-2888`.
#>  [2024-03-13 10:50:07.59611]: Processing sample `TCGA-AB-2889`.
#>  [2024-03-13 10:50:08.926262]: Processing sample `TCGA-AB-2890`.
#>  [2024-03-13 10:50:10.275068]: Processing sample `TCGA-AB-2891`.
#>  [2024-03-13 10:50:11.590017]: Processing sample `TCGA-AB-2894`.
#>  [2024-03-13 10:50:12.945213]: Processing sample `TCGA-AB-2895`.
#>  [2024-03-13 10:50:14.276197]: Processing sample `TCGA-AB-2897`.
#>  [2024-03-13 10:50:15.60492]: Processing sample `TCGA-AB-2898`.
#>  [2024-03-13 10:50:16.919326]: Processing sample `TCGA-AB-2899`.
#>  [2024-03-13 10:50:18.259379]: Processing sample `TCGA-AB-2900`.
#>  [2024-03-13 10:50:19.577184]: Processing sample `TCGA-AB-2901`.
#>  [2024-03-13 10:50:20.917572]: Processing sample `TCGA-AB-2904`.
#>  [2024-03-13 10:50:22.231785]: Processing sample `TCGA-AB-2905`.
#>  [2024-03-13 10:50:23.552033]: Processing sample `TCGA-AB-2906`.
#>  [2024-03-13 10:50:24.866477]: Processing sample `TCGA-AB-2907`.
#>  [2024-03-13 10:50:26.192244]: Processing sample `TCGA-AB-2908`.
#>  [2024-03-13 10:50:27.534319]: Processing sample `TCGA-AB-2910`.
#>  [2024-03-13 10:50:28.846952]: Processing sample `TCGA-AB-2911`.
#>  [2024-03-13 10:50:30.17773]: Processing sample `TCGA-AB-2912`.
#>  [2024-03-13 10:50:31.521202]: Processing sample `TCGA-AB-2913`.
#>  [2024-03-13 10:50:32.834384]: Processing sample `TCGA-AB-2914`.
#>  [2024-03-13 10:50:34.165487]: Processing sample `TCGA-AB-2915`.
#>  [2024-03-13 10:50:35.524467]: Processing sample `TCGA-AB-2916`.
#>  [2024-03-13 10:50:36.838635]: Processing sample `TCGA-AB-2917`.
#>  [2024-03-13 10:50:38.18873]: Processing sample `TCGA-AB-2919`.
#>  [2024-03-13 10:50:39.502985]: Processing sample `TCGA-AB-2920`.
#>  [2024-03-13 10:50:40.848347]: Processing sample `TCGA-AB-2921`.
#>  [2024-03-13 10:50:42.192813]: Processing sample `TCGA-AB-2922`.
#>  [2024-03-13 10:50:43.540581]: Processing sample `TCGA-AB-2923`.
#>  [2024-03-13 10:50:44.88919]: Processing sample `TCGA-AB-2924`.
#>  [2024-03-13 10:50:46.227546]: Processing sample `TCGA-AB-2925`.
#>  [2024-03-13 10:50:47.540703]: Processing sample `TCGA-AB-2926`.
#>  [2024-03-13 10:50:48.909526]: Processing sample `TCGA-AB-2927`.
#>  [2024-03-13 10:50:50.229566]: Processing sample `TCGA-AB-2928`.
#>  [2024-03-13 10:50:51.587188]: Processing sample `TCGA-AB-2929`.
#>  [2024-03-13 10:50:52.950285]: Processing sample `TCGA-AB-2930`.
#>  [2024-03-13 10:50:54.333439]: Processing sample `TCGA-AB-2931`.
#>  [2024-03-13 10:50:55.656429]: Processing sample `TCGA-AB-2932`.
#>  [2024-03-13 10:50:56.99632]: Processing sample `TCGA-AB-2934`.
#>  [2024-03-13 10:50:58.329051]: Processing sample `TCGA-AB-2935`.
#>  [2024-03-13 10:50:59.678164]: Processing sample `TCGA-AB-2936`.
#>  [2024-03-13 10:51:01.012378]: Processing sample `TCGA-AB-2937`.
#>  [2024-03-13 10:51:02.305403]: Processing sample `TCGA-AB-2938`.
#>  [2024-03-13 10:51:03.582466]: Processing sample `TCGA-AB-2939`.
#>  [2024-03-13 10:51:04.855023]: Processing sample `TCGA-AB-2940`.
#>  [2024-03-13 10:51:06.127497]: Processing sample `TCGA-AB-2941`.
#>  [2024-03-13 10:51:07.401881]: Processing sample `TCGA-AB-2943`.
#>  [2024-03-13 10:51:08.663834]: Processing sample `TCGA-AB-2945`.
#>  [2024-03-13 10:51:09.952823]: Processing sample `TCGA-AB-2946`.
#>  [2024-03-13 10:51:11.31013]: Processing sample `TCGA-AB-2947`.
#>  [2024-03-13 10:51:12.602024]: Processing sample `TCGA-AB-2949`.
#>  [2024-03-13 10:51:13.885957]: Processing sample `TCGA-AB-2950`.
#>  [2024-03-13 10:51:15.168115]: Processing sample `TCGA-AB-2952`.
#>  [2024-03-13 10:51:16.45251]: Processing sample `TCGA-AB-2955`.
#>  [2024-03-13 10:51:17.739712]: Processing sample `TCGA-AB-2956`.
#>  [2024-03-13 10:51:19.080796]: Processing sample `TCGA-AB-2957`.
#>  [2024-03-13 10:51:20.410381]: Processing sample `TCGA-AB-2959`.
#>  [2024-03-13 10:51:21.730083]: Processing sample `TCGA-AB-2963`.
#>  [2024-03-13 10:51:23.09314]: Processing sample `TCGA-AB-2964`.
#>  [2024-03-13 10:51:24.40825]: Processing sample `TCGA-AB-2965`.
#>  [2024-03-13 10:51:25.764359]: Processing sample `TCGA-AB-2966`.
#>  [2024-03-13 10:51:27.083341]: Processing sample `TCGA-AB-2967`.
#>  [2024-03-13 10:51:28.426753]: Processing sample `TCGA-AB-2968`.
#>  [2024-03-13 10:51:29.754459]: Processing sample `TCGA-AB-2970`.
#>  [2024-03-13 10:51:31.136456]: Processing sample `TCGA-AB-2971`.
#>  [2024-03-13 10:51:32.510793]: Processing sample `TCGA-AB-2972`.
#>  [2024-03-13 10:51:33.820951]: Processing sample `TCGA-AB-2973`.
#>  [2024-03-13 10:51:35.239862]: Processing sample `TCGA-AB-2974`.
#>  [2024-03-13 10:51:36.56035]: Processing sample `TCGA-AB-2975`.
#>  [2024-03-13 10:51:37.910085]: Processing sample `TCGA-AB-2976`.
#>  [2024-03-13 10:51:39.269342]: Processing sample `TCGA-AB-2977`.
#>  [2024-03-13 10:51:40.621294]: Processing sample `TCGA-AB-2978`.
#>  [2024-03-13 10:51:41.968635]: Processing sample `TCGA-AB-2979`.
#>  [2024-03-13 10:51:43.303119]: Processing sample `TCGA-AB-2980`.
#>  [2024-03-13 10:51:44.645596]: Processing sample `TCGA-AB-2981`.
#>  [2024-03-13 10:51:46.020193]: Processing sample `TCGA-AB-2982`.
#>  [2024-03-13 10:51:47.408903]: Processing sample `TCGA-AB-2983`.
#>  [2024-03-13 10:51:48.777553]: Processing sample `TCGA-AB-2984`.
#>  [2024-03-13 10:51:50.121754]: Processing sample `TCGA-AB-2985`.
#>  [2024-03-13 10:51:51.491612]: Processing sample `TCGA-AB-2986`.
#>  [2024-03-13 10:51:52.824721]: Processing sample `TCGA-AB-2987`.
#>  [2024-03-13 10:51:54.23443]: Processing sample `TCGA-AB-2988`.
#>  [2024-03-13 10:51:55.613137]: Processing sample `TCGA-AB-2989`.
#>  [2024-03-13 10:51:57.012665]: Processing sample `TCGA-AB-2990`.
#>  [2024-03-13 10:51:58.370311]: Processing sample `TCGA-AB-2991`.
#>  [2024-03-13 10:51:59.712911]: Processing sample `TCGA-AB-2992`.
#>  [2024-03-13 10:52:01.056572]: Processing sample `TCGA-AB-2993`.
#>  [2024-03-13 10:52:02.406984]: Processing sample `TCGA-AB-2994`.
#>  [2024-03-13 10:52:03.758658]: Processing sample `TCGA-AB-2995`.
#>  [2024-03-13 10:52:05.114392]: Processing sample `TCGA-AB-2996`.
#>  [2024-03-13 10:52:06.479587]: Processing sample `TCGA-AB-2997`.
#>  [2024-03-13 10:52:07.820473]: Processing sample `TCGA-AB-2998`.
#>  [2024-03-13 10:52:09.194096]: Processing sample `TCGA-AB-2999`.
#>  [2024-03-13 10:52:10.56655]: Processing sample `TCGA-AB-3000`.
#>  [2024-03-13 10:52:11.936671]: Processing sample `TCGA-AB-3001`.
#>  [2024-03-13 10:52:13.30676]: Processing sample `TCGA-AB-3002`.
#>  [2024-03-13 10:52:14.71273]: Processing sample `TCGA-AB-3005`.
#>  [2024-03-13 10:52:16.082228]: Processing sample `TCGA-AB-3006`.
#>  [2024-03-13 10:52:17.428633]: Processing sample `TCGA-AB-3007`.
#>  [2024-03-13 10:52:18.772044]: Processing sample `TCGA-AB-3008`.
#>  [2024-03-13 10:52:20.103501]: Processing sample `TCGA-AB-3009`.
#>  [2024-03-13 10:52:21.39808]: Processing sample `TCGA-AB-3011`.
#>  [2024-03-13 10:52:22.734886]: Processing sample `TCGA-AB-3012`.
#>  [2024-03-13 10:52:24.066003]: Gotten.
#>  [2024-03-13 10:52:24.068522]: Reporting p values...
#>  [2024-03-13 10:52:24.070143]: Started.
#>  [2024-03-13 10:52:24.071572]: Batch mode enabled.
#>  [2024-03-13 10:52:24.073589]: Done.
#>  [2024-03-13 10:52:24.075021]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.076482]: Started.
#>  [2024-03-13 10:52:24.077833]: Batch mode enabled.
#>  [2024-03-13 10:52:24.079669]: Done.
#>  [2024-03-13 10:52:24.081107]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.0825]: Started.
#>  [2024-03-13 10:52:24.083872]: Batch mode enabled.
#>  [2024-03-13 10:52:24.085659]: Done.
#>  [2024-03-13 10:52:24.087056]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.088469]: Started.
#>  [2024-03-13 10:52:24.089807]: Batch mode enabled.
#>  [2024-03-13 10:52:24.091584]: Done.
#>  [2024-03-13 10:52:24.092983]: 0.004 secs elapsed.
#>  [2024-03-13 10:52:24.094372]: Started.
#>  [2024-03-13 10:52:24.095768]: Batch mode enabled.
#>  [2024-03-13 10:52:24.09754]: Done.
#>  [2024-03-13 10:52:24.098918]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.100373]: Started.
#>  [2024-03-13 10:52:24.101721]: Batch mode enabled.
#>  [2024-03-13 10:52:24.103514]: Done.
#>  [2024-03-13 10:52:24.104914]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.106293]: Started.
#>  [2024-03-13 10:52:24.107666]: Batch mode enabled.
#>  [2024-03-13 10:52:24.109522]: Done.
#>  [2024-03-13 10:52:24.110914]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.112346]: Started.
#>  [2024-03-13 10:52:24.113693]: Batch mode enabled.
#>  [2024-03-13 10:52:24.115505]: Done.
#>  [2024-03-13 10:52:24.116894]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.118277]: Started.
#>  [2024-03-13 10:52:24.119656]: Batch mode enabled.
#>  [2024-03-13 10:52:24.121441]: Done.
#>  [2024-03-13 10:52:24.122881]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.124327]: Started.
#>  [2024-03-13 10:52:24.125723]: Batch mode enabled.
#>  [2024-03-13 10:52:24.127507]: Done.
#>  [2024-03-13 10:52:24.128911]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.130324]: Started.
#>  [2024-03-13 10:52:24.131693]: Batch mode enabled.
#>  [2024-03-13 10:52:24.133599]: Done.
#>  [2024-03-13 10:52:24.135033]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.136584]: Started.
#>  [2024-03-13 10:52:24.137978]: Batch mode enabled.
#>  [2024-03-13 10:52:24.140013]: Done.
#>  [2024-03-13 10:52:24.141466]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.142918]: Started.
#>  [2024-03-13 10:52:24.144405]: Batch mode enabled.
#>  [2024-03-13 10:52:24.146494]: Done.
#>  [2024-03-13 10:52:24.148009]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.149504]: Started.
#>  [2024-03-13 10:52:24.150925]: Batch mode enabled.
#>  [2024-03-13 10:52:24.153191]: Done.
#>  [2024-03-13 10:52:24.15473]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.156264]: Started.
#>  [2024-03-13 10:52:24.157695]: Batch mode enabled.
#>  [2024-03-13 10:52:24.15988]: Done.
#>  [2024-03-13 10:52:24.161394]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.162893]: Started.
#>  [2024-03-13 10:52:24.164367]: Batch mode enabled.
#>  [2024-03-13 10:52:24.166484]: Done.
#>  [2024-03-13 10:52:24.168016]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.16953]: Started.
#>  [2024-03-13 10:52:24.170973]: Batch mode enabled.
#>  [2024-03-13 10:52:24.173107]: Done.
#>  [2024-03-13 10:52:24.174622]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.176227]: Started.
#>  [2024-03-13 10:52:24.177664]: Batch mode enabled.
#>  [2024-03-13 10:52:24.179795]: Done.
#>  [2024-03-13 10:52:24.181286]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.182771]: Started.
#>  [2024-03-13 10:52:24.184317]: Batch mode enabled.
#>  [2024-03-13 10:52:24.186349]: Done.
#>  [2024-03-13 10:52:24.187847]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.189322]: Started.
#>  [2024-03-13 10:52:24.190715]: Batch mode enabled.
#>  [2024-03-13 10:52:24.192658]: Done.
#>  [2024-03-13 10:52:24.194131]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.19565]: Started.
#>  [2024-03-13 10:52:24.197147]: Batch mode enabled.
#>  [2024-03-13 10:52:24.199113]: Done.
#>  [2024-03-13 10:52:24.200621]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.202091]: Started.
#>  [2024-03-13 10:52:24.203558]: Batch mode enabled.
#>  [2024-03-13 10:52:24.20551]: Done.
#>  [2024-03-13 10:52:24.206961]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.208453]: Started.
#>  [2024-03-13 10:52:24.209838]: Batch mode enabled.
#>  [2024-03-13 10:52:24.211756]: Done.
#>  [2024-03-13 10:52:24.21321]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.214649]: Started.
#>  [2024-03-13 10:52:24.216051]: Batch mode enabled.
#>  [2024-03-13 10:52:24.217898]: Done.
#>  [2024-03-13 10:52:24.219353]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.220781]: Started.
#>  [2024-03-13 10:52:24.222159]: Batch mode enabled.
#>  [2024-03-13 10:52:24.22409]: Done.
#>  [2024-03-13 10:52:24.225528]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.226961]: Started.
#>  [2024-03-13 10:52:24.228372]: Batch mode enabled.
#>  [2024-03-13 10:52:24.230278]: Done.
#>  [2024-03-13 10:52:24.231758]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.233204]: Started.
#>  [2024-03-13 10:52:24.234585]: Batch mode enabled.
#>  [2024-03-13 10:52:24.236452]: Done.
#>  [2024-03-13 10:52:24.237874]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.23932]: Started.
#>  [2024-03-13 10:52:24.240678]: Batch mode enabled.
#>  [2024-03-13 10:52:24.242491]: Done.
#>  [2024-03-13 10:52:24.243974]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.245397]: Started.
#>  [2024-03-13 10:52:24.24676]: Batch mode enabled.
#>  [2024-03-13 10:52:24.24861]: Done.
#>  [2024-03-13 10:52:24.250024]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.251461]: Started.
#>  [2024-03-13 10:52:24.252816]: Batch mode enabled.
#> ! [2024-03-13 10:52:24.254488]: NA result detected from t.test, reporting proportion as p value.
#>  [2024-03-13 10:52:24.256186]: Done.
#>  [2024-03-13 10:52:24.257604]: 0.006 secs elapsed.
#>  [2024-03-13 10:52:24.259014]: Started.
#>  [2024-03-13 10:52:24.260414]: Batch mode enabled.
#>  [2024-03-13 10:52:24.262252]: Done.
#>  [2024-03-13 10:52:24.263726]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.265167]: Started.
#>  [2024-03-13 10:52:24.266529]: Batch mode enabled.
#>  [2024-03-13 10:52:24.268367]: Done.
#>  [2024-03-13 10:52:24.26978]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.271192]: Started.
#>  [2024-03-13 10:52:24.272781]: Batch mode enabled.
#>  [2024-03-13 10:52:24.274618]: Done.
#>  [2024-03-13 10:52:24.276065]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.277484]: Started.
#>  [2024-03-13 10:52:24.278882]: Batch mode enabled.
#>  [2024-03-13 10:52:24.280751]: Done.
#>  [2024-03-13 10:52:24.282168]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.283602]: Started.
#>  [2024-03-13 10:52:24.284966]: Batch mode enabled.
#>  [2024-03-13 10:52:24.286796]: Done.
#>  [2024-03-13 10:52:24.288256]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.289659]: Started.
#>  [2024-03-13 10:52:24.291005]: Batch mode enabled.
#>  [2024-03-13 10:52:24.292809]: Done.
#>  [2024-03-13 10:52:24.294228]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.295659]: Started.
#>  [2024-03-13 10:52:24.297007]: Batch mode enabled.
#>  [2024-03-13 10:52:24.298789]: Done.
#>  [2024-03-13 10:52:24.30022]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.301619]: Started.
#>  [2024-03-13 10:52:24.302959]: Batch mode enabled.
#>  [2024-03-13 10:52:24.304771]: Done.
#>  [2024-03-13 10:52:24.306173]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.307608]: Started.
#>  [2024-03-13 10:52:24.308947]: Batch mode enabled.
#>  [2024-03-13 10:52:24.310727]: Done.
#>  [2024-03-13 10:52:24.312189]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.313582]: Started.
#>  [2024-03-13 10:52:24.314932]: Batch mode enabled.
#>  [2024-03-13 10:52:24.316735]: Done.
#>  [2024-03-13 10:52:24.318132]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.319538]: Started.
#>  [2024-03-13 10:52:24.320888]: Batch mode enabled.
#>  [2024-03-13 10:52:24.322659]: Done.
#>  [2024-03-13 10:52:24.324094]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.325474]: Started.
#>  [2024-03-13 10:52:24.326812]: Batch mode enabled.
#>  [2024-03-13 10:52:24.328598]: Done.
#>  [2024-03-13 10:52:24.32999]: 0.004 secs elapsed.
#>  [2024-03-13 10:52:24.331399]: Started.
#>  [2024-03-13 10:52:24.332745]: Batch mode enabled.
#>  [2024-03-13 10:52:24.334516]: Done.
#>  [2024-03-13 10:52:24.335968]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.337357]: Started.
#>  [2024-03-13 10:52:24.338693]: Batch mode enabled.
#>  [2024-03-13 10:52:24.340469]: Done.
#>  [2024-03-13 10:52:24.341878]: 0.004 secs elapsed.
#>  [2024-03-13 10:52:24.343294]: Started.
#>  [2024-03-13 10:52:24.344637]: Batch mode enabled.
#>  [2024-03-13 10:52:24.346393]: Done.
#>  [2024-03-13 10:52:24.34784]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.349231]: Started.
#>  [2024-03-13 10:52:24.350568]: Batch mode enabled.
#>  [2024-03-13 10:52:24.352354]: Done.
#>  [2024-03-13 10:52:24.353745]: 0.004 secs elapsed.
#>  [2024-03-13 10:52:24.355136]: Started.
#>  [2024-03-13 10:52:24.356501]: Batch mode enabled.
#>  [2024-03-13 10:52:24.358286]: Done.
#>  [2024-03-13 10:52:24.359703]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.361084]: Started.
#>  [2024-03-13 10:52:24.362437]: Batch mode enabled.
#>  [2024-03-13 10:52:24.364235]: Done.
#>  [2024-03-13 10:52:24.365626]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.367015]: Started.
#>  [2024-03-13 10:52:24.368388]: Batch mode enabled.
#>  [2024-03-13 10:52:24.370144]: Done.
#>  [2024-03-13 10:52:24.371556]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.372943]: Started.
#>  [2024-03-13 10:52:24.374311]: Batch mode enabled.
#>  [2024-03-13 10:52:24.376123]: Done.
#>  [2024-03-13 10:52:24.37753]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.378913]: Started.
#>  [2024-03-13 10:52:24.380275]: Batch mode enabled.
#>  [2024-03-13 10:52:24.382025]: Done.
#>  [2024-03-13 10:52:24.383456]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.384853]: Started.
#>  [2024-03-13 10:52:24.386197]: Batch mode enabled.
#>  [2024-03-13 10:52:24.387982]: Done.
#>  [2024-03-13 10:52:24.389382]: 0.004 secs elapsed.
#>  [2024-03-13 10:52:24.390774]: Started.
#>  [2024-03-13 10:52:24.392142]: Batch mode enabled.
#>  [2024-03-13 10:52:24.393899]: Done.
#>  [2024-03-13 10:52:24.395321]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.396715]: Started.
#>  [2024-03-13 10:52:24.398071]: Batch mode enabled.
#>  [2024-03-13 10:52:24.399915]: Done.
#>  [2024-03-13 10:52:24.401326]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.402722]: Started.
#>  [2024-03-13 10:52:24.404124]: Batch mode enabled.
#>  [2024-03-13 10:52:24.405941]: Done.
#>  [2024-03-13 10:52:24.407384]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.40881]: Started.
#>  [2024-03-13 10:52:24.41019]: Batch mode enabled.
#>  [2024-03-13 10:52:24.412063]: Done.
#>  [2024-03-13 10:52:24.413491]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.414921]: Started.
#>  [2024-03-13 10:52:24.416318]: Batch mode enabled.
#>  [2024-03-13 10:52:24.418137]: Done.
#>  [2024-03-13 10:52:24.419601]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.421027]: Started.
#>  [2024-03-13 10:52:24.422403]: Batch mode enabled.
#>  [2024-03-13 10:52:24.42424]: Done.
#>  [2024-03-13 10:52:24.425677]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.42709]: Started.
#>  [2024-03-13 10:52:24.428477]: Batch mode enabled.
#>  [2024-03-13 10:52:24.43027]: Done.
#>  [2024-03-13 10:52:24.43173]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.433137]: Started.
#>  [2024-03-13 10:52:24.434514]: Batch mode enabled.
#>  [2024-03-13 10:52:24.436337]: Done.
#>  [2024-03-13 10:52:24.437744]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.439139]: Started.
#>  [2024-03-13 10:52:24.440514]: Batch mode enabled.
#>  [2024-03-13 10:52:24.442293]: Done.
#>  [2024-03-13 10:52:24.443723]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.445126]: Started.
#>  [2024-03-13 10:52:24.446477]: Batch mode enabled.
#>  [2024-03-13 10:52:24.448289]: Done.
#>  [2024-03-13 10:52:24.449733]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.451117]: Started.
#>  [2024-03-13 10:52:24.452513]: Batch mode enabled.
#>  [2024-03-13 10:52:24.454311]: Done.
#>  [2024-03-13 10:52:24.455788]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.457185]: Started.
#>  [2024-03-13 10:52:24.458553]: Batch mode enabled.
#>  [2024-03-13 10:52:24.460406]: Done.
#>  [2024-03-13 10:52:24.461944]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.463386]: Started.
#>  [2024-03-13 10:52:24.464754]: Batch mode enabled.
#>  [2024-03-13 10:52:24.466567]: Done.
#>  [2024-03-13 10:52:24.468032]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.469439]: Started.
#>  [2024-03-13 10:52:24.470802]: Batch mode enabled.
#>  [2024-03-13 10:52:24.472632]: Done.
#>  [2024-03-13 10:52:24.474061]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.475533]: Started.
#>  [2024-03-13 10:52:24.476918]: Batch mode enabled.
#>  [2024-03-13 10:52:24.478742]: Done.
#>  [2024-03-13 10:52:24.480211]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.48162]: Started.
#>  [2024-03-13 10:52:24.482991]: Batch mode enabled.
#>  [2024-03-13 10:52:24.484819]: Done.
#>  [2024-03-13 10:52:24.48624]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.487669]: Started.
#>  [2024-03-13 10:52:24.489043]: Batch mode enabled.
#>  [2024-03-13 10:52:24.490848]: Done.
#>  [2024-03-13 10:52:24.492331]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.493804]: Started.
#>  [2024-03-13 10:52:24.495212]: Batch mode enabled.
#>  [2024-03-13 10:52:24.497116]: Done.
#>  [2024-03-13 10:52:24.498628]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.500102]: Started.
#>  [2024-03-13 10:52:24.501496]: Batch mode enabled.
#>  [2024-03-13 10:52:24.503384]: Done.
#>  [2024-03-13 10:52:24.504884]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.506355]: Started.
#>  [2024-03-13 10:52:24.507801]: Batch mode enabled.
#>  [2024-03-13 10:52:24.509821]: Done.
#>  [2024-03-13 10:52:24.511355]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.512889]: Started.
#>  [2024-03-13 10:52:24.514343]: Batch mode enabled.
#>  [2024-03-13 10:52:24.516327]: Done.
#>  [2024-03-13 10:52:24.517813]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.519323]: Started.
#>  [2024-03-13 10:52:24.520728]: Batch mode enabled.
#>  [2024-03-13 10:52:24.522575]: Done.
#>  [2024-03-13 10:52:24.524059]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.525518]: Started.
#>  [2024-03-13 10:52:24.526898]: Batch mode enabled.
#>  [2024-03-13 10:52:24.528949]: Done.
#>  [2024-03-13 10:52:24.530522]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.532071]: Started.
#>  [2024-03-13 10:52:24.533514]: Batch mode enabled.
#>  [2024-03-13 10:52:24.535482]: Done.
#>  [2024-03-13 10:52:24.537068]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.538592]: Started.
#>  [2024-03-13 10:52:24.540085]: Batch mode enabled.
#>  [2024-03-13 10:52:24.542005]: Done.
#>  [2024-03-13 10:52:24.543515]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.545049]: Started.
#>  [2024-03-13 10:52:24.546534]: Batch mode enabled.
#>  [2024-03-13 10:52:24.548522]: Done.
#>  [2024-03-13 10:52:24.550073]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.551639]: Started.
#>  [2024-03-13 10:52:24.553114]: Batch mode enabled.
#>  [2024-03-13 10:52:24.555072]: Done.
#>  [2024-03-13 10:52:24.556648]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.558225]: Started.
#>  [2024-03-13 10:52:24.559855]: Batch mode enabled.
#>  [2024-03-13 10:52:24.561945]: Done.
#>  [2024-03-13 10:52:24.563565]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.56512]: Started.
#>  [2024-03-13 10:52:24.566552]: Batch mode enabled.
#>  [2024-03-13 10:52:24.568522]: Done.
#>  [2024-03-13 10:52:24.57]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.571549]: Started.
#>  [2024-03-13 10:52:24.573017]: Batch mode enabled.
#>  [2024-03-13 10:52:24.574976]: Done.
#>  [2024-03-13 10:52:24.576576]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.578119]: Started.
#>  [2024-03-13 10:52:24.579539]: Batch mode enabled.
#>  [2024-03-13 10:52:24.581441]: Done.
#>  [2024-03-13 10:52:24.583074]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.584799]: Started.
#>  [2024-03-13 10:52:24.586403]: Batch mode enabled.
#>  [2024-03-13 10:52:24.588614]: Done.
#>  [2024-03-13 10:52:24.590491]: 0.006 secs elapsed.
#>  [2024-03-13 10:52:24.592291]: Started.
#>  [2024-03-13 10:52:24.593841]: Batch mode enabled.
#>  [2024-03-13 10:52:24.59604]: Done.
#>  [2024-03-13 10:52:24.597514]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.598981]: Started.
#>  [2024-03-13 10:52:24.600457]: Batch mode enabled.
#>  [2024-03-13 10:52:24.602334]: Done.
#>  [2024-03-13 10:52:24.603827]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.6053]: Started.
#>  [2024-03-13 10:52:24.606808]: Batch mode enabled.
#>  [2024-03-13 10:52:24.608999]: Done.
#>  [2024-03-13 10:52:24.610587]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.612214]: Started.
#>  [2024-03-13 10:52:24.613748]: Batch mode enabled.
#>  [2024-03-13 10:52:24.615844]: Done.
#>  [2024-03-13 10:52:24.617445]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.619027]: Started.
#>  [2024-03-13 10:52:24.620583]: Batch mode enabled.
#>  [2024-03-13 10:52:24.622598]: Done.
#>  [2024-03-13 10:52:24.624224]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.625804]: Started.
#>  [2024-03-13 10:52:24.627343]: Batch mode enabled.
#>  [2024-03-13 10:52:24.629329]: Done.
#>  [2024-03-13 10:52:24.630849]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.632409]: Started.
#>  [2024-03-13 10:52:24.633855]: Batch mode enabled.
#>  [2024-03-13 10:52:24.635802]: Done.
#>  [2024-03-13 10:52:24.637285]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.638788]: Started.
#>  [2024-03-13 10:52:24.640261]: Batch mode enabled.
#>  [2024-03-13 10:52:24.642143]: Done.
#>  [2024-03-13 10:52:24.643649]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.645135]: Started.
#>  [2024-03-13 10:52:24.646563]: Batch mode enabled.
#>  [2024-03-13 10:52:24.648473]: Done.
#>  [2024-03-13 10:52:24.649935]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.651399]: Started.
#>  [2024-03-13 10:52:24.652797]: Batch mode enabled.
#>  [2024-03-13 10:52:24.654756]: Done.
#>  [2024-03-13 10:52:24.65624]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.657684]: Started.
#>  [2024-03-13 10:52:24.659091]: Batch mode enabled.
#>  [2024-03-13 10:52:24.660965]: Done.
#>  [2024-03-13 10:52:24.662418]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.663885]: Started.
#>  [2024-03-13 10:52:24.665303]: Batch mode enabled.
#>  [2024-03-13 10:52:24.667132]: Done.
#>  [2024-03-13 10:52:24.668614]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.670068]: Started.
#>  [2024-03-13 10:52:24.671512]: Batch mode enabled.
#>  [2024-03-13 10:52:24.673356]: Done.
#>  [2024-03-13 10:52:24.674818]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.676284]: Started.
#>  [2024-03-13 10:52:24.677675]: Batch mode enabled.
#>  [2024-03-13 10:52:24.67954]: Done.
#>  [2024-03-13 10:52:24.680991]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.682429]: Started.
#>  [2024-03-13 10:52:24.683843]: Batch mode enabled.
#>  [2024-03-13 10:52:24.6857]: Done.
#>  [2024-03-13 10:52:24.687146]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.688628]: Started.
#>  [2024-03-13 10:52:24.690015]: Batch mode enabled.
#>  [2024-03-13 10:52:24.69188]: Done.
#>  [2024-03-13 10:52:24.693348]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.694806]: Started.
#>  [2024-03-13 10:52:24.696245]: Batch mode enabled.
#>  [2024-03-13 10:52:24.698162]: Done.
#>  [2024-03-13 10:52:24.69966]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.701125]: Started.
#>  [2024-03-13 10:52:24.702543]: Batch mode enabled.
#>  [2024-03-13 10:52:24.704417]: Done.
#>  [2024-03-13 10:52:24.705857]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.70731]: Started.
#>  [2024-03-13 10:52:24.708711]: Batch mode enabled.
#>  [2024-03-13 10:52:24.710524]: Done.
#>  [2024-03-13 10:52:24.71198]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.713412]: Started.
#>  [2024-03-13 10:52:24.714805]: Batch mode enabled.
#>  [2024-03-13 10:52:24.716653]: Done.
#>  [2024-03-13 10:52:24.718109]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.719567]: Started.
#>  [2024-03-13 10:52:24.720965]: Batch mode enabled.
#>  [2024-03-13 10:52:24.722788]: Done.
#>  [2024-03-13 10:52:24.724265]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.725697]: Started.
#>  [2024-03-13 10:52:24.727101]: Batch mode enabled.
#>  [2024-03-13 10:52:24.728993]: Done.
#>  [2024-03-13 10:52:24.730444]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.731916]: Started.
#>  [2024-03-13 10:52:24.733329]: Batch mode enabled.
#>  [2024-03-13 10:52:24.735186]: Done.
#>  [2024-03-13 10:52:24.73666]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.738108]: Started.
#>  [2024-03-13 10:52:24.739529]: Batch mode enabled.
#>  [2024-03-13 10:52:24.741374]: Done.
#>  [2024-03-13 10:52:24.742849]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.744398]: Started.
#>  [2024-03-13 10:52:24.745825]: Batch mode enabled.
#>  [2024-03-13 10:52:24.747693]: Done.
#>  [2024-03-13 10:52:24.749169]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.750611]: Started.
#>  [2024-03-13 10:52:24.752031]: Batch mode enabled.
#>  [2024-03-13 10:52:24.753859]: Done.
#>  [2024-03-13 10:52:24.755354]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.756804]: Started.
#>  [2024-03-13 10:52:24.758199]: Batch mode enabled.
#>  [2024-03-13 10:52:24.760103]: Done.
#>  [2024-03-13 10:52:24.761565]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.763]: Started.
#>  [2024-03-13 10:52:24.764424]: Batch mode enabled.
#>  [2024-03-13 10:52:24.766266]: Done.
#>  [2024-03-13 10:52:24.767741]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.769192]: Started.
#>  [2024-03-13 10:52:24.770587]: Batch mode enabled.
#>  [2024-03-13 10:52:24.772433]: Done.
#>  [2024-03-13 10:52:24.773889]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.775367]: Started.
#>  [2024-03-13 10:52:24.776776]: Batch mode enabled.
#>  [2024-03-13 10:52:24.778619]: Done.
#>  [2024-03-13 10:52:24.780128]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.781589]: Started.
#>  [2024-03-13 10:52:24.782987]: Batch mode enabled.
#>  [2024-03-13 10:52:24.784874]: Done.
#>  [2024-03-13 10:52:24.786335]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.787803]: Started.
#>  [2024-03-13 10:52:24.789215]: Batch mode enabled.
#>  [2024-03-13 10:52:24.791042]: Done.
#>  [2024-03-13 10:52:24.792547]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.794033]: Started.
#>  [2024-03-13 10:52:24.795483]: Batch mode enabled.
#>  [2024-03-13 10:52:24.797351]: Done.
#>  [2024-03-13 10:52:24.798821]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.800309]: Started.
#>  [2024-03-13 10:52:24.80172]: Batch mode enabled.
#>  [2024-03-13 10:52:24.803591]: Done.
#>  [2024-03-13 10:52:24.805061]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.806525]: Started.
#>  [2024-03-13 10:52:24.807961]: Batch mode enabled.
#>  [2024-03-13 10:52:24.809807]: Done.
#>  [2024-03-13 10:52:24.811281]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.812721]: Started.
#>  [2024-03-13 10:52:24.814119]: Batch mode enabled.
#>  [2024-03-13 10:52:24.815989]: Done.
#>  [2024-03-13 10:52:24.817433]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.818866]: Started.
#>  [2024-03-13 10:52:24.820296]: Batch mode enabled.
#>  [2024-03-13 10:52:24.822106]: Done.
#>  [2024-03-13 10:52:24.823564]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.825009]: Started.
#>  [2024-03-13 10:52:24.826403]: Batch mode enabled.
#>  [2024-03-13 10:52:24.828236]: Done.
#>  [2024-03-13 10:52:24.829672]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.831101]: Started.
#>  [2024-03-13 10:52:24.832505]: Batch mode enabled.
#>  [2024-03-13 10:52:24.834323]: Done.
#>  [2024-03-13 10:52:24.835789]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.837218]: Started.
#>  [2024-03-13 10:52:24.8386]: Batch mode enabled.
#>  [2024-03-13 10:52:24.841255]: Done.
#>  [2024-03-13 10:52:24.843414]: 0.006 secs elapsed.
#>  [2024-03-13 10:52:24.845536]: Started.
#>  [2024-03-13 10:52:24.847622]: Batch mode enabled.
#>  [2024-03-13 10:52:24.850266]: Done.
#>  [2024-03-13 10:52:24.852441]: 0.007 secs elapsed.
#>  [2024-03-13 10:52:24.854578]: Started.
#>  [2024-03-13 10:52:24.856676]: Batch mode enabled.
#>  [2024-03-13 10:52:24.859357]: Done.
#>  [2024-03-13 10:52:24.861476]: 0.007 secs elapsed.
#>  [2024-03-13 10:52:24.863653]: Started.
#>  [2024-03-13 10:52:24.865835]: Batch mode enabled.
#>  [2024-03-13 10:52:24.86849]: Done.
#>  [2024-03-13 10:52:24.870212]: 0.007 secs elapsed.
#>  [2024-03-13 10:52:24.8717]: Started.
#>  [2024-03-13 10:52:24.873113]: Batch mode enabled.
#>  [2024-03-13 10:52:24.874949]: Done.
#>  [2024-03-13 10:52:24.876519]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.87796]: Started.
#>  [2024-03-13 10:52:24.879484]: Batch mode enabled.
#>  [2024-03-13 10:52:24.881329]: Done.
#>  [2024-03-13 10:52:24.882773]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.884313]: Started.
#>  [2024-03-13 10:52:24.88571]: Batch mode enabled.
#>  [2024-03-13 10:52:24.887597]: Done.
#>  [2024-03-13 10:52:24.889072]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.890544]: Started.
#>  [2024-03-13 10:52:24.891958]: Batch mode enabled.
#>  [2024-03-13 10:52:24.893824]: Done.
#>  [2024-03-13 10:52:24.8953]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.896768]: Started.
#>  [2024-03-13 10:52:24.898154]: Batch mode enabled.
#>  [2024-03-13 10:52:24.900016]: Done.
#>  [2024-03-13 10:52:24.901456]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.902901]: Started.
#>  [2024-03-13 10:52:24.904346]: Batch mode enabled.
#>  [2024-03-13 10:52:24.906193]: Done.
#>  [2024-03-13 10:52:24.907656]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.909104]: Started.
#>  [2024-03-13 10:52:24.910518]: Batch mode enabled.
#>  [2024-03-13 10:52:24.912367]: Done.
#>  [2024-03-13 10:52:24.913806]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.915299]: Started.
#>  [2024-03-13 10:52:24.916721]: Batch mode enabled.
#>  [2024-03-13 10:52:24.918549]: Done.
#>  [2024-03-13 10:52:24.920051]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.921496]: Started.
#>  [2024-03-13 10:52:24.922904]: Batch mode enabled.
#>  [2024-03-13 10:52:24.924747]: Done.
#>  [2024-03-13 10:52:24.92618]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.927657]: Started.
#>  [2024-03-13 10:52:24.929061]: Batch mode enabled.
#>  [2024-03-13 10:52:24.930868]: Done.
#>  [2024-03-13 10:52:24.932343]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.933786]: Started.
#>  [2024-03-13 10:52:24.935213]: Batch mode enabled.
#>  [2024-03-13 10:52:24.937085]: Done.
#>  [2024-03-13 10:52:24.938528]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.939977]: Started.
#>  [2024-03-13 10:52:24.941388]: Batch mode enabled.
#>  [2024-03-13 10:52:24.94319]: Done.
#>  [2024-03-13 10:52:24.944697]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.946139]: Started.
#>  [2024-03-13 10:52:24.947584]: Batch mode enabled.
#>  [2024-03-13 10:52:24.949419]: Done.
#>  [2024-03-13 10:52:24.950866]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.952342]: Started.
#>  [2024-03-13 10:52:24.953726]: Batch mode enabled.
#>  [2024-03-13 10:52:24.95559]: Done.
#>  [2024-03-13 10:52:24.957027]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.958449]: Started.
#>  [2024-03-13 10:52:24.959872]: Batch mode enabled.
#>  [2024-03-13 10:52:24.9617]: Done.
#>  [2024-03-13 10:52:24.963141]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.964598]: Started.
#>  [2024-03-13 10:52:24.966016]: Batch mode enabled.
#>  [2024-03-13 10:52:24.9679]: Done.
#>  [2024-03-13 10:52:24.969367]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.970825]: Started.
#>  [2024-03-13 10:52:24.972233]: Batch mode enabled.
#>  [2024-03-13 10:52:24.974082]: Done.
#>  [2024-03-13 10:52:24.975573]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.977077]: Started.
#>  [2024-03-13 10:52:24.978496]: Batch mode enabled.
#>  [2024-03-13 10:52:24.980348]: Done.
#>  [2024-03-13 10:52:24.981798]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.983238]: Started.
#>  [2024-03-13 10:52:24.984671]: Batch mode enabled.
#>  [2024-03-13 10:52:24.986494]: Done.
#>  [2024-03-13 10:52:24.988072]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.989531]: Started.
#>  [2024-03-13 10:52:24.990942]: Batch mode enabled.
#>  [2024-03-13 10:52:24.992807]: Done.
#>  [2024-03-13 10:52:24.994257]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:24.995719]: Started.
#>  [2024-03-13 10:52:24.997135]: Batch mode enabled.
#>  [2024-03-13 10:52:24.999072]: Done.
#>  [2024-03-13 10:52:25.000561]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:25.00201]: Started.
#>  [2024-03-13 10:52:25.003445]: Batch mode enabled.
#>  [2024-03-13 10:52:25.005287]: Done.
#>  [2024-03-13 10:52:25.006773]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:25.008241]: Started.
#>  [2024-03-13 10:52:25.009647]: Batch mode enabled.
#>  [2024-03-13 10:52:25.011552]: Done.
#>  [2024-03-13 10:52:25.013006]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:25.014479]: Started.
#>  [2024-03-13 10:52:25.01591]: Batch mode enabled.
#>  [2024-03-13 10:52:25.017818]: Done.
#>  [2024-03-13 10:52:25.019315]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:25.020779]: Started.
#>  [2024-03-13 10:52:25.022205]: Batch mode enabled.
#>  [2024-03-13 10:52:25.02411]: Done.
#>  [2024-03-13 10:52:25.02561]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:25.02707]: Started.
#>  [2024-03-13 10:52:25.028508]: Batch mode enabled.
#>  [2024-03-13 10:52:25.030415]: Done.
#>  [2024-03-13 10:52:25.03194]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:25.033414]: Started.
#>  [2024-03-13 10:52:25.034827]: Batch mode enabled.
#>  [2024-03-13 10:52:25.036864]: Done.
#>  [2024-03-13 10:52:25.038373]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:25.039896]: Started.
#>  [2024-03-13 10:52:25.04132]: Batch mode enabled.
#>  [2024-03-13 10:52:25.043202]: Done.
#>  [2024-03-13 10:52:25.044723]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:25.046203]: Started.
#>  [2024-03-13 10:52:25.047644]: Batch mode enabled.
#>  [2024-03-13 10:52:25.049551]: Done.
#>  [2024-03-13 10:52:25.051029]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:25.052521]: Started.
#>  [2024-03-13 10:52:25.053932]: Batch mode enabled.
#>  [2024-03-13 10:52:25.05584]: Done.
#>  [2024-03-13 10:52:25.057307]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:25.058749]: Started.
#>  [2024-03-13 10:52:25.060207]: Batch mode enabled.
#>  [2024-03-13 10:52:25.062083]: Done.
#>  [2024-03-13 10:52:25.063601]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:25.065086]: Started.
#>  [2024-03-13 10:52:25.066496]: Batch mode enabled.
#>  [2024-03-13 10:52:25.068401]: Done.
#>  [2024-03-13 10:52:25.069856]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:25.07132]: Started.
#>  [2024-03-13 10:52:25.072736]: Batch mode enabled.
#>  [2024-03-13 10:52:25.074604]: Done.
#>  [2024-03-13 10:52:25.076134]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:25.077621]: Started.
#>  [2024-03-13 10:52:25.079019]: Batch mode enabled.
#>  [2024-03-13 10:52:25.080912]: Done.
#>  [2024-03-13 10:52:25.082379]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:25.083868]: Started.
#>  [2024-03-13 10:52:25.085304]: Batch mode enabled.
#>  [2024-03-13 10:52:25.087238]: Done.
#>  [2024-03-13 10:52:25.088744]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:25.090203]: Started.
#>  [2024-03-13 10:52:25.091639]: Batch mode enabled.
#>  [2024-03-13 10:52:25.093507]: Done.
#>  [2024-03-13 10:52:25.094974]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:25.096486]: Started.
#>  [2024-03-13 10:52:25.097897]: Batch mode enabled.
#>  [2024-03-13 10:52:25.099785]: Done.
#>  [2024-03-13 10:52:25.101257]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:25.102705]: Started.
#>  [2024-03-13 10:52:25.104126]: Batch mode enabled.
#>  [2024-03-13 10:52:25.105983]: Done.
#>  [2024-03-13 10:52:25.107494]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:25.109035]: Started.
#>  [2024-03-13 10:52:25.110466]: Batch mode enabled.
#>  [2024-03-13 10:52:25.112391]: Done.
#>  [2024-03-13 10:52:25.113869]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:25.115397]: Started.
#>  [2024-03-13 10:52:25.116799]: Batch mode enabled.
#>  [2024-03-13 10:52:25.118656]: Done.
#>  [2024-03-13 10:52:25.120175]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:25.121627]: Started.
#>  [2024-03-13 10:52:25.123066]: Batch mode enabled.
#>  [2024-03-13 10:52:25.12499]: Done.
#>  [2024-03-13 10:52:25.126444]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:25.127965]: Started.
#>  [2024-03-13 10:52:25.129387]: Batch mode enabled.
#>  [2024-03-13 10:52:25.131239]: Done.
#>  [2024-03-13 10:52:25.132748]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:25.134217]: Started.
#>  [2024-03-13 10:52:25.135705]: Batch mode enabled.
#>  [2024-03-13 10:52:25.137583]: Done.
#>  [2024-03-13 10:52:25.139106]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:25.140607]: Started.
#>  [2024-03-13 10:52:25.142027]: Batch mode enabled.
#>  [2024-03-13 10:52:25.143894]: Done.
#>  [2024-03-13 10:52:25.14537]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:25.146838]: Started.
#>  [2024-03-13 10:52:25.148266]: Batch mode enabled.
#>  [2024-03-13 10:52:25.150124]: Done.
#>  [2024-03-13 10:52:25.151606]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:25.153197]: Started.
#>  [2024-03-13 10:52:25.154626]: Batch mode enabled.
#>  [2024-03-13 10:52:25.156525]: Done.
#>  [2024-03-13 10:52:25.157991]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:25.159454]: Started.
#>  [2024-03-13 10:52:25.160861]: Batch mode enabled.
#>  [2024-03-13 10:52:25.162702]: Done.
#>  [2024-03-13 10:52:25.164176]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:25.165619]: Started.
#>  [2024-03-13 10:52:25.167011]: Batch mode enabled.
#>  [2024-03-13 10:52:25.168913]: Done.
#>  [2024-03-13 10:52:25.170428]: 0.005 secs elapsed.
#>  [2024-03-13 10:52:25.171926]: Done.
#>  [2024-03-13 10:52:25.173362]: Cleaning results...
#>  [2024-03-13 10:52:26.557481]: Outputing.
#>  [2024-03-13 10:52:26.560073]: Total 3.929 mins elapsed.
#>  [2024-03-13 10:52:26.562201]: Started.
#>  [2024-03-13 10:52:26.565241]: NULL sample detected, aggregate mode enabled.
#>  [2024-03-13 10:52:26.566855]: The summarized values will be stored in 'summary' element of result ggplot2 object.
#>  [2024-03-13 10:52:26.593698]: Plotting.
#>  [2024-03-13 10:52:26.650149]: 0.088 secs elapsed.
#>  [2024-03-13 10:52:26.652508]: Started.
#>  [2024-03-13 10:52:26.657989]: Plotting.
#>  [2024-03-13 10:52:26.726424]: 0.074 secs elapsed.
#>  [2024-03-13 10:52:26.728309]: Started.
#>  [2024-03-13 10:52:26.733289]: Plotting.
#>  [2024-03-13 10:52:26.788498]: 0.06 secs elapsed.
#>  [2024-03-13 10:52:26.790728]: Started.
#>  [2024-03-13 10:52:26.793715]: NULL sample detected, aggregate mode enabled.
#>  [2024-03-13 10:52:26.795385]: The summarized values will be stored in 'summary' element of result ggplot2 object.
#>  [2024-03-13 10:52:26.809186]: Plotting.
#>  [2024-03-13 10:52:26.857056]: 0.066 secs elapsed.
#>  [2024-03-13 10:52:26.858998]: Started.
#>  [2024-03-13 10:52:26.863036]: Plotting.
#>  [2024-03-13 10:52:26.920277]: 0.061 secs elapsed.
#>  [2024-03-13 10:52:26.922503]: Started.
#>  [2024-03-13 10:52:26.939199]: Plotting.
#>  [2024-03-13 10:52:26.982698]: 0.06 secs elapsed.
#>  [2024-03-13 10:52:26.984657]: Started.
#>  [2024-03-13 10:52:27.000421]: Plotting.
#>  [2024-03-13 10:52:27.0448]: 0.06 secs elapsed.
#>  [2024-03-13 10:52:27.046705]: Started.
#>  [2024-03-13 10:52:27.087935]: Plotting.
#>  [2024-03-13 10:52:27.133505]: 0.087 secs elapsed.
#>  [2024-03-13 10:52:27.135447]: Started.
#>  [2024-03-13 10:52:27.15441]: Plotting.
#>  [2024-03-13 10:52:27.200206]: 0.065 secs elapsed.
#> Warning: Removed 21 rows containing non-finite outside the scale range
#> (`stat_boxplot()`).
#> Warning: Removed 21 rows containing missing values or values outside the scale range
#> (`geom_point()`).

# }