Introduction to the Julia programming language

19 Machine learning¶

Types of Machine Learning¶

Supervised learning¶

Popular Machine Learning Packages in Julia:

Flux.jl (Deep learning, flexible):

  • Powerful and flexible framework for building and training various neural network architectures.
  • Offers automatic differentiation for efficient gradient calculations.
  • Similar to PyTorch in functionality and community, but with a more concise syntax.

MLJ.jl (General-purpose, user-friendly):

  • General-purpose machine learning library with familiar algorithms for classification, regression, and dimensionality reduction.
  • Provides a user-friendly interface with clear documentation.
  • Similar to scikit-learn in offering established algorithms and a user-friendly API, but with a focus on Julia's performance.

XGBoost¶

  • XGBoost (eXtreme Gradient Boosting) is a powerful machine learning algorithm excelling for regression and cassification
  • It's particularly well-suited for handling tabular data
  • XGBoost is known for accuracy, efficiency, and scalability to large datasets
  • XGBoost uses gradient boosting to combine weak decision trees into a strong learner.
  • Julia users can leverage XGBoost through the XGBoost.jl package, providing a convenient interface to this powerful algorithm within the Julia ecosystem.

We use the simulated data from the MAGIC telescope.

The MAGIC telescope is a Cherenkov telescope situated on La Palma, one of the Canary Islands. The MAGIC machine learning dataset can be obtained from UC Irvine Machine Learning Repository.

Our task is to separate signal events (gamma showers) and background events (hadron showers) based on the features of a measured Cherenkov shower.

Classification of air showers¶

Features of the measured air showers¶

The features of a shower are:

1.  fLength:  continuous  # major axis of ellipse [mm]
2.  fWidth:   continuous  # minor axis of ellipse [mm] 
3.  fSize:    continuous  # 10-log of sum of content of all pixels [in #phot]
4.  fConc:    continuous  # ratio of sum of two highest pixels over fSize  [ratio]
5.  fConc1:   continuous  # ratio of highest pixel over fSize  [ratio]
6.  fAsym:    continuous  # distance from highest pixel to center, projected onto major axis [mm]
7.  fM3Long:  continuous  # 3rd root of third moment along major axis  [mm] 
8.  fM3Trans: continuous  # 3rd root of third moment along minor axis  [mm]
9.  fAlpha:   continuous  # angle of major axis with vector to origin [deg]
10. fDist:    continuous  # distance from origin to center of ellipse [mm]
11. class:    g,h         # gamma (signal), hadron (background)

g = gamma (signal): 12332 h = hadron (background): 6688

For technical reasons, the number of h events is underestimated. In the real data, the h class represents the majority of the events.

In [1]:
using CSV, DataFrames, XGBoost, MLUtils, Plots
ENV["DATAFRAMES_ROWS"] = 10;
In [2]:
magic_data = CSV.read(joinpath("data", "magic04_data.txt"), DataFrame)
magic_data.class = (l -> l == "g" ? 1 : 0).(magic_data.class)
magic_data
19020×11 DataFrame
19010 rows omitted
RowfLengthfWidthfSizefConcfConc1fAsymfM3LongfM3TransfAlphafDistclass
Float64Float64Float64Float64Float64Float64Float64Float64Float64Float64Int64
128.796716.00212.64490.39180.198227.700422.011-8.202740.09281.88281
231.603611.72352.51850.53030.377326.272223.8238-9.95746.3609205.2611
3162.052136.0314.06120.03740.0187116.741-64.858-45.21676.96256.7881
423.81729.57282.33850.61470.392227.2107-6.4633-7.151310.449116.7371
575.136230.92053.16110.31680.1832-5.527728.552521.83934.648356.4621
⋮⋮⋮⋮⋮⋮⋮⋮⋮⋮⋮⋮
1901621.384610.9172.61610.58570.393415.261811.52452.87662.4229106.8260
1901728.94526.7022.26720.53510.278437.081613.1853-2.963286.7975247.4560
1901875.445547.53053.44830.14170.0549-9.356141.0562-9.466230.2987256.5170
19019120.51376.90183.99390.09440.06835.8043-93.5224-63.838984.6874408.3170
19020187.18153.00143.20930.28760.1539-167.312-168.45631.475552.731272.3170
In [3]:
# y = value to predict, X = features
# Convert DataFrame to tuple of arrays
X = Matrix(magic_data[:, 1:end-1])  # Features
y = magic_data[:, :class];          # Target
In [4]:
# Shuffle observations
shuffled_indices = shuffleobs(1:size(X, 1))  # Shuffle row indices
X_shuffled = X[shuffled_indices, :]
y_shuffled = y[shuffled_indices, :];
In [5]:
# Split shuffled data into training and test sets, 
# 80% training, 20% testing
train_indices, test_indices = splitobs(1:size(X, 1), at = 0.8)  

train_X = X_shuffled[train_indices, :]
train_y = vec(y_shuffled[train_indices, :])
test_X = X_shuffled[test_indices, :]
test_y = vec(y_shuffled[test_indices, :]);
In [6]:
bst = xgboost((train_X, train_y), num_round=1000, objective="binary:logistic")
┌ Info: XGBoost: starting training.
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:601
┌ Info: [1]	train-logloss:0.51961751233641407
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [2]	train-logloss:0.44760091668024238
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [3]	train-logloss:0.40027777335021869
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [4]	train-logloss:0.36961938653603493
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [5]	train-logloss:0.34615575183637354
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [6]	train-logloss:0.32903825727435365
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [7]	train-logloss:0.31338244138606730
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [8]	train-logloss:0.30129257287878103
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [9]	train-logloss:0.29120115306033517
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [10]	train-logloss:0.28516550187829914
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [11]	train-logloss:0.27939344976147779
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [12]	train-logloss:0.27392389411105483
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [13]	train-logloss:0.26756347830237903
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [14]	train-logloss:0.26310670169318373
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [15]	train-logloss:0.26017766008414911
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [16]	train-logloss:0.25566225158072448
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [17]	train-logloss:0.25318789387160479
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [18]	train-logloss:0.24821597620360450
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [19]	train-logloss:0.24441469325922410
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [20]	train-logloss:0.24025268311760489
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [21]	train-logloss:0.23664777121877484
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [22]	train-logloss:0.23376650528890594
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [23]	train-logloss:0.23086384495462861
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [24]	train-logloss:0.22634867749162965
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [25]	train-logloss:0.22182425173782197
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [26]	train-logloss:0.22065596485596509
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [27]	train-logloss:0.21710336601492913
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [28]	train-logloss:0.21248435737963861
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [29]	train-logloss:0.21076874599335263
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [30]	train-logloss:0.20943414775047992
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [31]	train-logloss:0.20895252100069911
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [32]	train-logloss:0.20583056290924212
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [33]	train-logloss:0.20423824301824034
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [34]	train-logloss:0.20377668952593159
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [35]	train-logloss:0.20096424078849504
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [36]	train-logloss:0.20049190974806486
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [37]	train-logloss:0.19859856029631290
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [38]	train-logloss:0.19681615922923548
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [39]	train-logloss:0.19637776153180231
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [40]	train-logloss:0.19531901521294948
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [41]	train-logloss:0.19298252711767278
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [42]	train-logloss:0.19080135570790005
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [43]	train-logloss:0.18845923124697778
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [44]	train-logloss:0.18591343377094657
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [45]	train-logloss:0.18309501650588472
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [46]	train-logloss:0.18158267441539380
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [47]	train-logloss:0.18007077168000560
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [48]	train-logloss:0.17852584510598329
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [49]	train-logloss:0.17640984657901629
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [50]	train-logloss:0.17540213196915994
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [51]	train-logloss:0.17344311575853899
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [52]	train-logloss:0.17065978587405040
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [53]	train-logloss:0.16943812134624586
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [54]	train-logloss:0.16909964396386523
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [55]	train-logloss:0.16765301002030886
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [56]	train-logloss:0.16678525739100603
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [57]	train-logloss:0.16636422968657549
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [58]	train-logloss:0.16560291720116976
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [59]	train-logloss:0.16522827950864841
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [60]	train-logloss:0.16380747586567568
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [61]	train-logloss:0.16249229013691166
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [62]	train-logloss:0.16232398537189668
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [63]	train-logloss:0.16102393767325959
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [64]	train-logloss:0.15903516996708503
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [65]	train-logloss:0.15813790963320365
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [66]	train-logloss:0.15726844193004816
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [67]	train-logloss:0.15619792059798168
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [68]	train-logloss:0.15465163090914075
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [69]	train-logloss:0.15343636109234690
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [70]	train-logloss:0.15200696855688467
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [71]	train-logloss:0.15102293132211944
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [72]	train-logloss:0.14963083794491308
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [73]	train-logloss:0.14787302588839604
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [74]	train-logloss:0.14695276934317347
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [75]	train-logloss:0.14502773910933883
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [76]	train-logloss:0.14371421542282814
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [77]	train-logloss:0.14253583255155092
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [78]	train-logloss:0.14226605105808043
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [79]	train-logloss:0.14215092134834842
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [80]	train-logloss:0.14076208249940303
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [81]	train-logloss:0.13966814977147010
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [82]	train-logloss:0.13825395386024164
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [83]	train-logloss:0.13667364287011799
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [84]	train-logloss:0.13641560556507148
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [85]	train-logloss:0.13567537847757169
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [86]	train-logloss:0.13510976099642091
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [87]	train-logloss:0.13436743254923514
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [88]	train-logloss:0.13337940954364225
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [89]	train-logloss:0.13306951260506786
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [90]	train-logloss:0.13240637688756715
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [91]	train-logloss:0.13183492200356509
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [92]	train-logloss:0.12992805224921045
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [93]	train-logloss:0.12969023527428941
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [94]	train-logloss:0.12852399420663940
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [95]	train-logloss:0.12693981610744787
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [96]	train-logloss:0.12593306918834971
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [97]	train-logloss:0.12431444534191516
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [98]	train-logloss:0.12329078847124869
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [99]	train-logloss:0.12169355349036350
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [100]	train-logloss:0.12100654145275615
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [101]	train-logloss:0.12024637001625038
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [102]	train-logloss:0.11967181558014796
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [103]	train-logloss:0.11884424757535984
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [104]	train-logloss:0.11815336127410184
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [105]	train-logloss:0.11790490104969653
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [106]	train-logloss:0.11684857959584240
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [107]	train-logloss:0.11597598649794502
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [108]	train-logloss:0.11542739507424098
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [109]	train-logloss:0.11389531080777560
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [110]	train-logloss:0.11273844924847796
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [111]	train-logloss:0.11158391292861539
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [112]	train-logloss:0.11059578775731714
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [113]	train-logloss:0.10977598198752242
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [114]	train-logloss:0.10860988673255666
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [115]	train-logloss:0.10804719588834821
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [116]	train-logloss:0.10763692712898044
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [117]	train-logloss:0.10724055469073362
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [118]	train-logloss:0.10661676729899029
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [119]	train-logloss:0.10548616065366413
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [120]	train-logloss:0.10488852441251610
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [121]	train-logloss:0.10446604025775694
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [122]	train-logloss:0.10430761240095765
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [123]	train-logloss:0.10370977116130503
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [124]	train-logloss:0.10264391833173539
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [125]	train-logloss:0.10167912189638988
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [126]	train-logloss:0.10086986861884960
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [127]	train-logloss:0.10022184270030812
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [128]	train-logloss:0.09932302243279013
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [129]	train-logloss:0.09836694638456298
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [130]	train-logloss:0.09697948317032258
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [131]	train-logloss:0.09667371301290253
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [132]	train-logloss:0.09658023303615733
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [133]	train-logloss:0.09568323659135290
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [134]	train-logloss:0.09480007459140199
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [135]	train-logloss:0.09441591630722136
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [136]	train-logloss:0.09307562122183181
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [137]	train-logloss:0.09227327884051142
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [138]	train-logloss:0.09160943601219196
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [139]	train-logloss:0.09084035001058838
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [140]	train-logloss:0.09053834054469379
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [141]	train-logloss:0.08981139093313734
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [142]	train-logloss:0.08917545489192030
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [143]	train-logloss:0.08856002465890550
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [144]	train-logloss:0.08808015916623720
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [145]	train-logloss:0.08777615636830575
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [146]	train-logloss:0.08707866575469940
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [147]	train-logloss:0.08687670515087380
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [148]	train-logloss:0.08680801494143529
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [149]	train-logloss:0.08634332603155008
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [150]	train-logloss:0.08598332860972162
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [151]	train-logloss:0.08544368836970227
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [152]	train-logloss:0.08487455476482191
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [153]	train-logloss:0.08407283398384614
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [154]	train-logloss:0.08361368483013580
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [155]	train-logloss:0.08280499294771221
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [156]	train-logloss:0.08264290508680291
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [157]	train-logloss:0.08182430382859029
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [158]	train-logloss:0.08091704621999292
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [159]	train-logloss:0.08008320248436886
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [160]	train-logloss:0.07948560128761614
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [161]	train-logloss:0.07902334950596109
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [162]	train-logloss:0.07846041059702294
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [163]	train-logloss:0.07815329543432521
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [164]	train-logloss:0.07776351396803673
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [165]	train-logloss:0.07754329899517644
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [166]	train-logloss:0.07687730909798238
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [167]	train-logloss:0.07645410747654879
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [168]	train-logloss:0.07579634722558705
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [169]	train-logloss:0.07515010786751072
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [170]	train-logloss:0.07511063852560845
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [171]	train-logloss:0.07460343445467345
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [172]	train-logloss:0.07439356898954587
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [173]	train-logloss:0.07355561381305611
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [174]	train-logloss:0.07266272517534618
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [175]	train-logloss:0.07211406100198474
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [176]	train-logloss:0.07179573603764135
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [177]	train-logloss:0.07128822038581616
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [178]	train-logloss:0.07084100624931512
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [179]	train-logloss:0.07065559551767620
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [180]	train-logloss:0.07054001627406900
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [181]	train-logloss:0.06990915669989889
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [182]	train-logloss:0.06960688635264700
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [183]	train-logloss:0.06958203318465546
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [184]	train-logloss:0.06903134216944092
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [185]	train-logloss:0.06854995089280846
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [186]	train-logloss:0.06798117353122024
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [187]	train-logloss:0.06788553554975592
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [188]	train-logloss:0.06777886344891934
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [189]	train-logloss:0.06758382982124238
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [190]	train-logloss:0.06738126644913364
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [191]	train-logloss:0.06664032081081916
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [192]	train-logloss:0.06628559538323894
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [193]	train-logloss:0.06612876461842970
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [194]	train-logloss:0.06569518408046525
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [195]	train-logloss:0.06505102116131009
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [196]	train-logloss:0.06483612019926986
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [197]	train-logloss:0.06401068556882389
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [198]	train-logloss:0.06327196345865531
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [199]	train-logloss:0.06258882841872504
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [200]	train-logloss:0.06228687136149047
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [201]	train-logloss:0.06211718283528558
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [202]	train-logloss:0.06193375980607296
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [203]	train-logloss:0.06156465594392192
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [204]	train-logloss:0.06108845034544735
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [205]	train-logloss:0.06074501350719105
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [206]	train-logloss:0.06051997481503351
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [207]	train-logloss:0.06036335680159356
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [208]	train-logloss:0.05965434275448141
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [209]	train-logloss:0.05908393811367341
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [210]	train-logloss:0.05863866726575289
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [211]	train-logloss:0.05803849155619467
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [212]	train-logloss:0.05769724934900743
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [213]	train-logloss:0.05735987829753475
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [214]	train-logloss:0.05728025019241049
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [215]	train-logloss:0.05674998715799764
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [216]	train-logloss:0.05613406639912866
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [217]	train-logloss:0.05570129791624517
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [218]	train-logloss:0.05562286269511855
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [219]	train-logloss:0.05537009830842740
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [220]	train-logloss:0.05512748007509191
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [221]	train-logloss:0.05477195534791699
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [222]	train-logloss:0.05429726837127487
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [223]	train-logloss:0.05367600767762704
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [224]	train-logloss:0.05313056780998530
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [225]	train-logloss:0.05284825454697372
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [226]	train-logloss:0.05255325006252835
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [227]	train-logloss:0.05227475941374071
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [228]	train-logloss:0.05188269544514406
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [229]	train-logloss:0.05148240004012980
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [230]	train-logloss:0.05106896200105575
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [231]	train-logloss:0.05093529510471029
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [232]	train-logloss:0.05063752057884392
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [233]	train-logloss:0.05025239776624289
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [234]	train-logloss:0.05013183420026342
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [235]	train-logloss:0.05007770396783633
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [236]	train-logloss:0.04979059707750586
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [237]	train-logloss:0.04950707627432303
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [238]	train-logloss:0.04924705459952092
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [239]	train-logloss:0.04893851241189404
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [240]	train-logloss:0.04868793569730680
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [241]	train-logloss:0.04811869153528495
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [242]	train-logloss:0.04756065394318806
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [243]	train-logloss:0.04719839637057867
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [244]	train-logloss:0.04695801060607192
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [245]	train-logloss:0.04677595384785704
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [246]	train-logloss:0.04641055533822736
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [247]	train-logloss:0.04617938843237554
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [248]	train-logloss:0.04599383692680997
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [249]	train-logloss:0.04569588078872897
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [250]	train-logloss:0.04530658467679818
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [251]	train-logloss:0.04496273894585710
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [252]	train-logloss:0.04467971313836298
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [253]	train-logloss:0.04454378901394029
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [254]	train-logloss:0.04435033587286611
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [255]	train-logloss:0.04400446725989347
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [256]	train-logloss:0.04366427444470738
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [257]	train-logloss:0.04321558094063497
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [258]	train-logloss:0.04281833395745468
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [259]	train-logloss:0.04232135904547031
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [260]	train-logloss:0.04221894025753070
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [261]	train-logloss:0.04200816604902192
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [262]	train-logloss:0.04175308486319876
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [263]	train-logloss:0.04149338383840621
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [264]	train-logloss:0.04112852207474754
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [265]	train-logloss:0.04076108566971821
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [266]	train-logloss:0.04040885524403230
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [267]	train-logloss:0.04011515808545287
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [268]	train-logloss:0.04003946488585298
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [269]	train-logloss:0.03980586206816004
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [270]	train-logloss:0.03961274475366007
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [271]	train-logloss:0.03942118389361072
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [272]	train-logloss:0.03932888580213065
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [273]	train-logloss:0.03930696610236632
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [274]	train-logloss:0.03926249205345972
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [275]	train-logloss:0.03913472391483623
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [276]	train-logloss:0.03895781661668305
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [277]	train-logloss:0.03874682574407194
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [278]	train-logloss:0.03871891236673920
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [279]	train-logloss:0.03856991657231952
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [280]	train-logloss:0.03842544843267662
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [281]	train-logloss:0.03820979179211228
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [282]	train-logloss:0.03805386654513349
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [283]	train-logloss:0.03782924566156109
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [284]	train-logloss:0.03759381261841757
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [285]	train-logloss:0.03738164782382223
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [286]	train-logloss:0.03702974538469843
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [287]	train-logloss:0.03687868511757787
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [288]	train-logloss:0.03660382087577373
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [289]	train-logloss:0.03635444484725191
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [290]	train-logloss:0.03620216244565626
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [291]	train-logloss:0.03597392218471848
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [292]	train-logloss:0.03582273284215954
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [293]	train-logloss:0.03564003380651583
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [294]	train-logloss:0.03536030500025977
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [295]	train-logloss:0.03516971333009448
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [296]	train-logloss:0.03502357684807623
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [297]	train-logloss:0.03488911715978513
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [298]	train-logloss:0.03468445057496673
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [299]	train-logloss:0.03449265810310654
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [300]	train-logloss:0.03429866793636114
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [301]	train-logloss:0.03415689666770416
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [302]	train-logloss:0.03396120660113213
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [303]	train-logloss:0.03384335061217205
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [304]	train-logloss:0.03368609265174376
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [305]	train-logloss:0.03350031115500245
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [306]	train-logloss:0.03342137131720670
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [307]	train-logloss:0.03332268492901395
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [308]	train-logloss:0.03306690098411134
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [309]	train-logloss:0.03298421067208970
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [310]	train-logloss:0.03270049979654840
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [311]	train-logloss:0.03262541133479220
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [312]	train-logloss:0.03228914776189839
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [313]	train-logloss:0.03194082458019639
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [314]	train-logloss:0.03175302211401572
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [315]	train-logloss:0.03162879818477653
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [316]	train-logloss:0.03160216440427436
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [317]	train-logloss:0.03153027450137058
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [318]	train-logloss:0.03147310513100465
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [319]	train-logloss:0.03124090969182850
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [320]	train-logloss:0.03096972549836785
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [321]	train-logloss:0.03094239397235568
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [322]	train-logloss:0.03081964760016912
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [323]	train-logloss:0.03063825966899462
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [324]	train-logloss:0.03043506336961369
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [325]	train-logloss:0.03009682392021452
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [326]	train-logloss:0.02982713218281036
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [327]	train-logloss:0.02962539576799276
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [328]	train-logloss:0.02952321343955668
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [329]	train-logloss:0.02948659032408235
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [330]	train-logloss:0.02942785922864097
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [331]	train-logloss:0.02925021876317124
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [332]	train-logloss:0.02919155302018417
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [333]	train-logloss:0.02902800144050786
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [334]	train-logloss:0.02887188769171582
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [335]	train-logloss:0.02874535603709994
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [336]	train-logloss:0.02865250833034744
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [337]	train-logloss:0.02851901976039596
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [338]	train-logloss:0.02832813042445512
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [339]	train-logloss:0.02817792433589044
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [340]	train-logloss:0.02803760535818762
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [341]	train-logloss:0.02800953627778252
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [342]	train-logloss:0.02794815930343972
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [343]	train-logloss:0.02788207367634133
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [344]	train-logloss:0.02769022465037024
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [345]	train-logloss:0.02764250910255829
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [346]	train-logloss:0.02761076282119473
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [347]	train-logloss:0.02755889437903088
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [348]	train-logloss:0.02752114673319464
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [349]	train-logloss:0.02746751588455047
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [350]	train-logloss:0.02734632509107824
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [351]	train-logloss:0.02728695786666925
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [352]	train-logloss:0.02716511008030706
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [353]	train-logloss:0.02705971341709506
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [354]	train-logloss:0.02687294502411161
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [355]	train-logloss:0.02673290685305418
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [356]	train-logloss:0.02660996779069262
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [357]	train-logloss:0.02651440242679854
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [358]	train-logloss:0.02643828356166616
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [359]	train-logloss:0.02634372765090557
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [360]	train-logloss:0.02625270238984724
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [361]	train-logloss:0.02618564782203739
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [362]	train-logloss:0.02607632209683155
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [363]	train-logloss:0.02597594486183463
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [364]	train-logloss:0.02585761699676137
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [365]	train-logloss:0.02583539999559024
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [366]	train-logloss:0.02579856685246967
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [367]	train-logloss:0.02561860413749268
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [368]	train-logloss:0.02552118547512839
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [369]	train-logloss:0.02540589408384659
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [370]	train-logloss:0.02528640384402985
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [371]	train-logloss:0.02498724980489923
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [372]	train-logloss:0.02484954385576760
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [373]	train-logloss:0.02472153209575016
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [374]	train-logloss:0.02457810144632969
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [375]	train-logloss:0.02447186440411441
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [376]	train-logloss:0.02426474289496602
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [377]	train-logloss:0.02419938569478596
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [378]	train-logloss:0.02416646062872711
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [379]	train-logloss:0.02411970394816164
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [380]	train-logloss:0.02404324744169030
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [381]	train-logloss:0.02402190979814802
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [382]	train-logloss:0.02400923263446469
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [383]	train-logloss:0.02394965432437678
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [384]	train-logloss:0.02393010279670367
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [385]	train-logloss:0.02389917819076301
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [386]	train-logloss:0.02367030968229173
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [387]	train-logloss:0.02349446427941853
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [388]	train-logloss:0.02335969452685646
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [389]	train-logloss:0.02323979227476270
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [390]	train-logloss:0.02310073443026097
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [391]	train-logloss:0.02298341068691680
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [392]	train-logloss:0.02287011863527266
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [393]	train-logloss:0.02280213392067644
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [394]	train-logloss:0.02279505602339334
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [395]	train-logloss:0.02278759444322412
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [396]	train-logloss:0.02273910813470813
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [397]	train-logloss:0.02267836283945270
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [398]	train-logloss:0.02262188936860439
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [399]	train-logloss:0.02247592209513787
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [400]	train-logloss:0.02239190121957920
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [401]	train-logloss:0.02235124376721088
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [402]	train-logloss:0.02224062439571105
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [403]	train-logloss:0.02214149088934293
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [404]	train-logloss:0.02190942002405738
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [405]	train-logloss:0.02185307208057055
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [406]	train-logloss:0.02166253118377742
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [407]	train-logloss:0.02155034055633575
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [408]	train-logloss:0.02138455413091965
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [409]	train-logloss:0.02135104878190169
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [410]	train-logloss:0.02120744485664564
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [411]	train-logloss:0.02116984549002362
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [412]	train-logloss:0.02114228323877502
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [413]	train-logloss:0.02111781906205291
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [414]	train-logloss:0.02109775930579247
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [415]	train-logloss:0.02101504864518268
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [416]	train-logloss:0.02089002345615948
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [417]	train-logloss:0.02070934087790537
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [418]	train-logloss:0.02063049943099770
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [419]	train-logloss:0.02052327537089262
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [420]	train-logloss:0.02045342709269686
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [421]	train-logloss:0.02035251025102016
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [422]	train-logloss:0.02027717147837670
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [423]	train-logloss:0.02021259806088089
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [424]	train-logloss:0.02011605967395489
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [425]	train-logloss:0.02004573381971659
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [426]	train-logloss:0.01994141814520599
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [427]	train-logloss:0.01985186631675150
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [428]	train-logloss:0.01981526940352050
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [429]	train-logloss:0.01971036899817853
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [430]	train-logloss:0.01963372097825454
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [431]	train-logloss:0.01952499777691917
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [432]	train-logloss:0.01945818064283211
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [433]	train-logloss:0.01935258484066357
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [434]	train-logloss:0.01926744812278715
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [435]	train-logloss:0.01920344009614192
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [436]	train-logloss:0.01905452759781249
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [437]	train-logloss:0.01896066735146401
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [438]	train-logloss:0.01889505517023169
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [439]	train-logloss:0.01887942101721714
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [440]	train-logloss:0.01880728677878923
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [441]	train-logloss:0.01874879175663594
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [442]	train-logloss:0.01871158775459321
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [443]	train-logloss:0.01865746190523406
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [444]	train-logloss:0.01863828253618596
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [445]	train-logloss:0.01859546966895072
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [446]	train-logloss:0.01858498621284380
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [447]	train-logloss:0.01852189150286627
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [448]	train-logloss:0.01840766707466764
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [449]	train-logloss:0.01833568152602030
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [450]	train-logloss:0.01828647144143513
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [451]	train-logloss:0.01817641183622298
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [452]	train-logloss:0.01815187618678730
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [453]	train-logloss:0.01809120124414550
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [454]	train-logloss:0.01801544403637434
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [455]	train-logloss:0.01792453444628076
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [456]	train-logloss:0.01784292245237453
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [457]	train-logloss:0.01777741009792765
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [458]	train-logloss:0.01776249357222583
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [459]	train-logloss:0.01768210477101357
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [460]	train-logloss:0.01762156585961315
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [461]	train-logloss:0.01761181842888548
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [462]	train-logloss:0.01748861632640119
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [463]	train-logloss:0.01741859304098962
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [464]	train-logloss:0.01738893282602813
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [465]	train-logloss:0.01729064268161319
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [466]	train-logloss:0.01715178748742470
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [467]	train-logloss:0.01709239458458849
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [468]	train-logloss:0.01696066941271105
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [469]	train-logloss:0.01686442566404682
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [470]	train-logloss:0.01677328747657238
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [471]	train-logloss:0.01675852545758596
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [472]	train-logloss:0.01669489132159944
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [473]	train-logloss:0.01658742370948443
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [474]	train-logloss:0.01652747602822875
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [475]	train-logloss:0.01650339481131525
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [476]	train-logloss:0.01647037380258926
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [477]	train-logloss:0.01643848147813957
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [478]	train-logloss:0.01637186380613144
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [479]	train-logloss:0.01630524678522951
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [480]	train-logloss:0.01626003063457480
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [481]	train-logloss:0.01616330095894327
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [482]	train-logloss:0.01606703761249800
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [483]	train-logloss:0.01598327125543011
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [484]	train-logloss:0.01592887919496642
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [485]	train-logloss:0.01590802097565608
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [486]	train-logloss:0.01585944896519869
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [487]	train-logloss:0.01579155439763985
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [488]	train-logloss:0.01570213167313949
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [489]	train-logloss:0.01565389816023177
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [490]	train-logloss:0.01562501463484202
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [491]	train-logloss:0.01557480761744538
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [492]	train-logloss:0.01551629524829739
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [493]	train-logloss:0.01547057907745361
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [494]	train-logloss:0.01536452944347844
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [495]	train-logloss:0.01529957421789930
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [496]	train-logloss:0.01519564149157431
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [497]	train-logloss:0.01508528913769990
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [498]	train-logloss:0.01505593583337234
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [499]	train-logloss:0.01500850300206954
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [500]	train-logloss:0.01496391841779485
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [501]	train-logloss:0.01492948282345258
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [502]	train-logloss:0.01483386770599590
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [503]	train-logloss:0.01472001953684454
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [504]	train-logloss:0.01466851799528334
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [505]	train-logloss:0.01466221817285342
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [506]	train-logloss:0.01459674307934019
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [507]	train-logloss:0.01456304552049535
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [508]	train-logloss:0.01452167065385881
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [509]	train-logloss:0.01450695249660698
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [510]	train-logloss:0.01444479361091354
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [511]	train-logloss:0.01438351103628392
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [512]	train-logloss:0.01434792627950104
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [513]	train-logloss:0.01433245016823121
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [514]	train-logloss:0.01429499414202130
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [515]	train-logloss:0.01419474755160397
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [516]	train-logloss:0.01411119030509826
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [517]	train-logloss:0.01405460716418721
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [518]	train-logloss:0.01397222133047053
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [519]	train-logloss:0.01390356501075816
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [520]	train-logloss:0.01386562315222132
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [521]	train-logloss:0.01378201612803326
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [522]	train-logloss:0.01376376706709129
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [523]	train-logloss:0.01370826270294995
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [524]	train-logloss:0.01362795576582434
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [525]	train-logloss:0.01357035468457409
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [526]	train-logloss:0.01353814008603167
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [527]	train-logloss:0.01352351174468751
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [528]	train-logloss:0.01349447213428833
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [529]	train-logloss:0.01346423259621513
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [530]	train-logloss:0.01345340481892457
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [531]	train-logloss:0.01342254697673883
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [532]	train-logloss:0.01339325855172635
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [533]	train-logloss:0.01335669451302847
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [534]	train-logloss:0.01329653216800403
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [535]	train-logloss:0.01328901394860864
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [536]	train-logloss:0.01327111413504662
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [537]	train-logloss:0.01323631955717849
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [538]	train-logloss:0.01322772934545500
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [539]	train-logloss:0.01321392436318519
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [540]	train-logloss:0.01320837498548867
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [541]	train-logloss:0.01316567023458058
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [542]	train-logloss:0.01312832651342504
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [543]	train-logloss:0.01307340762017105
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [544]	train-logloss:0.01302458007816428
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [545]	train-logloss:0.01300091184311081
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [546]	train-logloss:0.01298929412592265
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [547]	train-logloss:0.01296082595496600
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [548]	train-logloss:0.01292844131474267
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [549]	train-logloss:0.01291562886656663
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [550]	train-logloss:0.01290072253616445
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [551]	train-logloss:0.01284508187861081
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [552]	train-logloss:0.01277057471120936
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [553]	train-logloss:0.01268157645472383
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [554]	train-logloss:0.01265883802174965
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [555]	train-logloss:0.01261912680547296
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [556]	train-logloss:0.01259291857936222
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [557]	train-logloss:0.01255811711569558
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [558]	train-logloss:0.01250117623201847
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [559]	train-logloss:0.01246661321673810
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [560]	train-logloss:0.01245047194235318
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [561]	train-logloss:0.01241745815947324
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [562]	train-logloss:0.01234044197031338
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [563]	train-logloss:0.01231630967763731
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [564]	train-logloss:0.01228468405055888
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [565]	train-logloss:0.01225512884085673
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [566]	train-logloss:0.01223571096155269
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [567]	train-logloss:0.01221086092505892
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [568]	train-logloss:0.01218199857456178
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [569]	train-logloss:0.01216204289108406
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [570]	train-logloss:0.01215473428034617
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [571]	train-logloss:0.01210788555314033
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [572]	train-logloss:0.01205315384193548
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [573]	train-logloss:0.01201210701804968
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [574]	train-logloss:0.01194315157646374
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [575]	train-logloss:0.01190869182216422
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [576]	train-logloss:0.01187838674828259
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [577]	train-logloss:0.01182962272774432
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [578]	train-logloss:0.01178401068857998
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [579]	train-logloss:0.01172765223562709
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [580]	train-logloss:0.01171885399296979
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [581]	train-logloss:0.01167028351459798
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [582]	train-logloss:0.01163417584765278
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [583]	train-logloss:0.01160565794789211
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [584]	train-logloss:0.01156177933861340
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [585]	train-logloss:0.01153426478252963
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [586]	train-logloss:0.01150700702874884
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [587]	train-logloss:0.01149733627496177
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [588]	train-logloss:0.01148268553405372
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [589]	train-logloss:0.01145797759110765
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [590]	train-logloss:0.01143695076806693
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [591]	train-logloss:0.01141115630726302
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [592]	train-logloss:0.01133381700229810
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [593]	train-logloss:0.01128666655566847
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [594]	train-logloss:0.01123848829818370
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [595]	train-logloss:0.01122012949844179
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [596]	train-logloss:0.01118515402995262
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [597]	train-logloss:0.01117511155003376
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [598]	train-logloss:0.01112567753354627
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [599]	train-logloss:0.01107186117553266
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [600]	train-logloss:0.01103483355945194
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [601]	train-logloss:0.01098822065331726
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [602]	train-logloss:0.01096583721871912
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [603]	train-logloss:0.01095478152891104
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [604]	train-logloss:0.01092647196299757
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [605]	train-logloss:0.01089530593975932
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [606]	train-logloss:0.01085232984341887
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [607]	train-logloss:0.01084020262128218
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [608]	train-logloss:0.01079893949325451
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [609]	train-logloss:0.01074999206209656
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [610]	train-logloss:0.01069440095105091
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [611]	train-logloss:0.01066322807628399
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [612]	train-logloss:0.01065490993275512
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [613]	train-logloss:0.01062998009524306
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [614]	train-logloss:0.01060057827742458
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [615]	train-logloss:0.01056080236094481
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [616]	train-logloss:0.01052498282974929
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [617]	train-logloss:0.01048376267740512
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [618]	train-logloss:0.01046774071998368
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [619]	train-logloss:0.01043935996500326
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [620]	train-logloss:0.01041524771028392
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [621]	train-logloss:0.01039023670554826
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [622]	train-logloss:0.01036718454669821
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [623]	train-logloss:0.01030128158850849
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [624]	train-logloss:0.01027828897178456
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [625]	train-logloss:0.01026725396718180
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [626]	train-logloss:0.01025223830705564
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [627]	train-logloss:0.01024163433138303
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [628]	train-logloss:0.01022678862406562
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [629]	train-logloss:0.01015260275730382
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [630]	train-logloss:0.01014192740562906
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [631]	train-logloss:0.01012861232953431
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [632]	train-logloss:0.01010673574978717
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [633]	train-logloss:0.01008253028054421
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [634]	train-logloss:0.01003231513864643
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [635]	train-logloss:0.01001133010142200
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [636]	train-logloss:0.00997598284889571
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [637]	train-logloss:0.00992894173024439
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [638]	train-logloss:0.00991952397327576
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [639]	train-logloss:0.00988106013317015
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [640]	train-logloss:0.00985957335510008
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [641]	train-logloss:0.00984748482769988
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [642]	train-logloss:0.00980483444967912
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [643]	train-logloss:0.00976367381809948
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [644]	train-logloss:0.00974322937585332
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [645]	train-logloss:0.00972551235613266
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [646]	train-logloss:0.00971580728302929
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [647]	train-logloss:0.00966039626046783
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [648]	train-logloss:0.00963394265708105
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [649]	train-logloss:0.00957967131059715
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [650]	train-logloss:0.00954855563132731
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [651]	train-logloss:0.00951815209392538
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [652]	train-logloss:0.00950000935650319
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [653]	train-logloss:0.00948694500881886
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [654]	train-logloss:0.00947512077603839
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [655]	train-logloss:0.00943706192996819
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [656]	train-logloss:0.00942277496559798
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [657]	train-logloss:0.00939784096154396
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [658]	train-logloss:0.00936136830329513
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [659]	train-logloss:0.00932493857611801
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [660]	train-logloss:0.00929438950851855
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [661]	train-logloss:0.00926476084320382
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [662]	train-logloss:0.00923625491183814
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [663]	train-logloss:0.00922543703302911
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [664]	train-logloss:0.00922159476807707
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [665]	train-logloss:0.00920426855443771
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [666]	train-logloss:0.00915809429732180
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [667]	train-logloss:0.00914843428934894
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [668]	train-logloss:0.00911377233551006
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [669]	train-logloss:0.00909097476201146
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [670]	train-logloss:0.00907692030181292
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [671]	train-logloss:0.00906837145010598
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [672]	train-logloss:0.00904983195333619
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [673]	train-logloss:0.00903259399922981
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [674]	train-logloss:0.00899524016199206
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [675]	train-logloss:0.00898366323193356
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [676]	train-logloss:0.00896648495766150
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [677]	train-logloss:0.00892709034700799
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [678]	train-logloss:0.00889176868535204
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [679]	train-logloss:0.00887480257413580
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [680]	train-logloss:0.00884971834600890
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [681]	train-logloss:0.00884121689066376
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [682]	train-logloss:0.00881737850886361
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [683]	train-logloss:0.00881268518557312
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [684]	train-logloss:0.00878129804648557
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [685]	train-logloss:0.00876750153512971
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [686]	train-logloss:0.00874691979828424
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [687]	train-logloss:0.00873542169400331
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [688]	train-logloss:0.00870282517385329
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [689]	train-logloss:0.00867613672296370
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [690]	train-logloss:0.00864690495025087
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [691]	train-logloss:0.00863966819347584
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [692]	train-logloss:0.00862952531858458
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [693]	train-logloss:0.00861467763988551
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [694]	train-logloss:0.00860820133332151
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [695]	train-logloss:0.00859331114592072
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [696]	train-logloss:0.00857826172231274
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [697]	train-logloss:0.00856740005656406
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [698]	train-logloss:0.00854708971892328
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [699]	train-logloss:0.00853141884583333
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [700]	train-logloss:0.00848340965636480
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [701]	train-logloss:0.00844581997643876
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [702]	train-logloss:0.00842109670155042
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [703]	train-logloss:0.00838609212117314
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [704]	train-logloss:0.00836965747608538
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [705]	train-logloss:0.00834899324108149
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [706]	train-logloss:0.00834198337818730
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [707]	train-logloss:0.00833035802480627
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [708]	train-logloss:0.00831340383860199
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [709]	train-logloss:0.00830319577290935
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [710]	train-logloss:0.00829774588922342
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [711]	train-logloss:0.00829269213637631
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [712]	train-logloss:0.00828920351069479
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [713]	train-logloss:0.00825963285053409
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [714]	train-logloss:0.00824508194090341
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [715]	train-logloss:0.00821733341413680
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [716]	train-logloss:0.00820272438538847
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [717]	train-logloss:0.00819329743267744
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [718]	train-logloss:0.00817280740303259
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [719]	train-logloss:0.00814314326370070
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [720]	train-logloss:0.00811530231792388
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [721]	train-logloss:0.00809150070221789
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [722]	train-logloss:0.00808015268789354
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [723]	train-logloss:0.00807255892560440
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [724]	train-logloss:0.00805175763708327
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [725]	train-logloss:0.00802487444095652
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [726]	train-logloss:0.00799516797068902
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [727]	train-logloss:0.00798947022565704
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [728]	train-logloss:0.00798009947432766
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [729]	train-logloss:0.00797564167862735
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [730]	train-logloss:0.00794958741281653
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [731]	train-logloss:0.00792554822776314
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [732]	train-logloss:0.00791263667874411
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [733]	train-logloss:0.00789545544039062
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [734]	train-logloss:0.00788335684581247
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [735]	train-logloss:0.00786871089718683
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [736]	train-logloss:0.00785156073822444
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [737]	train-logloss:0.00782293728287099
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [738]	train-logloss:0.00779752581866866
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [739]	train-logloss:0.00777963503471901
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [740]	train-logloss:0.00776204130918720
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [741]	train-logloss:0.00775177814789213
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [742]	train-logloss:0.00772250332308437
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [743]	train-logloss:0.00771618360541931
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [744]	train-logloss:0.00771221912875133
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [745]	train-logloss:0.00767513317727535
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [746]	train-logloss:0.00766217799948886
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [747]	train-logloss:0.00764841623879821
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [748]	train-logloss:0.00764068110520308
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [749]	train-logloss:0.00763726887583092
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [750]	train-logloss:0.00761187588399303
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [751]	train-logloss:0.00758319217252477
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [752]	train-logloss:0.00757387622560983
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [753]	train-logloss:0.00756655953922726
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [754]	train-logloss:0.00755869772351019
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [755]	train-logloss:0.00754961687534439
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [756]	train-logloss:0.00753974796475465
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [757]	train-logloss:0.00751602405817113
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [758]	train-logloss:0.00750946163874908
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [759]	train-logloss:0.00748694627059838
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [760]	train-logloss:0.00748047855176386
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [761]	train-logloss:0.00745906403819480
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [762]	train-logloss:0.00744805585243085
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [763]	train-logloss:0.00743225156814987
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [764]	train-logloss:0.00741368523428027
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [765]	train-logloss:0.00738699198347090
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [766]	train-logloss:0.00737551152376741
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [767]	train-logloss:0.00736769729480904
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [768]	train-logloss:0.00736120487698751
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [769]	train-logloss:0.00734405940971157
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [770]	train-logloss:0.00733011537887587
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [771]	train-logloss:0.00732656247747283
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [772]	train-logloss:0.00731941084737072
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [773]	train-logloss:0.00731383694886096
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [774]	train-logloss:0.00730901088691128
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [775]	train-logloss:0.00730522029944050
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [776]	train-logloss:0.00729886152109368
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [777]	train-logloss:0.00727959438012419
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [778]	train-logloss:0.00727568461204922
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [779]	train-logloss:0.00725161559715639
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [780]	train-logloss:0.00724067234709319
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [781]	train-logloss:0.00723357397878292
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [782]	train-logloss:0.00723206887944104
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [783]	train-logloss:0.00722024453984003
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [784]	train-logloss:0.00721325696040665
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [785]	train-logloss:0.00719831520032933
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [786]	train-logloss:0.00718632258843381
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [787]	train-logloss:0.00716017295755736
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [788]	train-logloss:0.00713834553258163
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [789]	train-logloss:0.00710979086132592
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [790]	train-logloss:0.00709859824899376
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [791]	train-logloss:0.00707449059643708
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [792]	train-logloss:0.00705024279210385
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [793]	train-logloss:0.00704199592996286
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [794]	train-logloss:0.00703732883678914
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [795]	train-logloss:0.00702276584750171
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [796]	train-logloss:0.00699780664585650
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [797]	train-logloss:0.00697027650953712
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [798]	train-logloss:0.00695473276977823
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [799]	train-logloss:0.00695076542407719
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [800]	train-logloss:0.00693970212917891
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [801]	train-logloss:0.00692627738323515
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [802]	train-logloss:0.00690217763809186
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [803]	train-logloss:0.00687262983285604
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [804]	train-logloss:0.00685983031758773
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [805]	train-logloss:0.00684942017841310
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [806]	train-logloss:0.00683002221362409
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [807]	train-logloss:0.00681638125614928
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [808]	train-logloss:0.00680562665816440
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [809]	train-logloss:0.00677349380334526
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [810]	train-logloss:0.00675233353820429
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [811]	train-logloss:0.00674759369017910
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [812]	train-logloss:0.00672062691704064
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [813]	train-logloss:0.00670001377960873
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [814]	train-logloss:0.00669248020563085
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [815]	train-logloss:0.00668177514045796
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [816]	train-logloss:0.00666309221276575
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [817]	train-logloss:0.00664588784845052
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [818]	train-logloss:0.00662988226831803
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [819]	train-logloss:0.00660695183252476
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [820]	train-logloss:0.00659160176814812
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [821]	train-logloss:0.00656312287569540
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [822]	train-logloss:0.00654957759014318
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [823]	train-logloss:0.00654357218036846
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [824]	train-logloss:0.00652788225832010
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [825]	train-logloss:0.00652496858570116
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [826]	train-logloss:0.00651444525326224
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [827]	train-logloss:0.00650223712095533
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [828]	train-logloss:0.00648393919466842
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [829]	train-logloss:0.00647203355582637
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [830]	train-logloss:0.00645483734211155
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [831]	train-logloss:0.00643602449573467
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [832]	train-logloss:0.00642545964194493
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [833]	train-logloss:0.00642267411734306
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [834]	train-logloss:0.00641643127384566
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [835]	train-logloss:0.00641099689923162
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [836]	train-logloss:0.00640700835901249
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [837]	train-logloss:0.00639823862572724
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [838]	train-logloss:0.00637867622246064
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [839]	train-logloss:0.00636012794075806
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [840]	train-logloss:0.00633988442094835
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [841]	train-logloss:0.00631419561485942
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [842]	train-logloss:0.00630570759756670
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [843]	train-logloss:0.00629784816924764
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [844]	train-logloss:0.00629282461469779
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [845]	train-logloss:0.00628518966831908
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [846]	train-logloss:0.00626949644697054
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [847]	train-logloss:0.00624879456584969
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [848]	train-logloss:0.00622793046959312
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [849]	train-logloss:0.00620459333103435
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [850]	train-logloss:0.00619516969540206
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [851]	train-logloss:0.00619216848794892
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [852]	train-logloss:0.00617666798030860
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [853]	train-logloss:0.00616581192352163
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [854]	train-logloss:0.00615353281749193
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [855]	train-logloss:0.00613875399092076
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [856]	train-logloss:0.00613066427313764
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [857]	train-logloss:0.00611993748091777
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [858]	train-logloss:0.00610732992158868
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [859]	train-logloss:0.00609508841768095
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [860]	train-logloss:0.00609266942414623
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [861]	train-logloss:0.00607446237423355
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [862]	train-logloss:0.00606368771751572
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [863]	train-logloss:0.00604413623052650
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [864]	train-logloss:0.00603799535876057
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [865]	train-logloss:0.00603002920745639
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [866]	train-logloss:0.00601470386033942
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [867]	train-logloss:0.00600189152082498
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [868]	train-logloss:0.00599617714692610
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [869]	train-logloss:0.00599212343659127
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [870]	train-logloss:0.00598194391196221
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [871]	train-logloss:0.00597872812537568
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [872]	train-logloss:0.00596670769408839
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [873]	train-logloss:0.00595728558391649
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [874]	train-logloss:0.00594441819338502
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [875]	train-logloss:0.00593953307837480
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [876]	train-logloss:0.00593544580058388
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [877]	train-logloss:0.00590584894477248
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [878]	train-logloss:0.00589737141246872
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [879]	train-logloss:0.00589571136456632
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [880]	train-logloss:0.00589016168652569
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [881]	train-logloss:0.00587544615325324
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [882]	train-logloss:0.00586778508288300
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [883]	train-logloss:0.00585757734887022
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [884]	train-logloss:0.00584593640340275
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [885]	train-logloss:0.00584342272343029
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [886]	train-logloss:0.00584037421750301
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [887]	train-logloss:0.00583700074467117
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [888]	train-logloss:0.00582306837038003
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [889]	train-logloss:0.00580879129885554
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [890]	train-logloss:0.00579913592418984
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [891]	train-logloss:0.00578906551959655
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [892]	train-logloss:0.00577860652652768
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [893]	train-logloss:0.00576277290461829
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [894]	train-logloss:0.00575558618496729
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [895]	train-logloss:0.00573882088351693
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [896]	train-logloss:0.00573037707601192
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [897]	train-logloss:0.00570422074438066
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [898]	train-logloss:0.00569872324854333
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [899]	train-logloss:0.00568246501698889
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [900]	train-logloss:0.00567689210857880
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [901]	train-logloss:0.00566248485188219
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [902]	train-logloss:0.00565041953690110
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [903]	train-logloss:0.00563213449937815
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [904]	train-logloss:0.00562737003130019
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [905]	train-logloss:0.00561304779407860
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [906]	train-logloss:0.00559956052600632
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [907]	train-logloss:0.00558804066265545
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [908]	train-logloss:0.00558177413347246
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [909]	train-logloss:0.00556641444704043
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [910]	train-logloss:0.00555759898297306
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [911]	train-logloss:0.00554808859118590
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [912]	train-logloss:0.00552855631472422
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [913]	train-logloss:0.00552078850172956
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [914]	train-logloss:0.00551734113967885
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [915]	train-logloss:0.00551243705347392
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [916]	train-logloss:0.00550579310145234
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [917]	train-logloss:0.00549802769633380
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [918]	train-logloss:0.00549234378733605
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [919]	train-logloss:0.00549010730645304
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [920]	train-logloss:0.00548450240695299
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [921]	train-logloss:0.00547780856943712
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [922]	train-logloss:0.00546751411005160
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [923]	train-logloss:0.00546397783366743
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [924]	train-logloss:0.00544878852436909
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [925]	train-logloss:0.00542668864564000
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [926]	train-logloss:0.00542168140699877
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [927]	train-logloss:0.00540860098408640
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [928]	train-logloss:0.00539849007926987
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [929]	train-logloss:0.00539443577380299
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [930]	train-logloss:0.00539208990993767
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [931]	train-logloss:0.00538516566120023
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [932]	train-logloss:0.00537409679468152
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [933]	train-logloss:0.00536164813992183
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [934]	train-logloss:0.00535833459173663
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [935]	train-logloss:0.00534666160193763
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [936]	train-logloss:0.00534206519515718
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [937]	train-logloss:0.00532391855153391
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [938]	train-logloss:0.00530522394651191
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [939]	train-logloss:0.00530011590318026
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [940]	train-logloss:0.00529663728234924
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [941]	train-logloss:0.00529014869780570
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [942]	train-logloss:0.00527914235645166
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [943]	train-logloss:0.00526760614813335
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [944]	train-logloss:0.00525339126770788
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [945]	train-logloss:0.00524021620089395
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [946]	train-logloss:0.00523541984201873
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [947]	train-logloss:0.00523060499715142
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [948]	train-logloss:0.00522710560337582
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [949]	train-logloss:0.00521590773089574
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [950]	train-logloss:0.00521166893585383
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [951]	train-logloss:0.00520163280519990
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [952]	train-logloss:0.00519618691792184
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [953]	train-logloss:0.00519459957439803
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [954]	train-logloss:0.00518414279797108
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [955]	train-logloss:0.00517930659754612
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [956]	train-logloss:0.00517225417770412
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [957]	train-logloss:0.00516944538504270
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [958]	train-logloss:0.00515704362497539
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [959]	train-logloss:0.00514349631314236
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [960]	train-logloss:0.00513638315652951
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [961]	train-logloss:0.00512951170271786
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [962]	train-logloss:0.00511472230037653
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [963]	train-logloss:0.00510718990721081
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [964]	train-logloss:0.00509703371950592
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [965]	train-logloss:0.00508543689612940
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [966]	train-logloss:0.00507125499042451
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [967]	train-logloss:0.00505427263511115
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [968]	train-logloss:0.00504977008874441
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [969]	train-logloss:0.00503881732136989
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [970]	train-logloss:0.00503756110662677
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [971]	train-logloss:0.00502453454939361
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [972]	train-logloss:0.00501321325230539
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [973]	train-logloss:0.00500980769985504
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [974]	train-logloss:0.00499800262529639
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [975]	train-logloss:0.00498194272281517
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [976]	train-logloss:0.00497374507227479
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [977]	train-logloss:0.00496312171327368
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [978]	train-logloss:0.00496108345153501
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [979]	train-logloss:0.00495688994469528
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [980]	train-logloss:0.00495486540780942
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [981]	train-logloss:0.00494832978617354
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [982]	train-logloss:0.00494384126404924
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [983]	train-logloss:0.00493176466161026
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [984]	train-logloss:0.00492920504838072
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [985]	train-logloss:0.00492546558323727
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [986]	train-logloss:0.00491371532498809
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [987]	train-logloss:0.00490169727821665
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [988]	train-logloss:0.00489999474230095
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [989]	train-logloss:0.00489845359765416
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [990]	train-logloss:0.00488231889893285
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [991]	train-logloss:0.00487725778871872
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [992]	train-logloss:0.00486861935014483
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [993]	train-logloss:0.00486535538198981
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [994]	train-logloss:0.00486062316481094
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [995]	train-logloss:0.00485807698967945
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [996]	train-logloss:0.00485630354959092
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [997]	train-logloss:0.00485230582334499
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [998]	train-logloss:0.00484918277934076
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [999]	train-logloss:0.00484289924070381
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: [1000]	train-logloss:0.00484130405699632
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:451
┌ Info: Training rounds complete.
└ @ XGBoost /Users/reygers/.julia/packages/XGBoost/nqMqQ/src/booster.jl:603
Booster()

Evaluate model on test data

In [7]:
predictions = predict(bst, test_X);

Plot predicted probabilities for the test sample for signal and background events:

In [8]:
signal_indicees = findall(test_y .== 1);
backgr_indecees = findall(test_y .!= 1);

stephist(predictions[signal_indicees], normalize=true, label="signal", bins=100, size=(400,300))
stephist!(predictions[backgr_indecees], normalize=true, label="backgr", bins=100)

Accuracy (fraction of correctly classified instances):

In [9]:
# Calculate evaluation metric (e.g., accuracy)
threshold = 0.8
predicted_labels = Int64.(predictions .> threshold)
acc = sum(predicted_labels .== test_y) / length(test_y)
println("accuracy = $(acc)")
accuracy = 0.867770767613039

MNIST classification using Flux¶

See here for more information on the https://en.wikipedia.org/wiki/MNIST_database.

Convolutional Neural Networks (CNNs)¶

Layers of a CNN¶

The following code is from the course Julia for Optimization and Learning.

In [21]:
using MLDatasets

T = Float32
X_train, y_train = MLDatasets.MNIST(T, :train)[:]
X_test, y_test = MLDatasets.MNIST(T, :test)[:];
In [22]:
using Plots

# Choose some random indices to plot
indices_to_plot = rand(1:size(X_train)[3])
heatmap(X_train[:, :, indices_to_plot]', color=:grays, axis=false, c=:greys, legend=false, size=(200, 200))
In [12]:
function reshape_data(X::AbstractArray{<:Real, 3})
    s = size(X)
    return reshape(X, s[1], s[2], 1, s[3])
end
reshape_data (generic function with 1 method)
In [13]:
using Flux
using Flux: onehotbatch, onecold

function load_data(dataset; T=Float32, onehot=false, classes=0:9)
    X_train, y_train = dataset(T, :train)[:]
    X_test, y_test = dataset(T, :test)[:]

    X_train = reshape_data(X_train)
    X_test = reshape_data(X_test)

    if onehot
        y_train = onehotbatch(y_train, classes)
        y_test = onehotbatch(y_test, classes)
    end

    return X_train, y_train, X_test, y_test
end
load_data (generic function with 1 method)
In [23]:
X_train, y_train, X_test, y_test = 
    load_data(MLDatasets.MNIST; T=T, onehot=true);
In [15]:
using Random
using Flux: flatten

Random.seed!(31)
m = Chain(
    Conv((2,2), 1=>16, relu),
    MaxPool((2,2)),
    Conv((2,2), 16=>8, relu),
    MaxPool((2,2)),
    flatten,
    Dense(288, size(y_train,1)),
    softmax,
)
Chain(
  Conv((2, 2), 1 => 16, relu),          # 80 parameters
  MaxPool((2, 2)),
  Conv((2, 2), 16 => 8, relu),          # 520 parameters
  MaxPool((2, 2)),
  Flux.flatten,
  Dense(288 => 10),                     # 2_890 parameters
  NNlib.softmax,
)                   # Total: 6 arrays, 3_490 parameters, 14.711 KiB.

Define the loss function

In [16]:
using Flux: crossentropy

L(X, y) = crossentropy(m(X), y)
L (generic function with 1 method)
In [17]:
using Flux.Data: DataLoader

batchsize = 32
batches = DataLoader((X_train, y_train); batchsize, shuffle = true)
1875-element DataLoader(::Tuple{Array{Float32, 4}, OneHotArrays.OneHotMatrix{UInt32, Vector{UInt32}}}, shuffle=true, batchsize=32)
  with first element:
  (28×28×1×32 Array{Float32, 4}, 10×32 OneHotMatrix(::Vector{UInt32}) with eltype Bool,)
In [18]:
using BSON
using Flux: params

function train_model!(m, L, X, y;
        opt = Descent(0.1),
        batchsize = 128,
        n_epochs = 10,
        file_name = "")

    batches = DataLoader((X, y); batchsize, shuffle = true)

    for _ in 1:n_epochs
        Flux.train!(L, params(m), batches, opt)
    end

    !isempty(file_name) && BSON.bson(file_name, m=m)

    return
end
train_model! (generic function with 1 method)
In [19]:
file_name = "mnist_simple.bson"
train_model!(m, L, X_train, y_train; n_epochs=10, file_name=file_name)
In [20]:
using Statistics

accuracy(x, y) = mean(onecold(m(x)) .== onecold(y))

"Test accuracy = " * string(accuracy(X_test, y_test))
"Test accuracy = 0.9753"