You can't beat their model because they don't include all the data they use in the competition dataset. It's a highly sanitized and simplified toy problem used for hiring and marketing. They don't even tell you what the features are so it's impossible to use domain expertise to constrain the fitting problem (this is a critical component to building profitable trading models because of the signal to noise ratio in the data)