Investment products that offer alternatives to stocks and bonds tend to be both more complex—and more risky—than traditional investments, and often tempt investors with special features and higher returns than offered by basic investments.