The size/material safety issue is really about pressure, as the pressures involved with a large projectile and more powder can be vastly different from those with smaller bores, which use pistol size loads. There are plenty of historical examples of pistol and blunderbuss barrels being made from brass, which were no doubt considered safe for repeated firing. Some of these blunderbuss barrels could have quite large bores, but none of them approached most full scale cannon. I think using information from Parrott-Cannon's VP-Sim program (
http://www.gboreloaded.com/forums/index.php/topic,228711) would be a good start in getting numbers, though it is limited in smaller bore sizes. More relevant numbers would have to be determined through some experimentation, which unfortunately requires resources that most of us don't possess. I'd personally like to see some pressure tests done on some of these brass pistol/blunderbuss barrels, which would give a good idea of the sort of pressures a cannon in their scale would deal with.
Theory aside, if making your own cannon, why not choose the best materials you have at your disposal? When safety is concerned, often from an engineering perpective, you size materials that are tested in the given application. In the case of cannon, there has been extensive testing, and as Dan has said, much of it pointed to what has become known as gun metal, which is a range of alloys around 90/10 that have historically been used with good results. I know of several cannon made of 660, which is not a particularly strong bronze, but doesn't have a high zinc content, which is the downfall of most brasses (zinc contributes a high brittleness to brass). There are also many more modern alloys that have also been used successfully (such as silcon bronzes), and are tested in high pressure and peak pressure situations. These are also viable options, though there is less documentation available in the specific application of cannon, so some more research on the specific alloy may be required, as DD stated.
As far as One Bullet Dan should be concerned, there is no reason to spend more on the 360 brass, since it is known to be inferior for this application. Some of the bronzes mentioned will have differing machinability, which may be a factor, but I was told when I looked into this a few years ago, that if you're set up for steel, any of them should be easy enough to machine.