Allowed - but declare over the limits.
- Customs says each passenger may not carry more than NT$100,000 and RMB 20,000 in or out of Taiwan, and the amount above that must be declared or is confiscated; the part above the limit may not be brought in or out even with a declaration.
- Foreign currency worth more than US$10,000 must be declared.
What a Taiwan Customs office says about currency limits
A Kaohsiung Customs FAQ page says each passenger may carry up to NT$100,000 and up to RMB 20,000 into or out of Taiwan. Amounts above those limits must be declared or are liable to confiscation, and even with a declaration, the excess cannot be brought in or out.
For other foreign currencies, amounts above US$10,000 or the equivalent must be declared, and once you have declared, there is no limit on the amount. The same goes for traveller's cheques, other cheques, promissory notes, bills of exchange and similar instruments with a total face value above US$10,000. The page does not mention gold. It says that if the English and Chinese versions differ, the Chinese one prevails. This is a regional office page, so check the Customs Administration for the current limits.
Source read: Customs Administration, Kaohsiung Customs, FAQ page (English). Gold and the exact penalty are not on the page.