Since the Hong Kong SAR Government promulgated the first Digital 21 IT Strategy in November 1998, multiple major initiatives had been launched to establish the underlying infrastructure for facilitating future development of E-Government in Hong Kong. For increasing effectiveness and efficiency, the Government of Hong Kong SAR adopted different institutional frameworks and management modes to implement and operate each E-Government initiative. This paper studied two closely related and complementary major E-Government infrastructure initiatives in Hong Kong - Public Key Infrastructure (PKI) and Electronic Services Delivery (ESD) - and examined the lessons learned from these cases. The cases were then put under the scrutiny of the four stage model proposed by Layne and Lee and the managed portfolio approach in E-Government sourcing examined by Scholl. Key implications for future EGovernment projects were also discussed to consolidate the experience and generalize the findings to advance the planning and management of EGovernment infrastructure in the future.