With the advance in computer and network technologies, the real-time interaction and the on-time delivery of multimedia data through the Internet by broadband network are becoming more popular. A variety of multimedia systems and Internet applications have been emerging, fulfilling the ever increasing demand on the Internet streaming applications. This paper outlines the design of a MPEG-4 video system. With the new features provided by the MPEG-4 standard, i.e. the object-based media with arbitrary- shaped coding, object-based QoS degradation is possible. It enables the system to discard the less important objects within the video stream when the network is congested. Our video system proposes a new transmission scheme for the system to transmit MPEG-4 video over an open network. Based on the nature of the video objects and their frames, transmission priorities among video objects are assigned. The transmission scheme then regulates the flow of the video data and their frames so that important data are delivered on time to the video client regardless the delay fluctuation of the open network.