Frequency Domain Disentanglement for Arbitrary Neural Style Transfer

نویسندگان

چکیده

Arbitrary neural style transfer has been a popular research topic due to its rich application scenarios. Effective disentanglement of content and is the critical factor for synthesizing an image with arbitrary style. The existing methods focus on disentangling feature representations in spatial domain where components are innately entangled difficult be disentangled clearly. Therefore, these always suffer from low-quality results because sub-optimal disentanglement. To address such challenge, this paper proposes frequency mixer (FreMixer) module that disentangles re-entangles spectrum domain. Since have different frequency-domain characteristics (frequency bands patterns), FreMixer could well disentangle two components. Based module, we design novel Frequency Domain Disentanglement (FDD) framework transfer. Qualitative quantitative experiments verify proposed method can render better stylized compared state-of-the-art methods.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Time Domain Neural Audio Style Transfer

A recently published method for audio style transfer has shown how to extend the process of image style transfer to audio. This method synthesizes audio "content" and "style" independently using the magnitudes of a short time Fourier transform, shallow convolutional networks with randomly initialized filters, and iterative phase reconstruction with Griffin-Lim. In this work, we explore whether ...

متن کامل

Stereoscopic Neural Style Transfer

This paper presents the first attempt at stereoscopic neural style transfer, which responds to the emerging demand for 3D movies or AR/VR. We start with a careful examination of applying existing monocular style transfer methods to left and right views of stereoscopic images separately. This reveals that the original disparity consistency cannot be well preserved in the final stylization result...

متن کامل

Fast Patch-based Style Transfer of Arbitrary Style

Artistic style transfer is an image synthesis problem where the content of an image is reproduced with the style of another. Recent works show that a visually appealing style transfer can be achieved by using the hidden activations of a pretrained convolutional neural network. However, existing methods either apply (i) an optimization procedure that works for any style image but is very expensi...

متن کامل

Demystifying Neural Style Transfer

Neural Style Transfer [Gatys et al., 2016] has recently demonstrated very exciting results which catches eyes in both academia and industry. Despite the amazing results, the principle of neural style transfer, especially why the Gram matrices could represent style remains unclear. In this paper, we propose a novel interpretation of neural style transfer by treating it as a domain adaptation pro...

متن کامل

Meta Networks for Neural Style Transfer

In this paper we propose a new method to get the specified network parameters through one time feed-forward propagation of the meta networks and explore the application to neural style transfer. Recent works on style transfer typically need to train image transformation networks for every new style, and the style is encoded in the network parameters by enormous iterations of stochastic gradient...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence

سال: 2023

ISSN: ['2159-5399', '2374-3468']

DOI: https://doi.org/10.1609/aaai.v37i1.25212