애스크로AIPublic Preview
← 학술논문 검색
학술논문한국경영과학회지2023.11 발행

ContrastVAE++: 사후 붕괴 완화와 언어모델 기반 데이터 증강을 통한 대조적 변분 오토인코더의 성능 향상

ContrastVAE++: Enhancing Contrastive Variational AutoEncoder Performance through Posterior Collapse Alleviation and Language Model-based Data Augmentation

나요셉(국민대학교); 홍종현(국민대학교); 김진호(국민대학교); 조윤호(국민대학교)

48권 4호, 53~67쪽

초록

Sequential recommendation systems utilize the user's temporal behavioral information to identify preferences and provide relevant items. ContrastVAE, a VAE-based SOTA recommendation model, has proposed an effective method for sequential recommendation by combining contrastive learning and data augmentation. However, ContrastVAE has a posterior collapse problem in which the decoder does not consider the encoder condition when generating sequential information, and it uses a data augmentation technique inefficient to learn the latent space. To overcome these limitations, this study proposes ContrastVAE++, which alleviates the posterior collapse problem and applies an advanced augmentation technique. ContrastVAE++ employs context-based data augmentation to consider the correlation between items, Dirichlet-distributed noise to apply a distribution dependent on the encoder output, and decoder cross-attention for effective latent vector representation. Our experimental results show that ContrastVAE++ outperforms ContrastVAE on all experimental data.

Abstract

Sequential recommendation systems utilize the user's temporal behavioral information to identify preferences and provide relevant items. ContrastVAE, a VAE-based SOTA recommendation model, has proposed an effective method for sequential recommendation by combining contrastive learning and data augmentation. However, ContrastVAE has a posterior collapse problem in which the decoder does not consider the encoder condition when generating sequential information, and it uses a data augmentation technique inefficient to learn the latent space. To overcome these limitations, this study proposes ContrastVAE++, which alleviates the posterior collapse problem and applies an advanced augmentation technique. ContrastVAE++ employs context-based data augmentation to consider the correlation between items, Dirichlet-distributed noise to apply a distribution dependent on the encoder output, and decoder cross-attention for effective latent vector representation. Our experimental results show that ContrastVAE++ outperforms ContrastVAE on all experimental data.

발행기관:
한국경영과학회
분류:
경영학

AI 법률 상담

이 논문의 주제에 대해 더 알고 싶으신가요?

460만+ 법률 자료에서 관련 판례·법령·해석례를 찾아 답변합니다

AI 상담 시작
ContrastVAE++: 사후 붕괴 완화와 언어모델 기반 데이터 증강을 통한 대조적 변분 오토인코더의 성능 향상 | 한국경영과학회지 2023 | AskLaw | 애스크로 AI