AI 연구 논문 데일리

번역이 포함된 일일 선별된 AI 연구 논문

OmniFusion 기술 보고서
OmniFusion Technical Report

Elizaveta Goncharova, Anton Razzhigaev, Matvey Mikhalchuk, Maxim Kurkin, Irina Abdullaeva, Matvey Skripkin, Ivan Oseledets, Denis Dimitrov, Andrey Kuznetsov•Apr 9, 2024•7810

LLM2Vec: 대형 언어 모델은 사실 강력한 텍스트 인코더입니다
LLM2Vec: Large Language Models Are Secretly Powerful Text Encoders

Parishad BehnamGhader, Vaibhav Adlakha, Marius Mosbach, Dzmitry Bahdanau, Nicolas Chapados, Siva Reddy•Apr 9, 2024•668

이글과 핀치: 행렬 값 상태와 동적 순환을 갖는 RWKV
Eagle and Finch: RWKV with Matrix-Valued States and Dynamic Recurrence

Bo Peng, Daniel Goldstein, Quentin Anthony, Alon Albalak, Eric Alcaide, Stella Biderman, Eugene Cheah, Teddy Ferdinan, Haowen Hou, Przemysław Kazienko, Kranthi Kiran GV, Jan Kocoń, Bartłomiej Koptyra, Satyapriya Krishna, Ronald McClelland Jr., Niklas Muennighoff, Fares Obeid, Atsushi Saito, Guangyu Song, Haoqin Tu, Stanisław Woźniak, Ruichong Zhang, Bingchen Zhao, Qihang Zhao, Peng Zhou, Jian Zhu, Rui-Jie Zhu•Apr 8, 2024•391

InternLM-XComposer2-4KHD: 336픽셀부터 4K HD까지 해상도를 다루는 선구적인 대형 비전-언어 모델
InternLM-XComposer2-4KHD: A Pioneering Large Vision-Language Model Handling Resolutions from 336 Pixels to 4K HD

Xiaoyi Dong, Pan Zhang, Yuhang Zang, Yuhang Cao, Bin Wang, Linke Ouyang, Songyang Zhang, Haodong Duan, Wenwei Zhang, Yining Li, Hang Yan, Yang Gao, Zhe Chen, Xinyue Zhang, Wei Li, Jingwen Li, Wenhai Wang, Kai Chen, Conghui He, Xingcheng Zhang, Jifeng Dai, Yu Qiao, Dahua Lin, Jiaqi Wang•Apr 9, 2024•311

MiniCPM: 확장 가능한 학습 전략을 통해 소형 언어 모델의 잠재력 발휘하기
MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategies

Shengding Hu, Yuge Tu, Xu Han, Chaoqun He, Ganqu Cui, Xiang Long, Zhi Zheng, Yewei Fang, Yuxiang Huang, Weilin Zhao, Xinrong Zhang, Zheng Leng Thai, Kaihuo Zhang, Chongyi Wang, Yuan Yao, Chenyang Zhao, Jie Zhou, Jie Cai, Zhongwu Zhai, Ning Ding, Chao Jia, Guoyang Zeng, Dahai Li, Zhiyuan Liu, Maosong Sun•Apr 9, 2024•231

CodecLM: 맞춤형 합성 데이터를 활용한 언어 모델 정렬
CodecLM: Aligning Language Models with Tailored Synthetic Data

Zifeng Wang, Chun-Liang Li, Vincent Perot, Long T. Le, Jin Miao, Zizhao Zhang, Chen-Yu Lee, Tomas Pfister•Apr 8, 2024•180

MuPT: 생성형 심볼릭 음악 사전 학습 트랜스포머
MuPT: A Generative Symbolic Music Pretrained Transformer

Xingwei Qu, Yuelin Bai, Yinghao Ma, Ziya Zhou, Ka Man Lo, Jiaheng Liu, Ruibin Yuan, Lejun Min, Xueling Liu, Tianyu Zhang, Xinrun Du, Shuyue Guo, Yiming Liang, Yizhi Li, Shangda Wu, Junting Zhou, Tianyu Zheng, Ziyang Ma, Fengze Han, Wei Xue, Gus Xia, Emmanouil Benetos, Xiang Yue, Chenghua Lin, Xu Tan, Stephen W. Huang, Wenhu Chen, Jie Fu, Ge Zhang•Apr 9, 2024•160

Hash3D: 3D 생성을 위한 학습 없는 가속화 기술
Hash3D: Training-free Acceleration for 3D Generation

Xingyi Yang, Xinchao Wang•Apr 9, 2024•130

SambaLingo: 대규모 언어 모델에 새로운 언어를 가르치기
SambaLingo: Teaching Large Language Models New Languages

Zoltan Csaki, Bo Li, Jonathan Li, Qiantong Xu, Pian Pawakapan, Leon Zhang, Yun Du, Hengyu Zhao, Changran Hu, Urmish Thakker•Apr 8, 2024•130

Urban Architect: 레이아웃 사전 정보를 활용한 조작 가능한 3D 도시 장면 생성
Urban Architect: Steerable 3D Urban Scene Generation with Layout Prior

Fan Lu, Kwan-Yee Lin, Yan Xu, Hongsheng Li, Guang Chen, Changjun Jiang•Apr 10, 2024•101

가우시안 스플래팅에서의 밀집화 개선
Revising Densification in Gaussian Splatting

Samuel Rota Bulò, Lorenzo Porzi, Peter Kontschieder•Apr 9, 2024•90

Magic-Boost: 멀티뷰 조건부 확산 모델을 통한 3D 생성 성능 향상
Magic-Boost: Boost 3D Generation with Mutli-View Conditioned Diffusion

Fan Yang, Jianfeng Zhang, Yichun Shi, Bowen Chen, Chenxu Zhang, Huichao Zhang, Xiaofeng Yang, Jiashi Feng, Guosheng Lin•Apr 9, 2024•70

손에 쥔 물체의 3D 재구성
Reconstructing Hand-Held Objects in 3D

Jane Wu, Georgios Pavlakos, Georgia Gkioxari, Jitendra Malik•Apr 9, 2024•60

코끼리는 절대 잊지 않는다: 대형 언어 모델에서의 표 형식 데이터 기억 및 학습
Elephants Never Forget: Memorization and Learning of Tabular Data in Large Language Models

Sebastian Bordt, Harsha Nori, Vanessa Rodrigues, Besmira Nushi, Rich Caruana•Apr 9, 2024•50