Saturday, July 27, 2024
Google search engine
HomeUncategorizedCan Programming Languages Boost Each Other via Instruction Tuning? Yes

Can Programming Languages Boost Each Other via Instruction Tuning? Yes

[Submitted on 31 Aug 2023]

Download PDF

Abstract: When human programmers have mastered a programming language, it would be
easier when they learn a new programming language. In this report, we focus on
exploring whether programming languages can boost each other during the
instruction fine-tuning phase of code large language models. We conduct
extensive experiments of 8 popular programming languages (Python, JavaScript,
TypeScript, C, C++, Java, Go, HTML) on StarCoder. Results demonstrate that
programming languages can significantly improve each other. For example,
CodeM-Python 15B trained on Python is able to increase Java by an absolute
17.95% pass@1 on HumanEval-X. More surprisingly, we found that CodeM-HTML 7B
trained on the HTML corpus can improve Java by an absolute 15.24% pass@1. Our
training data is released at this https URL.

Submission history

From: Daoguang Zan [view email]



[v1]

Thu, 31 Aug 2023 15:53:51 UTC (73 KB)

Read More

RELATED ARTICLES

LEAVE A REPLY

Please enter your comment!
Please enter your name here

- Advertisment -
Google search engine

Most Popular

Recent Comments