1st ICML Workshop on In-Context Learning (ICL @ ICML 2024)

In-context learning (ICL) is an emerging capability of large-scale models, including large language models (LLMs) like GPT-3, to acquire new capabilities directly from the context of an input example without separate training or fine-tuning, enabling these models to adapt rapidly to new tasks, datasets, and domains. This workshop brings together diverse perspectives on this new paradigm to assess progress, synthesize best practices, and chart open problems. Core topics will include architectural and other inductive biases enabling in-context skill acquisition, and reliable evaluation of ICL in application domains including reinforcement learning, representation learning, and safe and reliable machine learning.

In case of any issues or questions, feel free to email the organizers at iclworkshop@googlegroups.com.

Important Dates

Submission Deadline	Friday, May 24th, 2024, Anywhere on Earth (AoE)
Decision Notification	Monday, June 17th, 2024
Camera-ready Deadline	Sunday, July 21st, 2024, Anywhere on Earth (AoE)
Workshop Date	Saturday, July 27th, 2024

Call for Papers

We invite submissions to the ICL 2024 workshop, focusing on the development of new architectures, algorithms, theoretical analysis, empirical studies, and applications of In-Context Learning (ICL). Submissions must present original research that has not been previously published.

Specific topics of interest include, but are not limited to:

architectures, training paradigms, and inductive biases that enable or improve ICL;
theoretical analyses and guarantees for ICL methods;
empirical evaluation of the performance of ICL on interpretability, controllability, and safety considerations for ICL systems;
similarities and differences between ICL in large-scale language modeling systems and learned algorithms in other domains;
the relationship between ICL and few-shot learning, meta-learning and automated machine learning (AutoML).

Accepted papers will be presented as posters and a subset will be selected for oral presentation. The ICL 2024 workshop will be held in person at ICML 2024 with virtual participation options to be determined.

Submission Guidelines

We welcome both long (up to 8 pages) and short papers (up to 4 pages); the track can be selected during submission. Submitted manuscripts should be composed of a page-limited main body followed by an unlimited number of pages for references and appendices, all in a single file. Submissions should be uploaded via the ICML 2024 Workshop ICL Submission portal on OpenReview.

Paper templates and style files (adapted from the ICML template) can be found in this Overleaf template. Submissions must follow the template and style, be properly anonymized (for double-blind review), and not exceed the page limits for the specified track (excluding references and appendices). We will have non-archival proceedings, but will share accepted papers and their reviews on OpenReview. We encourage including code in papers, though we ask to anonymize the code along with the submission.

Dual Submission Policy

We aim to host work-in-preparation that would most benefit from feedback, which informs our dual submission policy. We accept submissions that are currently under review for publication in other venues. However, as per ICML guidelines, we do not accept works accepted for publication in another archival venue as of the date of the workshop deadline. A work accepted at ICML 2024 or KDD 2024 can thus not be submitted to the workshop, but a paper under review at NeurIPS 2024 would be eligible.

Author-Reviewer Policy

The workshop program committee plays an important role in identifying and giving feedback on up-and-coming work that would most benefit from discussion and visibility at the workshop. To sustain our review and program selection processes, we require at least one author of each submitted paper to participate as a reviewer for the ICL 2024 workshop (identified in the OpenReview submission form).

We will ask each reviewer to evaluate 1–2 submissions starting the week of Monday, May 27th. All reviews will be due no later than Friday, June 7th, anywhere on earth, to enable us to notify authors on time. Our active review period is thus between May 27th and June 7th.

Call for Reviewers

If you are interested in reviewing papers for the workshop outside of the author-reviewer requirements, we invite you to nominate yourself and/or others to serve on the program committee by filling out the reviewer nomination form .