Welcome to the LLM Reasoning Task Collection repository! This project is an open collaboration to create a comprehensive master list of reasoning tasks that can teach, elicit, or show reasoning samples to large language models (LLMs) for training purposes.
The goal of this repository is to gather a diverse set of reasoning tasks designed to improve the reasoning capabilities of LLMs. Contributors are encouraged to submit tasks, provide examples, and optionally include diagrams or workflows to illustrate how the tasks function.
When submitting a task, please adhere to the following schema:
Name: {Task Name, String}
Description: {Details of what the task is, String}
Example(s) {list of example inputs and outputs for the task, String}:
- Example 1:
input and output
- Example 2:
input and output
Diagram (Optional) {image of a diagram/workflow of how the task would work, Image}`
Name: Syllogism Reasoning
Description: This task involves providing a series of syllogisms to the model to evaluate its logical reasoning capabilities.
Example(s):
- Example 1:
Input: All men are mortal. Socrates is a man. What can we conclude?
Output: Socrates is mortal.
- Example 2:
Input: All fruits have seeds. An apple is a fruit. What can we conclude?
Output: An apple has seeds.
Diagram (Optional): None
We welcome contributions from everyone! To contribute, please see our Contribution Guide.
This project is licensed under the Apache 2.0 License. See the LICENSE file for details.