tasks.md

August 6, 2024 ยท View on GitHub

Task NameDescription
Analogical Problem SolvingUsing analogies to solve problems by applying solutions from one domain to another similar situation.
Analogy CreationCreating analogies to compare different concepts, situations, or objects.
Analyzing Cultural DifferencesComparing and contrasting different cultural practices, beliefs, or norms.
Analyzing Decision Making ProcessesExamining and evaluating decision-making processes, including steps, factors, and reasoning.
Analyzing Decision TreesInterpreting and evaluating decision trees to understand decision-making processes.
Analyzing Historical CounterfactualsConsidering alternative outcomes of historical events by changing key factors or decisions.
Analyzing Rhetorical StrategiesIdentifying and evaluating rhetorical strategies used in a given text or speech.
Assessing Risk And UncertaintyEvaluating scenarios with incomplete information to determine potential risks and uncertainties.
Bias DetectionIdentifying and explaining biases present in given scenarios, statements, or data.
Bias MitigationConstructing a statement as close to the ground truth as possible, given a statement and the bias that led to it.
Calculating ProbabilitiesCalculating probabilities for various scenarios, including simple and compound events.
Categorizing Information Into HierarchiesOrganizing information into hierarchical structures based on relationships or logical criteria.
Causal Chain AnalysisIdentifying and analyzing a sequence of events or factors that lead to a specific outcome.
Completing AnalogiesCompleting analogies to evaluate the ability to recognize relationships between pairs of words and apply them to new contexts.
Constructing Valid ArgumentsCreating logically sound arguments to support a given conclusion or claim.
Counterfactual AnalysisExamining hypothetical scenarios that are contrary to what actually happened.
Critical Factor Identification in Theory of MindUnderstanding that similar agents may act differently, or different agents may act similarly, based on a third factor.
Critiquing Argument StructuresAnalyzing and evaluating the structure, logic, and effectiveness of arguments.
Curry's ParadoxExamining a specific form of semantic paradox that seemingly proves arbitrary claims through self-reference and logical implication.
Deciphering Ambiguous InstructionsInterpreting and clarifying unclear or incomplete instructions.
Deconstructing Complex SystemsBreaking down complex systems into their constituent parts and explaining how these parts interact.
Deconstructing MetaphorsAnalyzing and explaining the meaning behind metaphors.
Deducing Motives From ActionsAnalyzing actions of individuals or groups to infer their underlying motivations or intentions.
Deducing Rules From ExamplesAnalyzing examples to infer the underlying rule or pattern.
Deductive Logic PuzzlesSolving deductive logic puzzles to evaluate the ability to use given information, make logical inferences, and arrive at a correct conclusion.
Describing Spatial RelationshipsAccurately describing the relative positions and orientations of objects in space.
Detecting Sarcasm And IronyIdentifying and explaining instances of sarcasm or irony in given statements or scenarios.
Determining Alternative OutcomesAnalyzing historical events or decisions and reasoning about possible alternative outcomes if key factors had been different.
Distinguishing Correlation from CausationAnalyzing given scenarios or statistical relationships to identify cases where correlation does not imply causation.
Distinguishing Fact From OpinionDifferentiating between factual statements and opinions in given texts or scenarios.
Equation DerivationDeriving mathematical equations from given information or scenarios to evaluate the ability to translate word problems into mathematical expressions and manipulate them to reach a solution.
Estimating DurationEstimating the time required for various activities or processes.
Ethical Dilemma ResolutionAnalyzing complex ethical scenarios and proposing reasoned solutions.
Evaluating Analogies For AccuracyAssessing given analogies for their accuracy and appropriateness.
Evaluating Competing TheoriesAnalyzing and comparing multiple theories for a phenomenon, assessing their strengths and weaknesses, and determining which is best supported by evidence.
Evaluating Policy ImplicationsAnalyzing proposed policies or decisions and predicting their potential consequences across various domains.
Evaluating Source CredibilityAssessing the reliability and trustworthiness of various information sources.
Fermi EstimationMaking rough numerical estimates for complex questions using logical reasoning and educated guesses.
First Order False BeliefIdentifying why a misinformed agent may behave contrary to reality due to inaccurate beliefs.
First Order IgnoranceIdentifying why an agent may lack knowledge or awareness of certain facts or events.
Forecasting Technological ImpactsPredicting and analyzing potential effects of emerging or hypothetical technologies on society, economy, and daily life.
Generating Creative SolutionsDeveloping innovative and unique solutions to given problems or challenges.
Higher Order False BeliefHandling a complex chain of agent's beliefs about the knowledge (and accuracy of the knowledge) of other agents to ultimately predict the behavior of an agent.
Hypothesis FormationGenerating plausible hypotheses to explain observed phenomena or solve problems.
Identifying AnachronismsRecognizing elements that are out of place in a given historical context.
Identifying Cause and Effect RelationshipsAnalyzing given scenarios or statements to identify and explain cause and effect relationships present.
Identifying Cognitive BiasesRecognizing and explaining cognitive biases in given scenarios or decision-making processes.
Identifying Hallucination Prone QuestionsRecognizing questions that are likely to lead to hallucination or questions it simply doesn't know the answer to.
Identifying Implicit Biases In LanguageRecognizing subtle biases embedded in language use.
Identifying Logical FallaciesIdentifying and explaining common logical fallacies in given arguments or statements to evaluate the ability to recognize flawed reasoning.
Identifying Logical InconsistenciesDetecting and explaining logical inconsistencies or contradictions within given information.
Identifying RelationshipsIdentifying the relationship between pairs of words or concepts to evaluate the ability to recognize various types of connections and articulate them clearly.
Identifying Unstated AssumptionsRecognizing and articulating implicit assumptions in statements, arguments, or scenarios.
Inference Drawing From Incomplete DataMaking logical deductions or inferences based on limited or incomplete information.
Inferring Emotional StatesAnalyzing scenarios to infer people's emotional states based on their behavior and context.
Inferring Motivations From ActionsAnalyzing described actions or behaviors to deduce the underlying motivations, intentions, or goals of the individuals involved.
Interpreting Ambiguous StatementsAnalyzing statements with multiple possible interpretations and identifying different ways they can be understood.
Interpreting and Creating TimelinesReading or creating timelines to represent a series of events or processes.
Interpreting Body Language CuesAnalyzing and interpreting non-verbal communication signals, such as facial expressions, postures, and gestures.
Interpreting Legal Language And PrecedentsAnalyzing and interpreting legal texts, statutes, or case law to understand their implications and applications.
Interpreting Nonverbal CommunicationAnalyzing and interpreting nonverbal cues in human communication.
Interpreting Statistical DataAnalyzing and interpreting statistical data presented in various formats.
Lateral Thinking PuzzlesSolving lateral thinking puzzles to evaluate the ability to think creatively, consider unconventional scenarios, and ask relevant questions to reach the correct solution.
Mathematical Word ProblemsSolving mathematical word problems to evaluate the ability to interpret real-world scenarios, extract relevant information, and perform appropriate calculations.
Mental Rotation TasksMentally rotating objects or shapes and predicting their appearance from different angles.
Moral Reasoning In Everyday SituationsAnalyzing everyday scenarios that present moral dilemmas and reasoning through the ethical implications of different actions.
Narrative Gap FillingFilling in missing information or events in a narrative to create a coherent story.
Parsing Complex SentencesAnalyzing sentences to identify grammatical structures and explain relationships between parts.
Pattern Recognition in Spatial ArrangementsIdentifying patterns or rules inentifying patterns or rules in the spatial arrangement of objects or shapes.
Perspective Taking In Social ScenariosAnalyzing social situations from different viewpoints to understand the motivations, emotions, and potential reactions of various parties involved.
Predicting Market TrendsAnalyzing economic indicators and data to forecast potential future market trends.
Predicting Outcomes Based on ScenariosAnalyzing given scenarios and predicting potential outcomes based on the information provided.
Prioritizing Conflicting GoalsAnalyzing and resolving situations with conflicting objectives, requiring trade-offs and strategic decision-making.
Proof VerificationVerifying mathematical proofs to evaluate the ability to understand logical arguments, identify correct steps in a proof, and spot errors or gaps in reasoning.
Recognizing Emotional SubtextIdentifying and interpreting underlying emotional content or implications in text that are not explicitly stated.
Recognizing Patterns In BehaviorIdentifying recurring patterns or trends in human or animal behavior based on given scenarios or data.
Recognizing Patterns In SequencesIdentifying and extending patterns in numerical, alphabetical, or symbolic sequences.
Reconciling Conflicting InformationAnalyzing and resolving contradictory information from multiple sources.
Reverse Engineering ProcessesAnalyzing a final result and working backwards to determine the steps or components that led to that outcome.
Risk Assessment In Decision MakingEvaluating potential risks and benefits associated with different courses of action in a given scenario.
Second Order False BeliefUnderstanding that an agent may hold a false belief about another agent's belief, leading to misinterpretations of actions or intentions.
Sequencing EventsArranging a set of events in chronological order.
Solving Riddles And Word PuzzlesDeciphering and solving various types of riddles and word puzzles.
Solving Word Problems With Multiple VariablesTranslating word problems into mathematical equations and solving them.
Spatial Problem SolvingUsing spatial reasoning to solve practical problems or puzzles.
[Stack Based Reasoning] (https://github.com/NousResearch/Open-Reasoning-Tasks/blob/main/tasks/stack-based-reasoning) Using stacks and reverse thinking to convert chain of thought into stacks of instructions for others to follow
Syllogism ReasoningProviding a series of syllogisms to evaluate logical reasoning capabilities.
Trait Attribution In Behavioral ScenariosAnalyzing described behaviors or actions and inferring personality traits or characteristics that might explain those behaviors.
Trend Analysis And ForecastingExamining historical data or patterns to identify trends and make predictions about future outcomes.
Truth Table CompletionCompleting truth tables for given logical expressions to evaluate the understanding of Boolean logic and ability to determine the truth value of complex statements.
Truth Table CompletionsCompleting truth tables for given logical expressions.
Towers of HanoiThe Tower of Hanoi is a puzzle where you must move a stack of disks from one rod to another, obeying rules about disk size and movement.
Understanding Time Based RelationshipsAnalyzing and explaining relationships between events based on their timing.
Understanding Time Zones and Global Time DifferencesCalculating time differences across various time zones and understanding how global time works.
Unraveling ParadoxesAnalyzing and explaining paradoxes or logical puzzles.
Multiturn Latex GenerationGenerating latex documents and suggesting edits using multiturn instructions.