SkillRise is a reinforcement learning framework that trains a single policy to solve a sequence of related tasks by alternating between solving tasks with an evolving skill document and curating that document from trajectories.

Stars

5

7-day growth

No data

Forks

0

Open issues

0

License

Apache-2.0

Last updated

2026-07-29

AI repository intelligence
FR-AI / ANALYSIS

Why it is worth attention

It introduces decoupled cross-task credit assignment and achieves state-of-the-art results across three distinct benchmarks (ALFWorld, WebShop, ScienceWorld), outperforming prompting methods and RL baselines.

Who it is for

  • Researchers in reinforcement learning
  • Developers of multi-task or continual learning agents
  • Practitioners working on embodied AI and instruction following
  • Students studying skill transfer in RL

Use cases

  • Training an agent to perform a sequence of household tasks by building and refining a skill document
  • Improving generalization of web navigation agents by learning transferable skills
  • Enabling a single policy to adapt to new tasks in science lab environments without retraining
  • Benchmarking cross-task skill learning algorithms on standard environments

Strengths

  • Achieves best overall results compared to prompting-based methods and RL baselines across three benchmarks
  • Uses decoupled group-relative advantages for credit assignment within the same role and position
  • Open-source with Apache 2.0 license, built on widely-used frameworks like veRL and BEACON
  • Provides reproducible setup with example scripts and task sequences bundled in repository

Considerations

  • Requires separate environment backends (ALFWorld, WebShop, ScienceWorld) with manual setup as per linked repositories
  • Single policy approach may be sensitive to task ordering; only tested on a few benchmarks
  • Computational resource requirements not specified in README; may be high for RL training

README quick start

SkillRise

SkillRise is an end-to-end reinforcement learning framework for cross-task skill learning. A single policy plays an ordered sequence of related tasks, alternating between solving the current task with an evolving skill document and curating that document from the resulting trajectory before moving to the next task. Evaluated on ALFWorld, WebShop, and ScienceWorld.

Method

SkillRise (a) constructs progressively challenging task sequences from the same task family, (b) rolls out a single policy that alternates Solve and Curate so the skill document evolves and transfers across tasks, and (c) uses decoupled cross-task credit assignment with group-relative advantages computed only within the same role and position.

Setup

pip install -r requirements.txt   # verl is vendored in verl/, no separate install

Environment backends:

  • ALFWorld and WebShop: follow the verl-agent setup.
  • ScienceWorld: follow the BEACON setup.

Running

Edit examples//env.sh (set SKILLRISE_MODEL_PATH, data paths, WANDB_API_KEY), then:

bash examples/skillrise_alfworld/skillrise_alfworld_qwen3_4b.sh   # SkillRise
bash examples/skillrise_alfworld/grpo_alfworld_qwen3_4b.sh        # GRPO baseline

Same layout for skillrise_webshop/ and skillrise_sciworld/. Task sequences are bundled under data/groups/.

Results

SkillRise achieves the best overall results across ALFWorld, WebShop, and ScienceWorld, outperforming prompting-based methods and RL baselines.

License

Apache License 2.0 (derivative of verl / verl-agent). See LICENSE and NOTICE.

🤝 Acknowledgement

This project builds on veRL, verl-agent, BEACON, ALFWorld, WebShop, and ScienceWorld. We thank the authors of those projects.

Related repositories

Similar projects matched by category, topics, and programming language.

lopopolo
Featured
lopopolo GitHub avatar

harness-engineering

Harness Engineering is a methodology for improving coding agent outputs by carefully crafting the environment around them—providing curated context, tools, and executable constraints that encode an organization’s nonfunctional requirements and cumulative lessons.

AI & Machine LearningAI Agents
2,390
slvDev
Featured
slvDev GitHub avatar

esp32-ai

A 28.9 million parameter language model runs on an $8 ESP32-S3 microcontroller entirely on-device, generating simple stories at about 9.5 tokens per second.

AI & Machine LearningLarge Language Models
1,960
littledivy
Featured
littledivy GitHub avatar

mimic

mimic captures traffic from any iOS or web app and automatically generates a Python client library that lets you call the app's API like a regular library.

AI & Machine Learning
1,482