SkillRise 是一个端到端的强化学习框架,用于跨任务技能学习。通过单策略交替执行任务求解(利用不断演化的技能文档)和文档策展(从轨迹中提取),实现任务序列的学习。

Stars

5

7 天增长

暂无数据

Fork 数

0

开放 Issue

0

开源协议

Apache-2.0

最近更新

2026-07-29

AI 仓库情报摘要
FR-AI / ANALYSIS

为什么值得关注

该框架提出解耦的跨任务信用分配方法,在 ALFWorld、WebShop 和 ScienceWorld 三个基准上取得了最佳结果,优于提示方法和 RL 基线。

适合谁使用

  • 强化学习研究人员
  • 多任务或持续学习算法开发者
  • 具身智能与指令跟随领域实践者
  • 技能迁移学习方向的学生

典型使用场景

  • 训练智能体通过构建和优化技能文档执行一系列家务任务
  • 提升网络导航智能体通过可迁移技能学习的泛化能力
  • 使单一策略无需重新训练即可适应科学实验环境的新任务
  • 在标准环境中基准测试跨任务技能学习算法

项目优势

  • 在三个基准上相比提示方法和 RL 基线取得最佳整体结果
  • 使用解耦的组相对优势进行同一角色和位置内的信用分配
  • 采用 Apache 2.0 许可证开源,基于 veRL 和 BEACON 等流行框架构建
  • 提供可复现的脚本和预打包的任务序列

使用前须知

  • 需要手动设置多个环境后端(ALFWorld, WebShop, ScienceWorld)
  • 任务顺序可能影响单策略的表现,仅在少数基准上测试
  • 未说明计算资源需求,RL 训练可能成本较高

README 快速开始

SkillRise

SkillRise is an end-to-end reinforcement learning framework for cross-task skill learning. A single policy plays an ordered sequence of related tasks, alternating between solving the current task with an evolving skill document and curating that document from the resulting trajectory before moving to the next task. Evaluated on ALFWorld, WebShop, and ScienceWorld.

Method

SkillRise (a) constructs progressively challenging task sequences from the same task family, (b) rolls out a single policy that alternates Solve and Curate so the skill document evolves and transfers across tasks, and (c) uses decoupled cross-task credit assignment with group-relative advantages computed only within the same role and position.

Setup

pip install -r requirements.txt   # verl is vendored in verl/, no separate install

Environment backends:

  • ALFWorld and WebShop: follow the verl-agent setup.
  • ScienceWorld: follow the BEACON setup.

Running

Edit examples//env.sh (set SKILLRISE_MODEL_PATH, data paths, WANDB_API_KEY), then:

bash examples/skillrise_alfworld/skillrise_alfworld_qwen3_4b.sh   # SkillRise
bash examples/skillrise_alfworld/grpo_alfworld_qwen3_4b.sh        # GRPO baseline

Same layout for skillrise_webshop/ and skillrise_sciworld/. Task sequences are bundled under data/groups/.

Results

SkillRise achieves the best overall results across ALFWorld, WebShop, and ScienceWorld, outperforming prompting-based methods and RL baselines.

License

Apache License 2.0 (derivative of verl / verl-agent). See LICENSE and NOTICE.

🤝 Acknowledgement

This project builds on veRL, verl-agent, BEACON, ALFWorld, WebShop, and ScienceWorld. We thank the authors of those projects.

相关仓库与替代方案

根据分类、Topic 和编程语言匹配的相似项目。

lopopolo
精选
lopopolo GitHub avatar

harness-engineering

Harness Engineering is a methodology for improving coding agent outputs by carefully crafting the environment around them—providing curated context, tools, and executable constraints that encode an organization’s nonfunctional requirements and cumulative lessons.

AI 与机器学习AI 智能体
2,390
slvDev
精选
slvDev GitHub avatar

esp32-ai

A 28.9 million parameter language model runs on an $8 ESP32-S3 microcontroller entirely on-device, generating simple stories at about 9.5 tokens per second.

AI 与机器学习大语言模型
1,960
littledivy
精选
littledivy GitHub avatar

mimic

mimic captures traffic from any iOS or web app and automatically generates a Python client library that lets you call the app's API like a regular library.

AI 与机器学习
1,482