Skip to content

Misina Lab

CI

A framework for building procedural scene generators for agricultural robotics simulation. You write a generator's parameters and build code in Rust, and Misina Lab makes the rest from them: a live parameter editor, a Python package, and an Isaac Lab spawner that brings the scene in as USD.

Warning

Developer preview. Expect breaking changes.

A vineyard built on Misina Lab, in Isaac Lab A vineyard built on Misina Lab, in Isaac Lab

It ships with two reference generators, a vineyard and a tomato greenhouse, to try it on and to start from. If you need help, or would like to work together on a generator of your own, get in touch.

🌐 Try them in your browser, the vineyard or the greenhouse: a bit slower, and they need WebGPU.

📚 The docs are at azazdeaz.github.io/misina-lab.

Contents: Features · How it works · Build a generator · Reference generators · Try it · Roadmap · Support · Development · License

Features

Every generator built on Misina Lab gets:

  • 🎛️ A live parameter editor. Every parameter is a slider with a tooltip, and the scene rebuilds as you drag.
  • 🤖 Isaac Lab in one paste. Copy Isaac Lab cfg puts the editor's settings on the clipboard. Pasted into a scene config, the scene generates on first use, is cached as USD and spawns like any USD file.
  • 🐍 A Python package. Typed params classes, a headless write_usd(), and a parameters page with every default and range.
  • 🎲 Reproducible. The same seed gives the same scene, and nudging one part never re-rolls another.
  • 🏷️ Every part addressable. Every part is a named prim, down to a single leaf or fruit, and carries its ground truth, such as ripeness.
  • ⚡ Built to scale. Level of detail and the number of mesh variants trade fidelity for frame rate.
  • ✂️ Bendable, cuttable parts. Flexible parts bend under Newton's VBD solver and can be cut anywhere while the simulation runs.

How it works

flowchart LR
    params["Parameters"] --> build["Scene build<br/>Rust and Bevy"]
    build --> viewer["Viewer<br/>live preview"]
    build --> doc["Scene document<br/>JSON"]
    doc --> usd["USD stage"]
    usd --> isaac["Isaac Lab"]
  1. A generator declares its parameters as plain Rust structs and builds its scene in Bevy as ordinary meshes and transforms.
  2. The viewer draws that scene as it is built, so a slider answers at once.
  3. For simulation, the scene leaves Rust as a plain JSON document, and Python turns it into a USD stage.
  4. In Isaac Lab, the generator's cfg class does this on first use, caches the USD, and spawns it as an ordinary USD asset.

Build a generator

A generator is one Rust crate: its parameters as plain structs, and one build system per kind of thing in the scene. Everything else is made from those declarations.

flowchart LR
    subgraph you ["You write"]
        direction LR
        params["Params structs"]
        systems["Build systems"]
    end
    subgraph misina ["Misina Lab makes"]
        direction LR
        panel["Viewer and panel"]
        python["Python classes and stubs"]
        cfg["Isaac Lab cfg and spawner"]
        page["Parameters page"]
        usd["USD export"]
    end
    you --> misina

Reference generators

Both are built on Misina Lab. Each is a Python package of its own, and a starting point for a new generator.

Vinery Lab

Vineyards for developing and testing vineyard robots: trellised rows on rolling terrain, down to every leaf.

  • 🍃 Leaves as detailed meshes, for depth-based perception
  • 🌿 Stray shoots that bend as a robot pushes through, and cut anywhere
  • ❄️ A dormant mode: bare canes with a bud at every node, every one cuttable
  • 🌾 Cover crops in the alleys, and weeds under the vines whose long stems can bend

README · Parameters · Playground · pip install vinery-lab

Examples

Example What it shows
Quadruped An ANYmal-C walks every alley, down one and back up the next.
Straddler A portal robot drives every row with the trellis passing under its frame. --trim hedges the stray shoots.
Pruning A Bumblebee-like arm on a UGV cuts every cane of a dormant row back to two buds.

Each is a uv project of its own: cd into it and uv run main.py. They build the generator from this checkout, so they need Rust and hardware that runs Isaac Sim 6.2.

Greenhouse Lab

The rows of a high-wire tomato greenhouse, grown to any week of the season.

A greenhouse built on Misina Lab, in Isaac Lab

  • 🍅 Every fruit its own prim, with its stage from bud and flower to ripe
  • 🦾 A Cut and a Bend frame on every truss, where a gripper takes it
  • 📅 The crop's age in weeks, from young plants on their twines to meters of lowered stem
  • 🛤️ Heating-pipe rails in every path, uneven up to and past the 2° spec

README · Parameters · Playground · pip install greenhouse-lab

Examples

Example What it shows
Greenhouse A pipe-rail robot with a UR5e on its lift cuts every due truss in the harvest band of each path, which drops to the floor.
BUTom capture A trolley laid out like PATHoBot films RGB-D sequences of the crop with BUTom-ST21's calibrated cameras, written in that dataset's layout.

Try it

In the browser. Each generator's viewer runs at azazdeaz.github.io/misina-lab/playground/vinery and azazdeaz.github.io/misina-lab/playground/greenhouse.

From Python.

pip install vinery-lab        # the vineyard
pip install greenhouse-lab    # the greenhouse

Wheels are built for Linux x86_64 and Python 3.12 and later; anywhere else pip builds from source, which needs Rust.

From a checkout, with Rust installed, either reference generator opens in the viewer:

cargo run --release                     # the vineyard
cargo run --release -p greenhouse-lab   # the greenhouse

Move a slider and the scene rebuilds what it touches. Copy Isaac Lab cfg puts the settings on the clipboard, ready to paste into an Isaac Lab scene config.

Roadmap

Upcoming

  • Optionally use PointInstancer to spawn organs without a unique prim path
  • Simulate human workers and other safety critical scenarios

Planned

  • RTK-GNSS data generation
  • GeoJSON and TASKDATA.xml export
  • Complete example projects demonstrating task executions
  • Share what you need for your project 🚀

Each reference generator's README has its own roadmap.

Support

If you need help with Misina Lab, or would like to work together on a generator for your own crop, layout or equipment, feel free to reach out to @azazdeaz. General questions and suggestions are just as welcome.

Development

License

Licensed under either of Apache License, Version 2.0 or MIT License, at your option.