Merge pull request 'ethan/readme' (#11) from ethan/readme into main
Reviewed-on: luckyrobots/luckyworld#11
This commit is contained in:
commit
5355fa3d9a
BIN
Assets/Default_Logo_Horizontal.png
(Stored with Git LFS)
Normal file
BIN
Assets/Default_Logo_Horizontal.png
(Stored with Git LFS)
Normal file
Binary file not shown.
BIN
Assets/bedroom.png
(Stored with Git LFS)
Normal file
BIN
Assets/bedroom.png
(Stored with Git LFS)
Normal file
Binary file not shown.
BIN
Assets/loft.png
(Stored with Git LFS)
Normal file
BIN
Assets/loft.png
(Stored with Git LFS)
Normal file
Binary file not shown.
BIN
Assets/luck-e.mp4
Normal file
BIN
Assets/luck-e.mp4
Normal file
Binary file not shown.
213
README.md
213
README.md
@ -1,20 +1,199 @@
|
||||
# luckyworld
|
||||
<p align="center">
|
||||
<img width="500" alt="Lucky World Simulator" src="Assets/Default_Logo_Horizontal.png" />
|
||||
</p>
|
||||
|
||||
this is our unreal repository with our complete source code...
|
||||
<p align="center">
|
||||
Infinite Synthetic Data Generation for Embodied AI
|
||||
</p>
|
||||
|
||||
steps to pull the source code down and compile
|
||||
<div align="center">
|
||||
|
||||
* (Don't download the .zip file. It's best to use the CLI or a visual tool so LFS can install the proper libraries)
|
||||
* git clone https://luckyrobots.com/luckyrobots/luckyworld.git
|
||||
* cd luckyworld
|
||||
* install git lfs
|
||||
* brew install git-lfs (macOS)
|
||||
* sudo yum install git-lfs (linux)
|
||||
* choco install git (windows) or via https://git-scm.com/download/win
|
||||
* select option to install git-lfs
|
||||
* git lfs pull (just in case)
|
||||
* right click .uproject file.
|
||||
* Generate Visual Studio Project Files (windows)
|
||||
* Open the generated .sln file with your IDE (i.e. Visual Studio or Rider)
|
||||
* (The project starts in 5.5 binary version so if you're using source you will need to right click the .uproject and switch your engine version)
|
||||
* Debug 'luckyrobots'
|
||||
[](https://opensource.org/licenses/MIT)
|
||||
[](https://www.unrealengine.com/)
|
||||
[](https://discord.gg/5CH3wx3tAs)
|
||||
|
||||
</div>
|
||||
|
||||
<p align="center">
|
||||
<video src="Assets/luck-e.mp4" controls></video>
|
||||
</p>
|
||||
|
||||
## Overview
|
||||
|
||||
Lucky World is a state-of-the-art simulator built by Lucky Robots to create hyperrealistic environment interactions using the power of Unreal Engine 5 and MuJoCo physics. Designed from the ground up for robotic learning, Lucky World enables you to generate infinitely many hyperrealistic demonstrations for training robust robotic systems that can easily bridge the gap the sim2real gap.
|
||||
|
||||
<p align="center">
|
||||
<img width="49%" alt="Bedroom environment" src="Assets/bedroom.png" />
|
||||
<img width="49%" alt="Loft environment" src="Assets/loft.png" />
|
||||
</p>
|
||||
|
||||
|
||||
## Core Technology
|
||||
|
||||
- **Unreal Engine 5** - Leveraging Nanite virtualized micropolygon geometry and Lumen global illumination for immaculate visual fidelity
|
||||
- **MuJoCo Physics** - Industry-leading physics simulation ensuring accurate object interactions, contacts, and material properties
|
||||
- **Procedural Generation** - Dynamic environment creation with randomized object placement, lighting conditions, and material properties
|
||||
- **Sensor Simulation** - High-fidelity simulated sensors including RGB cameras, depth sensors, LiDAR, and IMUs
|
||||
|
||||
## Features
|
||||
|
||||
- **Hyperrealistic Environments** - Meticulously crafted indoor scenes with physically based materials and lighting
|
||||
- **Dynamic Interactions** - Fully interactive objects with realistic physics responses and material properties
|
||||
- **Advanced Robotics** - Pre-configured robots including Stretch v1 and Franka Arm with accurate kinematic models
|
||||
- **Configurable Difficulty** - Adjustable environment complexity, lighting conditions, and object arrangements
|
||||
- **Data Collection** - Built-in tools for capturing ground truth data, including depth maps, segmentation masks, and bounding boxes
|
||||
- **Real-time Rendering** - Optimized for real-time performance on modern hardware
|
||||
|
||||
## System Requirements
|
||||
|
||||
- **Operating Systems**: Windows 10/11, macOS, Linux (Ubuntu 20.04+)
|
||||
- **Hardware**:
|
||||
- GPU: NVIDIA GTX 1080 or AMD equivalent (minimum), RTX 3080 or equivalent (recommended)
|
||||
- CPU: 8-core processor (recommended)
|
||||
- RAM: 16GB (minimum), 32GB (recommended)
|
||||
- Storage: 50GB available SSD space
|
||||
- **Software**:
|
||||
- Unreal Engine 5.5
|
||||
- Git LFS
|
||||
- Visual Studio 2022 or Rider (Windows)
|
||||
- Xcode 14+ (macOS)
|
||||
- Clang or GCC (Linux)
|
||||
|
||||
## Installation
|
||||
|
||||
Follow these steps to pull down the source code and compile the project:
|
||||
|
||||
### 1. Clone the Repository
|
||||
|
||||
**Important**: Don't download the .zip file. It's best to use the CLI or a visual tool so Git LFS can install the proper libraries.
|
||||
|
||||
```bash
|
||||
git clone https://luckyrobots.com/luckyrobots/luckyworld.git
|
||||
cd luckyworld
|
||||
```
|
||||
|
||||
### 2. Install Git LFS
|
||||
|
||||
Install Git LFS based on your operating system:
|
||||
|
||||
**macOS**:
|
||||
```bash
|
||||
brew install git-lfs
|
||||
```
|
||||
|
||||
**Linux**:
|
||||
```bash
|
||||
sudo yum install git-lfs
|
||||
```
|
||||
|
||||
**Windows**:
|
||||
```bash
|
||||
# Install via Visual Installer
|
||||
# https://git-scm.com/download/win
|
||||
# (Be sure to select the option to install git-lfs)
|
||||
|
||||
# Or via Chocolatey
|
||||
choco install git
|
||||
```
|
||||
|
||||
### 3. Pull LFS Files
|
||||
|
||||
Run this command to ensure all large binary files are properly downloaded:
|
||||
|
||||
```bash
|
||||
git lfs pull
|
||||
```
|
||||
|
||||
### 4. Setup Project Files
|
||||
|
||||
**Windows**:
|
||||
- Right-click the `.uproject` file
|
||||
- Select "Generate Visual Studio Project Files"
|
||||
- Open the generated `.sln` file with your IDE (i.e. Visual Studio or Rider)
|
||||
|
||||
**macOS/Linux**:
|
||||
- Right-click the `.uproject` file
|
||||
- Follow platform-specific steps to generate project files
|
||||
|
||||
### 5. Engine Version Note
|
||||
|
||||
The project starts in UE 5.5 binary version. If you're using source:
|
||||
- Right-click the `.uproject` file
|
||||
- Select "Switch Unreal Engine version..."
|
||||
- Choose your installed engine version
|
||||
|
||||
### 6. Build and Run
|
||||
|
||||
- Debug 'luckyrobots'
|
||||
|
||||
## Using Lucky World
|
||||
|
||||
### Editor Mode
|
||||
|
||||
Lucky World can be used directly in the Unreal Editor for:
|
||||
|
||||
1. **Environment Creation**:
|
||||
- Design custom environments using UE5's powerful editor tools
|
||||
- Place and configure objects, furniture, and obstacles
|
||||
- Adjust lighting, materials, and atmospheric conditions
|
||||
|
||||
2. **Robot Configuration**:
|
||||
- Configure robot parameters through the Robot Blueprint editor
|
||||
- Adjust sensor placement, field of view, and resolution
|
||||
- Calibrate physics parameters for realistic robot movement
|
||||
|
||||
3. **Simulation Settings**:
|
||||
- Set simulation frame rate and physics substeps
|
||||
- Configure environment difficulty and randomization parameters
|
||||
- Adjust camera properties and sensor noise levels
|
||||
|
||||
### Standalone Mode
|
||||
|
||||
For pure simulation or data collection:
|
||||
|
||||
1. Package the project (File > Package Project)
|
||||
2. Run the standalone executable
|
||||
3. Configure simulation parameters via the settings menu
|
||||
4. Collect data using the built-in recording tools
|
||||
|
||||
## Configuration
|
||||
|
||||
### Environments
|
||||
|
||||
Lucky World includes several pre-built environments:
|
||||
|
||||
- Loft
|
||||
- Rome
|
||||
- Paris
|
||||
- Marseille
|
||||
- Istanbul
|
||||
- Kitchen (for Panda Arm)
|
||||
|
||||
Each environment can be customized through the Content Browser (`Content/Environments/`).
|
||||
|
||||
## Troubleshooting
|
||||
|
||||
### Common Issues
|
||||
|
||||
**Missing Assets / LFS Files**:
|
||||
```bash
|
||||
git lfs install
|
||||
git lfs pull
|
||||
```
|
||||
|
||||
**Compilation Errors**:
|
||||
- Verify correct Unreal Engine version is selected
|
||||
- Clear derived data folder (`[Engine]/DerivedDataCache/`)
|
||||
- Rebuild project
|
||||
|
||||
**Performance Issues**:
|
||||
- Adjust rendering settings in `Edit > Project Settings > Engine > Rendering`
|
||||
- Lower simulation physics detail in `Edit > Project Settings > Engine > Physics`
|
||||
|
||||
**Crashes on Startup**:
|
||||
- Check logs in `[ProjectFolder]/Saved/Logs/`
|
||||
- Verify GPU drivers are up to date
|
||||
|
||||
## License
|
||||
|
||||
Lucky World is licensed under the MIT License - see the [LICENSE](LICENSE) file for details.
|
Loading…
x
Reference in New Issue
Block a user