Octopus: Embodied Vision-Language Programmer from Environmental Feedback

Keyphrases

• Programmer 100%
• Vision-language 100%
• Environmental Feedback 100%
• Octopus 100%
• Embodied Vision 100%
• Executable Code 60%
• Reinforcement Learning 40%
• Vision-language Models 40%
• Action Sequence 40%
• Training Data 20%
• Model-driven Development 20%
• Video Games 20%
• Simulation Model 20%
• Model Driven Architecture 20%
• Agent Decision 20%
• High-level Planning 20%
• Embodied Agents 20%
• Collaborative Application 20%
• Vision-based 20%
• AI Community 20%
• Minecraft 20%
• Multimodal Perception 20%
• Training Scheme 20%
• Multimodal Reasoning 20%
• Code Generation 20%
• Grand Theft Auto 20%
• Simulation Environment 20%
• Code Generator 20%
• Embodied AI 20%
• Simulation Datasets 20%
• Enhanced Training 20%
• Open Sourcing 20%
• GPT-4 20%

Computer Science

• Executable Code 100%
• Reinforcement Learning 66%
• Language Modeling 66%
• Action Sequence 66%
• Training Data 33%
• Benchmarking 33%
• Decision-Making 33%
• Artificial Intelligence 33%
• Model Development 33%
• Model Architecture 33%
• videogame 33%
• Code Generation 33%
• Grand Theft Auto 33%
• Generative Pre-Trained Transformer 4 33%
• Simulation Environment 33%
• Abstract Level 33%
• Detailed Output 33%
• Code Generator 33%