We’ve been busy in 2024 so far, bringing you WebSockets, interactive commands, H100s and more. Learn about what’s new at Modal.

🐚 Interactive commands

You can use modal container exec to run interactive commands inside active Modal containers. Inspect the filesystem of an in-progress job, monitor processes, or debug environment issues.

🔗 WebSocket support

Modal functions now support the WebSocket protocol. This unlocks the ability to host frameworks like Streamlit and ComfyUI out of the box. Stay tuned for more native WebSocket-based Modal examples.

🚀 H100 GPUs

You asked, and we delivered. H100s are now available on Modal!

👩‍💻 Client updates

pip install --upgrade modal to get the latest features:

• @build Decorated-based lifecycle hooks
• Volumes can now have automatic background commits.
• Volumes have more CLI commands including get, put and rm.
• Sandboxes support lookup from ID, terminate and poll.
• with image.imports() for declaring global image-specific imports
• Image.from_registry supports private Docker registry authentication.
• Dicts can now be cleared.

Want more updates? The Modal client now has a detailed changelog.

🍉 Fresh examples

• Turbo.art, a playground for creative exploration
• Embedding English Wikipedia in under 15 minutes
• How to fine-tune an LLM on Modal
• Host ComfyUI on Modal

If you’ve built anything else using Modal, share it with us on the community Slack.