Uptime Industries introduces Lemony AI, an 'AI-in-a-box' portable device for on-premise AI infrastructure.
Lemony AI can run large language models, AI agents, and workflows on a single node, with each device requiring only 65 watts of power.
Clusters of Lemony nodes can be interconnected to form larger AI clusters, with each node capable of sustaining an LLM up to 75 billion parameters.
Partnerships with IBM and JetBrains allow easier access to AI models, including closed models, for Uptime's customers.
The idea for Lemony AI originated from a side project of Uptime's co-founders, leading to the development of a compact device for local AI processing.
The emphasis on data privacy and ease of adoption aims to encourage organizations, especially those wary of cloud-based models, to embrace AI technologies.
The device targets businesses in regulated sectors like finance, healthcare, and law, offering a self-contained solution for AI processing.
Uptime has secured $2 million in seed funding and plans to further develop its devices, expanding compatibility to other hardware like Nvidia DGX Spark.
Lemony AI is priced at $499 a month for up to five users, with future plans to enhance the software for multi-user team collaborations.