Introduction: Access to inexpensive respiratory support to newborn infants improves survival in low-income countries. Standard bubble continuous positive airway pressure (CPAP) has been extensively used worldwide for more than 30 years. One project aimed at providing affordable CPAP is the Pumani system developed by Rice 360. Compared to standard bubble CPAP the system has an unconventional design. The aim was to compare the Pumani system with two traditional bubble CPAP systems, focusing on in-vitro performance and safety. Methods: The Pumani system was compared to traditional bubble CPAP from Fisher & Paykel (Auckland, New Zealand) and Diamedica (Devon, United Kingdom). The systems were tested using static flow resistance and simulated breathing for a range of fresh gas flows and submersion levels. Results: There were large differences between the Pumani CPAP and the conventional bubble CPAP systems. The Pumani system was not pressure stable, had high resistance and high imposed work of breathing. It was not possible to use submersion depth to adjust CPAP without accounting for fresh gas flow. Discussion: The Pumani design is novel and not similar to any previously described CPAP system. The main mechanism for CPAP generation was resistance, not submersion depth. The system should therefore not be referred to as bubble CPAP. The clinical consequences of its pressure instability and high imposed work of breathing are not known and trials on outcome and safety are needed.