05- 24 2019

Automatic multithreaded-safe memory managed classes in Cython

In this blog post, we present our progress in integrating a memory-managed class system in Cython which doesn't use the GIL. This new class systems allows truly multithreaded OOP in Cython with the ease of use of Python classes.

0 comment | Share:

|

03- 05 2019

Towards reliable SFTP interfaces

Interfacing two applications through SFTP in a reliable way can be very tricky. This blog lists possible approaches towards reliability and fundamental principles that must be enforced.

0 comment | Share:

|

02- 13 2019

Nexedi Showcases SlapOS 4G/5G Network Management System based on Free Software, Open Hardware and Edge Computing

Nexedi will showcase during Mobile World Congress 2019 its next generation Network Management System (SlapOS NMS) designed for low latency 4G and 5G. SlapOS NMS is a Free Software converged solution for edge computing and radio networks. It now supports open source 3GPP stacks (ex. SRS), proprietary stacks (ex. Amarisoft) and open hardware (ex. Lime Microsystems, Open Compute Project).

0 comment | Share:

| Categories edge computing ; network management system ; 4G LTE ; 5G NR ; Software Defined Radio ; MWC Barcelona ; Free Software ; Open Hardware

02- 13 2019

SlapOS EdgePacer: plug-and-play Edge Computing for corporate networks based on Nexedi Free Software and Open Hardware

Nexedi will introduce at Mobile World Congress 2019 an innovative Edge Computing enabler: SlapOS EdgePacer. Based on industrial grade Open Hardware by Olimex, SlapOS EdgePacer extends existing corporate networks with essential edge services: content delivery network (CDN), IoT buffering, low latency routing, resilient networking and IPv6 everywhere.

0 comment | Share:

| Categories edge computing ; network quality ; resilience ; network stability ; 4G LTE ; 5G NR ; MWC Barcelona

01- 11 2019

Scipy and scikit-learn compiled to WebAssembly in Pyodide

The Pyodide project aims to compile the CPython interpreter and scientific Python stack to WebAssembly allowing to use Python libraries in the browser. In the past, numpy, pandas and matplotlib have been packaged in Pyodide. In this post we will outline latest developments funded by Nexedi, which include packaging scipy and scikit-learn, improvements in testing workflow and ability to install packages from custom URLs.

0 comment | Share:

| Categories python ; multi-core ; cython ; coroutine ; lwan

01- 11 2019

Cython nogil extension on multi core introduction

In this blog post, we show a proof of concept to make multi-core processing possible in CPython. It involves adding a new data type in Cython which is not limited by the CPython GIL and a new coroutine which together make real multi-core possible.

0 comment | Share:

| Categories python ; multi-core ; cython ; coroutine ; lwan

11- 07 2018

Open Source / Free Software for Effective Industry 4.0

Programme and Information about the Industry 4.0 Meetup by Nexedi GmbH and Fraunhofer IAO on November 12th, 2018 in Stuttgart with Amarisoft, Linutronix, Olimex and Télécom ParisTech.

0 comment | Share:

| Categories nexedi ; olimex ; edge computing ; big data ; industry 4.0 ; automation ; amarisoft ; fraunhofer ; open source ; free software

11- 05 2018

Can Free big data regulate AI and the data economy?

Market does not seem to provide any valid solution to the new issues posed by a data economy which is characterised by a combination of increasing returns and legal blockers to community or ecosystem based competition. As a consequence, the current known optimal organisation to monetise big data and A.I. is the private or state monopoly. We review in this article possible alternatives that could be considered in the future and how to enforce them.

0 comment | Share:

|

10- 31 2018

Are Linux containers stable enough for production and why Nexedi uses SlapOS nano-containers instead ?

Nexedi does not use LXC containers or docker because it is impossible to ensure their stable operation especially in case of kernel ABI mismatch or missing containerisation of system calls. Instead, we use SlapOS nano-containers which have provided since 2010 similar benefits in a more stable way while using less resources. SlapOS nano-containers will soon be deployed on embedded device using Elbe embedded Linux with over-the-air (OTA) upgrade and secure boot.

0 comment | Share:

|

10- 30 2018

Five Evolutions of Cloud Computing

Cloud Computing is essentially the automation of IT service provisioning through software which replace human tasks. It is currently evolving in multiple directions. Free Software and Open Hardware will eventually lead to massive price cuts compared to current price levels in USA or Asia. Edge Computing will reduce the need of data centres whenever network latency or availability become critical. Service Workers will eliminate the need of servers, both at the edge or at the data centre, in 90% cases. Big Servers will eventually replace smaller servers as the standard fabric the data centre.

0 comment | Share:

| Categories SlapOS ; edge computing ; cloud computing ; service worker ; open hardware ; OCP

10- 10 2018

OfficeJS Iodide: Migration of Jupyter Notebooks to Iodide Notebooks

OfficeJS Iodide notebooks can be used offline or online on any modern HTML5 web browser such as Firefox or Chrome. With the support of data science libraries such as NumPy, Pandas, Matplotlib, Plotly, etc. and soon scikit-learn, its nice to be server independent and carry on with data science just using browser. Hence, we tried to migrate some already famous lectures on data science on github. This web page mentions the steps and problems faced while migrating and obviously, the final result.

0 comment | Share:

| Categories core ; OfficeJS ; Iodide ; Notebook ; pyodide ; Scientific lectures

10- 02 2018

Rapid.Space: High Performance, Low Cost, Ethical Cloud based on Open Hardware and Free Software

Nexedi launches beta phase of rapid.space * low cost, high performance, ethical cloud * based on Open Hardware, Open Source Free Software and circular economy

0 comment | Share:

| Categories Free Software cloud ; Open Hardware cloud ; High Performance ; Low Cost ; Hosting

09- 29 2018

High Performance Virtual Machines for Database Applications

Rapid.Space is a new provider of low cost, ethical yet high performance servers targeted at big data applications, high performance computing, software development and large database applications. Rapid.Space provisions on each server a single "dedicated virtual machine" which takes control of all resources of the server. Performance degradation for memory, CPU or 10 Gbps networking is not noticeable. Performance degradation for disk I/O is at most 30%, a 800% improvement compared to traditional storage virtualisation technologies used by some cloud computing services.

0 comment | Share:

| Categories qemu ; ERP5 ; Rapid Space ; SSD

09- 26 2018

OfficeJS Iodide: Ubiquitous Data Science Notebooks for Business and Education

Iodide and Pyodide have brought a standard notebook application to OfficeJS that can be used for business reporting, research and education. They support data science libraries such as NumPy, Pandas, Matplotlib, Plotly, etc. and soon scikit-learn. OfficeJS Iodide notebooks can be used offline or online on any modern HTML5 web browser such as Firefox or Chrome. Thanks to JIO, notebooks can be synchronised with Dropbox, WebDAV, ERP5 and any other storage supported by a JIO plugin. Iodide notebooks can also be embedded through RenderJS into any business application. The dream of ubiquitous data sciences at no infrastructure cost has come to a reality.

0 comment | Share:

| Categories core ; business template ; update

08- 06 2018

5G without USA: yes we can!

European technology suppliers combined with Shenzen ecosystem of small and medium businesses can provide everything that is needed to create latest generation 4G and 5G virtual radio access network (VRAN) infrastructure without depending on USA suppliers and at a fraction of the cost of traditional approaches of the four dominant telecom infrastructure providers.

0 comment | Share:

|

07- 27 2018

Multi-threaded coroutines with work stealing in Cython

After making a proof of concept multi-core HTTP server for Python using Lwan and Cython, we decided to extract Lwan's coroutines and evaluate them on their own. This experiment shows that system programming in Cython is possible.

0 comment | Share:

|

07- 18 2018

How Nexedi moved to HTTP2 with Caddy

After trying and failing to move to HTTP2 using Apache in 2017, Nexedi has adopted Go language based Caddy server. Initial results of HTTP2 show significant speed improvement and good stability. Next step will be the adoption of QUIC. Migration was smooth and entirely automated thank to a test driver devops approach recently introduced in SlapOS.

0 comment | Share:

| Categories http2 ; QUIC ; CDN

07- 15 2018

Edge Computing for Industrial Automation and Control

The business of industrial automation and control will move away over time from existing, highly profitable, proprietary product lines towards much more flexible yet less profitable open hardware and Free Software. Future profits will eventually emerge from online services based on industrial big data, personalisation, legal regulation and trade secret powered by increasingly smart sensors and gateways at the edge.

0 comment | Share:

| Categories slapos ; edge computing ; automation ; control ; wendelin ; fluentd ; big data ; digital transformation

07- 05 2018

A multi-core Python HTTP server (much) faster than Go (spoiler: Cython)

A multi-core Python HTTP server that is about 40% to 110% faster than Go can be built by relying on the Cython language and LWAN C library. A proof of concept validates the possibility of high performance system programming in the Cython language.

0 comment | Share:

| Categories python ; multi-core ; go ; cython ; coroutine ; lwan

07- 05 2018

Python multi-core benchmark in uvloop context

The existence of cython combined with a clean concurrency model based on technologies such as gevent and pygolang could change the situation if both can be tightly integrated into cython's static cdef code rather than scattered as it is today.

0 comment | Share:

| Categories uvloop ; python ; multi-core ; go ; cython ; coroutine ; stackless ; gevent ; pygolang

Blog