Pix2pix Neural Network to Work in Real Time

Pix2pix is neural network that creates photos based on the user's sketch
16 August 2018   963

Developer Zaid Alyafeai of the University of Oil and Fossils named by King Fahd created a browser version of the pix2pix system - it turns the user's sketches into photographs in real time. While the service can only redraw the cats, the facades of buildings and shoes. 

The TensorFlow.js library loads a neural network model on the user's computer - this allows to conduct calculations on the user's device. While drawing shoes or cats, the user draws a detail of the image, and the system turns it into a "photo" in real time.

pix2pix
pix2pix
pix2pix
pix2pix
 

When drawing the houses, the algorithm splits the image into areas with objects of different types. For example, a roof or window will have different colors.

pix2pix
pix2pix

Specialists from the University of California at Berkeley introduced the pix2pix algorithm based on a generative-competitive network in 2016. Initially, the authors created a system that needed to be deployed on a computer. Third-party specialists could transfer it to the browser, but the algorithm took as input only a complete sketch and worked on the server, so the service was shut down. The source code is available at GitHub.

Ring UI 1.0 Library Released

Learn about new features and improvements of Jet Brains' open source library
28 September 2018   944

JetBrains told about the release of the Ring UI 1.0 library. Updates have affected the support of Babel 7, the finalization of the visual language, customizable CSS properties, and the library home page has moved.

In addition, in the new version, the developers did:

  • most components moved to CSS;
  • "pop-up messages", "tabs" and "buttons-switches" components;
  • the ability to configure the list of browsers in which the application will work, thanks to the support of Babel 7.

Colors from the Ring UI can be used for the harmonious design of their application. To do this, you need to configure PostCSS as follows:

plugins: [
  ...
  require('postcss-custom-properties')({
    preserve: true,
    variables: require('@jetbrains/ring-ui/extract-css-vars')
  })
]

Changes in the visual language look like this:

Ring UI
Ring UI

At the end of July 2018, the company reported that its products would not support legacy license servers. Changes were made to the development environments of versions 2018.2.1 and .NET 2018.3 tools.