Demonstrating its investment in AI, Microsoft today announced Power Apps Express Design, a new feature-packed / low-power Power Apps service that can convert uploaded PDF, PowerPoint, Figma design files, screenshots or hand-drawn sketch. in a working application (after some games). Presented at Build 2022, Microsoft said that Express Design uses “industry-leading” AI to scan entries and produce controls for applications that work backed by data storage.
Express Design is the first major AI-powered capability to arrive in Power Apps since the release of Power Fx, which leverages OpenAI’s GPT-3 to translate instructions such as “find products where the name begins with” kids “into formulas. and uses the upward trend without code / low code. According to Gartner, up to 70% of applications will be developed using code-free / low-code technology, including artificial intelligence, by 2025. The company also anticipates that “citizen developers” will start. that is, those without a formal computer background). to far outperform traditional developers in large organizations during the year.
Microsoft explained how Express Design works in a number of blog posts. Microsoft’s Azure Cognitive Services platform object detection models perform image recognition, form mapping, and document figures (including sketches) on buildings that exist within an application. Express Design can understand what a button, grouping, or text box can be, and generate an application automatically from those drawings, or at least an approximation of an application.
Image credits: Microsoft
Express Design doesn’t do all the hard work for you. Once a file is scanned, application components such as fields, text tags, date selectors, and buttons must be manually tagged and connected to a database in the Microsoft Dataverse service. As with applications created in the usual way in Power Apps, users can add additional screens (either manually or by converting new sketches) and upload images to customize the background, buttons, and other components before publishing them.
Interestingly, Microsoft first underwent the transformation of sketches for coding in 2018 with Sketch2Code, a research project that used AI to turn handwritten drawings into functional HTML prototypes. Many others have researched the idea, including Airbnb and Alibaba, which developed their own AI systems to translate interface sketches into mock-ups and product code.
From a commercial standpoint, startup Zecoda uses AI to convert design files to front-end code automatically. But Express Design has the advantage of Microsoft’s scale.
“One of the big pushes we’ve been doing is moving to the next level, going from hundreds of millions of people who can use these tools to billions of people who can use those tools,” said Charles Lamanna, Microsoft’s corporate vice president. of business applications and platforms, was cited in a blog post. “If we want everyone to be a developer, we can’t plan to teach everyone how to write Python or JavaScript code. That’s not possible. But it’s possible if we create the right experiences and put them in front of enough people who can click, drag and drop. go and use concepts that are familiar to create amazing solutions.
Express Design is now available to all Power Apps customers.