{"id":2830,"date":"2022-10-20T12:31:03","date_gmt":"2022-10-20T19:31:03","guid":{"rendered":"https:\/\/devblogs.microsoft.com\/surface-duo\/?p=2830"},"modified":"2022-10-20T12:31:03","modified_gmt":"2022-10-20T19:31:03","slug":"persisting-sharing-ink","status":"publish","type":"post","link":"https:\/\/devblogs.microsoft.com\/surface-duo\/persisting-sharing-ink\/","title":{"rendered":"Persisting and sharing ink"},"content":{"rendered":"

\n Hello Android developers!\n<\/p>\n<\/p>\n

\n We have some updates to the InkSDK<\/a> that we would like to share with you, as well as some general guidance on persisting ink and open ink standards.\n<\/p>\n

Overview<\/h2>\n<\/p>\n

\n While Android provides different canvases for rendering ink, there is little guidance on how to store that ink or what format it should be in when communicating with other apps. Let\u2019s dive into some topics surrounding this concept.\n<\/p>\n

Persisting Ink<\/h2>\n<\/p>\n

\n Rendering ink on a canvas is important, but how that data is pulled off the canvas and saved is equally as important.\n<\/p>\n

\n In the previous InkSDK versions, developers have access to a bitmap<\/a> representation of the canvas, which is useful for sharing drawings with other apps. But what if you want to save the drawing and be able to edit it later? A bitmap does not provide this functionality.\n<\/p>\n

\n To save and load notes without data or functionality loss, there are a couple of approaches to enable this. These approaches convert a canvas\u2019s ink to some other data type that can be saved locally.\n<\/p>\n

    \n
  1. \n Serializing the data into a string using Kotlin or Java serializers (often formatted as JSON<\/a>)\n<\/li>\n
  2. \n Creating a custom parser that converts the data into a differently structured format<\/p>\n
      \n
    1. \n Converting to an open standard type like InkML<\/a> is more complex, but may have some advantages that will be discussed below\n <\/li>\n<\/ol>\n<\/li>\n<\/ol>\n

      \n Regardless of the developer\u2019s approach to saving the ink (e.g. saving in a file, saving in a Room database<\/a>, etc.), oftentimes only saving simple data types is supported. Anything with references to a Context<\/a>, Activity<\/a>, or Application<\/a> are difficult to save without causing memory leaks.\n<\/p>\n

      \n The Brush class introduced in the InkSDK contains all the data needed to persist drawings without any data loss.\n<\/p>\n

      \n Some of the topics covered here, as well as some more info on persisting ink can be found in a discussion in our SDK repo<\/a>.\n<\/p>\n

      Open Ink Standards<\/h2>\n<\/p>\n

      \n Assuming that ink data is available within the application, can we now send it to other apps to be rendered? Not necessarily. To send data between any two apps, they need to both understand the data format. The same holds true with ink.\n<\/p>\n

      \n Just as there are open standards<\/a> for transferring commonly encountered data like .png for images, there are open standards for ink.\n<\/p>\n

      \n To send ink between apps, both apps need to agree on a specific format. Since copy\/pasting ink between apps is still relatively uncommon in Android, many inking apps today opt not to accept ink formats, choosing to only accept bitmaps or screenshots of the ink instead. This approach has some key disadvantages, like the ones discussed on persisting ink using bitmaps.\n<\/p>\n

      \n While a bitmap may preserve what the ink looked like at a given point in time, a lot of data is lost. Data cannot be easily added to a drawing, so editing it becomes impossible. In a basic sense, exporting a drawing to another app as a bitmap declares the drawing as finished, with no room for additional edits.\n<\/p>\n

      \n \"Diagram\n<\/p>\n

      \n A different approach is to use an open ink standard like InkML (Ink Markup Language)<\/a> for sending ink data. InkML is growing in popularity and has the advantage of being accepted by a growing number of web pages and other apps. It has room for additions and deletions, unlike bitmap representations.\n<\/p>\n

      \n By no means is InkML or any other open standard a complete replacement for sending bitmap representations of drawings. Implementing it in your app, however, can help enhance a user\u2019s overall inking experience.\n<\/p>\n

      \n \"Diagram\n<\/p>\n

      Updates to the InkSDK<\/h2>\n<\/p>\n

      \n Now that we have some context, let\u2019s take a look at some changes that have been made to the InkSDK.\n<\/p>\n

      \n Developers can access ink data from the canvas now, allowing them to save and load data as they see fit. Ink data is formatted as a Brush data class<\/a>, which packages the necessary information that a single brush stroke may contain.\n<\/p>\n

      data class Brush(, \r\n    val color: Int,\r\n    val strokeWidth: Float,\r\n    val strokeWidthMax: Float,\r\n    val paintHandler: DynamicPaintHandler?,\r\n    val stroke: InputManager.ExtendedStroke\r\n)<\/pre>\n
      \n  All of the fields in the Brush class are common things we\u2019ve seen in the inking canvas (InkView.kt<\/a>) in the past, but let\u2019s quickly cover their uses.\n<\/p>\n