{"id":3013,"date":"2011-05-26T17:50:51","date_gmt":"2011-05-26T17:50:51","guid":{"rendered":"https:\/\/blogs.msdn.microsoft.com\/vcblog\/2011\/05\/26\/enforcing-correct-concurrent-access-of-class-data\/"},"modified":"2021-10-04T17:56:36","modified_gmt":"2021-10-04T17:56:36","slug":"enforcing-correct-concurrent-access-of-class-data","status":"publish","type":"post","link":"https:\/\/devblogs.microsoft.com\/cppblog\/enforcing-correct-concurrent-access-of-class-data\/","title":{"rendered":"Enforcing Correct Concurrent Access of Class Data"},"content":{"rendered":"

\"Jim<\/a><\/p>\n

Hi, this is Jim Springfield<\/strong>. I’m an architect on the Visual C++ team.<\/p>\n

In any concurrent application, protecting data from concurrent access is extremely important. There are many primitives that can be used for this, such as critical sections, mutexes, reader-writer locks, etc. There are also some newer high-level approaches to concurrency such as those provided by the Concurrency Runtime<\/a>, although this isn’t the focus of what I’m showing here. However, there isn’t a good way in C++ to make sure that you are really protecting data correctly when accessing it from multiple threads. You will often see a comment (likely made by the original author) next to a member that reminds you to take some lock when accessing the data. There may be many data items all using the same lock and there may be more than one lock, with some data protected by one lock and some by another.<\/p>\n

When it comes time to access some data from a member function, you have to start asking some questions. Who is going to call this member? What locks will already be held? Could I deadlock here? While I don’t have a solution to all of these, I do have a technique that allows you to be more aggressive with trying things and more comfortable with making changes to existing code, while guaranteeing that you don’t violate the requirement that a particular lock is held.<\/p>\n

What I’m going to show is a way to associate a lock with a data member such that whenever that data member is accessed, a check is made that the proper lock is held by the thread. The basis for the technique uses native properties<\/a> to provide access to data members. With a small set of macros, you can easily retrofit existing code to provide this benefit. I developed this technique years ago and I have used it in several code bases to catch problems with concurrent access.<\/p>\n

Here is an example of something you will typically see in code. The developer has written that a critical section should be held when accessing m_rgContextsCache<\/span>.<\/p>\n

\n
\n
\n
    \n
  1. \/\/ Make sure m_cs is held when accessing m_rgContextsCache<\/span><\/li>\n
  2. vector<FileConfig> m_rgContextsCache;<\/li>\n<\/ol>\n<\/div>\n<\/div>\n<\/div>\n

    Wouldn’t it be great if this information could be specified in code AND enforced? The code below shows how to transform this into just that.<\/p>\n

    \n
    \n
    \n
      \n
    1. PROTECTED_MEMBER(m_cs, vector<FileConfig>, m_rgContextsCache);<\/li>\n<\/ol>\n<\/div>\n<\/div>\n<\/div>\n

      Now, whenever m_rgContextsCache<\/span> is accessed, a user-defined function will be called if the proper lock is not held. What the macro does is to create the actual data member with a slightly modified name and a property with the name specified. Now, all you have to do is run your code and see if any errors occur. There is one “gotcha<\/em>”. When members are initialized in the constructor or referenced in a destructor, the lock isn’t going to be held. For those cases, you need to directly access the member. A macro that translates a name into the modified “real” name can be used. It can also be used anywhere that it is specifically safe to access the member outside of the lock. The nice thing is that it is now very clear when you are doing this. Here is the code for this.<\/p>\n

      \n
      \n
      \n
        \n
      1. \/\/ The USN macro is used when you need to access a data member in an “unsafe” way.<\/span><\/li>\n
      2. \/\/ This makes sense when you know no other thread is accessing it, such as in a constructor.<\/span><\/li>\n
      3. #define<\/span> USN(name) name##_usn_<\/li>\n<\/ol>\n<\/div>\n<\/div>\n<\/div>\n

        The PROTECTED_MEMBER<\/span> macro is defined below. The first line creates the actual member. The second line creates the property and the remaining lines implement the get and put.<\/p>\n

        \n
        \n
        \n
          \n
        1. #define<\/span> PROTECTED_MEMBER(cs, type, name) \\<\/li>\n
        2.     type USN(name);\\<\/li>\n
        3.     __declspec<\/span>(property<\/span>(get=Get_#<\/span>#name, put=Put_##name)) type name;\\<\/li>\n
        4.     type & Get_#<\/span>#name()\\<\/li>\n
        5.     {_PROTECT(verify_lock(cs));return<\/span> USN(name);}\\<\/li>\n
        6.     type const<\/span> & Get_#<\/span>#name() const\\<\/span><\/li>\n
        7.     {_PROTECT(verify_lock(cs));return<\/span> USN(name);}\\<\/li>\n
        8.     type & Put_#<\/span>#name(type const<\/span> & x)\\<\/li>\n
        9.     {_PROTECT(verify_lock(cs));USN(name) = x;return<\/span> USN(name);}<\/li>\n<\/ol>\n<\/div>\n<\/div>\n<\/div>\n

          There are a couple of things that aren’t defined yet. The verify_lock<\/span> function will return a boolean indicating whether the lock is held or not. These can be defined for any type of lock you use. There is also the _PROTECT<\/span> macro. This should be defined to do whatever you want in the case of a failure. This could log, assert, crash, etc.<\/p>\n

          There are some other variations of the macro to handle some additional cases. One is to handle arrays. It provides a parameterized property which handles the index.<\/p>\n

          \n
          \n
          \n
            \n
          1. #define<\/span> PROTECTED_MEMBER_ARRAY(cs, elemtype, name, length) \\<\/li>\n
          2.     typedef<\/span> elemtype type_#<\/span>#name[length];\\<\/li>\n
          3.     elemtype USN(name)[length];\\<\/li>\n
          4.     __declspec<\/span>(property<\/span>(get=Get_#<\/span>#name, put=Put_##name)) elemtype name[length];\\<\/li>\n
          5.     elemtype& Get_#<\/span>#name(size_t i)\\<\/li>\n
          6.     {_PROTECT(verify_lock(cs));return<\/span> USN(name)[i];}\\<\/li>\n
          7.     type_#<\/span>#name& Get_##name()\\<\/li>\n
          8.     {_PROTECT(verify_lock(cs));return<\/span> USN(name);}\\<\/li>\n
          9.     const<\/span> elemtype& Put_#<\/span>#name(size_t i, elemtype const<\/span>& x)\\<\/li>\n
          10.     {_PROTECT(verify_lock(cs));USN(name)[i] = x;return<\/span> USN(name)[i];}<\/li>\n<\/ol>\n<\/div>\n<\/div>\n<\/div>\n

            To handle a reader-writer lock, a slightly different macro is used. Instead of “verify_lock<\/span>”, two other functions are used: verify_readlock<\/span> and verify_writelock<\/span>. Again, these can be user-defined to handle any type of reader-writer lock. There is one additional wrinkle here, however. There is a function defined called “GetWritable_##name<\/span>”. The getter returns a const&<\/span> to the underlying member and verifies that a read lock is held, but this won’t allow you to call methods on it that modify it. To do that, you have to explicitly call GetWritable_##name<\/span>. This will return a non-const reference and verify the write lock is held.<\/p>\n

            \n
            \n
            \n
              \n
            1. #define<\/span> PROTECTED_MEMBER_RW(lock, type, name) \\<\/li>\n
            2.     type USN(name);\\<\/li>\n
            3.     __declspec<\/span>(property<\/span>(get=Get_#<\/span>#name, put=Put_##name)) type name;\\<\/li>\n
            4.     const<\/span> type & Get_#<\/span>#name()\\<\/li>\n
            5.     {_PROTECT(verify_readlock(lock));return<\/span> USN(name);}\\<\/li>\n
            6.     type & Put_#<\/span>#name(type const<\/span>& x)\\<\/li>\n
            7.     {_PROTECT(verify_writelock(lock));USN(name) = x;return<\/span> USN(name);}\\<\/li>\n
            8.     __declspec<\/span>(property<\/span>(get=GetWritable_#<\/span>#name)) type Writable_##name;\\<\/li>\n
            9.     type & GetWritable_#<\/span>#name()\\<\/li>\n
            10.     {_PROTECT(verify_writelock(lock));return<\/span> USN(name);}<\/li>\n<\/ol>\n<\/div>\n<\/div>\n<\/div>\n

              There are a couple of other variations to the PROTECTED_MEMBER<\/span> macro to handle some cases that can occur. If the data member can’t be assigned to (i.e. it is a type without assignment), we need to not provide a “Put” or we will get a compile error. Similarly, we may have a type that can’t be assigned from const<\/span> data. These cases occur rarely in practice, but they do occur.<\/p>\n

              \n
              \n
              \n
                \n
              1. #define<\/span> PROTECTED_MEMBER_NC(cs, type, name) \\<\/li>\n
              2.     type USN(name);\\<\/li>\n
              3.     __declspec<\/span>(property<\/span>(get=Get_#<\/span>#name, put=Put_##name)) type name;\\<\/li>\n
              4.     type & Get_#<\/span>#name()\\<\/li>\n
              5.     {_PROTECT(verify_lock(cs));return<\/span> USN(name);}\\<\/li>\n
              6.     type const<\/span> & Get_#<\/span>#name() const\\<\/span><\/li>\n
              7.     {_PROTECT(verify_lock(cs));return<\/span> USN(name);}\\<\/li>\n
              8.     template<\/span> <typename<\/span> T>\\<\/li>\n
              9.     type & Put_#<\/span>#name(T x)\\<\/li>\n
              10.     {_PROTECT(verify_lock(cs));USN(name) = x;return<\/span> USN(name);}\\<\/li>\n
              11.  <\/li>\n
              12. #define<\/span> PROTECTED_MEMBER_GET(cs, type, name) \\<\/li>\n
              13.     type USN(name);\\<\/li>\n
              14.     __declspec<\/span>(property<\/span>(get=Get_#<\/span>#name, put=Put_##name)) type name;\\<\/li>\n
              15.     type & Get_#<\/span>#name()\\<\/li>\n
              16.     {_PROTECT(verify_lock(cs));return<\/span> USN(name);}\\<\/li>\n
              17.     type const<\/span> & Get_#<\/span>#name() const\\<\/span><\/li>\n
              18.     {_PROTECT(verify_lock(cs));return<\/span> USN(name);}<\/li>\n<\/ol>\n<\/div>\n<\/div>\n<\/div>\n

                Finally, here are some examples of verify_lock<\/span> and verify_unlock<\/span> that can handle critical sections by pointer or by reference.<\/p>\n

                \n
                \n
                \n
                  \n
                1. inline<\/span> bool<\/span> verify_lock(const<\/span> CRITICAL_SECTION& cs)<\/li>\n
                2. {<\/li>\n
                3.     return<\/span> (cs.OwningThread == (HANDLE)(UINT_PTR)GetCurrentThreadId());<\/li>\n
                4. }<\/li>\n
                5. inline<\/span> bool<\/span> verify_unlock(const<\/span> CRITICAL_SECTION& cs)<\/li>\n
                6. {<\/li>\n
                7.     return<\/span> (cs.OwningThread == (HANDLE)(UINT_PTR)0);<\/li>\n
                8. }<\/li>\n
                9.  <\/li>\n
                10. inline<\/span> bool<\/span> verify_lock(const<\/span> CRITICAL_SECTION* cs)<\/li>\n
                11. {<\/li>\n
                12.     return<\/span> (cs->OwningThread == (HANDLE)(UINT_PTR)GetCurrentThreadId());<\/li>\n
                13. }<\/li>\n
                14. inline<\/span> bool<\/span> verify_unlock(const<\/span> CRITICAL_SECTION* cs)<\/li>\n
                15. {<\/li>\n
                16.     return<\/span> (cs->OwningThread == (HANDLE)(UINT_PTR)0);<\/li>\n
                17. }<\/li>\n<\/ol>\n<\/div>\n<\/div>\n<\/div>\n

                  What I typically do is put all of these macros in a header file under an #ifdef _PROTECT<\/span> guard. If _PROTECT<\/span> is not defined, then I simply let everything collapse to simple data members. For release builds, the code is just as fast as before.<\/p>\n

                  \n
                  \n
                  \n
                    \n
                  1. #ifdef<\/span> _PROTECT<\/li>\n
                  2. \/\/ All of the code from above<\/span><\/li>\n
                  3. #else<\/span><\/li>\n
                  4. #define<\/span> USN(name) name<\/li>\n
                  5. #define<\/span> PROTECTED_MEMBER(cs, type, name) type name;<\/li>\n
                  6. #define<\/span> PROTECTED_MEMBER_NC(cs, type, name) type name;<\/li>\n
                  7. #define<\/span> PROTECTED_MEMBER_GET(cs, type, name) type name;<\/li>\n
                  8. #define<\/span> PROTECTED_MEMBER_RW(cs, type, name) type name;<\/li>\n
                  9. #define<\/span> PROTECTED_MEMBER_ARRAY(cs, elemtype, name, length) elemtype name[length];<\/li>\n
                  10. #endif<\/span><\/li>\n<\/ol>\n<\/div>\n<\/div>\n<\/div>\n

                    Finally, there is no good way that I’ve found to do this for global or static member data. Usually, it isn’t too much work to wrap global or static data into a class (along with the appropriate lock), which is what I’ve done when I need to.<\/p>\n","protected":false},"excerpt":{"rendered":"

                    Hi, this is Jim Springfield. I’m an architect on the Visual C++ team. In any concurrent application, protecting data from concurrent access is extremely important. There are many primitives that can be used for this, such as critical sections, mutexes, reader-writer locks, etc. There are also some newer high-level approaches to concurrency such as those […]<\/p>\n","protected":false},"author":289,"featured_media":35994,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[1],"tags":[80],"class_list":["post-3013","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-cplusplus","tag-parallelism"],"acf":[],"blog_post_summary":"

                    Hi, this is Jim Springfield. I’m an architect on the Visual C++ team. In any concurrent application, protecting data from concurrent access is extremely important. There are many primitives that can be used for this, such as critical sections, mutexes, reader-writer locks, etc. There are also some newer high-level approaches to concurrency such as those […]<\/p>\n","_links":{"self":[{"href":"https:\/\/devblogs.microsoft.com\/cppblog\/wp-json\/wp\/v2\/posts\/3013","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/devblogs.microsoft.com\/cppblog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/devblogs.microsoft.com\/cppblog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/cppblog\/wp-json\/wp\/v2\/users\/289"}],"replies":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/cppblog\/wp-json\/wp\/v2\/comments?post=3013"}],"version-history":[{"count":0,"href":"https:\/\/devblogs.microsoft.com\/cppblog\/wp-json\/wp\/v2\/posts\/3013\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/cppblog\/wp-json\/wp\/v2\/media\/35994"}],"wp:attachment":[{"href":"https:\/\/devblogs.microsoft.com\/cppblog\/wp-json\/wp\/v2\/media?parent=3013"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/cppblog\/wp-json\/wp\/v2\/categories?post=3013"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/cppblog\/wp-json\/wp\/v2\/tags?post=3013"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}