{"id":105872,"date":"2021-11-04T07:00:00","date_gmt":"2021-11-04T14:00:00","guid":{"rendered":"https:\/\/devblogs.microsoft.com\/oldnewthing\/?p=105872"},"modified":"2023-09-16T07:15:39","modified_gmt":"2023-09-16T14:15:39","slug":"20211104-00","status":"publish","type":"post","link":"https:\/\/devblogs.microsoft.com\/oldnewthing\/20211104-00\/?p=105872","title":{"rendered":"How can I prevent myself from accessing a lambda captured variable or a parameter after I’m done with it?"},"content":{"rendered":"

We saw last time that you can have your cake and eat it too: You can have a capturing lambda coroutine provided you copy the captures to the coroutine frame before the coroutine’s first suspension point<\/a>. From that point onward, you use the copies in the frame instead of the original captured variables, because the original captured variables may no longer exist!<\/p>\n

You therefore must exercise willpower to resist the temptation to access those captured variables, since they are now poison. Is there a way to help stop yourself from doing a bad thing? Like, put a “Do not touch” sticker on the captured variable?<\/p>\n

We can do this by taking advantage of name hiding<\/i>, which also goes by the name shadowing<\/i>. Name hiding is normally something you are scared of, because it often happens by mistake:<\/p>\n

int open_or_alt(char const* name, char const* altname)\r\n{\r\n    int fd = open(name, 0);\r\n    if (fd == -1 && errno == ENOENT) {\r\n        \/\/ accidentally shadowed outer \"fd\" variable\r\n        int fd = open(altname, 0);\r\n    }\r\n    return fd;\r\n}\r\n<\/pre>\n
In our case, we can use it on purpose. Suppose we define some type, call it hide_name<\/code>, and we use it to hide the names of things we don’t want to see any more.<\/p>\n
void RegisterClickHandler(Button const& button, int key)\r\n{\r\n    button.Click([key](auto&&, auto&&)\r\n        -> winrt::fire_and_forget\r\n        {\r\n            auto copiedKey = key;\r\n            hide_name key; \/\/ \"key is now dead to me\"<\/span>\r\n            co_await winrt::resume_background();\r\n            NotifyClick(key); \/\/ want this to be an error\r\n        });\r\n}\r\n<\/pre>\n
What we’re doing is declaring a local variable named key<\/code> which hides the captured variable with the same name. Any attempt to use key<\/code> after the point of declaration will use the local variable version and not the captured variable version. Let’s assume that hide_name<\/code> is carefully defined so that using it instead of the hidden variable has maximum likelihood of generating a compiler error. (We’ll look at how we can do this later.)<\/p>\n
You can also hide parameters, which is handy if you have a coroutine that must accept parameters by reference (say, for some compatibility reason), but needs to access them after a suspension point.<\/p>\n
\/\/ This used to refresh synchronously, but now we refresh\r\n\/\/ asynchronously. The parameter is still passed by reference\r\n\/\/ for compatibility.\r\nwinrt::fire_and_forget Refresh(winrt::com_ptr<Widget> const& widget)\r\n{\r\n    auto copiedWidget = widget;\r\n    hide_name widget;<\/span>\r\n    co_await winrt::resume_background();\r\n    copiedWidget->Reset();\r\n    copiedWidget->Reload();\r\n}\r\n<\/pre>\n
Note that you can hide names from outer scopes. You cannot hide a name from the same scope.<\/p>\n
winrt::fire_and_forget GiveAwayTheWidget()\r\n{\r\n    Widget widget;\r\n    widget.Initialize();\r\n    GiveAway(std::move(widget));\r\n\r\n    \/\/ Try to prevent accidentally using a moved-from variable.\r\n    hide_name widget; \/\/ error\r\n\r\n    ...\r\n}\r\n<\/pre>\n
Since hide_name blah;<\/code> is a declaration, you can hide multiple names by separate them with commas.<\/p>\n
    hide_name a, b, c; \/\/ all three names are hidden\r\n<\/pre>\n
Okay, so the big question is “What should hide_name<\/code> be in order to maximize the likelihood that using it will result in a compiler error?”<\/p>\n
I came up with this:<\/p>\n
using hide_name = void(struct hidden_name);\r\n<\/pre>\n
This says that hide_name<\/code> is an alias for a function that accepts an incomplete type called hidden_name<\/code> and which returns a void<\/code>. When you write<\/p>\n
hide_name a;\r\n<\/pre>\n
what you’re really saying is “a<\/code> is a function that accepts an object of type hidden_name<\/code> and which returns void<\/code>.” It’s just a function declaration, not a variable declaration. But function names are still names, so they participate in name hiding.<\/p>\n
Using the name a<\/code> by itself will decay to a function pointer, which is not convertible to anything interesting. In particular, you can’t even do this:<\/p>\n
void* p = &a;\r\n<\/pre>\n
Function pointers are not compatible with data pointers, so this catches the case where somebody accidentally tried to pass the address of a captured variable to something that accepts a void*<\/code>.<\/p>\n
You can’t do arithmetic on function pointers, so those will generate errors. And you can’t call the function pointer because its sole parameter is hidden_name<\/code> which is an incomplete type.<\/p>\n
Functions cannot be assigned to, so that blocks any attempt to write to a<\/code>.<\/p>\n
If somehow somebody gets past all these barriers (say by explicitly casting to uintptr_t<\/code> on an implementation that supports it), they will fail at link time with an unresolved external complaining that there is no function named a<\/code> that accepts a hidden_name<\/code> as a parameter. (No such function can exist because hidden_name<\/code> is an incomplete type.)<\/p>\n
Here’s what I found in my experiments:<\/p>\n
Accessing the variable in various ways.<\/p>\n
void test(int);\r\nint i;\r\nhide_name a;\r\n\r\n\/\/ All accept this. \"v\" is a pointer to function.\r\n\/\/ You will probably get errors when you try to use \"v\", though.\r\nauto v = a;\r\n\r\n\/\/ msvc: C2440: cannot convert from 'hide_name (__cdecl *)' to 'int'\r\n\/\/ gcc: invalid conversion from 'void (*)(hidden_name)' to 'int' in assignment\r\n\/\/ clang: assigning to 'int' from incompatible type 'hide_name'\r\n\/\/ icc: a value of type \"hide_name *\" cannot be assigned to an entity of type \"int\"\r\ni = a;\r\n\r\n\/\/ msvc: C2659: '=': function as left operand\r\n\/\/ gcc: assignment of function 'void a(hidden_name)'\r\n\/\/ clang: non-object type 'hide_name' is not assignable\r\n\/\/ icc: expression must be a modifiable lvalue\r\na = i;\r\n\r\n\/\/ msvc: cannot convert argument 1 from 'hide_name (__cdecl *)' to 'int'\r\n\/\/ gcc: invalid conversion from 'void (*)(hidden_name)' to 'int'\r\n\/\/ clang: no matching function for call to 'test'\r\n\/\/ icc: argument of type \"hide_name *\" is incompatible with parameter of type \"int\"\r\ntest(a);\r\n\r\n\/\/ msvc: C2296: '+': illegal, left operand has type 'hide_name (__cdecl *)'\r\n\/\/ gcc: pointer to a function used in arithmetic\r\n\/\/ clang: arithmetic on a pointer to the function type 'hide_name'\r\n\/\/ icc: a value of type \"hide_name *\" cannot be assigned to an entity of type \"int\"\r\ni = a + 1;\r\n\r\n\/\/ msvc: C2296: '+': illegal, left operand has type 'hide_name (__cdecl *)'\r\n\/\/ gcc: pointer to a function used in arithmetic\r\n\/\/ clang: arithmetic on a pointer to the function type 'hide_name'\r\n\/\/ icc: NO ERROR AT COMPILE TIME! (Fails to link.)\u00b9\r\nauto p = a + 1;\r\n\r\n\/\/ msvc: C2070: 'hide_name': illegal sizeof operand\r\n\/\/ gcc: ISO C++ forbids applying 'sizeof' to an expression of function type\u00b2\r\n\/\/ clang: invalid application of 'sizeof' to a function type\r\n\/\/ icc: warning: operand of sizeof may not be a function\r\nauto size = sizeof(a);\r\n\r\n\/\/ msvc: C228: left of '.method' must have class\/struct\/union\r\n\/\/ gcc: request for member 'method' in 'a', which is of non-class type 'hide_name'\r\n\/\/ clang: member reference base type 'hide_name' is not a structure or union\r\n\/\/ icc: expression must have class type\r\na.method();\r\n<\/pre>\n
Furthermore, since this is a function declaration and not a variable declaration, you are less likely to get “unused local variable” errors. gcc, clang, and icc ignore the unused function declaration.<\/p>\n
Unfortunately, the place where this trick is most useful is in coroutines, and that’s where compilers today are the weakest. MSVC 19.28 was okay with it, but it seems that MSVC 19.29 does complain about unused function declarations in coroutines. As of this writing,  a fix is pending release<\/a>. [Update February 15, 2022<\/b>: It is fixed in Visual Studio 2022 Version 17.1<\/a>.] gcc, on the other hand,  totally freaks out about function declarations in coroutines<\/a>: Version 11 produces the inscrutable error “data member ‘enclosing_function()::_Z18enclosing_functionv.frame::__a.2.3’ invalid declared function.” Version 12 blows up with  an internal compiler error<\/a>.<\/p>\n
So maybe you should hold off on this for a bit longer.<\/p>\n
\u00b9 For some reason, icc treats the size of a function as 1. Sometimes it warns you that it’s making this nonstandard decision. Other times, it just does it without telling you.<\/p>\n
\u00b2 I find it amusing that one of the gcc error messages says “ISO C++ forbids…”, as if it’s saying “Hey, I totally would let you get away with this, but those pesky C++ standard folks tell me I’m not allowed to. So don’t blame me!”<\/p>\n","protected":false},"excerpt":{"rendered":"
Name-hiding on purpose.<\/p>\n","protected":false},"author":1069,"featured_media":111744,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[1],"tags":[25],"class_list":["post-105872","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-oldnewthing","tag-code"],"acf":[],"blog_post_summary":"
Name-hiding on purpose.<\/p>\n","_links":{"self":[{"href":"https:\/\/devblogs.microsoft.com\/oldnewthing\/wp-json\/wp\/v2\/posts\/105872","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/devblogs.microsoft.com\/oldnewthing\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/devblogs.microsoft.com\/oldnewthing\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/oldnewthing\/wp-json\/wp\/v2\/users\/1069"}],"replies":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/oldnewthing\/wp-json\/wp\/v2\/comments?post=105872"}],"version-history":[{"count":0,"href":"https:\/\/devblogs.microsoft.com\/oldnewthing\/wp-json\/wp\/v2\/posts\/105872\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/oldnewthing\/wp-json\/wp\/v2\/media\/111744"}],"wp:attachment":[{"href":"https:\/\/devblogs.microsoft.com\/oldnewthing\/wp-json\/wp\/v2\/media?parent=105872"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/oldnewthing\/wp-json\/wp\/v2\/categories?post=105872"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/devblogs.microsoft.com\/oldnewthing\/wp-json\/wp\/v2\/tags?post=105872"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}